Note: This is test shard 1 of 8.
[==========] Running 2 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 1 test from MaintenanceModeRF3ITest
[ RUN ] MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate
2026-06-19T06:29:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T06:29:25Z Disabled control of system clock
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260619 06:29:25.169590 7552 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu
/tmp/dist-test-taskFG9pG8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.96.62:40917
--webserver_interface=127.7.96.62
--webserver_port=0
--builtin_ntp_servers=127.7.96.20:33055
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.96.62:40917 with env {}
W20260619 06:29:25.480224 7560 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:29:25.480476 7560 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:29:25.480633 7560 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:29:25.487388 7560 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 06:29:25.487468 7560 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:29:25.487583 7560 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 06:29:25.487656 7560 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 06:29:25.496407 7560 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.96.20:33055
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.96.62:40917
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.96.62:40917
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.96.62
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:40:48 UTC on ccycloud.quasar-zrzaui.root.comops.site
build id 4455154
ASAN enabled
I20260619 06:29:25.497638 7560 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:29:25.499329 7560 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:29:25.511098 7568 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:29:25.511163 7565 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:29:25.511057 7566 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:29:25.511946 7560 server_base.cc:1034] running on GCE node
I20260619 06:29:25.512739 7560 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:29:25.514119 7560 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:29:25.515375 7560 hybrid_clock.cc:648] HybridClock initialized: now 1781850565515283 us; error 44 us; skew 500 ppm
I20260619 06:29:25.515707 7560 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 06:29:25.522198 7560 webserver.cc:460] Webserver started at http://127.7.96.62:33643/ using document root <none> and password file <none>
I20260619 06:29:25.522946 7560 fs_manager.cc:359] Metadata directory not provided
I20260619 06:29:25.523079 7560 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:29:25.523368 7560 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:29:25.525902 7560 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/master-0/data/instance:
uuid: "fe668818447248c3876af051ae7f45f8"
format_stamp: "Formatted at 2026-06-19 06:29:25 on dist-test-slave-cvm7"
I20260619 06:29:25.526698 7560 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/master-0/wal/instance:
uuid: "fe668818447248c3876af051ae7f45f8"
format_stamp: "Formatted at 2026-06-19 06:29:25 on dist-test-slave-cvm7"
I20260619 06:29:25.531572 7560 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260619 06:29:25.534711 7574 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:29:25.535935 7560 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260619 06:29:25.536100 7560 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/master-0/data,/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/master-0/wal
uuid: "fe668818447248c3876af051ae7f45f8"
format_stamp: "Formatted at 2026-06-19 06:29:25 on dist-test-slave-cvm7"
I20260619 06:29:25.536293 7560 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:29:25.566582 7560 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:29:25.567425 7560 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:29:25.567703 7560 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:29:25.585373 7560 rpc_server.cc:307] RPC server started. Bound to: 127.7.96.62:40917
I20260619 06:29:25.585410 7625 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.96.62:40917 every 8 connection(s)
I20260619 06:29:25.586726 7560 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/master-0/data/info.pb
I20260619 06:29:25.590236 7626 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:29:25.593703 7552 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu as pid 7560
I20260619 06:29:25.593979 7552 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/master-0/wal/instance
I20260619 06:29:25.600054 7626 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe668818447248c3876af051ae7f45f8: Bootstrap starting.
I20260619 06:29:25.604115 7626 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fe668818447248c3876af051ae7f45f8: Neither blocks nor log segments found. Creating new log.
I20260619 06:29:25.605425 7626 log.cc:824] T 00000000000000000000000000000000 P fe668818447248c3876af051ae7f45f8: Log is configured to *not* fsync() on all Append() calls
I20260619 06:29:25.608959 7626 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe668818447248c3876af051ae7f45f8: No bootstrap required, opened a new log
I20260619 06:29:25.619138 7626 raft_consensus.cc:348] T 00000000000000000000000000000000 P fe668818447248c3876af051ae7f45f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe668818447248c3876af051ae7f45f8" member_type: VOTER last_known_addr { host: "127.7.96.62" port: 40917 } }
I20260619 06:29:25.619508 7626 raft_consensus.cc:374] T 00000000000000000000000000000000 P fe668818447248c3876af051ae7f45f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:29:25.619625 7626 raft_consensus.cc:729] T 00000000000000000000000000000000 P fe668818447248c3876af051ae7f45f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe668818447248c3876af051ae7f45f8, State: Initialized, Role: FOLLOWER
I20260619 06:29:25.620338 7626 consensus_queue.cc:260] T 00000000000000000000000000000000 P fe668818447248c3876af051ae7f45f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe668818447248c3876af051ae7f45f8" member_type: VOTER last_known_addr { host: "127.7.96.62" port: 40917 } }
I20260619 06:29:25.620585 7626 raft_consensus.cc:388] T 00000000000000000000000000000000 P fe668818447248c3876af051ae7f45f8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 06:29:25.620759 7626 raft_consensus.cc:482] T 00000000000000000000000000000000 P fe668818447248c3876af051ae7f45f8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 06:29:25.620939 7626 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fe668818447248c3876af051ae7f45f8 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:29:25.624001 7626 raft_consensus.cc:504] T 00000000000000000000000000000000 P fe668818447248c3876af051ae7f45f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe668818447248c3876af051ae7f45f8" member_type: VOTER last_known_addr { host: "127.7.96.62" port: 40917 } }
I20260619 06:29:25.624570 7626 leader_election.cc:302] T 00000000000000000000000000000000 P fe668818447248c3876af051ae7f45f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fe668818447248c3876af051ae7f45f8; no voters:
I20260619 06:29:25.625272 7626 leader_election.cc:288] T 00000000000000000000000000000000 P fe668818447248c3876af051ae7f45f8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 06:29:25.625464 7631 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fe668818447248c3876af051ae7f45f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:29:25.626116 7631 raft_consensus.cc:686] T 00000000000000000000000000000000 P fe668818447248c3876af051ae7f45f8 [term 1 LEADER]: Becoming Leader. State: Replica: fe668818447248c3876af051ae7f45f8, State: Running, Role: LEADER
I20260619 06:29:25.626693 7631 consensus_queue.cc:237] T 00000000000000000000000000000000 P fe668818447248c3876af051ae7f45f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe668818447248c3876af051ae7f45f8" member_type: VOTER last_known_addr { host: "127.7.96.62" port: 40917 } }
I20260619 06:29:25.629532 7633 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe668818447248c3876af051ae7f45f8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fe668818447248c3876af051ae7f45f8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe668818447248c3876af051ae7f45f8" member_type: VOTER last_known_addr { host: "127.7.96.62" port: 40917 } } }
I20260619 06:29:25.629891 7633 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe668818447248c3876af051ae7f45f8 [sys.catalog]: This master's current role is: LEADER
I20260619 06:29:25.629941 7631 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe668818447248c3876af051ae7f45f8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fe668818447248c3876af051ae7f45f8. Latest consensus state: current_term: 1 leader_uuid: "fe668818447248c3876af051ae7f45f8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe668818447248c3876af051ae7f45f8" member_type: VOTER last_known_addr { host: "127.7.96.62" port: 40917 } } }
I20260619 06:29:25.630141 7631 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe668818447248c3876af051ae7f45f8 [sys.catalog]: This master's current role is: LEADER
I20260619 06:29:25.630833 7626 sys_catalog.cc:564] T 00000000000000000000000000000000 P fe668818447248c3876af051ae7f45f8 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 06:29:25.631804 7635 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 06:29:25.637321 7635 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 06:29:25.646304 7635 catalog_manager.cc:1347] Generated new cluster ID: a3c969ff50f84242b0eb3422a5066dee
I20260619 06:29:25.646421 7635 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 06:29:25.660758 7635 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 06:29:25.661981 7635 catalog_manager.cc:1504] Loading token signing keys...
I20260619 06:29:25.668421 7635 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fe668818447248c3876af051ae7f45f8: Generated new TSK 0
I20260619 06:29:25.669178 7635 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 06:29:25.680012 7552 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu
/tmp/dist-test-taskFG9pG8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.96.1:0
--local_ip_for_outbound_sockets=127.7.96.1
--webserver_interface=127.7.96.1
--webserver_port=0
--tserver_master_addrs=127.7.96.62:40917
--builtin_ntp_servers=127.7.96.20:33055
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--follower_unavailable_considered_failed_sec=2
--enable_log_gc=false with env {}
W20260619 06:29:26.020290 7650 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:29:26.020552 7650 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:29:26.020648 7650 flags.cc:425] Enabled unsafe flag: --enable_log_gc=false
W20260619 06:29:26.020776 7650 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:29:26.028653 7650 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:29:26.028805 7650 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.96.1
I20260619 06:29:26.037859 7650 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.96.20:33055
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=2
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.96.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.96.1
--webserver_port=0
--enable_log_gc=false
--tserver_master_addrs=127.7.96.62:40917
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.96.1
--log_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:40:48 UTC on ccycloud.quasar-zrzaui.root.comops.site
build id 4455154
ASAN enabled
I20260619 06:29:26.039145 7650 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:29:26.040983 7650 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:29:26.053750 7655 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:29:26.053714 7658 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:29:26.053980 7656 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:29:26.054886 7650 server_base.cc:1034] running on GCE node
I20260619 06:29:26.055469 7650 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:29:26.056399 7650 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:29:26.057628 7650 hybrid_clock.cc:648] HybridClock initialized: now 1781850566057585 us; error 59 us; skew 500 ppm
I20260619 06:29:26.057930 7650 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 06:29:26.060195 7650 webserver.cc:460] Webserver started at http://127.7.96.1:38977/ using document root <none> and password file <none>
I20260619 06:29:26.060881 7650 fs_manager.cc:359] Metadata directory not provided
I20260619 06:29:26.061012 7650 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:29:26.061331 7650 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:29:26.063891 7650 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-0/data/instance:
uuid: "b46f2dae92104884b86705d6bbc20003"
format_stamp: "Formatted at 2026-06-19 06:29:26 on dist-test-slave-cvm7"
I20260619 06:29:26.064656 7650 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-0/wal/instance:
uuid: "b46f2dae92104884b86705d6bbc20003"
format_stamp: "Formatted at 2026-06-19 06:29:26 on dist-test-slave-cvm7"
I20260619 06:29:26.069617 7650 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260619 06:29:26.072813 7664 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:29:26.073973 7650 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260619 06:29:26.074138 7650 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-0/data,/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-0/wal
uuid: "b46f2dae92104884b86705d6bbc20003"
format_stamp: "Formatted at 2026-06-19 06:29:26 on dist-test-slave-cvm7"
I20260619 06:29:26.074337 7650 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:29:26.120901 7650 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:29:26.121820 7650 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:29:26.122131 7650 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:29:26.123193 7650 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:29:26.124616 7650 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:29:26.124747 7650 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:29:26.124907 7650 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:29:26.124998 7650 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:29:26.157436 7650 rpc_server.cc:307] RPC server started. Bound to: 127.7.96.1:33323
I20260619 06:29:26.157480 7776 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.96.1:33323 every 8 connection(s)
I20260619 06:29:26.158769 7650 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-0/data/info.pb
I20260619 06:29:26.167249 7552 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu as pid 7650
I20260619 06:29:26.167438 7552 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-0/wal/instance
I20260619 06:29:26.171382 7552 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu
/tmp/dist-test-taskFG9pG8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.96.2:0
--local_ip_for_outbound_sockets=127.7.96.2
--webserver_interface=127.7.96.2
--webserver_port=0
--tserver_master_addrs=127.7.96.62:40917
--builtin_ntp_servers=127.7.96.20:33055
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--follower_unavailable_considered_failed_sec=2
--enable_log_gc=false with env {}
I20260619 06:29:26.173525 7777 heartbeater.cc:347] Connected to a master server at 127.7.96.62:40917
I20260619 06:29:26.173827 7777 heartbeater.cc:464] Registering TS with master...
I20260619 06:29:26.174690 7777 heartbeater.cc:511] Master 127.7.96.62:40917 requested a full tablet report, sending...
I20260619 06:29:26.176774 7591 ts_manager.cc:194] Registered new tserver with Master: b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323)
I20260619 06:29:26.178475 7591 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.96.1:48427
W20260619 06:29:26.479758 7781 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:29:26.480146 7781 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:29:26.480279 7781 flags.cc:425] Enabled unsafe flag: --enable_log_gc=false
W20260619 06:29:26.480357 7781 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:29:26.487480 7781 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:29:26.487664 7781 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.96.2
I20260619 06:29:26.496392 7781 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.96.20:33055
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=2
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.96.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.96.2
--webserver_port=0
--enable_log_gc=false
--tserver_master_addrs=127.7.96.62:40917
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.96.2
--log_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:40:48 UTC on ccycloud.quasar-zrzaui.root.comops.site
build id 4455154
ASAN enabled
I20260619 06:29:26.497576 7781 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:29:26.499317 7781 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:29:26.512097 7786 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:29:26.512125 7789 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:29:26.512092 7787 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:29:26.512988 7781 server_base.cc:1034] running on GCE node
I20260619 06:29:26.513521 7781 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:29:26.514410 7781 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:29:26.515630 7781 hybrid_clock.cc:648] HybridClock initialized: now 1781850566515582 us; error 44 us; skew 500 ppm
I20260619 06:29:26.515947 7781 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 06:29:26.518090 7781 webserver.cc:460] Webserver started at http://127.7.96.2:33087/ using document root <none> and password file <none>
I20260619 06:29:26.518837 7781 fs_manager.cc:359] Metadata directory not provided
I20260619 06:29:26.518967 7781 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:29:26.519275 7781 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:29:26.521739 7781 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-1/data/instance:
uuid: "996381a7495d4720a6f6be44a1d4781b"
format_stamp: "Formatted at 2026-06-19 06:29:26 on dist-test-slave-cvm7"
I20260619 06:29:26.522483 7781 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-1/wal/instance:
uuid: "996381a7495d4720a6f6be44a1d4781b"
format_stamp: "Formatted at 2026-06-19 06:29:26 on dist-test-slave-cvm7"
I20260619 06:29:26.527292 7781 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260619 06:29:26.530584 7795 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:29:26.531915 7781 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260619 06:29:26.532073 7781 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-1/data,/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-1/wal
uuid: "996381a7495d4720a6f6be44a1d4781b"
format_stamp: "Formatted at 2026-06-19 06:29:26 on dist-test-slave-cvm7"
I20260619 06:29:26.532287 7781 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:29:26.553503 7781 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:29:26.554376 7781 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:29:26.554744 7781 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:29:26.555667 7781 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:29:26.557088 7781 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:29:26.557206 7781 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:29:26.557343 7781 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:29:26.557430 7781 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:29:26.590765 7781 rpc_server.cc:307] RPC server started. Bound to: 127.7.96.2:37063
I20260619 06:29:26.590802 7907 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.96.2:37063 every 8 connection(s)
I20260619 06:29:26.592017 7781 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-1/data/info.pb
I20260619 06:29:26.597594 7552 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu as pid 7781
I20260619 06:29:26.597750 7552 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-1/wal/instance
I20260619 06:29:26.600987 7552 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu
/tmp/dist-test-taskFG9pG8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.96.3:0
--local_ip_for_outbound_sockets=127.7.96.3
--webserver_interface=127.7.96.3
--webserver_port=0
--tserver_master_addrs=127.7.96.62:40917
--builtin_ntp_servers=127.7.96.20:33055
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--follower_unavailable_considered_failed_sec=2
--enable_log_gc=false with env {}
I20260619 06:29:26.608305 7908 heartbeater.cc:347] Connected to a master server at 127.7.96.62:40917
I20260619 06:29:26.608594 7908 heartbeater.cc:464] Registering TS with master...
I20260619 06:29:26.609282 7908 heartbeater.cc:511] Master 127.7.96.62:40917 requested a full tablet report, sending...
I20260619 06:29:26.610733 7591 ts_manager.cc:194] Registered new tserver with Master: 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063)
I20260619 06:29:26.612005 7591 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.96.2:38001
W20260619 06:29:26.922206 7911 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:29:26.922444 7911 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:29:26.922556 7911 flags.cc:425] Enabled unsafe flag: --enable_log_gc=false
W20260619 06:29:26.922624 7911 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:29:26.929476 7911 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:29:26.929621 7911 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.96.3
I20260619 06:29:26.938928 7911 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.96.20:33055
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=2
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.96.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.96.3
--webserver_port=0
--enable_log_gc=false
--tserver_master_addrs=127.7.96.62:40917
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.96.3
--log_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:40:48 UTC on ccycloud.quasar-zrzaui.root.comops.site
build id 4455154
ASAN enabled
I20260619 06:29:26.940236 7911 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:29:26.941978 7911 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:29:26.955381 7917 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:29:26.955860 7919 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:29:26.955462 7916 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:29:26.956697 7911 server_base.cc:1034] running on GCE node
I20260619 06:29:26.957635 7911 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:29:26.958447 7911 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:29:26.959690 7911 hybrid_clock.cc:648] HybridClock initialized: now 1781850566959648 us; error 35 us; skew 500 ppm
I20260619 06:29:26.960004 7911 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 06:29:26.962194 7911 webserver.cc:460] Webserver started at http://127.7.96.3:36853/ using document root <none> and password file <none>
I20260619 06:29:26.962934 7911 fs_manager.cc:359] Metadata directory not provided
I20260619 06:29:26.963049 7911 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:29:26.963364 7911 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:29:26.965816 7911 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-2/data/instance:
uuid: "3fc4e58423894a27a7b94de5c6013cf1"
format_stamp: "Formatted at 2026-06-19 06:29:26 on dist-test-slave-cvm7"
I20260619 06:29:26.966568 7911 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-2/wal/instance:
uuid: "3fc4e58423894a27a7b94de5c6013cf1"
format_stamp: "Formatted at 2026-06-19 06:29:26 on dist-test-slave-cvm7"
I20260619 06:29:26.971477 7911 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260619 06:29:26.974829 7925 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:29:26.976047 7911 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260619 06:29:26.976230 7911 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-2/data,/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-2/wal
uuid: "3fc4e58423894a27a7b94de5c6013cf1"
format_stamp: "Formatted at 2026-06-19 06:29:26 on dist-test-slave-cvm7"
I20260619 06:29:26.976450 7911 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:29:26.991945 7911 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:29:26.992797 7911 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:29:26.993124 7911 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:29:26.994032 7911 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:29:26.995473 7911 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:29:26.995591 7911 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:29:26.995728 7911 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:29:26.995826 7911 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:29:27.030941 7911 rpc_server.cc:307] RPC server started. Bound to: 127.7.96.3:37499
I20260619 06:29:27.030958 8037 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.96.3:37499 every 8 connection(s)
I20260619 06:29:27.032449 7911 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-2/data/info.pb
I20260619 06:29:27.037806 7552 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu as pid 7911
I20260619 06:29:27.037984 7552 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-2/wal/instance
I20260619 06:29:27.047397 8038 heartbeater.cc:347] Connected to a master server at 127.7.96.62:40917
I20260619 06:29:27.047744 8038 heartbeater.cc:464] Registering TS with master...
I20260619 06:29:27.048445 8038 heartbeater.cc:511] Master 127.7.96.62:40917 requested a full tablet report, sending...
I20260619 06:29:27.049824 7591 ts_manager.cc:194] Registered new tserver with Master: 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499)
I20260619 06:29:27.050591 7591 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.96.3:55695
I20260619 06:29:27.054334 7552 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260619 06:29:27.075426 7552 test_util.cc:268] Using random seed: 1779951168
I20260619 06:29:27.099207 7591 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49262:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\004\001\000UUU\025\004\001\000\252\252\252*\004\001\000\377\377\377?\004\001\000TUUU\004\001\000\251\252\252j"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 06:29:27.101223 7591 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 06:29:27.146059 7712 tablet_service.cc:1467] Processing CreateTablet for tablet 08686b31ffd64266bcdbd6f5eb29a87d (DEFAULT_TABLE table=test-workload [id=fbe49391e27b48eaa4c974bb6242a990]), partition=RANGE (key) PARTITION VALUES < 357913941
I20260619 06:29:27.146694 7708 tablet_service.cc:1467] Processing CreateTablet for tablet 6cffdcc0e99c47aead56bbaea58d3e4d (DEFAULT_TABLE table=test-workload [id=fbe49391e27b48eaa4c974bb6242a990]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1789569705
I20260619 06:29:27.148398 7712 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08686b31ffd64266bcdbd6f5eb29a87d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:29:27.148324 7841 tablet_service.cc:1467] Processing CreateTablet for tablet 98eb40b379a24876b6334fff708de671 (DEFAULT_TABLE table=test-workload [id=fbe49391e27b48eaa4c974bb6242a990]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 1073741823
I20260619 06:29:27.150034 7841 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98eb40b379a24876b6334fff708de671. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:29:27.149247 7969 tablet_service.cc:1467] Processing CreateTablet for tablet 6cffdcc0e99c47aead56bbaea58d3e4d (DEFAULT_TABLE table=test-workload [id=fbe49391e27b48eaa4c974bb6242a990]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1789569705
I20260619 06:29:27.150198 7968 tablet_service.cc:1467] Processing CreateTablet for tablet e3e5e97eabdf42cf8e46ccb4b61c5fb7 (DEFAULT_TABLE table=test-workload [id=fbe49391e27b48eaa4c974bb6242a990]), partition=RANGE (key) PARTITION 1789569705 <= VALUES
I20260619 06:29:27.150682 7709 tablet_service.cc:1467] Processing CreateTablet for tablet f5c2224f852746c8893931fd3ff27126 (DEFAULT_TABLE table=test-workload [id=fbe49391e27b48eaa4c974bb6242a990]), partition=RANGE (key) PARTITION 1073741823 <= VALUES < 1431655764
I20260619 06:29:27.151085 7709 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f5c2224f852746c8893931fd3ff27126. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:29:27.150955 7971 tablet_service.cc:1467] Processing CreateTablet for tablet 98eb40b379a24876b6334fff708de671 (DEFAULT_TABLE table=test-workload [id=fbe49391e27b48eaa4c974bb6242a990]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 1073741823
I20260619 06:29:27.151381 7973 tablet_service.cc:1467] Processing CreateTablet for tablet 08686b31ffd64266bcdbd6f5eb29a87d (DEFAULT_TABLE table=test-workload [id=fbe49391e27b48eaa4c974bb6242a990]), partition=RANGE (key) PARTITION VALUES < 357913941
I20260619 06:29:27.151795 7708 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6cffdcc0e99c47aead56bbaea58d3e4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:29:27.149622 7970 tablet_service.cc:1467] Processing CreateTablet for tablet f5c2224f852746c8893931fd3ff27126 (DEFAULT_TABLE table=test-workload [id=fbe49391e27b48eaa4c974bb6242a990]), partition=RANGE (key) PARTITION 1073741823 <= VALUES < 1431655764
I20260619 06:29:27.152011 7839 tablet_service.cc:1467] Processing CreateTablet for tablet 6cffdcc0e99c47aead56bbaea58d3e4d (DEFAULT_TABLE table=test-workload [id=fbe49391e27b48eaa4c974bb6242a990]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1789569705
I20260619 06:29:27.152415 7839 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6cffdcc0e99c47aead56bbaea58d3e4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:29:27.151800 7710 tablet_service.cc:1467] Processing CreateTablet for tablet 98eb40b379a24876b6334fff708de671 (DEFAULT_TABLE table=test-workload [id=fbe49391e27b48eaa4c974bb6242a990]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 1073741823
I20260619 06:29:27.152609 7971 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98eb40b379a24876b6334fff708de671. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:29:27.152761 7710 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98eb40b379a24876b6334fff708de671. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:29:27.145985 7707 tablet_service.cc:1467] Processing CreateTablet for tablet e3e5e97eabdf42cf8e46ccb4b61c5fb7 (DEFAULT_TABLE table=test-workload [id=fbe49391e27b48eaa4c974bb6242a990]), partition=RANGE (key) PARTITION 1789569705 <= VALUES
I20260619 06:29:27.153537 7707 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e3e5e97eabdf42cf8e46ccb4b61c5fb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:29:27.151551 7838 tablet_service.cc:1467] Processing CreateTablet for tablet e3e5e97eabdf42cf8e46ccb4b61c5fb7 (DEFAULT_TABLE table=test-workload [id=fbe49391e27b48eaa4c974bb6242a990]), partition=RANGE (key) PARTITION 1789569705 <= VALUES
I20260619 06:29:27.146415 7711 tablet_service.cc:1467] Processing CreateTablet for tablet 8e2da70288694680bec48ac95c14656f (DEFAULT_TABLE table=test-workload [id=fbe49391e27b48eaa4c974bb6242a990]), partition=RANGE (key) PARTITION 357913941 <= VALUES < 715827882
I20260619 06:29:27.155575 7840 tablet_service.cc:1467] Processing CreateTablet for tablet f5c2224f852746c8893931fd3ff27126 (DEFAULT_TABLE table=test-workload [id=fbe49391e27b48eaa4c974bb6242a990]), partition=RANGE (key) PARTITION 1073741823 <= VALUES < 1431655764
I20260619 06:29:27.155838 7711 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e2da70288694680bec48ac95c14656f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:29:27.155889 7843 tablet_service.cc:1467] Processing CreateTablet for tablet 08686b31ffd64266bcdbd6f5eb29a87d (DEFAULT_TABLE table=test-workload [id=fbe49391e27b48eaa4c974bb6242a990]), partition=RANGE (key) PARTITION VALUES < 357913941
I20260619 06:29:27.156252 7838 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e3e5e97eabdf42cf8e46ccb4b61c5fb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:29:27.156896 7840 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f5c2224f852746c8893931fd3ff27126. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:29:27.157160 7842 tablet_service.cc:1467] Processing CreateTablet for tablet 8e2da70288694680bec48ac95c14656f (DEFAULT_TABLE table=test-workload [id=fbe49391e27b48eaa4c974bb6242a990]), partition=RANGE (key) PARTITION 357913941 <= VALUES < 715827882
I20260619 06:29:27.157881 7843 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08686b31ffd64266bcdbd6f5eb29a87d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:29:27.157927 7972 tablet_service.cc:1467] Processing CreateTablet for tablet 8e2da70288694680bec48ac95c14656f (DEFAULT_TABLE table=test-workload [id=fbe49391e27b48eaa4c974bb6242a990]), partition=RANGE (key) PARTITION 357913941 <= VALUES < 715827882
I20260619 06:29:27.158299 7969 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6cffdcc0e99c47aead56bbaea58d3e4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:29:27.158397 7842 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e2da70288694680bec48ac95c14656f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:29:27.158663 7968 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e3e5e97eabdf42cf8e46ccb4b61c5fb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:29:27.159209 7970 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f5c2224f852746c8893931fd3ff27126. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:29:27.159981 7973 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08686b31ffd64266bcdbd6f5eb29a87d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:29:27.160526 7972 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e2da70288694680bec48ac95c14656f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:29:27.181245 7777 heartbeater.cc:503] Master 127.7.96.62:40917 was elected leader, sending a full tablet report...
I20260619 06:29:27.199057 8062 tablet_bootstrap.cc:492] T f5c2224f852746c8893931fd3ff27126 P 996381a7495d4720a6f6be44a1d4781b: Bootstrap starting.
I20260619 06:29:27.203210 8062 tablet_bootstrap.cc:654] T f5c2224f852746c8893931fd3ff27126 P 996381a7495d4720a6f6be44a1d4781b: Neither blocks nor log segments found. Creating new log.
I20260619 06:29:27.204344 8063 tablet_bootstrap.cc:492] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003: Bootstrap starting.
I20260619 06:29:27.204454 8062 log.cc:824] T f5c2224f852746c8893931fd3ff27126 P 996381a7495d4720a6f6be44a1d4781b: Log is configured to *not* fsync() on all Append() calls
I20260619 06:29:27.205542 8061 tablet_bootstrap.cc:492] T 98eb40b379a24876b6334fff708de671 P 3fc4e58423894a27a7b94de5c6013cf1: Bootstrap starting.
I20260619 06:29:27.208894 8061 tablet_bootstrap.cc:654] T 98eb40b379a24876b6334fff708de671 P 3fc4e58423894a27a7b94de5c6013cf1: Neither blocks nor log segments found. Creating new log.
I20260619 06:29:27.209110 8062 tablet_bootstrap.cc:492] T f5c2224f852746c8893931fd3ff27126 P 996381a7495d4720a6f6be44a1d4781b: No bootstrap required, opened a new log
I20260619 06:29:27.209367 8062 ts_tablet_manager.cc:1397] T f5c2224f852746c8893931fd3ff27126 P 996381a7495d4720a6f6be44a1d4781b: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.003s
I20260619 06:29:27.210062 8061 log.cc:824] T 98eb40b379a24876b6334fff708de671 P 3fc4e58423894a27a7b94de5c6013cf1: Log is configured to *not* fsync() on all Append() calls
I20260619 06:29:27.210845 8063 tablet_bootstrap.cc:654] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003: Neither blocks nor log segments found. Creating new log.
I20260619 06:29:27.212389 8063 log.cc:824] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003: Log is configured to *not* fsync() on all Append() calls
I20260619 06:29:27.215528 8063 tablet_bootstrap.cc:492] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003: No bootstrap required, opened a new log
I20260619 06:29:27.215979 8063 ts_tablet_manager.cc:1397] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.005s
I20260619 06:29:27.218165 8061 tablet_bootstrap.cc:492] T 98eb40b379a24876b6334fff708de671 P 3fc4e58423894a27a7b94de5c6013cf1: No bootstrap required, opened a new log
I20260619 06:29:27.218410 8061 ts_tablet_manager.cc:1397] T 98eb40b379a24876b6334fff708de671 P 3fc4e58423894a27a7b94de5c6013cf1: Time spent bootstrapping tablet: real 0.013s user 0.005s sys 0.003s
I20260619 06:29:27.219986 8062 raft_consensus.cc:348] T f5c2224f852746c8893931fd3ff27126 P 996381a7495d4720a6f6be44a1d4781b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:27.220417 8062 raft_consensus.cc:374] T f5c2224f852746c8893931fd3ff27126 P 996381a7495d4720a6f6be44a1d4781b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:29:27.220526 8062 raft_consensus.cc:729] T f5c2224f852746c8893931fd3ff27126 P 996381a7495d4720a6f6be44a1d4781b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 996381a7495d4720a6f6be44a1d4781b, State: Initialized, Role: FOLLOWER
I20260619 06:29:27.221163 8062 consensus_queue.cc:260] T f5c2224f852746c8893931fd3ff27126 P 996381a7495d4720a6f6be44a1d4781b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:27.228237 8063 raft_consensus.cc:348] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:27.228780 8063 raft_consensus.cc:374] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:29:27.228880 8063 raft_consensus.cc:729] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b46f2dae92104884b86705d6bbc20003, State: Initialized, Role: FOLLOWER
I20260619 06:29:27.229575 8063 consensus_queue.cc:260] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:27.231635 8062 ts_tablet_manager.cc:1428] T f5c2224f852746c8893931fd3ff27126 P 996381a7495d4720a6f6be44a1d4781b: Time spent starting tablet: real 0.022s user 0.023s sys 0.001s
I20260619 06:29:27.232163 7908 heartbeater.cc:503] Master 127.7.96.62:40917 was elected leader, sending a full tablet report...
I20260619 06:29:27.232234 8061 raft_consensus.cc:348] T 98eb40b379a24876b6334fff708de671 P 3fc4e58423894a27a7b94de5c6013cf1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:27.232671 8061 raft_consensus.cc:374] T 98eb40b379a24876b6334fff708de671 P 3fc4e58423894a27a7b94de5c6013cf1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:29:27.232767 8061 raft_consensus.cc:729] T 98eb40b379a24876b6334fff708de671 P 3fc4e58423894a27a7b94de5c6013cf1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fc4e58423894a27a7b94de5c6013cf1, State: Initialized, Role: FOLLOWER
I20260619 06:29:27.233443 8061 consensus_queue.cc:260] T 98eb40b379a24876b6334fff708de671 P 3fc4e58423894a27a7b94de5c6013cf1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:27.234164 8062 tablet_bootstrap.cc:492] T 98eb40b379a24876b6334fff708de671 P 996381a7495d4720a6f6be44a1d4781b: Bootstrap starting.
I20260619 06:29:27.236666 8062 tablet_bootstrap.cc:654] T 98eb40b379a24876b6334fff708de671 P 996381a7495d4720a6f6be44a1d4781b: Neither blocks nor log segments found. Creating new log.
I20260619 06:29:27.239087 8063 ts_tablet_manager.cc:1428] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003: Time spent starting tablet: real 0.023s user 0.016s sys 0.000s
I20260619 06:29:27.239494 8063 tablet_bootstrap.cc:492] T f5c2224f852746c8893931fd3ff27126 P b46f2dae92104884b86705d6bbc20003: Bootstrap starting.
I20260619 06:29:27.239538 8038 heartbeater.cc:503] Master 127.7.96.62:40917 was elected leader, sending a full tablet report...
I20260619 06:29:27.241518 8063 tablet_bootstrap.cc:654] T f5c2224f852746c8893931fd3ff27126 P b46f2dae92104884b86705d6bbc20003: Neither blocks nor log segments found. Creating new log.
I20260619 06:29:27.242307 8061 ts_tablet_manager.cc:1428] T 98eb40b379a24876b6334fff708de671 P 3fc4e58423894a27a7b94de5c6013cf1: Time spent starting tablet: real 0.022s user 0.016s sys 0.004s
I20260619 06:29:27.242726 8061 tablet_bootstrap.cc:492] T 08686b31ffd64266bcdbd6f5eb29a87d P 3fc4e58423894a27a7b94de5c6013cf1: Bootstrap starting.
I20260619 06:29:27.243445 8062 tablet_bootstrap.cc:492] T 98eb40b379a24876b6334fff708de671 P 996381a7495d4720a6f6be44a1d4781b: No bootstrap required, opened a new log
I20260619 06:29:27.243589 8062 ts_tablet_manager.cc:1397] T 98eb40b379a24876b6334fff708de671 P 996381a7495d4720a6f6be44a1d4781b: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.000s
I20260619 06:29:27.244297 8061 tablet_bootstrap.cc:654] T 08686b31ffd64266bcdbd6f5eb29a87d P 3fc4e58423894a27a7b94de5c6013cf1: Neither blocks nor log segments found. Creating new log.
I20260619 06:29:27.244443 8062 raft_consensus.cc:348] T 98eb40b379a24876b6334fff708de671 P 996381a7495d4720a6f6be44a1d4781b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:27.244720 8062 raft_consensus.cc:374] T 98eb40b379a24876b6334fff708de671 P 996381a7495d4720a6f6be44a1d4781b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:29:27.244814 8062 raft_consensus.cc:729] T 98eb40b379a24876b6334fff708de671 P 996381a7495d4720a6f6be44a1d4781b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 996381a7495d4720a6f6be44a1d4781b, State: Initialized, Role: FOLLOWER
I20260619 06:29:27.245061 8062 consensus_queue.cc:260] T 98eb40b379a24876b6334fff708de671 P 996381a7495d4720a6f6be44a1d4781b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:27.245888 8062 ts_tablet_manager.cc:1428] T 98eb40b379a24876b6334fff708de671 P 996381a7495d4720a6f6be44a1d4781b: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260619 06:29:27.246171 8062 tablet_bootstrap.cc:492] T 8e2da70288694680bec48ac95c14656f P 996381a7495d4720a6f6be44a1d4781b: Bootstrap starting.
I20260619 06:29:27.248368 8062 tablet_bootstrap.cc:654] T 8e2da70288694680bec48ac95c14656f P 996381a7495d4720a6f6be44a1d4781b: Neither blocks nor log segments found. Creating new log.
I20260619 06:29:27.250622 8063 tablet_bootstrap.cc:492] T f5c2224f852746c8893931fd3ff27126 P b46f2dae92104884b86705d6bbc20003: No bootstrap required, opened a new log
I20260619 06:29:27.251039 8061 tablet_bootstrap.cc:492] T 08686b31ffd64266bcdbd6f5eb29a87d P 3fc4e58423894a27a7b94de5c6013cf1: No bootstrap required, opened a new log
I20260619 06:29:27.251160 8063 ts_tablet_manager.cc:1397] T f5c2224f852746c8893931fd3ff27126 P b46f2dae92104884b86705d6bbc20003: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.000s
I20260619 06:29:27.251113 8067 raft_consensus.cc:482] T f5c2224f852746c8893931fd3ff27126 P 996381a7495d4720a6f6be44a1d4781b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:29:27.251256 8061 ts_tablet_manager.cc:1397] T 08686b31ffd64266bcdbd6f5eb29a87d P 3fc4e58423894a27a7b94de5c6013cf1: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.006s
I20260619 06:29:27.251437 8067 raft_consensus.cc:504] T f5c2224f852746c8893931fd3ff27126 P 996381a7495d4720a6f6be44a1d4781b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:27.252036 8063 raft_consensus.cc:348] T f5c2224f852746c8893931fd3ff27126 P b46f2dae92104884b86705d6bbc20003 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:27.252036 8061 raft_consensus.cc:348] T 08686b31ffd64266bcdbd6f5eb29a87d P 3fc4e58423894a27a7b94de5c6013cf1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } } peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } }
I20260619 06:29:27.252281 8061 raft_consensus.cc:374] T 08686b31ffd64266bcdbd6f5eb29a87d P 3fc4e58423894a27a7b94de5c6013cf1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:29:27.252281 8063 raft_consensus.cc:374] T f5c2224f852746c8893931fd3ff27126 P b46f2dae92104884b86705d6bbc20003 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:29:27.252372 8063 raft_consensus.cc:729] T f5c2224f852746c8893931fd3ff27126 P b46f2dae92104884b86705d6bbc20003 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b46f2dae92104884b86705d6bbc20003, State: Initialized, Role: FOLLOWER
I20260619 06:29:27.252480 8061 raft_consensus.cc:729] T 08686b31ffd64266bcdbd6f5eb29a87d P 3fc4e58423894a27a7b94de5c6013cf1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fc4e58423894a27a7b94de5c6013cf1, State: Initialized, Role: FOLLOWER
I20260619 06:29:27.252640 8063 consensus_queue.cc:260] T f5c2224f852746c8893931fd3ff27126 P b46f2dae92104884b86705d6bbc20003 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:27.252770 8061 consensus_queue.cc:260] T 08686b31ffd64266bcdbd6f5eb29a87d P 3fc4e58423894a27a7b94de5c6013cf1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } } peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } }
I20260619 06:29:27.253211 8063 ts_tablet_manager.cc:1428] T f5c2224f852746c8893931fd3ff27126 P b46f2dae92104884b86705d6bbc20003: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260619 06:29:27.253453 8063 tablet_bootstrap.cc:492] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003: Bootstrap starting.
I20260619 06:29:27.253866 8061 ts_tablet_manager.cc:1428] T 08686b31ffd64266bcdbd6f5eb29a87d P 3fc4e58423894a27a7b94de5c6013cf1: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260619 06:29:27.254143 8061 tablet_bootstrap.cc:492] T f5c2224f852746c8893931fd3ff27126 P 3fc4e58423894a27a7b94de5c6013cf1: Bootstrap starting.
I20260619 06:29:27.255121 8063 tablet_bootstrap.cc:654] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003: Neither blocks nor log segments found. Creating new log.
I20260619 06:29:27.255625 8069 raft_consensus.cc:482] T 98eb40b379a24876b6334fff708de671 P 3fc4e58423894a27a7b94de5c6013cf1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:29:27.255877 8069 raft_consensus.cc:504] T 98eb40b379a24876b6334fff708de671 P 3fc4e58423894a27a7b94de5c6013cf1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:27.257766 8062 tablet_bootstrap.cc:492] T 8e2da70288694680bec48ac95c14656f P 996381a7495d4720a6f6be44a1d4781b: No bootstrap required, opened a new log
I20260619 06:29:27.257913 8062 ts_tablet_manager.cc:1397] T 8e2da70288694680bec48ac95c14656f P 996381a7495d4720a6f6be44a1d4781b: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.000s
I20260619 06:29:27.258195 8069 leader_election.cc:288] T 98eb40b379a24876b6334fff708de671 P 3fc4e58423894a27a7b94de5c6013cf1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323), 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063)
I20260619 06:29:27.258939 8062 raft_consensus.cc:348] T 8e2da70288694680bec48ac95c14656f P 996381a7495d4720a6f6be44a1d4781b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:27.259301 8062 raft_consensus.cc:374] T 8e2da70288694680bec48ac95c14656f P 996381a7495d4720a6f6be44a1d4781b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:29:27.259394 8062 raft_consensus.cc:729] T 8e2da70288694680bec48ac95c14656f P 996381a7495d4720a6f6be44a1d4781b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 996381a7495d4720a6f6be44a1d4781b, State: Initialized, Role: FOLLOWER
I20260619 06:29:27.259652 8062 consensus_queue.cc:260] T 8e2da70288694680bec48ac95c14656f P 996381a7495d4720a6f6be44a1d4781b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:27.271698 8067 leader_election.cc:288] T f5c2224f852746c8893931fd3ff27126 P 996381a7495d4720a6f6be44a1d4781b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323), 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499)
W20260619 06:29:27.284354 8039 tablet.cc:2369] T 08686b31ffd64266bcdbd6f5eb29a87d P 3fc4e58423894a27a7b94de5c6013cf1: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260619 06:29:27.284907 8039 tablet_replica_mm_ops.cc:318] Log GC is disabled (check --enable_log_gc)
I20260619 06:29:27.289479 8068 raft_consensus.cc:482] T f5c2224f852746c8893931fd3ff27126 P b46f2dae92104884b86705d6bbc20003 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:29:27.289803 8068 raft_consensus.cc:504] T f5c2224f852746c8893931fd3ff27126 P b46f2dae92104884b86705d6bbc20003 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:27.293193 8068 leader_election.cc:288] T f5c2224f852746c8893931fd3ff27126 P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063), 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499)
I20260619 06:29:27.302616 8061 tablet_bootstrap.cc:654] T f5c2224f852746c8893931fd3ff27126 P 3fc4e58423894a27a7b94de5c6013cf1: Neither blocks nor log segments found. Creating new log.
I20260619 06:29:27.299957 7863 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98eb40b379a24876b6334fff708de671" candidate_uuid: "3fc4e58423894a27a7b94de5c6013cf1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "996381a7495d4720a6f6be44a1d4781b" is_pre_election: true
I20260619 06:29:27.304333 7863 raft_consensus.cc:2454] T 98eb40b379a24876b6334fff708de671 P 996381a7495d4720a6f6be44a1d4781b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fc4e58423894a27a7b94de5c6013cf1 in term 0.
I20260619 06:29:27.305521 8062 ts_tablet_manager.cc:1428] T 8e2da70288694680bec48ac95c14656f P 996381a7495d4720a6f6be44a1d4781b: Time spent starting tablet: real 0.047s user 0.006s sys 0.023s
I20260619 06:29:27.306797 8062 tablet_bootstrap.cc:492] T 08686b31ffd64266bcdbd6f5eb29a87d P 996381a7495d4720a6f6be44a1d4781b: Bootstrap starting.
I20260619 06:29:27.306703 7926 leader_election.cc:302] T 98eb40b379a24876b6334fff708de671 P 3fc4e58423894a27a7b94de5c6013cf1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fc4e58423894a27a7b94de5c6013cf1, 996381a7495d4720a6f6be44a1d4781b; no voters:
I20260619 06:29:27.309120 8062 tablet_bootstrap.cc:654] T 08686b31ffd64266bcdbd6f5eb29a87d P 996381a7495d4720a6f6be44a1d4781b: Neither blocks nor log segments found. Creating new log.
I20260619 06:29:27.309988 8069 raft_consensus.cc:2781] T 98eb40b379a24876b6334fff708de671 P 3fc4e58423894a27a7b94de5c6013cf1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 06:29:27.310177 8069 raft_consensus.cc:482] T 98eb40b379a24876b6334fff708de671 P 3fc4e58423894a27a7b94de5c6013cf1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 06:29:27.310285 8069 raft_consensus.cc:3037] T 98eb40b379a24876b6334fff708de671 P 3fc4e58423894a27a7b94de5c6013cf1 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:29:27.313800 8069 raft_consensus.cc:504] T 98eb40b379a24876b6334fff708de671 P 3fc4e58423894a27a7b94de5c6013cf1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:27.315304 7863 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98eb40b379a24876b6334fff708de671" candidate_uuid: "3fc4e58423894a27a7b94de5c6013cf1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "996381a7495d4720a6f6be44a1d4781b"
I20260619 06:29:27.315560 7863 raft_consensus.cc:3037] T 98eb40b379a24876b6334fff708de671 P 996381a7495d4720a6f6be44a1d4781b [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:29:27.318799 8068 raft_consensus.cc:482] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:29:27.319013 8068 raft_consensus.cc:504] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:27.319435 7863 raft_consensus.cc:2454] T 98eb40b379a24876b6334fff708de671 P 996381a7495d4720a6f6be44a1d4781b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fc4e58423894a27a7b94de5c6013cf1 in term 1.
I20260619 06:29:27.319743 8068 leader_election.cc:288] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063), 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499)
I20260619 06:29:27.319921 7926 leader_election.cc:302] T 98eb40b379a24876b6334fff708de671 P 3fc4e58423894a27a7b94de5c6013cf1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fc4e58423894a27a7b94de5c6013cf1, 996381a7495d4720a6f6be44a1d4781b; no voters:
I20260619 06:29:27.322669 8069 leader_election.cc:288] T 98eb40b379a24876b6334fff708de671 P 3fc4e58423894a27a7b94de5c6013cf1 [CANDIDATE]: Term 1 election: Requested vote from peers b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323), 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063)
I20260619 06:29:27.323051 8069 raft_consensus.cc:2781] T 98eb40b379a24876b6334fff708de671 P 3fc4e58423894a27a7b94de5c6013cf1 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:29:27.323422 8069 raft_consensus.cc:686] T 98eb40b379a24876b6334fff708de671 P 3fc4e58423894a27a7b94de5c6013cf1 [term 1 LEADER]: Becoming Leader. State: Replica: 3fc4e58423894a27a7b94de5c6013cf1, State: Running, Role: LEADER
I20260619 06:29:27.324283 8069 consensus_queue.cc:237] T 98eb40b379a24876b6334fff708de671 P 3fc4e58423894a27a7b94de5c6013cf1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:27.326617 8076 raft_consensus.cc:482] T 8e2da70288694680bec48ac95c14656f P 996381a7495d4720a6f6be44a1d4781b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:29:27.327531 8076 raft_consensus.cc:504] T 8e2da70288694680bec48ac95c14656f P 996381a7495d4720a6f6be44a1d4781b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:27.331256 7731 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98eb40b379a24876b6334fff708de671" candidate_uuid: "3fc4e58423894a27a7b94de5c6013cf1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b46f2dae92104884b86705d6bbc20003"
I20260619 06:29:27.331277 7732 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98eb40b379a24876b6334fff708de671" candidate_uuid: "3fc4e58423894a27a7b94de5c6013cf1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b46f2dae92104884b86705d6bbc20003" is_pre_election: true
I20260619 06:29:27.332820 8063 tablet_bootstrap.cc:492] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003: No bootstrap required, opened a new log
W20260619 06:29:27.332870 7929 leader_election.cc:341] T 98eb40b379a24876b6334fff708de671 P 3fc4e58423894a27a7b94de5c6013cf1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Illegal state: must be running to vote when last-logged opid is not known
I20260619 06:29:27.332991 8063 ts_tablet_manager.cc:1397] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003: Time spent bootstrapping tablet: real 0.080s user 0.037s sys 0.040s
W20260619 06:29:27.333247 7929 leader_election.cc:341] T 98eb40b379a24876b6334fff708de671 P 3fc4e58423894a27a7b94de5c6013cf1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Illegal state: must be running to vote when last-logged opid is not known
I20260619 06:29:27.333767 8063 raft_consensus.cc:348] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:27.334036 8063 raft_consensus.cc:374] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:29:27.334133 8063 raft_consensus.cc:729] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b46f2dae92104884b86705d6bbc20003, State: Initialized, Role: FOLLOWER
I20260619 06:29:27.334388 8063 consensus_queue.cc:260] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:27.337942 8063 ts_tablet_manager.cc:1428] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260619 06:29:27.340764 8063 tablet_bootstrap.cc:492] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003: Bootstrap starting.
I20260619 06:29:27.342967 8063 tablet_bootstrap.cc:654] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003: Neither blocks nor log segments found. Creating new log.
W20260619 06:29:27.344062 7909 tablet.cc:2369] T 8e2da70288694680bec48ac95c14656f P 996381a7495d4720a6f6be44a1d4781b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260619 06:29:27.344596 7909 tablet_replica_mm_ops.cc:318] Log GC is disabled (check --enable_log_gc)
I20260619 06:29:27.350800 8076 leader_election.cc:288] T 8e2da70288694680bec48ac95c14656f P 996381a7495d4720a6f6be44a1d4781b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323), 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499)
I20260619 06:29:27.354732 8061 tablet_bootstrap.cc:492] T f5c2224f852746c8893931fd3ff27126 P 3fc4e58423894a27a7b94de5c6013cf1: No bootstrap required, opened a new log
I20260619 06:29:27.354986 8061 ts_tablet_manager.cc:1397] T f5c2224f852746c8893931fd3ff27126 P 3fc4e58423894a27a7b94de5c6013cf1: Time spent bootstrapping tablet: real 0.101s user 0.007s sys 0.022s
I20260619 06:29:27.355798 7732 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5c2224f852746c8893931fd3ff27126" candidate_uuid: "996381a7495d4720a6f6be44a1d4781b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b46f2dae92104884b86705d6bbc20003" is_pre_election: true
I20260619 06:29:27.356148 7732 raft_consensus.cc:2454] T f5c2224f852746c8893931fd3ff27126 P b46f2dae92104884b86705d6bbc20003 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 996381a7495d4720a6f6be44a1d4781b in term 0.
I20260619 06:29:27.356051 8061 raft_consensus.cc:348] T f5c2224f852746c8893931fd3ff27126 P 3fc4e58423894a27a7b94de5c6013cf1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:27.356488 8061 raft_consensus.cc:374] T f5c2224f852746c8893931fd3ff27126 P 3fc4e58423894a27a7b94de5c6013cf1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:29:27.356513 7731 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e2da70288694680bec48ac95c14656f" candidate_uuid: "996381a7495d4720a6f6be44a1d4781b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b46f2dae92104884b86705d6bbc20003" is_pre_election: true
I20260619 06:29:27.356637 8061 raft_consensus.cc:729] T f5c2224f852746c8893931fd3ff27126 P 3fc4e58423894a27a7b94de5c6013cf1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fc4e58423894a27a7b94de5c6013cf1, State: Initialized, Role: FOLLOWER
I20260619 06:29:27.356810 7731 raft_consensus.cc:2454] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 996381a7495d4720a6f6be44a1d4781b in term 0.
I20260619 06:29:27.357131 8061 consensus_queue.cc:260] T f5c2224f852746c8893931fd3ff27126 P 3fc4e58423894a27a7b94de5c6013cf1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:27.357470 7799 leader_election.cc:302] T f5c2224f852746c8893931fd3ff27126 P 996381a7495d4720a6f6be44a1d4781b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 996381a7495d4720a6f6be44a1d4781b, b46f2dae92104884b86705d6bbc20003; no voters:
I20260619 06:29:27.357975 7799 leader_election.cc:302] T 8e2da70288694680bec48ac95c14656f P 996381a7495d4720a6f6be44a1d4781b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 996381a7495d4720a6f6be44a1d4781b, b46f2dae92104884b86705d6bbc20003; no voters:
I20260619 06:29:27.358259 8067 raft_consensus.cc:2781] T f5c2224f852746c8893931fd3ff27126 P 996381a7495d4720a6f6be44a1d4781b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 06:29:27.358389 8067 raft_consensus.cc:482] T f5c2224f852746c8893931fd3ff27126 P 996381a7495d4720a6f6be44a1d4781b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 06:29:27.358520 8067 raft_consensus.cc:3037] T f5c2224f852746c8893931fd3ff27126 P 996381a7495d4720a6f6be44a1d4781b [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:29:27.362039 8067 raft_consensus.cc:504] T f5c2224f852746c8893931fd3ff27126 P 996381a7495d4720a6f6be44a1d4781b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:27.362870 8067 leader_election.cc:288] T f5c2224f852746c8893931fd3ff27126 P 996381a7495d4720a6f6be44a1d4781b [CANDIDATE]: Term 1 election: Requested vote from peers b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323), 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499)
I20260619 06:29:27.363076 8067 raft_consensus.cc:2781] T 8e2da70288694680bec48ac95c14656f P 996381a7495d4720a6f6be44a1d4781b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 06:29:27.363176 8067 raft_consensus.cc:482] T 8e2da70288694680bec48ac95c14656f P 996381a7495d4720a6f6be44a1d4781b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 06:29:27.363289 8067 raft_consensus.cc:3037] T 8e2da70288694680bec48ac95c14656f P 996381a7495d4720a6f6be44a1d4781b [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:29:27.364912 8061 ts_tablet_manager.cc:1428] T f5c2224f852746c8893931fd3ff27126 P 3fc4e58423894a27a7b94de5c6013cf1: Time spent starting tablet: real 0.010s user 0.002s sys 0.006s
I20260619 06:29:27.365922 8061 tablet_bootstrap.cc:492] T 6cffdcc0e99c47aead56bbaea58d3e4d P 3fc4e58423894a27a7b94de5c6013cf1: Bootstrap starting.
I20260619 06:29:27.367146 7731 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5c2224f852746c8893931fd3ff27126" candidate_uuid: "996381a7495d4720a6f6be44a1d4781b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b46f2dae92104884b86705d6bbc20003"
I20260619 06:29:27.367419 7731 raft_consensus.cc:3037] T f5c2224f852746c8893931fd3ff27126 P b46f2dae92104884b86705d6bbc20003 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:29:27.368468 8061 tablet_bootstrap.cc:654] T 6cffdcc0e99c47aead56bbaea58d3e4d P 3fc4e58423894a27a7b94de5c6013cf1: Neither blocks nor log segments found. Creating new log.
I20260619 06:29:27.368963 8088 raft_consensus.cc:482] T 08686b31ffd64266bcdbd6f5eb29a87d P 3fc4e58423894a27a7b94de5c6013cf1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:29:27.370152 8088 raft_consensus.cc:504] T 08686b31ffd64266bcdbd6f5eb29a87d P 3fc4e58423894a27a7b94de5c6013cf1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } } peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } }
I20260619 06:29:27.371277 7731 raft_consensus.cc:2454] T f5c2224f852746c8893931fd3ff27126 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 996381a7495d4720a6f6be44a1d4781b in term 1.
I20260619 06:29:27.371665 7732 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08686b31ffd64266bcdbd6f5eb29a87d" candidate_uuid: "3fc4e58423894a27a7b94de5c6013cf1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b46f2dae92104884b86705d6bbc20003" is_pre_election: true
I20260619 06:29:27.371852 7799 leader_election.cc:302] T f5c2224f852746c8893931fd3ff27126 P 996381a7495d4720a6f6be44a1d4781b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 996381a7495d4720a6f6be44a1d4781b, b46f2dae92104884b86705d6bbc20003; no voters:
I20260619 06:29:27.372247 8076 raft_consensus.cc:2781] T f5c2224f852746c8893931fd3ff27126 P 996381a7495d4720a6f6be44a1d4781b [term 1 FOLLOWER]: Leader election won for term 1
W20260619 06:29:27.372432 7929 leader_election.cc:341] T 08686b31ffd64266bcdbd6f5eb29a87d P 3fc4e58423894a27a7b94de5c6013cf1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Illegal state: must be running to vote when last-logged opid is not known
I20260619 06:29:27.372673 8067 raft_consensus.cc:504] T 8e2da70288694680bec48ac95c14656f P 996381a7495d4720a6f6be44a1d4781b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:27.372864 8088 leader_election.cc:288] T 08686b31ffd64266bcdbd6f5eb29a87d P 3fc4e58423894a27a7b94de5c6013cf1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323), 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063)
I20260619 06:29:27.373761 8088 raft_consensus.cc:482] T f5c2224f852746c8893931fd3ff27126 P 3fc4e58423894a27a7b94de5c6013cf1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:29:27.373994 8088 raft_consensus.cc:504] T f5c2224f852746c8893931fd3ff27126 P 3fc4e58423894a27a7b94de5c6013cf1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:27.374114 7732 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e2da70288694680bec48ac95c14656f" candidate_uuid: "996381a7495d4720a6f6be44a1d4781b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b46f2dae92104884b86705d6bbc20003"
I20260619 06:29:27.374316 7732 raft_consensus.cc:3037] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:29:27.375398 7731 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5c2224f852746c8893931fd3ff27126" candidate_uuid: "3fc4e58423894a27a7b94de5c6013cf1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b46f2dae92104884b86705d6bbc20003" is_pre_election: true
I20260619 06:29:27.375795 7731 raft_consensus.cc:2379] T f5c2224f852746c8893931fd3ff27126 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3fc4e58423894a27a7b94de5c6013cf1 in current term 1: Already voted for candidate 996381a7495d4720a6f6be44a1d4781b in this term.
I20260619 06:29:27.376766 8088 leader_election.cc:288] T f5c2224f852746c8893931fd3ff27126 P 3fc4e58423894a27a7b94de5c6013cf1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323), 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063)
I20260619 06:29:27.378084 7732 raft_consensus.cc:2454] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 996381a7495d4720a6f6be44a1d4781b in term 1.
I20260619 06:29:27.378628 7799 leader_election.cc:302] T 8e2da70288694680bec48ac95c14656f P 996381a7495d4720a6f6be44a1d4781b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 996381a7495d4720a6f6be44a1d4781b, b46f2dae92104884b86705d6bbc20003; no voters:
I20260619 06:29:27.379024 8090 raft_consensus.cc:2781] T 8e2da70288694680bec48ac95c14656f P 996381a7495d4720a6f6be44a1d4781b [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:29:27.379410 8061 tablet_bootstrap.cc:492] T 6cffdcc0e99c47aead56bbaea58d3e4d P 3fc4e58423894a27a7b94de5c6013cf1: No bootstrap required, opened a new log
I20260619 06:29:27.379595 8061 ts_tablet_manager.cc:1397] T 6cffdcc0e99c47aead56bbaea58d3e4d P 3fc4e58423894a27a7b94de5c6013cf1: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.001s
I20260619 06:29:27.380795 8061 raft_consensus.cc:348] T 6cffdcc0e99c47aead56bbaea58d3e4d P 3fc4e58423894a27a7b94de5c6013cf1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:27.381089 8061 raft_consensus.cc:374] T 6cffdcc0e99c47aead56bbaea58d3e4d P 3fc4e58423894a27a7b94de5c6013cf1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:29:27.381189 8061 raft_consensus.cc:729] T 6cffdcc0e99c47aead56bbaea58d3e4d P 3fc4e58423894a27a7b94de5c6013cf1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fc4e58423894a27a7b94de5c6013cf1, State: Initialized, Role: FOLLOWER
I20260619 06:29:27.381510 8061 consensus_queue.cc:260] T 6cffdcc0e99c47aead56bbaea58d3e4d P 3fc4e58423894a27a7b94de5c6013cf1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:27.382254 8061 ts_tablet_manager.cc:1428] T 6cffdcc0e99c47aead56bbaea58d3e4d P 3fc4e58423894a27a7b94de5c6013cf1: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260619 06:29:27.382638 8061 tablet_bootstrap.cc:492] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 3fc4e58423894a27a7b94de5c6013cf1: Bootstrap starting.
I20260619 06:29:27.383019 8076 raft_consensus.cc:686] T f5c2224f852746c8893931fd3ff27126 P 996381a7495d4720a6f6be44a1d4781b [term 1 LEADER]: Becoming Leader. State: Replica: 996381a7495d4720a6f6be44a1d4781b, State: Running, Role: LEADER
I20260619 06:29:27.383890 8076 consensus_queue.cc:237] T f5c2224f852746c8893931fd3ff27126 P 996381a7495d4720a6f6be44a1d4781b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:27.384728 8061 tablet_bootstrap.cc:654] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 3fc4e58423894a27a7b94de5c6013cf1: Neither blocks nor log segments found. Creating new log.
I20260619 06:29:27.391896 8090 raft_consensus.cc:686] T 8e2da70288694680bec48ac95c14656f P 996381a7495d4720a6f6be44a1d4781b [term 1 LEADER]: Becoming Leader. State: Replica: 996381a7495d4720a6f6be44a1d4781b, State: Running, Role: LEADER
I20260619 06:29:27.392294 8090 consensus_queue.cc:237] T 8e2da70288694680bec48ac95c14656f P 996381a7495d4720a6f6be44a1d4781b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:27.394953 8061 tablet_bootstrap.cc:492] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 3fc4e58423894a27a7b94de5c6013cf1: No bootstrap required, opened a new log
I20260619 06:29:27.395128 8061 ts_tablet_manager.cc:1397] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 3fc4e58423894a27a7b94de5c6013cf1: Time spent bootstrapping tablet: real 0.013s user 0.008s sys 0.004s
W20260619 06:29:27.396032 7926 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.96.2:37063, user_credentials={real_user=slave}} blocked reactor thread for 76110.1us
I20260619 06:29:27.396824 7863 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08686b31ffd64266bcdbd6f5eb29a87d" candidate_uuid: "3fc4e58423894a27a7b94de5c6013cf1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "996381a7495d4720a6f6be44a1d4781b" is_pre_election: true
I20260619 06:29:27.397225 7591 catalog_manager.cc:5495] T 98eb40b379a24876b6334fff708de671 P 3fc4e58423894a27a7b94de5c6013cf1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3). New cstate: current_term: 1 leader_uuid: "3fc4e58423894a27a7b94de5c6013cf1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } health_report { overall_health: HEALTHY } } }
I20260619 06:29:27.398028 7863 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5c2224f852746c8893931fd3ff27126" candidate_uuid: "3fc4e58423894a27a7b94de5c6013cf1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "996381a7495d4720a6f6be44a1d4781b" is_pre_election: true
W20260619 06:29:27.398725 7926 leader_election.cc:341] T 08686b31ffd64266bcdbd6f5eb29a87d P 3fc4e58423894a27a7b94de5c6013cf1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063): Illegal state: must be running to vote when last-logged opid is not known
I20260619 06:29:27.398927 7926 leader_election.cc:302] T 08686b31ffd64266bcdbd6f5eb29a87d P 3fc4e58423894a27a7b94de5c6013cf1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3fc4e58423894a27a7b94de5c6013cf1; no voters: 996381a7495d4720a6f6be44a1d4781b, b46f2dae92104884b86705d6bbc20003
I20260619 06:29:27.399369 7926 leader_election.cc:302] T f5c2224f852746c8893931fd3ff27126 P 3fc4e58423894a27a7b94de5c6013cf1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3fc4e58423894a27a7b94de5c6013cf1; no voters: 996381a7495d4720a6f6be44a1d4781b, b46f2dae92104884b86705d6bbc20003
I20260619 06:29:27.400125 8067 leader_election.cc:288] T 8e2da70288694680bec48ac95c14656f P 996381a7495d4720a6f6be44a1d4781b [CANDIDATE]: Term 1 election: Requested vote from peers b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323), 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499)
I20260619 06:29:27.399660 8061 raft_consensus.cc:348] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 3fc4e58423894a27a7b94de5c6013cf1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:27.400477 8061 raft_consensus.cc:374] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 3fc4e58423894a27a7b94de5c6013cf1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:29:27.400560 8061 raft_consensus.cc:729] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 3fc4e58423894a27a7b94de5c6013cf1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fc4e58423894a27a7b94de5c6013cf1, State: Initialized, Role: FOLLOWER
I20260619 06:29:27.400779 8061 consensus_queue.cc:260] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 3fc4e58423894a27a7b94de5c6013cf1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:27.401330 8061 ts_tablet_manager.cc:1428] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 3fc4e58423894a27a7b94de5c6013cf1: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260619 06:29:27.401578 8061 tablet_bootstrap.cc:492] T 8e2da70288694680bec48ac95c14656f P 3fc4e58423894a27a7b94de5c6013cf1: Bootstrap starting.
I20260619 06:29:27.403689 8061 tablet_bootstrap.cc:654] T 8e2da70288694680bec48ac95c14656f P 3fc4e58423894a27a7b94de5c6013cf1: Neither blocks nor log segments found. Creating new log.
I20260619 06:29:27.409067 8084 raft_consensus.cc:3037] T f5c2224f852746c8893931fd3ff27126 P 3fc4e58423894a27a7b94de5c6013cf1 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:29:27.408938 7993 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5c2224f852746c8893931fd3ff27126" candidate_uuid: "996381a7495d4720a6f6be44a1d4781b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1" is_pre_election: true
I20260619 06:29:27.409420 7990 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e2da70288694680bec48ac95c14656f" candidate_uuid: "996381a7495d4720a6f6be44a1d4781b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1"
I20260619 06:29:27.408905 7992 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e2da70288694680bec48ac95c14656f" candidate_uuid: "996381a7495d4720a6f6be44a1d4781b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1" is_pre_election: true
I20260619 06:29:27.409777 7991 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5c2224f852746c8893931fd3ff27126" candidate_uuid: "996381a7495d4720a6f6be44a1d4781b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1"
W20260619 06:29:27.410470 7796 leader_election.cc:341] T 8e2da70288694680bec48ac95c14656f P 996381a7495d4720a6f6be44a1d4781b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499): Illegal state: must be running to vote when last-logged opid is not known
I20260619 06:29:27.408967 8069 raft_consensus.cc:2726] T 08686b31ffd64266bcdbd6f5eb29a87d P 3fc4e58423894a27a7b94de5c6013cf1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260619 06:29:27.411159 7796 leader_election.cc:341] T 8e2da70288694680bec48ac95c14656f P 996381a7495d4720a6f6be44a1d4781b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499): Illegal state: must be running to vote when last-logged opid is not known
W20260619 06:29:27.411401 7778 tablet.cc:2369] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260619 06:29:27.411808 7778 tablet_replica_mm_ops.cc:318] Log GC is disabled (check --enable_log_gc)
I20260619 06:29:27.412933 8084 raft_consensus.cc:2726] T f5c2224f852746c8893931fd3ff27126 P 3fc4e58423894a27a7b94de5c6013cf1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 06:29:27.413267 7993 raft_consensus.cc:2454] T f5c2224f852746c8893931fd3ff27126 P 3fc4e58423894a27a7b94de5c6013cf1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 996381a7495d4720a6f6be44a1d4781b in term 1.
I20260619 06:29:27.414666 8061 tablet_bootstrap.cc:492] T 8e2da70288694680bec48ac95c14656f P 3fc4e58423894a27a7b94de5c6013cf1: No bootstrap required, opened a new log
I20260619 06:29:27.414850 8061 ts_tablet_manager.cc:1397] T 8e2da70288694680bec48ac95c14656f P 3fc4e58423894a27a7b94de5c6013cf1: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.007s
I20260619 06:29:27.415762 8061 raft_consensus.cc:348] T 8e2da70288694680bec48ac95c14656f P 3fc4e58423894a27a7b94de5c6013cf1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:27.416016 8061 raft_consensus.cc:374] T 8e2da70288694680bec48ac95c14656f P 3fc4e58423894a27a7b94de5c6013cf1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:29:27.416121 8061 raft_consensus.cc:729] T 8e2da70288694680bec48ac95c14656f P 3fc4e58423894a27a7b94de5c6013cf1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fc4e58423894a27a7b94de5c6013cf1, State: Initialized, Role: FOLLOWER
I20260619 06:29:27.416404 8061 consensus_queue.cc:260] T 8e2da70288694680bec48ac95c14656f P 3fc4e58423894a27a7b94de5c6013cf1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:27.417094 8061 ts_tablet_manager.cc:1428] T 8e2da70288694680bec48ac95c14656f P 3fc4e58423894a27a7b94de5c6013cf1: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 06:29:27.425763 8062 tablet_bootstrap.cc:492] T 08686b31ffd64266bcdbd6f5eb29a87d P 996381a7495d4720a6f6be44a1d4781b: No bootstrap required, opened a new log
I20260619 06:29:27.425937 8062 ts_tablet_manager.cc:1397] T 08686b31ffd64266bcdbd6f5eb29a87d P 996381a7495d4720a6f6be44a1d4781b: Time spent bootstrapping tablet: real 0.119s user 0.023s sys 0.030s
I20260619 06:29:27.426966 8062 raft_consensus.cc:348] T 08686b31ffd64266bcdbd6f5eb29a87d P 996381a7495d4720a6f6be44a1d4781b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } } peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } }
I20260619 06:29:27.427294 8062 raft_consensus.cc:374] T 08686b31ffd64266bcdbd6f5eb29a87d P 996381a7495d4720a6f6be44a1d4781b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:29:27.427395 8062 raft_consensus.cc:729] T 08686b31ffd64266bcdbd6f5eb29a87d P 996381a7495d4720a6f6be44a1d4781b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 996381a7495d4720a6f6be44a1d4781b, State: Initialized, Role: FOLLOWER
I20260619 06:29:27.427646 8062 consensus_queue.cc:260] T 08686b31ffd64266bcdbd6f5eb29a87d P 996381a7495d4720a6f6be44a1d4781b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } } peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } }
I20260619 06:29:27.428382 8062 ts_tablet_manager.cc:1428] T 08686b31ffd64266bcdbd6f5eb29a87d P 996381a7495d4720a6f6be44a1d4781b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 06:29:27.428798 8062 tablet_bootstrap.cc:492] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 996381a7495d4720a6f6be44a1d4781b: Bootstrap starting.
I20260619 06:29:27.429411 7591 catalog_manager.cc:5495] T f5c2224f852746c8893931fd3ff27126 P 996381a7495d4720a6f6be44a1d4781b reported cstate change: term changed from 0 to 1, leader changed from <none> to 996381a7495d4720a6f6be44a1d4781b (127.7.96.2). New cstate: current_term: 1 leader_uuid: "996381a7495d4720a6f6be44a1d4781b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } health_report { overall_health: UNKNOWN } } }
I20260619 06:29:27.431147 8062 tablet_bootstrap.cc:654] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 996381a7495d4720a6f6be44a1d4781b: Neither blocks nor log segments found. Creating new log.
I20260619 06:29:27.435956 8069 raft_consensus.cc:482] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 3fc4e58423894a27a7b94de5c6013cf1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:29:27.435793 7591 catalog_manager.cc:5495] T 8e2da70288694680bec48ac95c14656f P 996381a7495d4720a6f6be44a1d4781b reported cstate change: term changed from 0 to 1, leader changed from <none> to 996381a7495d4720a6f6be44a1d4781b (127.7.96.2). New cstate: current_term: 1 leader_uuid: "996381a7495d4720a6f6be44a1d4781b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } health_report { overall_health: UNKNOWN } } }
I20260619 06:29:27.436091 8069 raft_consensus.cc:504] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 3fc4e58423894a27a7b94de5c6013cf1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
W20260619 06:29:27.436558 7929 consensus_peers.cc:487] T 98eb40b379a24876b6334fff708de671 P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260619 06:29:27.436672 8069 leader_election.cc:288] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 3fc4e58423894a27a7b94de5c6013cf1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323), 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063)
I20260619 06:29:27.437150 7863 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3e5e97eabdf42cf8e46ccb4b61c5fb7" candidate_uuid: "3fc4e58423894a27a7b94de5c6013cf1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "996381a7495d4720a6f6be44a1d4781b" is_pre_election: true
W20260619 06:29:27.437685 7926 leader_election.cc:341] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 3fc4e58423894a27a7b94de5c6013cf1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063): Illegal state: must be running to vote when last-logged opid is not known
I20260619 06:29:27.439640 7732 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3e5e97eabdf42cf8e46ccb4b61c5fb7" candidate_uuid: "3fc4e58423894a27a7b94de5c6013cf1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b46f2dae92104884b86705d6bbc20003" is_pre_election: true
I20260619 06:29:27.439966 7732 raft_consensus.cc:2454] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fc4e58423894a27a7b94de5c6013cf1 in term 0.
I20260619 06:29:27.440623 7929 leader_election.cc:302] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 3fc4e58423894a27a7b94de5c6013cf1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3fc4e58423894a27a7b94de5c6013cf1, b46f2dae92104884b86705d6bbc20003; no voters: 996381a7495d4720a6f6be44a1d4781b
I20260619 06:29:27.440909 8069 raft_consensus.cc:2781] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 3fc4e58423894a27a7b94de5c6013cf1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 06:29:27.441010 8069 raft_consensus.cc:482] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 3fc4e58423894a27a7b94de5c6013cf1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 06:29:27.441094 8069 raft_consensus.cc:3037] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 3fc4e58423894a27a7b94de5c6013cf1 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:29:27.441519 8062 tablet_bootstrap.cc:492] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 996381a7495d4720a6f6be44a1d4781b: No bootstrap required, opened a new log
I20260619 06:29:27.441617 8076 raft_consensus.cc:482] T 08686b31ffd64266bcdbd6f5eb29a87d P 996381a7495d4720a6f6be44a1d4781b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:29:27.441697 8062 ts_tablet_manager.cc:1397] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 996381a7495d4720a6f6be44a1d4781b: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.008s
I20260619 06:29:27.441859 8076 raft_consensus.cc:504] T 08686b31ffd64266bcdbd6f5eb29a87d P 996381a7495d4720a6f6be44a1d4781b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } } peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } }
I20260619 06:29:27.442776 8076 leader_election.cc:288] T 08686b31ffd64266bcdbd6f5eb29a87d P 996381a7495d4720a6f6be44a1d4781b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499), b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323)
I20260619 06:29:27.442718 8062 raft_consensus.cc:348] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 996381a7495d4720a6f6be44a1d4781b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:27.443051 8062 raft_consensus.cc:374] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 996381a7495d4720a6f6be44a1d4781b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:29:27.443063 7993 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08686b31ffd64266bcdbd6f5eb29a87d" candidate_uuid: "996381a7495d4720a6f6be44a1d4781b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1" is_pre_election: true
I20260619 06:29:27.443141 8062 raft_consensus.cc:729] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 996381a7495d4720a6f6be44a1d4781b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 996381a7495d4720a6f6be44a1d4781b, State: Initialized, Role: FOLLOWER
I20260619 06:29:27.443276 7993 raft_consensus.cc:2454] T 08686b31ffd64266bcdbd6f5eb29a87d P 3fc4e58423894a27a7b94de5c6013cf1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 996381a7495d4720a6f6be44a1d4781b in term 0.
I20260619 06:29:27.443404 8062 consensus_queue.cc:260] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 996381a7495d4720a6f6be44a1d4781b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:27.443852 7732 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08686b31ffd64266bcdbd6f5eb29a87d" candidate_uuid: "996381a7495d4720a6f6be44a1d4781b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b46f2dae92104884b86705d6bbc20003" is_pre_election: true
I20260619 06:29:27.444475 8062 ts_tablet_manager.cc:1428] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 996381a7495d4720a6f6be44a1d4781b: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260619 06:29:27.444761 8062 tablet_bootstrap.cc:492] T 6cffdcc0e99c47aead56bbaea58d3e4d P 996381a7495d4720a6f6be44a1d4781b: Bootstrap starting.
I20260619 06:29:27.445675 7796 leader_election.cc:302] T 08686b31ffd64266bcdbd6f5eb29a87d P 996381a7495d4720a6f6be44a1d4781b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fc4e58423894a27a7b94de5c6013cf1, 996381a7495d4720a6f6be44a1d4781b; no voters:
I20260619 06:29:27.445915 8076 raft_consensus.cc:2781] T 08686b31ffd64266bcdbd6f5eb29a87d P 996381a7495d4720a6f6be44a1d4781b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 06:29:27.446036 8076 raft_consensus.cc:482] T 08686b31ffd64266bcdbd6f5eb29a87d P 996381a7495d4720a6f6be44a1d4781b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260619 06:29:27.446147 7799 leader_election.cc:341] T 08686b31ffd64266bcdbd6f5eb29a87d P 996381a7495d4720a6f6be44a1d4781b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Illegal state: must be running to vote when last-logged opid is not known
I20260619 06:29:27.446143 8076 raft_consensus.cc:3037] T 08686b31ffd64266bcdbd6f5eb29a87d P 996381a7495d4720a6f6be44a1d4781b [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:29:27.446434 8062 tablet_bootstrap.cc:654] T 6cffdcc0e99c47aead56bbaea58d3e4d P 996381a7495d4720a6f6be44a1d4781b: Neither blocks nor log segments found. Creating new log.
I20260619 06:29:27.447888 8069 raft_consensus.cc:504] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 3fc4e58423894a27a7b94de5c6013cf1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:27.448058 8090 raft_consensus.cc:482] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 996381a7495d4720a6f6be44a1d4781b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:29:27.448206 8090 raft_consensus.cc:504] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 996381a7495d4720a6f6be44a1d4781b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:27.448738 8069 leader_election.cc:288] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 3fc4e58423894a27a7b94de5c6013cf1 [CANDIDATE]: Term 1 election: Requested vote from peers b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323), 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063)
I20260619 06:29:27.449105 8090 leader_election.cc:288] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 996381a7495d4720a6f6be44a1d4781b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323), 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499)
I20260619 06:29:27.449088 7732 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3e5e97eabdf42cf8e46ccb4b61c5fb7" candidate_uuid: "3fc4e58423894a27a7b94de5c6013cf1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b46f2dae92104884b86705d6bbc20003"
I20260619 06:29:27.449282 7732 raft_consensus.cc:3037] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:29:27.449680 7863 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3e5e97eabdf42cf8e46ccb4b61c5fb7" candidate_uuid: "3fc4e58423894a27a7b94de5c6013cf1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "996381a7495d4720a6f6be44a1d4781b"
I20260619 06:29:27.449851 7863 raft_consensus.cc:3037] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 996381a7495d4720a6f6be44a1d4781b [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:29:27.449764 7731 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3e5e97eabdf42cf8e46ccb4b61c5fb7" candidate_uuid: "996381a7495d4720a6f6be44a1d4781b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b46f2dae92104884b86705d6bbc20003" is_pre_election: true
I20260619 06:29:27.452652 8069 consensus_queue.cc:1035] T 98eb40b379a24876b6334fff708de671 P 3fc4e58423894a27a7b94de5c6013cf1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260619 06:29:27.452732 7993 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3e5e97eabdf42cf8e46ccb4b61c5fb7" candidate_uuid: "996381a7495d4720a6f6be44a1d4781b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1" is_pre_election: true
I20260619 06:29:27.453087 7993 raft_consensus.cc:2379] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 3fc4e58423894a27a7b94de5c6013cf1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 996381a7495d4720a6f6be44a1d4781b in current term 1: Already voted for candidate 3fc4e58423894a27a7b94de5c6013cf1 in this term.
I20260619 06:29:27.453606 7796 leader_election.cc:302] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 996381a7495d4720a6f6be44a1d4781b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 996381a7495d4720a6f6be44a1d4781b; no voters: 3fc4e58423894a27a7b94de5c6013cf1, b46f2dae92104884b86705d6bbc20003
I20260619 06:29:27.455412 7732 raft_consensus.cc:2454] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fc4e58423894a27a7b94de5c6013cf1 in term 1.
I20260619 06:29:27.455829 7929 leader_election.cc:302] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 3fc4e58423894a27a7b94de5c6013cf1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fc4e58423894a27a7b94de5c6013cf1, b46f2dae92104884b86705d6bbc20003; no voters:
I20260619 06:29:27.456243 7863 raft_consensus.cc:2454] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 996381a7495d4720a6f6be44a1d4781b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fc4e58423894a27a7b94de5c6013cf1 in term 1.
I20260619 06:29:27.456440 8067 raft_consensus.cc:2726] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 996381a7495d4720a6f6be44a1d4781b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 06:29:27.456780 8084 raft_consensus.cc:2781] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 3fc4e58423894a27a7b94de5c6013cf1 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:29:27.458436 8084 raft_consensus.cc:686] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 3fc4e58423894a27a7b94de5c6013cf1 [term 1 LEADER]: Becoming Leader. State: Replica: 3fc4e58423894a27a7b94de5c6013cf1, State: Running, Role: LEADER
I20260619 06:29:27.458931 8084 consensus_queue.cc:237] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 3fc4e58423894a27a7b94de5c6013cf1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:27.460388 8076 raft_consensus.cc:504] T 08686b31ffd64266bcdbd6f5eb29a87d P 996381a7495d4720a6f6be44a1d4781b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } } peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } }
I20260619 06:29:27.462093 8086 raft_consensus.cc:482] T 8e2da70288694680bec48ac95c14656f P 3fc4e58423894a27a7b94de5c6013cf1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:29:27.462168 8063 tablet_bootstrap.cc:492] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003: No bootstrap required, opened a new log
I20260619 06:29:27.462335 8063 ts_tablet_manager.cc:1397] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003: Time spent bootstrapping tablet: real 0.122s user 0.040s sys 0.052s
I20260619 06:29:27.462265 8086 raft_consensus.cc:504] T 8e2da70288694680bec48ac95c14656f P 3fc4e58423894a27a7b94de5c6013cf1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:27.463299 8086 leader_election.cc:288] T 8e2da70288694680bec48ac95c14656f P 3fc4e58423894a27a7b94de5c6013cf1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323), 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063)
I20260619 06:29:27.463215 8063 raft_consensus.cc:348] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:27.463421 8063 raft_consensus.cc:374] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:29:27.463516 8063 raft_consensus.cc:729] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b46f2dae92104884b86705d6bbc20003, State: Initialized, Role: FOLLOWER
I20260619 06:29:27.463723 8063 consensus_queue.cc:260] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:27.463893 7993 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08686b31ffd64266bcdbd6f5eb29a87d" candidate_uuid: "996381a7495d4720a6f6be44a1d4781b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1"
I20260619 06:29:27.464049 7993 raft_consensus.cc:3037] T 08686b31ffd64266bcdbd6f5eb29a87d P 3fc4e58423894a27a7b94de5c6013cf1 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:29:27.464007 7732 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e2da70288694680bec48ac95c14656f" candidate_uuid: "3fc4e58423894a27a7b94de5c6013cf1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b46f2dae92104884b86705d6bbc20003" is_pre_election: true
I20260619 06:29:27.464282 7732 raft_consensus.cc:2379] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3fc4e58423894a27a7b94de5c6013cf1 in current term 1: Already voted for candidate 996381a7495d4720a6f6be44a1d4781b in this term.
I20260619 06:29:27.464351 8063 ts_tablet_manager.cc:1428] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260619 06:29:27.464651 8063 tablet_bootstrap.cc:492] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003: Bootstrap starting.
I20260619 06:29:27.466264 8063 tablet_bootstrap.cc:654] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003: Neither blocks nor log segments found. Creating new log.
I20260619 06:29:27.466943 7993 raft_consensus.cc:2454] T 08686b31ffd64266bcdbd6f5eb29a87d P 3fc4e58423894a27a7b94de5c6013cf1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 996381a7495d4720a6f6be44a1d4781b in term 1.
I20260619 06:29:27.467209 7862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e2da70288694680bec48ac95c14656f" candidate_uuid: "3fc4e58423894a27a7b94de5c6013cf1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "996381a7495d4720a6f6be44a1d4781b" is_pre_election: true
I20260619 06:29:27.467882 8076 leader_election.cc:288] T 08686b31ffd64266bcdbd6f5eb29a87d P 996381a7495d4720a6f6be44a1d4781b [CANDIDATE]: Term 1 election: Requested vote from peers 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499), b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323)
I20260619 06:29:27.469254 7732 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08686b31ffd64266bcdbd6f5eb29a87d" candidate_uuid: "996381a7495d4720a6f6be44a1d4781b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b46f2dae92104884b86705d6bbc20003"
W20260619 06:29:27.469915 7799 leader_election.cc:341] T 08686b31ffd64266bcdbd6f5eb29a87d P 996381a7495d4720a6f6be44a1d4781b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Illegal state: must be running to vote when last-logged opid is not known
I20260619 06:29:27.470328 7926 leader_election.cc:302] T 8e2da70288694680bec48ac95c14656f P 3fc4e58423894a27a7b94de5c6013cf1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3fc4e58423894a27a7b94de5c6013cf1; no voters: 996381a7495d4720a6f6be44a1d4781b, b46f2dae92104884b86705d6bbc20003
I20260619 06:29:27.470984 7796 leader_election.cc:302] T 08686b31ffd64266bcdbd6f5eb29a87d P 996381a7495d4720a6f6be44a1d4781b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3fc4e58423894a27a7b94de5c6013cf1, 996381a7495d4720a6f6be44a1d4781b; no voters: b46f2dae92104884b86705d6bbc20003
I20260619 06:29:27.471684 8067 raft_consensus.cc:2781] T 08686b31ffd64266bcdbd6f5eb29a87d P 996381a7495d4720a6f6be44a1d4781b [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:29:27.472237 8067 raft_consensus.cc:686] T 08686b31ffd64266bcdbd6f5eb29a87d P 996381a7495d4720a6f6be44a1d4781b [term 1 LEADER]: Becoming Leader. State: Replica: 996381a7495d4720a6f6be44a1d4781b, State: Running, Role: LEADER
I20260619 06:29:27.472579 8067 consensus_queue.cc:237] T 08686b31ffd64266bcdbd6f5eb29a87d P 996381a7495d4720a6f6be44a1d4781b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } } peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } }
I20260619 06:29:27.473438 8069 raft_consensus.cc:3037] T 8e2da70288694680bec48ac95c14656f P 3fc4e58423894a27a7b94de5c6013cf1 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:29:27.475350 8090 consensus_queue.cc:1035] T f5c2224f852746c8893931fd3ff27126 P 996381a7495d4720a6f6be44a1d4781b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 06:29:27.476037 8069 raft_consensus.cc:2726] T 8e2da70288694680bec48ac95c14656f P 3fc4e58423894a27a7b94de5c6013cf1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 06:29:27.476204 8069 raft_consensus.cc:482] T 6cffdcc0e99c47aead56bbaea58d3e4d P 3fc4e58423894a27a7b94de5c6013cf1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:29:27.476330 8069 raft_consensus.cc:504] T 6cffdcc0e99c47aead56bbaea58d3e4d P 3fc4e58423894a27a7b94de5c6013cf1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:27.477183 7731 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cffdcc0e99c47aead56bbaea58d3e4d" candidate_uuid: "3fc4e58423894a27a7b94de5c6013cf1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b46f2dae92104884b86705d6bbc20003" is_pre_election: true
I20260619 06:29:27.477391 7731 raft_consensus.cc:2454] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fc4e58423894a27a7b94de5c6013cf1 in term 0.
I20260619 06:29:27.477692 8069 leader_election.cc:288] T 6cffdcc0e99c47aead56bbaea58d3e4d P 3fc4e58423894a27a7b94de5c6013cf1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323), 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063)
I20260619 06:29:27.478003 7929 leader_election.cc:302] T 6cffdcc0e99c47aead56bbaea58d3e4d P 3fc4e58423894a27a7b94de5c6013cf1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fc4e58423894a27a7b94de5c6013cf1, b46f2dae92104884b86705d6bbc20003; no voters:
I20260619 06:29:27.477932 7862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5c2224f852746c8893931fd3ff27126" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "996381a7495d4720a6f6be44a1d4781b" is_pre_election: true
I20260619 06:29:27.478345 8069 raft_consensus.cc:2781] T 6cffdcc0e99c47aead56bbaea58d3e4d P 3fc4e58423894a27a7b94de5c6013cf1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 06:29:27.478467 8069 raft_consensus.cc:482] T 6cffdcc0e99c47aead56bbaea58d3e4d P 3fc4e58423894a27a7b94de5c6013cf1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 06:29:27.478739 8069 raft_consensus.cc:3037] T 6cffdcc0e99c47aead56bbaea58d3e4d P 3fc4e58423894a27a7b94de5c6013cf1 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:29:27.478894 7862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3e5e97eabdf42cf8e46ccb4b61c5fb7" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "996381a7495d4720a6f6be44a1d4781b" is_pre_election: true
I20260619 06:29:27.479219 7862 raft_consensus.cc:2379] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 996381a7495d4720a6f6be44a1d4781b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b46f2dae92104884b86705d6bbc20003 in current term 1: Already voted for candidate 3fc4e58423894a27a7b94de5c6013cf1 in this term.
I20260619 06:29:27.479450 7861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cffdcc0e99c47aead56bbaea58d3e4d" candidate_uuid: "3fc4e58423894a27a7b94de5c6013cf1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "996381a7495d4720a6f6be44a1d4781b" is_pre_election: true
W20260619 06:29:27.480051 7926 leader_election.cc:341] T 6cffdcc0e99c47aead56bbaea58d3e4d P 3fc4e58423894a27a7b94de5c6013cf1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063): Illegal state: must be running to vote when last-logged opid is not known
I20260619 06:29:27.481630 8069 raft_consensus.cc:504] T 6cffdcc0e99c47aead56bbaea58d3e4d P 3fc4e58423894a27a7b94de5c6013cf1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:27.482788 8067 consensus_queue.cc:1035] T f5c2224f852746c8893931fd3ff27126 P 996381a7495d4720a6f6be44a1d4781b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 06:29:27.484090 7591 catalog_manager.cc:5495] T 08686b31ffd64266bcdbd6f5eb29a87d P 996381a7495d4720a6f6be44a1d4781b reported cstate change: term changed from 0 to 1, leader changed from <none> to 996381a7495d4720a6f6be44a1d4781b (127.7.96.2). New cstate: current_term: 1 leader_uuid: "996381a7495d4720a6f6be44a1d4781b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } health_report { overall_health: HEALTHY } } }
I20260619 06:29:27.484872 8069 leader_election.cc:288] T 6cffdcc0e99c47aead56bbaea58d3e4d P 3fc4e58423894a27a7b94de5c6013cf1 [CANDIDATE]: Term 1 election: Requested vote from peers b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323), 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063)
I20260619 06:29:27.485137 7731 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cffdcc0e99c47aead56bbaea58d3e4d" candidate_uuid: "3fc4e58423894a27a7b94de5c6013cf1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b46f2dae92104884b86705d6bbc20003"
I20260619 06:29:27.485350 7731 raft_consensus.cc:3037] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:29:27.487411 7590 catalog_manager.cc:5495] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 3fc4e58423894a27a7b94de5c6013cf1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3). New cstate: current_term: 1 leader_uuid: "3fc4e58423894a27a7b94de5c6013cf1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } health_report { overall_health: HEALTHY } } }
I20260619 06:29:27.488011 7992 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3e5e97eabdf42cf8e46ccb4b61c5fb7" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1" is_pre_election: true
I20260619 06:29:27.488669 7991 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5c2224f852746c8893931fd3ff27126" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1" is_pre_election: true
I20260619 06:29:27.488652 7665 leader_election.cc:302] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b46f2dae92104884b86705d6bbc20003; no voters: 3fc4e58423894a27a7b94de5c6013cf1, 996381a7495d4720a6f6be44a1d4781b
I20260619 06:29:27.488909 7991 raft_consensus.cc:2454] T f5c2224f852746c8893931fd3ff27126 P 3fc4e58423894a27a7b94de5c6013cf1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b46f2dae92104884b86705d6bbc20003 in term 1.
I20260619 06:29:27.489152 8068 raft_consensus.cc:2726] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 06:29:27.489439 7861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cffdcc0e99c47aead56bbaea58d3e4d" candidate_uuid: "3fc4e58423894a27a7b94de5c6013cf1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "996381a7495d4720a6f6be44a1d4781b"
W20260619 06:29:27.490000 7926 leader_election.cc:341] T 6cffdcc0e99c47aead56bbaea58d3e4d P 3fc4e58423894a27a7b94de5c6013cf1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063): Illegal state: must be running to vote when last-logged opid is not known
I20260619 06:29:27.490823 7665 leader_election.cc:302] T f5c2224f852746c8893931fd3ff27126 P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3fc4e58423894a27a7b94de5c6013cf1, b46f2dae92104884b86705d6bbc20003; no voters: 996381a7495d4720a6f6be44a1d4781b
I20260619 06:29:27.492240 7731 raft_consensus.cc:2454] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fc4e58423894a27a7b94de5c6013cf1 in term 1.
I20260619 06:29:27.492534 8062 tablet_bootstrap.cc:492] T 6cffdcc0e99c47aead56bbaea58d3e4d P 996381a7495d4720a6f6be44a1d4781b: No bootstrap required, opened a new log
I20260619 06:29:27.492587 7929 leader_election.cc:302] T 6cffdcc0e99c47aead56bbaea58d3e4d P 3fc4e58423894a27a7b94de5c6013cf1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3fc4e58423894a27a7b94de5c6013cf1, b46f2dae92104884b86705d6bbc20003; no voters: 996381a7495d4720a6f6be44a1d4781b
I20260619 06:29:27.492717 8062 ts_tablet_manager.cc:1397] T 6cffdcc0e99c47aead56bbaea58d3e4d P 996381a7495d4720a6f6be44a1d4781b: Time spent bootstrapping tablet: real 0.048s user 0.004s sys 0.012s
I20260619 06:29:27.492951 8084 raft_consensus.cc:2781] T 6cffdcc0e99c47aead56bbaea58d3e4d P 3fc4e58423894a27a7b94de5c6013cf1 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:29:27.493134 8084 raft_consensus.cc:686] T 6cffdcc0e99c47aead56bbaea58d3e4d P 3fc4e58423894a27a7b94de5c6013cf1 [term 1 LEADER]: Becoming Leader. State: Replica: 3fc4e58423894a27a7b94de5c6013cf1, State: Running, Role: LEADER
I20260619 06:29:27.493408 8084 consensus_queue.cc:237] T 6cffdcc0e99c47aead56bbaea58d3e4d P 3fc4e58423894a27a7b94de5c6013cf1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:27.494959 8062 raft_consensus.cc:348] T 6cffdcc0e99c47aead56bbaea58d3e4d P 996381a7495d4720a6f6be44a1d4781b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:27.495240 8062 raft_consensus.cc:374] T 6cffdcc0e99c47aead56bbaea58d3e4d P 996381a7495d4720a6f6be44a1d4781b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:29:27.495357 8062 raft_consensus.cc:729] T 6cffdcc0e99c47aead56bbaea58d3e4d P 996381a7495d4720a6f6be44a1d4781b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 996381a7495d4720a6f6be44a1d4781b, State: Initialized, Role: FOLLOWER
I20260619 06:29:27.495445 8067 consensus_queue.cc:1035] T 8e2da70288694680bec48ac95c14656f P 996381a7495d4720a6f6be44a1d4781b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 06:29:27.495630 8062 consensus_queue.cc:260] T 6cffdcc0e99c47aead56bbaea58d3e4d P 996381a7495d4720a6f6be44a1d4781b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:27.496366 8062 ts_tablet_manager.cc:1428] T 6cffdcc0e99c47aead56bbaea58d3e4d P 996381a7495d4720a6f6be44a1d4781b: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260619 06:29:27.507974 8067 consensus_queue.cc:1035] T 8e2da70288694680bec48ac95c14656f P 996381a7495d4720a6f6be44a1d4781b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 06:29:27.518234 8068 raft_consensus.cc:2741] T f5c2224f852746c8893931fd3ff27126 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260619 06:29:27.526721 8063 tablet_bootstrap.cc:492] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003: No bootstrap required, opened a new log
I20260619 06:29:27.526919 8063 ts_tablet_manager.cc:1397] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003: Time spent bootstrapping tablet: real 0.062s user 0.020s sys 0.040s
I20260619 06:29:27.527400 7591 catalog_manager.cc:5495] T 6cffdcc0e99c47aead56bbaea58d3e4d P 3fc4e58423894a27a7b94de5c6013cf1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3). New cstate: current_term: 1 leader_uuid: "3fc4e58423894a27a7b94de5c6013cf1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } health_report { overall_health: HEALTHY } } }
I20260619 06:29:27.527700 8063 raft_consensus.cc:348] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:27.528051 8063 raft_consensus.cc:374] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:29:27.528155 8063 raft_consensus.cc:729] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b46f2dae92104884b86705d6bbc20003, State: Initialized, Role: FOLLOWER
I20260619 06:29:27.528479 8063 consensus_queue.cc:260] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:27.529188 8063 ts_tablet_manager.cc:1428] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 06:29:27.529543 8063 tablet_bootstrap.cc:492] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003: Bootstrap starting.
I20260619 06:29:27.531826 8063 tablet_bootstrap.cc:654] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003: Neither blocks nor log segments found. Creating new log.
I20260619 06:29:27.537433 7730 raft_consensus.cc:3037] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:29:27.540289 8063 tablet_bootstrap.cc:492] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003: No bootstrap required, opened a new log
I20260619 06:29:27.540436 8063 ts_tablet_manager.cc:1397] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.009s
I20260619 06:29:27.541311 8063 raft_consensus.cc:348] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } } peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } }
I20260619 06:29:27.541568 8063 raft_consensus.cc:374] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:29:27.541685 8063 raft_consensus.cc:729] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b46f2dae92104884b86705d6bbc20003, State: Initialized, Role: FOLLOWER
I20260619 06:29:27.541922 8063 consensus_queue.cc:260] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } } peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } }
I20260619 06:29:27.546792 8063 ts_tablet_manager.cc:1428] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003: Time spent starting tablet: real 0.006s user 0.001s sys 0.006s
I20260619 06:29:27.548177 8116 raft_consensus.cc:482] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:29:27.548439 8116 raft_consensus.cc:504] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } } peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } }
I20260619 06:29:27.549427 8116 leader_election.cc:288] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499), 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063)
I20260619 06:29:27.549839 7863 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08686b31ffd64266bcdbd6f5eb29a87d" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "996381a7495d4720a6f6be44a1d4781b" is_pre_election: true
I20260619 06:29:27.549825 7993 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08686b31ffd64266bcdbd6f5eb29a87d" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1" is_pre_election: true
I20260619 06:29:27.550191 7993 raft_consensus.cc:2379] T 08686b31ffd64266bcdbd6f5eb29a87d P 3fc4e58423894a27a7b94de5c6013cf1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b46f2dae92104884b86705d6bbc20003 in current term 1: Already voted for candidate 996381a7495d4720a6f6be44a1d4781b in this term.
I20260619 06:29:27.550666 7665 leader_election.cc:302] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b46f2dae92104884b86705d6bbc20003; no voters: 3fc4e58423894a27a7b94de5c6013cf1, 996381a7495d4720a6f6be44a1d4781b
I20260619 06:29:27.550933 8116 raft_consensus.cc:3037] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:29:27.552977 8068 raft_consensus.cc:482] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3fc4e58423894a27a7b94de5c6013cf1)
I20260619 06:29:27.553151 8068 raft_consensus.cc:504] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:27.554207 8068 leader_election.cc:288] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063), 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499)
I20260619 06:29:27.554785 8116 raft_consensus.cc:2726] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 06:29:27.554904 7993 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98eb40b379a24876b6334fff708de671" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1" is_pre_election: true
I20260619 06:29:27.555094 8088 consensus_queue.cc:1035] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 3fc4e58423894a27a7b94de5c6013cf1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 06:29:27.555465 7863 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98eb40b379a24876b6334fff708de671" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "996381a7495d4720a6f6be44a1d4781b" is_pre_election: true
I20260619 06:29:27.556005 7665 leader_election.cc:302] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b46f2dae92104884b86705d6bbc20003; no voters: 3fc4e58423894a27a7b94de5c6013cf1, 996381a7495d4720a6f6be44a1d4781b
I20260619 06:29:27.556272 8116 raft_consensus.cc:2726] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 06:29:27.559427 8086 consensus_queue.cc:1035] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 3fc4e58423894a27a7b94de5c6013cf1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 06:29:27.562522 8067 raft_consensus.cc:482] T 6cffdcc0e99c47aead56bbaea58d3e4d P 996381a7495d4720a6f6be44a1d4781b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:29:27.562696 8067 raft_consensus.cc:504] T 6cffdcc0e99c47aead56bbaea58d3e4d P 996381a7495d4720a6f6be44a1d4781b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:27.563323 8067 leader_election.cc:288] T 6cffdcc0e99c47aead56bbaea58d3e4d P 996381a7495d4720a6f6be44a1d4781b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323), 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499)
I20260619 06:29:27.563620 7732 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cffdcc0e99c47aead56bbaea58d3e4d" candidate_uuid: "996381a7495d4720a6f6be44a1d4781b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b46f2dae92104884b86705d6bbc20003" is_pre_election: true
I20260619 06:29:27.563870 7732 raft_consensus.cc:2379] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 996381a7495d4720a6f6be44a1d4781b in current term 1: Already voted for candidate 3fc4e58423894a27a7b94de5c6013cf1 in this term.
I20260619 06:29:27.564036 8067 consensus_queue.cc:1035] T 08686b31ffd64266bcdbd6f5eb29a87d P 996381a7495d4720a6f6be44a1d4781b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 06:29:27.564590 7993 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cffdcc0e99c47aead56bbaea58d3e4d" candidate_uuid: "996381a7495d4720a6f6be44a1d4781b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1" is_pre_election: true
I20260619 06:29:27.565145 7796 leader_election.cc:302] T 6cffdcc0e99c47aead56bbaea58d3e4d P 996381a7495d4720a6f6be44a1d4781b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 996381a7495d4720a6f6be44a1d4781b; no voters: 3fc4e58423894a27a7b94de5c6013cf1, b46f2dae92104884b86705d6bbc20003
I20260619 06:29:27.565898 8067 raft_consensus.cc:3037] T 6cffdcc0e99c47aead56bbaea58d3e4d P 996381a7495d4720a6f6be44a1d4781b [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:29:27.569947 8067 raft_consensus.cc:2726] T 6cffdcc0e99c47aead56bbaea58d3e4d P 996381a7495d4720a6f6be44a1d4781b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 06:29:27.571460 8067 consensus_queue.cc:1035] T 08686b31ffd64266bcdbd6f5eb29a87d P 996381a7495d4720a6f6be44a1d4781b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 06:29:27.576390 7552 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu
/tmp/dist-test-taskFG9pG8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.96.4:0
--local_ip_for_outbound_sockets=127.7.96.4
--webserver_interface=127.7.96.4
--webserver_port=0
--tserver_master_addrs=127.7.96.62:40917
--builtin_ntp_servers=127.7.96.20:33055
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--follower_unavailable_considered_failed_sec=2
--enable_log_gc=false with env {}
I20260619 06:29:27.604177 8086 consensus_queue.cc:1035] T 6cffdcc0e99c47aead56bbaea58d3e4d P 3fc4e58423894a27a7b94de5c6013cf1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 06:29:27.604593 8086 consensus_queue.cc:1035] T 6cffdcc0e99c47aead56bbaea58d3e4d P 3fc4e58423894a27a7b94de5c6013cf1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260619 06:29:28.445827 8126 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:29:28.446291 8126 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:29:28.446432 8126 flags.cc:425] Enabled unsafe flag: --enable_log_gc=false
W20260619 06:29:28.446547 8126 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:29:28.459193 8126 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:29:28.459431 8126 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.96.4
I20260619 06:29:28.475406 8126 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.96.20:33055
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=2
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.96.4:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-3/data/info.pb
--webserver_interface=127.7.96.4
--webserver_port=0
--enable_log_gc=false
--tserver_master_addrs=127.7.96.62:40917
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.96.4
--log_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-3/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:40:48 UTC on ccycloud.quasar-zrzaui.root.comops.site
build id 4455154
ASAN enabled
I20260619 06:29:28.477207 8126 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:29:28.480007 8126 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:29:28.517424 8161 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:29:28.520421 8160 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:29:28.523777 8164 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:29:28.621753 8126 server_base.cc:1034] running on GCE node
I20260619 06:29:28.622681 8126 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:29:28.641575 8126 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:29:28.649327 8126 hybrid_clock.cc:648] HybridClock initialized: now 1781850568649268 us; error 43 us; skew 500 ppm
I20260619 06:29:28.649785 8126 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 06:29:28.670902 8126 webserver.cc:460] Webserver started at http://127.7.96.4:45555/ using document root <none> and password file <none>
I20260619 06:29:28.671833 8126 fs_manager.cc:359] Metadata directory not provided
I20260619 06:29:28.671968 8126 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:29:28.672323 8126 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:29:28.676199 8126 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-3/data/instance:
uuid: "50e96b0fdd674f4396c6b2276d924f8a"
format_stamp: "Formatted at 2026-06-19 06:29:28 on dist-test-slave-cvm7"
I20260619 06:29:28.677115 8126 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-3/wal/instance:
uuid: "50e96b0fdd674f4396c6b2276d924f8a"
format_stamp: "Formatted at 2026-06-19 06:29:28 on dist-test-slave-cvm7"
I20260619 06:29:28.700938 8126 fs_manager.cc:691] Time spent creating directory manager: real 0.023s user 0.004s sys 0.015s
W20260619 06:29:28.730628 7799 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.96.1:33323, user_credentials={real_user=slave}} blocked reactor thread for 105413us
I20260619 06:29:28.754314 8170 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:29:28.756662 8126 fs_manager.cc:725] Time spent opening block manager: real 0.053s user 0.026s sys 0.001s
I20260619 06:29:28.756872 8126 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-3/data,/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-3/wal
uuid: "50e96b0fdd674f4396c6b2276d924f8a"
format_stamp: "Formatted at 2026-06-19 06:29:28 on dist-test-slave-cvm7"
I20260619 06:29:28.757134 8126 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-3/wal
metadata directory: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-3/wal
1 data directories: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:29:28.844085 8126 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:29:28.845196 8126 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:29:28.845552 8126 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:29:28.876268 8126 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:29:28.885303 8126 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:29:28.885429 8126 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:29:28.885541 8126 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:29:28.885636 8126 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:29:31.118158 8126 rpc_server.cc:307] RPC server started. Bound to: 127.7.96.4:42379
I20260619 06:29:31.118449 8290 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.96.4:42379 every 8 connection(s)
I20260619 06:29:31.120016 8126 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-3/data/info.pb
I20260619 06:29:31.122541 7552 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu as pid 8126
I20260619 06:29:31.122704 7552 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-3/wal/instance
I20260619 06:29:31.180513 8291 heartbeater.cc:347] Connected to a master server at 127.7.96.62:40917
I20260619 06:29:31.180790 8291 heartbeater.cc:464] Registering TS with master...
I20260619 06:29:31.181734 8291 heartbeater.cc:511] Master 127.7.96.62:40917 requested a full tablet report, sending...
I20260619 06:29:31.188160 7591 ts_manager.cc:194] Registered new tserver with Master: 50e96b0fdd674f4396c6b2276d924f8a (127.7.96.4:42379)
I20260619 06:29:31.189314 7591 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.96.4:34225
I20260619 06:29:31.576714 7591 ts_manager.cc:292] Set tserver state for b46f2dae92104884b86705d6bbc20003 to MAINTENANCE_MODE
I20260619 06:29:31.578403 7552 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu pid 7650
I20260619 06:29:31.579617 7772 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:29:32.155418 7552 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu with pid 7650
I20260619 06:29:32.195408 8291 heartbeater.cc:503] Master 127.7.96.62:40917 was elected leader, sending a full tablet report...
W20260619 06:29:32.215037 7929 connection.cc:535] client connection to 127.7.96.1:33323 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260619 06:29:32.215319 7929 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260619 06:29:32.219152 7799 connection.cc:535] client connection to 127.7.96.1:33323 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260619 06:29:32.219770 7799 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260619 06:29:32.239996 7929 consensus_peers.cc:487] T 98eb40b379a24876b6334fff708de671 P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260619 06:29:32.240187 7929 consensus_peers.cc:487] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260619 06:29:32.240322 7929 consensus_peers.cc:487] T 6cffdcc0e99c47aead56bbaea58d3e4d P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260619 06:29:32.244786 7799 consensus_peers.cc:487] T 8e2da70288694680bec48ac95c14656f P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260619 06:29:32.244946 7799 consensus_peers.cc:487] T 08686b31ffd64266bcdbd6f5eb29a87d P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260619 06:29:32.245072 7799 consensus_peers.cc:487] T f5c2224f852746c8893931fd3ff27126 P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260619 06:29:32.661783 7929 consensus_peers.cc:487] T 98eb40b379a24876b6334fff708de671 P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260619 06:29:32.669312 7929 consensus_peers.cc:487] T 6cffdcc0e99c47aead56bbaea58d3e4d P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260619 06:29:32.670346 7799 consensus_peers.cc:487] T 08686b31ffd64266bcdbd6f5eb29a87d P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260619 06:29:32.670522 7799 consensus_peers.cc:487] T 8e2da70288694680bec48ac95c14656f P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260619 06:29:32.731971 7929 consensus_peers.cc:487] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260619 06:29:32.789077 7799 consensus_peers.cc:487] T f5c2224f852746c8893931fd3ff27126 P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260619 06:29:33.148439 7929 consensus_peers.cc:487] T 6cffdcc0e99c47aead56bbaea58d3e4d P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260619 06:29:33.157541 7929 consensus_peers.cc:487] T 98eb40b379a24876b6334fff708de671 P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260619 06:29:33.216923 7799 consensus_peers.cc:487] T 8e2da70288694680bec48ac95c14656f P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260619 06:29:33.254034 7799 consensus_peers.cc:487] T 08686b31ffd64266bcdbd6f5eb29a87d P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260619 06:29:33.307812 7929 consensus_peers.cc:487] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260619 06:29:33.371145 7799 consensus_peers.cc:487] T f5c2224f852746c8893931fd3ff27126 P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260619 06:29:33.577476 8316 consensus_queue.cc:579] T 98eb40b379a24876b6334fff708de671 P 3fc4e58423894a27a7b94de5c6013cf1 [LEADER]: Leader has been unable to successfully communicate with peer b46f2dae92104884b86705d6bbc20003 for more than 2 seconds (2.016s)
I20260619 06:29:33.620769 8145 consensus_queue.cc:579] T 8e2da70288694680bec48ac95c14656f P 996381a7495d4720a6f6be44a1d4781b [LEADER]: Leader has been unable to successfully communicate with peer b46f2dae92104884b86705d6bbc20003 for more than 2 seconds (2.064s)
I20260619 06:29:33.629593 8154 consensus_queue.cc:579] T 6cffdcc0e99c47aead56bbaea58d3e4d P 3fc4e58423894a27a7b94de5c6013cf1 [LEADER]: Leader has been unable to successfully communicate with peer b46f2dae92104884b86705d6bbc20003 for more than 2 seconds (2.055s)
W20260619 06:29:33.636400 7929 consensus_peers.cc:487] T 6cffdcc0e99c47aead56bbaea58d3e4d P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260619 06:29:33.671793 7929 consensus_peers.cc:487] T 98eb40b379a24876b6334fff708de671 P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260619 06:29:33.681857 8076 consensus_queue.cc:579] T f5c2224f852746c8893931fd3ff27126 P 996381a7495d4720a6f6be44a1d4781b [LEADER]: Leader has been unable to successfully communicate with peer b46f2dae92104884b86705d6bbc20003 for more than 2 seconds (2.107s)
W20260619 06:29:33.753981 7799 consensus_peers.cc:487] T 8e2da70288694680bec48ac95c14656f P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260619 06:29:33.754158 7799 consensus_peers.cc:487] T 08686b31ffd64266bcdbd6f5eb29a87d P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260619 06:29:33.887341 7929 consensus_peers.cc:487] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260619 06:29:33.917198 7799 consensus_peers.cc:487] T f5c2224f852746c8893931fd3ff27126 P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260619 06:29:34.195927 7929 consensus_peers.cc:487] T 98eb40b379a24876b6334fff708de671 P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260619 06:29:34.198171 8076 consensus_queue.cc:579] T 08686b31ffd64266bcdbd6f5eb29a87d P 996381a7495d4720a6f6be44a1d4781b [LEADER]: Leader has been unable to successfully communicate with peer b46f2dae92104884b86705d6bbc20003 for more than 2 seconds (2.044s)
W20260619 06:29:34.212100 7929 consensus_peers.cc:487] T 6cffdcc0e99c47aead56bbaea58d3e4d P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260619 06:29:34.244267 8316 consensus_queue.cc:579] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 3fc4e58423894a27a7b94de5c6013cf1 [LEADER]: Leader has been unable to successfully communicate with peer b46f2dae92104884b86705d6bbc20003 for more than 2 seconds (2.094s)
W20260619 06:29:34.258157 7799 consensus_peers.cc:487] T 8e2da70288694680bec48ac95c14656f P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260619 06:29:34.333696 7799 consensus_peers.cc:487] T 08686b31ffd64266bcdbd6f5eb29a87d P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260619 06:29:34.392828 7799 consensus_peers.cc:487] T f5c2224f852746c8893931fd3ff27126 P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260619 06:29:34.460053 7929 consensus_peers.cc:487] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260619 06:29:34.741523 7929 consensus_peers.cc:487] T 98eb40b379a24876b6334fff708de671 P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260619 06:29:34.765264 7799 consensus_peers.cc:487] T 8e2da70288694680bec48ac95c14656f P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260619 06:29:34.774389 7929 consensus_peers.cc:487] T 6cffdcc0e99c47aead56bbaea58d3e4d P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260619 06:29:34.845515 7799 consensus_peers.cc:487] T 08686b31ffd64266bcdbd6f5eb29a87d P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260619 06:29:34.889146 7799 consensus_peers.cc:487] T f5c2224f852746c8893931fd3ff27126 P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260619 06:29:35.021003 7929 consensus_peers.cc:487] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260619 06:29:35.283179 7929 consensus_peers.cc:487] T 6cffdcc0e99c47aead56bbaea58d3e4d P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260619 06:29:35.290586 7929 consensus_peers.cc:487] T 98eb40b379a24876b6334fff708de671 P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260619 06:29:35.295907 7799 consensus_peers.cc:487] T 08686b31ffd64266bcdbd6f5eb29a87d P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260619 06:29:35.343245 7799 consensus_peers.cc:487] T 8e2da70288694680bec48ac95c14656f P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260619 06:29:35.395530 7552 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu pid 7560
I20260619 06:29:35.396906 7621 generic_service.cc:196] Checking for leaks (request via RPC)
W20260619 06:29:35.399659 7799 consensus_peers.cc:487] T f5c2224f852746c8893931fd3ff27126 P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260619 06:29:35.628157 7929 consensus_peers.cc:487] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260619 06:29:35.638829 7552 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu with pid 7560
I20260619 06:29:35.708616 7552 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu
/tmp/dist-test-taskFG9pG8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.96.62:40917
--webserver_interface=127.7.96.62
--webserver_port=33643
--builtin_ntp_servers=127.7.96.20:33055
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.96.62:40917 with env {}
W20260619 06:29:35.803578 7929 consensus_peers.cc:487] T 6cffdcc0e99c47aead56bbaea58d3e4d P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260619 06:29:35.809976 7799 consensus_peers.cc:487] T 08686b31ffd64266bcdbd6f5eb29a87d P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260619 06:29:35.820565 7929 consensus_peers.cc:487] T 98eb40b379a24876b6334fff708de671 P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260619 06:29:35.872002 7799 consensus_peers.cc:487] T 8e2da70288694680bec48ac95c14656f P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260619 06:29:35.963460 7799 consensus_peers.cc:487] T f5c2224f852746c8893931fd3ff27126 P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260619 06:29:36.206854 7908 heartbeater.cc:644] Failed to heartbeat to 127.7.96.62:40917 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.7.96.62:40917: connect: Connection refused (error 111)
W20260619 06:29:36.216243 8291 heartbeater.cc:644] Failed to heartbeat to 127.7.96.62:40917 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.7.96.62:40917: connect: Connection refused (error 111)
W20260619 06:29:36.272706 8038 heartbeater.cc:644] Failed to heartbeat to 127.7.96.62:40917 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.7.96.62:40917: connect: Connection refused (error 111)
W20260619 06:29:36.318419 7929 consensus_peers.cc:487] T 6cffdcc0e99c47aead56bbaea58d3e4d P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260619 06:29:36.348981 7799 consensus_peers.cc:487] T 08686b31ffd64266bcdbd6f5eb29a87d P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260619 06:29:36.364945 8325 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:29:36.365437 8325 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:29:36.365643 8325 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:29:36.377490 8325 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 06:29:36.377547 7929 consensus_peers.cc:487] T 98eb40b379a24876b6334fff708de671 P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260619 06:29:36.377709 8325 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:29:36.377787 8325 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 06:29:36.377918 8325 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260619 06:29:36.383605 7929 consensus_peers.cc:487] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260619 06:29:36.393137 8325 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.96.20:33055
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.96.62:40917
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.96.62:40917
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.96.62
--webserver_port=33643
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:40:48 UTC on ccycloud.quasar-zrzaui.root.comops.site
build id 4455154
ASAN enabled
I20260619 06:29:36.395145 8325 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:29:36.397500 8325 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:29:36.435137 7799 consensus_peers.cc:487] T 8e2da70288694680bec48ac95c14656f P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260619 06:29:36.517709 7799 consensus_peers.cc:487] T f5c2224f852746c8893931fd3ff27126 P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260619 06:29:36.519716 8335 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:29:36.526670 8336 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:29:36.529579 8339 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:29:36.584220 8325 server_base.cc:1034] running on GCE node
I20260619 06:29:36.585645 8325 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:29:36.591279 8325 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:29:36.611786 8325 hybrid_clock.cc:648] HybridClock initialized: now 1781850576611701 us; error 44 us; skew 500 ppm
I20260619 06:29:36.612375 8325 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 06:29:36.625169 8325 webserver.cc:460] Webserver started at http://127.7.96.62:33643/ using document root <none> and password file <none>
I20260619 06:29:36.626775 8325 fs_manager.cc:359] Metadata directory not provided
I20260619 06:29:36.627425 8325 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:29:36.691040 8325 fs_manager.cc:709] Time spent opening directory manager: real 0.061s user 0.012s sys 0.026s
I20260619 06:29:36.720980 8344 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:29:36.724365 8325 fs_manager.cc:725] Time spent opening block manager: real 0.031s user 0.001s sys 0.000s
I20260619 06:29:36.724670 8325 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/master-0/data,/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/master-0/wal
uuid: "fe668818447248c3876af051ae7f45f8"
format_stamp: "Formatted at 2026-06-19 06:29:25 on dist-test-slave-cvm7"
I20260619 06:29:36.726099 8325 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260619 06:29:36.811697 7929 consensus_peers.cc:487] T 6cffdcc0e99c47aead56bbaea58d3e4d P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260619 06:29:36.816886 8325 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:29:36.818015 8325 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:29:36.818344 8325 kserver.cc:163] Server-wide thread pool size limit: 3276
W20260619 06:29:36.883554 7799 consensus_peers.cc:487] T 08686b31ffd64266bcdbd6f5eb29a87d P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260619 06:29:36.919056 7929 consensus_peers.cc:487] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260619 06:29:36.951922 7929 consensus_peers.cc:487] T 98eb40b379a24876b6334fff708de671 P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260619 06:29:37.056437 7799 consensus_peers.cc:487] T 8e2da70288694680bec48ac95c14656f P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260619 06:29:37.114065 7799 consensus_peers.cc:487] T f5c2224f852746c8893931fd3ff27126 P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260619 06:29:37.246142 7929 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111) [suppressed 139 similar messages]
W20260619 06:29:37.262348 7799 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111) [suppressed 143 similar messages]
W20260619 06:29:37.404104 7799 consensus_peers.cc:487] T 08686b31ffd64266bcdbd6f5eb29a87d P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260619 06:29:37.413136 7929 consensus_peers.cc:487] T 6cffdcc0e99c47aead56bbaea58d3e4d P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260619 06:29:37.437693 7929 consensus_peers.cc:487] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260619 06:29:37.489498 8399 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.96.62:40917 every 8 connection(s)
I20260619 06:29:37.498206 8325 rpc_server.cc:307] RPC server started. Bound to: 127.7.96.62:40917
I20260619 06:29:37.503144 8325 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/master-0/data/info.pb
I20260619 06:29:37.509392 7552 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu as pid 8325
W20260619 06:29:37.550940 7799 consensus_peers.cc:487] T 8e2da70288694680bec48ac95c14656f P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260619 06:29:37.558091 8400 sys_catalog.cc:263] Verifying existing consensus state
I20260619 06:29:37.563027 8400 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe668818447248c3876af051ae7f45f8: Bootstrap starting.
I20260619 06:29:37.609282 8400 log.cc:824] T 00000000000000000000000000000000 P fe668818447248c3876af051ae7f45f8: Log is configured to *not* fsync() on all Append() calls
I20260619 06:29:37.638015 8400 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe668818447248c3876af051ae7f45f8: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=0 applied=13 ignored=0} inserts{seen=11 ignored=0} mutations{seen=12 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260619 06:29:37.639604 8400 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe668818447248c3876af051ae7f45f8: Bootstrap complete.
W20260619 06:29:37.650770 7799 consensus_peers.cc:487] T f5c2224f852746c8893931fd3ff27126 P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260619 06:29:37.654356 8400 raft_consensus.cc:348] T 00000000000000000000000000000000 P fe668818447248c3876af051ae7f45f8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe668818447248c3876af051ae7f45f8" member_type: VOTER last_known_addr { host: "127.7.96.62" port: 40917 } }
I20260619 06:29:37.655711 8400 raft_consensus.cc:729] T 00000000000000000000000000000000 P fe668818447248c3876af051ae7f45f8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe668818447248c3876af051ae7f45f8, State: Initialized, Role: FOLLOWER
I20260619 06:29:37.656663 8400 consensus_queue.cc:260] T 00000000000000000000000000000000 P fe668818447248c3876af051ae7f45f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 1.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe668818447248c3876af051ae7f45f8" member_type: VOTER last_known_addr { host: "127.7.96.62" port: 40917 } }
I20260619 06:29:37.657109 8400 raft_consensus.cc:388] T 00000000000000000000000000000000 P fe668818447248c3876af051ae7f45f8 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 06:29:37.657292 8400 raft_consensus.cc:482] T 00000000000000000000000000000000 P fe668818447248c3876af051ae7f45f8 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 06:29:37.657603 8400 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fe668818447248c3876af051ae7f45f8 [term 1 FOLLOWER]: Advancing to term 2
I20260619 06:29:37.663908 8400 raft_consensus.cc:504] T 00000000000000000000000000000000 P fe668818447248c3876af051ae7f45f8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe668818447248c3876af051ae7f45f8" member_type: VOTER last_known_addr { host: "127.7.96.62" port: 40917 } }
I20260619 06:29:37.664644 8400 leader_election.cc:302] T 00000000000000000000000000000000 P fe668818447248c3876af051ae7f45f8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fe668818447248c3876af051ae7f45f8; no voters:
W20260619 06:29:37.665858 7929 consensus_peers.cc:487] T 98eb40b379a24876b6334fff708de671 P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260619 06:29:37.670082 8400 leader_election.cc:288] T 00000000000000000000000000000000 P fe668818447248c3876af051ae7f45f8 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260619 06:29:37.670185 8403 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fe668818447248c3876af051ae7f45f8 [term 2 FOLLOWER]: Leader election won for term 2
I20260619 06:29:37.674160 8403 raft_consensus.cc:686] T 00000000000000000000000000000000 P fe668818447248c3876af051ae7f45f8 [term 2 LEADER]: Becoming Leader. State: Replica: fe668818447248c3876af051ae7f45f8, State: Running, Role: LEADER
I20260619 06:29:37.674782 8403 consensus_queue.cc:237] T 00000000000000000000000000000000 P fe668818447248c3876af051ae7f45f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 1.13, Last appended by leader: 13, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe668818447248c3876af051ae7f45f8" member_type: VOTER last_known_addr { host: "127.7.96.62" port: 40917 } }
I20260619 06:29:37.686448 8404 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe668818447248c3876af051ae7f45f8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fe668818447248c3876af051ae7f45f8. Latest consensus state: current_term: 2 leader_uuid: "fe668818447248c3876af051ae7f45f8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe668818447248c3876af051ae7f45f8" member_type: VOTER last_known_addr { host: "127.7.96.62" port: 40917 } } }
I20260619 06:29:37.687145 8405 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe668818447248c3876af051ae7f45f8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "fe668818447248c3876af051ae7f45f8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe668818447248c3876af051ae7f45f8" member_type: VOTER last_known_addr { host: "127.7.96.62" port: 40917 } } }
I20260619 06:29:37.687484 8405 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe668818447248c3876af051ae7f45f8 [sys.catalog]: This master's current role is: LEADER
I20260619 06:29:37.687841 8404 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe668818447248c3876af051ae7f45f8 [sys.catalog]: This master's current role is: LEADER
I20260619 06:29:37.689337 8400 sys_catalog.cc:564] T 00000000000000000000000000000000 P fe668818447248c3876af051ae7f45f8 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 06:29:37.702203 8409 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 06:29:37.741987 8409 catalog_manager.cc:669] Loaded metadata for table test-workload [id=fbe49391e27b48eaa4c974bb6242a990]
I20260619 06:29:37.744459 8409 tablet_loader.cc:96] loaded metadata for tablet 08686b31ffd64266bcdbd6f5eb29a87d (table test-workload [id=fbe49391e27b48eaa4c974bb6242a990])
I20260619 06:29:37.745036 8409 tablet_loader.cc:96] loaded metadata for tablet 6cffdcc0e99c47aead56bbaea58d3e4d (table test-workload [id=fbe49391e27b48eaa4c974bb6242a990])
I20260619 06:29:37.745524 8409 tablet_loader.cc:96] loaded metadata for tablet 8e2da70288694680bec48ac95c14656f (table test-workload [id=fbe49391e27b48eaa4c974bb6242a990])
I20260619 06:29:37.745934 8409 tablet_loader.cc:96] loaded metadata for tablet 98eb40b379a24876b6334fff708de671 (table test-workload [id=fbe49391e27b48eaa4c974bb6242a990])
I20260619 06:29:37.746554 8409 tablet_loader.cc:96] loaded metadata for tablet e3e5e97eabdf42cf8e46ccb4b61c5fb7 (table test-workload [id=fbe49391e27b48eaa4c974bb6242a990])
I20260619 06:29:37.747006 8409 tablet_loader.cc:96] loaded metadata for tablet f5c2224f852746c8893931fd3ff27126 (table test-workload [id=fbe49391e27b48eaa4c974bb6242a990])
I20260619 06:29:37.747328 8409 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 06:29:37.748749 8409 catalog_manager.cc:1259] Loaded cluster ID: a3c969ff50f84242b0eb3422a5066dee
I20260619 06:29:37.749325 8409 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 06:29:37.753536 8409 catalog_manager.cc:1504] Loading token signing keys...
I20260619 06:29:37.755167 8409 catalog_manager.cc:5879] T 00000000000000000000000000000000 P fe668818447248c3876af051ae7f45f8: Loaded TSK: 0
I20260619 06:29:37.756774 8409 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260619 06:29:37.936573 7929 consensus_peers.cc:487] T 6cffdcc0e99c47aead56bbaea58d3e4d P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260619 06:29:37.944262 7799 consensus_peers.cc:487] T 08686b31ffd64266bcdbd6f5eb29a87d P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260619 06:29:38.056165 7799 consensus_peers.cc:487] T 8e2da70288694680bec48ac95c14656f P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260619 06:29:38.203784 7929 consensus_peers.cc:487] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260619 06:29:38.221306 7929 consensus_peers.cc:487] T 98eb40b379a24876b6334fff708de671 P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260619 06:29:38.233464 7799 consensus_peers.cc:487] T f5c2224f852746c8893931fd3ff27126 P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260619 06:29:38.333506 8291 heartbeater.cc:347] Connected to a master server at 127.7.96.62:40917
I20260619 06:29:38.333712 7908 heartbeater.cc:347] Connected to a master server at 127.7.96.62:40917
I20260619 06:29:38.338382 8360 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" instance_seqno: 1781850566582538) as {username='slave'} at 127.7.96.2:48653; Asking this server to re-register.
I20260619 06:29:38.339790 8360 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "50e96b0fdd674f4396c6b2276d924f8a" instance_seqno: 1781850570731795) as {username='slave'} at 127.7.96.4:58847; Asking this server to re-register.
I20260619 06:29:38.340564 7908 heartbeater.cc:464] Registering TS with master...
I20260619 06:29:38.340827 7908 heartbeater.cc:511] Master 127.7.96.62:40917 requested a full tablet report, sending...
I20260619 06:29:38.342944 8291 heartbeater.cc:464] Registering TS with master...
I20260619 06:29:38.343228 8291 heartbeater.cc:511] Master 127.7.96.62:40917 requested a full tablet report, sending...
I20260619 06:29:38.343910 8360 ts_manager.cc:194] Registered new tserver with Master: 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063)
I20260619 06:29:38.351097 8361 ts_manager.cc:194] Registered new tserver with Master: 50e96b0fdd674f4396c6b2276d924f8a (127.7.96.4:42379)
I20260619 06:29:38.368345 8038 heartbeater.cc:347] Connected to a master server at 127.7.96.62:40917
I20260619 06:29:38.373340 8360 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" instance_seqno: 1781850567022024) as {username='slave'} at 127.7.96.3:44743; Asking this server to re-register.
I20260619 06:29:38.374001 8038 heartbeater.cc:464] Registering TS with master...
I20260619 06:29:38.374305 8038 heartbeater.cc:511] Master 127.7.96.62:40917 requested a full tablet report, sending...
I20260619 06:29:38.376181 8360 ts_manager.cc:194] Registered new tserver with Master: 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499)
W20260619 06:29:38.502586 7929 consensus_peers.cc:487] T 6cffdcc0e99c47aead56bbaea58d3e4d P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260619 06:29:38.505540 7799 consensus_peers.cc:487] T 08686b31ffd64266bcdbd6f5eb29a87d P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260619 06:29:38.615427 7799 consensus_peers.cc:487] T 8e2da70288694680bec48ac95c14656f P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260619 06:29:38.766155 7929 consensus_peers.cc:487] T 98eb40b379a24876b6334fff708de671 P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260619 06:29:38.784173 7929 consensus_peers.cc:487] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260619 06:29:38.839128 7799 consensus_peers.cc:487] T f5c2224f852746c8893931fd3ff27126 P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260619 06:29:39.075443 7929 consensus_peers.cc:487] T 6cffdcc0e99c47aead56bbaea58d3e4d P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260619 06:29:39.193553 7799 consensus_peers.cc:487] T 08686b31ffd64266bcdbd6f5eb29a87d P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260619 06:29:39.196161 7799 consensus_peers.cc:487] T 8e2da70288694680bec48ac95c14656f P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260619 06:29:39.284368 7929 consensus_peers.cc:487] T 98eb40b379a24876b6334fff708de671 P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260619 06:29:39.389634 7799 consensus_peers.cc:487] T f5c2224f852746c8893931fd3ff27126 P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260619 06:29:39.419745 7929 consensus_peers.cc:487] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260619 06:29:39.602604 7929 consensus_peers.cc:487] T 6cffdcc0e99c47aead56bbaea58d3e4d P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260619 06:29:39.721077 7799 consensus_peers.cc:487] T 8e2da70288694680bec48ac95c14656f P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260619 06:29:39.752588 7799 consensus_peers.cc:487] T 08686b31ffd64266bcdbd6f5eb29a87d P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260619 06:29:39.838428 7929 consensus_peers.cc:487] T 98eb40b379a24876b6334fff708de671 P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260619 06:29:39.917409 7799 consensus_peers.cc:487] T f5c2224f852746c8893931fd3ff27126 P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260619 06:29:40.014539 7929 consensus_peers.cc:487] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260619 06:29:40.167879 7929 consensus_peers.cc:487] T 6cffdcc0e99c47aead56bbaea58d3e4d P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260619 06:29:40.245766 7799 consensus_peers.cc:487] T 8e2da70288694680bec48ac95c14656f P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260619 06:29:40.298838 7799 consensus_peers.cc:487] T 08686b31ffd64266bcdbd6f5eb29a87d P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260619 06:29:40.321520 7929 consensus_peers.cc:487] T 98eb40b379a24876b6334fff708de671 P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260619 06:29:40.481225 7799 consensus_peers.cc:487] T f5c2224f852746c8893931fd3ff27126 P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260619 06:29:40.562951 7929 consensus_peers.cc:487] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
I20260619 06:29:40.636596 7552 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu
/tmp/dist-test-taskFG9pG8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.96.1:33323
--local_ip_for_outbound_sockets=127.7.96.1
--tserver_master_addrs=127.7.96.62:40917
--webserver_port=38977
--webserver_interface=127.7.96.1
--builtin_ntp_servers=127.7.96.20:33055
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--follower_unavailable_considered_failed_sec=2
--enable_log_gc=false with env {}
W20260619 06:29:40.667251 7929 consensus_peers.cc:487] T 6cffdcc0e99c47aead56bbaea58d3e4d P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 81: this message will repeat every 5th retry.
W20260619 06:29:40.802706 7799 consensus_peers.cc:487] T 8e2da70288694680bec48ac95c14656f P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 81: this message will repeat every 5th retry.
W20260619 06:29:40.859423 7929 consensus_peers.cc:487] T 98eb40b379a24876b6334fff708de671 P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 81: this message will repeat every 5th retry.
W20260619 06:29:41.071498 7799 consensus_peers.cc:487] T 08686b31ffd64266bcdbd6f5eb29a87d P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 81: this message will repeat every 5th retry.
W20260619 06:29:41.138633 7799 consensus_peers.cc:487] T f5c2224f852746c8893931fd3ff27126 P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 81: this message will repeat every 5th retry.
W20260619 06:29:41.237265 7929 consensus_peers.cc:487] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260619 06:29:41.409217 7799 consensus_peers.cc:487] T 8e2da70288694680bec48ac95c14656f P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 86: this message will repeat every 5th retry.
W20260619 06:29:41.413878 7929 consensus_peers.cc:487] T 6cffdcc0e99c47aead56bbaea58d3e4d P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 86: this message will repeat every 5th retry.
W20260619 06:29:41.448074 8435 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:29:41.448570 8435 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:29:41.448711 8435 flags.cc:425] Enabled unsafe flag: --enable_log_gc=false
W20260619 06:29:41.448808 8435 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:29:41.464560 8435 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:29:41.464874 8435 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.96.1
I20260619 06:29:41.481742 8435 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.96.20:33055
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=2
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.96.1:33323
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.96.1
--webserver_port=38977
--enable_log_gc=false
--tserver_master_addrs=127.7.96.62:40917
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.96.1
--log_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:40:48 UTC on ccycloud.quasar-zrzaui.root.comops.site
build id 4455154
ASAN enabled
I20260619 06:29:41.483680 8435 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:29:41.486076 8435 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:29:41.614559 8441 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:29:41.655190 8440 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:29:41.667927 8435 server_base.cc:1034] running on GCE node
W20260619 06:29:41.670841 8443 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:29:41.672189 8435 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
W20260619 06:29:41.703651 7799 consensus_peers.cc:487] T 08686b31ffd64266bcdbd6f5eb29a87d P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 86: this message will repeat every 5th retry.
I20260619 06:29:41.745309 8435 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
W20260619 06:29:41.750799 7799 consensus_peers.cc:487] T f5c2224f852746c8893931fd3ff27126 P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 86: this message will repeat every 5th retry.
I20260619 06:29:41.757572 8435 hybrid_clock.cc:648] HybridClock initialized: now 1781850581757428 us; error 126 us; skew 500 ppm
I20260619 06:29:41.758164 8435 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
W20260619 06:29:41.769009 7929 consensus_peers.cc:487] T 98eb40b379a24876b6334fff708de671 P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 86: this message will repeat every 5th retry.
I20260619 06:29:41.882792 8435 webserver.cc:460] Webserver started at http://127.7.96.1:38977/ using document root <none> and password file <none>
I20260619 06:29:41.884196 8435 fs_manager.cc:359] Metadata directory not provided
I20260619 06:29:41.887144 8435 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
W20260619 06:29:41.902148 7929 consensus_peers.cc:487] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 81: this message will repeat every 5th retry.
I20260619 06:29:41.940388 8435 fs_manager.cc:709] Time spent opening directory manager: real 0.043s user 0.005s sys 0.005s
W20260619 06:29:41.943745 7929 consensus_peers.cc:487] T 6cffdcc0e99c47aead56bbaea58d3e4d P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 91: this message will repeat every 5th retry.
I20260619 06:29:41.953437 8457 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:29:41.959864 8435 fs_manager.cc:725] Time spent opening block manager: real 0.010s user 0.002s sys 0.000s
I20260619 06:29:41.960116 8435 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-0/data,/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-0/wal
uuid: "b46f2dae92104884b86705d6bbc20003"
format_stamp: "Formatted at 2026-06-19 06:29:26 on dist-test-slave-cvm7"
I20260619 06:29:41.961516 8435 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260619 06:29:42.053982 7799 consensus_peers.cc:487] T 8e2da70288694680bec48ac95c14656f P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 91: this message will repeat every 5th retry.
I20260619 06:29:42.064843 8435 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:29:42.065974 8435 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:29:42.066396 8435 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:29:42.078972 8435 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:29:42.128988 8464 ts_tablet_manager.cc:542] Loading tablet metadata (0/6 complete)
I20260619 06:29:42.176957 8435 ts_tablet_manager.cc:579] Loaded tablet metadata (6 total tablets, 6 live tablets)
I20260619 06:29:42.177076 8435 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.074s user 0.005s sys 0.014s
I20260619 06:29:42.177223 8435 ts_tablet_manager.cc:594] Registering tablets (0/6 complete)
I20260619 06:29:42.200472 8464 tablet_bootstrap.cc:492] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003: Bootstrap starting.
I20260619 06:29:42.203451 8435 ts_tablet_manager.cc:610] Registered 6 tablets
I20260619 06:29:42.203715 8435 ts_tablet_manager.cc:589] Time spent register tablets: real 0.027s user 0.011s sys 0.007s
W20260619 06:29:42.284638 7929 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111) [suppressed 124 similar messages]
W20260619 06:29:42.285156 7799 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111) [suppressed 126 similar messages]
W20260619 06:29:42.303663 7799 consensus_peers.cc:487] T 08686b31ffd64266bcdbd6f5eb29a87d P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 91: this message will repeat every 5th retry.
I20260619 06:29:42.303810 8464 log.cc:824] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003: Log is configured to *not* fsync() on all Append() calls
W20260619 06:29:42.435843 7929 consensus_peers.cc:487] T 98eb40b379a24876b6334fff708de671 P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 91: this message will repeat every 5th retry.
W20260619 06:29:42.563848 7929 consensus_peers.cc:487] T 6cffdcc0e99c47aead56bbaea58d3e4d P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 96: this message will repeat every 5th retry.
W20260619 06:29:42.584956 7799 consensus_peers.cc:487] T f5c2224f852746c8893931fd3ff27126 P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 91: this message will repeat every 5th retry.
I20260619 06:29:42.694031 8464 tablet_bootstrap.cc:492] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003: Bootstrap replayed 1/1 log segments. Stats: ops{read=161 overwritten=0 applied=161 ignored=0} inserts{seen=1322 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260619 06:29:42.694892 8464 tablet_bootstrap.cc:492] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003: Bootstrap complete.
I20260619 06:29:42.696462 8464 ts_tablet_manager.cc:1397] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003: Time spent bootstrapping tablet: real 0.505s user 0.276s sys 0.031s
I20260619 06:29:42.704422 8464 raft_consensus.cc:348] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:42.705382 8464 raft_consensus.cc:729] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b46f2dae92104884b86705d6bbc20003, State: Initialized, Role: FOLLOWER
I20260619 06:29:42.706168 8464 consensus_queue.cc:260] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 161, Last appended: 1.161, Last appended by leader: 161, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:42.708195 8464 ts_tablet_manager.cc:1428] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003: Time spent starting tablet: real 0.012s user 0.007s sys 0.004s
I20260619 06:29:42.708621 8464 tablet_bootstrap.cc:492] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003: Bootstrap starting.
W20260619 06:29:42.803649 7929 consensus_peers.cc:487] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 86: this message will repeat every 5th retry.
W20260619 06:29:42.914734 7799 consensus_peers.cc:487] T 8e2da70288694680bec48ac95c14656f P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 96: this message will repeat every 5th retry.
I20260619 06:29:42.975958 8492 raft_consensus.cc:482] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:29:42.976284 8492 raft_consensus.cc:504] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:42.982234 8492 leader_election.cc:288] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063), 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499)
W20260619 06:29:43.007627 7799 consensus_peers.cc:487] T 08686b31ffd64266bcdbd6f5eb29a87d P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 96: this message will repeat every 5th retry.
I20260619 06:29:43.038843 7861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98eb40b379a24876b6334fff708de671" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 161 } } ignore_live_leader: false dest_uuid: "996381a7495d4720a6f6be44a1d4781b" is_pre_election: true
I20260619 06:29:43.104635 7992 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98eb40b379a24876b6334fff708de671" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 161 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1" is_pre_election: true
I20260619 06:29:43.133181 8458 leader_election.cc:302] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b46f2dae92104884b86705d6bbc20003; no voters: 3fc4e58423894a27a7b94de5c6013cf1, 996381a7495d4720a6f6be44a1d4781b
I20260619 06:29:43.134119 8492 raft_consensus.cc:2726] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260619 06:29:43.154053 7929 consensus_peers.cc:487] T 6cffdcc0e99c47aead56bbaea58d3e4d P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 101: this message will repeat every 5th retry.
W20260619 06:29:43.164779 7929 consensus_peers.cc:487] T 98eb40b379a24876b6334fff708de671 P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 96: this message will repeat every 5th retry.
I20260619 06:29:43.219494 8464 tablet_bootstrap.cc:492] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003: Bootstrap replayed 1/1 log segments. Stats: ops{read=161 overwritten=0 applied=161 ignored=0} inserts{seen=1362 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260619 06:29:43.220110 8464 tablet_bootstrap.cc:492] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003: Bootstrap complete.
I20260619 06:29:43.221371 8464 ts_tablet_manager.cc:1397] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003: Time spent bootstrapping tablet: real 0.513s user 0.272s sys 0.029s
I20260619 06:29:43.222378 8464 raft_consensus.cc:348] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:43.222699 8464 raft_consensus.cc:729] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b46f2dae92104884b86705d6bbc20003, State: Initialized, Role: FOLLOWER
I20260619 06:29:43.223037 8464 consensus_queue.cc:260] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 161, Last appended: 1.161, Last appended by leader: 161, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:43.223723 8464 ts_tablet_manager.cc:1428] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 06:29:43.224012 8464 tablet_bootstrap.cc:492] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003: Bootstrap starting.
W20260619 06:29:43.336450 7799 consensus_peers.cc:487] T f5c2224f852746c8893931fd3ff27126 P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 96: this message will repeat every 5th retry.
W20260619 06:29:43.363179 7929 consensus_peers.cc:487] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 91: this message will repeat every 5th retry.
I20260619 06:29:43.469446 8492 raft_consensus.cc:482] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:29:43.469633 8492 raft_consensus.cc:504] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:43.470355 8492 leader_election.cc:288] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063), 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499)
I20260619 06:29:43.471549 7862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98eb40b379a24876b6334fff708de671" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 161 } } ignore_live_leader: false dest_uuid: "996381a7495d4720a6f6be44a1d4781b" is_pre_election: true
I20260619 06:29:43.473520 7992 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98eb40b379a24876b6334fff708de671" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 161 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1" is_pre_election: true
I20260619 06:29:43.474172 8458 leader_election.cc:302] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b46f2dae92104884b86705d6bbc20003; no voters: 3fc4e58423894a27a7b94de5c6013cf1, 996381a7495d4720a6f6be44a1d4781b
I20260619 06:29:43.474607 8492 raft_consensus.cc:2726] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260619 06:29:43.550410 7799 consensus_peers.cc:487] T 8e2da70288694680bec48ac95c14656f P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 101: this message will repeat every 5th retry.
I20260619 06:29:43.569679 8492 raft_consensus.cc:482] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:29:43.569857 8492 raft_consensus.cc:504] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:43.570529 8492 leader_election.cc:288] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063), 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499)
I20260619 06:29:43.571768 7862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e2da70288694680bec48ac95c14656f" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 161 } } ignore_live_leader: false dest_uuid: "996381a7495d4720a6f6be44a1d4781b" is_pre_election: true
I20260619 06:29:43.579433 7992 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e2da70288694680bec48ac95c14656f" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 161 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1" is_pre_election: true
I20260619 06:29:43.581009 8458 leader_election.cc:302] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b46f2dae92104884b86705d6bbc20003; no voters: 3fc4e58423894a27a7b94de5c6013cf1, 996381a7495d4720a6f6be44a1d4781b
I20260619 06:29:43.581378 8492 raft_consensus.cc:2726] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 06:29:43.725629 8464 tablet_bootstrap.cc:492] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003: Bootstrap replayed 1/1 log segments. Stats: ops{read=162 overwritten=0 applied=161 ignored=0} inserts{seen=1285 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260619 06:29:43.726415 8464 tablet_bootstrap.cc:492] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003: Bootstrap complete.
W20260619 06:29:43.726935 7799 consensus_peers.cc:487] T 08686b31ffd64266bcdbd6f5eb29a87d P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 101: this message will repeat every 5th retry.
I20260619 06:29:43.727977 8464 ts_tablet_manager.cc:1397] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003: Time spent bootstrapping tablet: real 0.504s user 0.270s sys 0.029s
I20260619 06:29:43.728878 8464 raft_consensus.cc:348] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:43.740617 8464 raft_consensus.cc:729] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b46f2dae92104884b86705d6bbc20003, State: Initialized, Role: FOLLOWER
I20260619 06:29:43.740952 8464 consensus_queue.cc:260] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 161, Last appended: 1.162, Last appended by leader: 162, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:43.741602 8464 ts_tablet_manager.cc:1428] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003: Time spent starting tablet: real 0.013s user 0.007s sys 0.004s
I20260619 06:29:43.741919 8464 tablet_bootstrap.cc:492] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003: Bootstrap starting.
W20260619 06:29:43.797545 7929 consensus_peers.cc:487] T 6cffdcc0e99c47aead56bbaea58d3e4d P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 106: this message will repeat every 5th retry.
W20260619 06:29:43.959882 7929 consensus_peers.cc:487] T 98eb40b379a24876b6334fff708de671 P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 101: this message will repeat every 5th retry.
I20260619 06:29:43.986229 8492 raft_consensus.cc:482] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:29:43.986403 8492 raft_consensus.cc:504] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:43.987076 8492 leader_election.cc:288] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063), 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499)
I20260619 06:29:43.989372 7862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e2da70288694680bec48ac95c14656f" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 161 } } ignore_live_leader: false dest_uuid: "996381a7495d4720a6f6be44a1d4781b" is_pre_election: true
I20260619 06:29:43.989895 7991 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e2da70288694680bec48ac95c14656f" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 161 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1" is_pre_election: true
I20260619 06:29:43.990917 8458 leader_election.cc:302] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b46f2dae92104884b86705d6bbc20003; no voters: 3fc4e58423894a27a7b94de5c6013cf1, 996381a7495d4720a6f6be44a1d4781b
I20260619 06:29:43.991195 8492 raft_consensus.cc:2726] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 06:29:44.026409 8492 raft_consensus.cc:482] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:29:44.026614 8492 raft_consensus.cc:504] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
W20260619 06:29:44.027590 7799 consensus_peers.cc:487] T f5c2224f852746c8893931fd3ff27126 P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 101: this message will repeat every 5th retry.
I20260619 06:29:44.027698 8492 leader_election.cc:288] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063), 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499)
I20260619 06:29:44.028861 7993 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3e5e97eabdf42cf8e46ccb4b61c5fb7" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 162 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1" is_pre_election: true
I20260619 06:29:44.030828 7860 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3e5e97eabdf42cf8e46ccb4b61c5fb7" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 162 } } ignore_live_leader: false dest_uuid: "996381a7495d4720a6f6be44a1d4781b" is_pre_election: true
I20260619 06:29:44.031373 8458 leader_election.cc:302] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b46f2dae92104884b86705d6bbc20003; no voters: 3fc4e58423894a27a7b94de5c6013cf1, 996381a7495d4720a6f6be44a1d4781b
I20260619 06:29:44.031751 8492 raft_consensus.cc:2726] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260619 06:29:44.053469 7929 consensus_peers.cc:487] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 96: this message will repeat every 5th retry.
I20260619 06:29:44.055871 8492 raft_consensus.cc:482] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:29:44.056053 8492 raft_consensus.cc:504] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:44.056679 8492 leader_election.cc:288] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063), 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499)
I20260619 06:29:44.057857 7991 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98eb40b379a24876b6334fff708de671" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 161 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1" is_pre_election: true
I20260619 06:29:44.058748 7862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98eb40b379a24876b6334fff708de671" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 161 } } ignore_live_leader: false dest_uuid: "996381a7495d4720a6f6be44a1d4781b" is_pre_election: true
I20260619 06:29:44.059253 8458 leader_election.cc:302] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b46f2dae92104884b86705d6bbc20003; no voters: 3fc4e58423894a27a7b94de5c6013cf1, 996381a7495d4720a6f6be44a1d4781b
I20260619 06:29:44.059901 8492 raft_consensus.cc:2726] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 06:29:44.087540 8464 tablet_bootstrap.cc:492] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003: Bootstrap replayed 1/1 log segments. Stats: ops{read=163 overwritten=0 applied=162 ignored=0} inserts{seen=1332 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260619 06:29:44.088306 8464 tablet_bootstrap.cc:492] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003: Bootstrap complete.
I20260619 06:29:44.092357 8464 ts_tablet_manager.cc:1397] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003: Time spent bootstrapping tablet: real 0.350s user 0.241s sys 0.037s
I20260619 06:29:44.093446 8464 raft_consensus.cc:348] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } } peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } }
I20260619 06:29:44.094221 8464 raft_consensus.cc:729] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b46f2dae92104884b86705d6bbc20003, State: Initialized, Role: FOLLOWER
I20260619 06:29:44.094561 8464 consensus_queue.cc:260] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 162, Last appended: 1.163, Last appended by leader: 163, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } } peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } }
I20260619 06:29:44.095361 8464 ts_tablet_manager.cc:1428] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260619 06:29:44.095754 8464 tablet_bootstrap.cc:492] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003: Bootstrap starting.
W20260619 06:29:44.323501 7799 consensus_peers.cc:487] T 8e2da70288694680bec48ac95c14656f P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 106: this message will repeat every 5th retry.
W20260619 06:29:44.324028 7799 consensus_peers.cc:487] T 08686b31ffd64266bcdbd6f5eb29a87d P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 106: this message will repeat every 5th retry.
I20260619 06:29:44.393899 8492 raft_consensus.cc:482] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:29:44.394134 8492 raft_consensus.cc:504] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } } peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } }
I20260619 06:29:44.394738 8492 leader_election.cc:288] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499), 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063)
I20260619 06:29:44.394889 8492 raft_consensus.cc:482] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:29:44.395044 8492 raft_consensus.cc:504] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:44.395737 8492 leader_election.cc:288] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063), 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499)
I20260619 06:29:44.396936 7860 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e2da70288694680bec48ac95c14656f" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 161 } } ignore_live_leader: false dest_uuid: "996381a7495d4720a6f6be44a1d4781b" is_pre_election: true
W20260619 06:29:44.401010 7929 consensus_peers.cc:487] T 6cffdcc0e99c47aead56bbaea58d3e4d P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 111: this message will repeat every 5th retry.
I20260619 06:29:44.401012 7862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08686b31ffd64266bcdbd6f5eb29a87d" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 163 } } ignore_live_leader: false dest_uuid: "996381a7495d4720a6f6be44a1d4781b" is_pre_election: true
I20260619 06:29:44.413208 7992 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e2da70288694680bec48ac95c14656f" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 161 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1" is_pre_election: true
I20260619 06:29:44.413379 7990 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08686b31ffd64266bcdbd6f5eb29a87d" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 163 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1" is_pre_election: true
I20260619 06:29:44.417207 8458 leader_election.cc:302] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b46f2dae92104884b86705d6bbc20003; no voters: 3fc4e58423894a27a7b94de5c6013cf1, 996381a7495d4720a6f6be44a1d4781b
I20260619 06:29:44.417649 8458 leader_election.cc:302] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b46f2dae92104884b86705d6bbc20003; no voters: 3fc4e58423894a27a7b94de5c6013cf1, 996381a7495d4720a6f6be44a1d4781b
I20260619 06:29:44.417775 8550 raft_consensus.cc:2726] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 06:29:44.417974 8550 raft_consensus.cc:2726] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260619 06:29:44.465503 7799 consensus_peers.cc:487] T f5c2224f852746c8893931fd3ff27126 P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 106: this message will repeat every 5th retry.
I20260619 06:29:44.476485 8492 raft_consensus.cc:482] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:29:44.476649 8492 raft_consensus.cc:504] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:44.477267 8492 leader_election.cc:288] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063), 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499)
I20260619 06:29:44.478142 7862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3e5e97eabdf42cf8e46ccb4b61c5fb7" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 162 } } ignore_live_leader: false dest_uuid: "996381a7495d4720a6f6be44a1d4781b" is_pre_election: true
I20260619 06:29:44.483409 7990 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3e5e97eabdf42cf8e46ccb4b61c5fb7" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 162 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1" is_pre_election: true
I20260619 06:29:44.484475 8458 leader_election.cc:302] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b46f2dae92104884b86705d6bbc20003; no voters: 3fc4e58423894a27a7b94de5c6013cf1, 996381a7495d4720a6f6be44a1d4781b
I20260619 06:29:44.484975 8492 raft_consensus.cc:2726] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 06:29:44.720475 8492 raft_consensus.cc:482] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:29:44.720671 8492 raft_consensus.cc:504] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:44.721410 8492 leader_election.cc:288] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063), 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499)
I20260619 06:29:44.722007 7861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98eb40b379a24876b6334fff708de671" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 161 } } ignore_live_leader: false dest_uuid: "996381a7495d4720a6f6be44a1d4781b" is_pre_election: true
I20260619 06:29:44.722687 7990 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98eb40b379a24876b6334fff708de671" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 161 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1" is_pre_election: true
I20260619 06:29:44.723677 8458 leader_election.cc:302] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b46f2dae92104884b86705d6bbc20003; no voters: 3fc4e58423894a27a7b94de5c6013cf1, 996381a7495d4720a6f6be44a1d4781b
W20260619 06:29:44.723886 7929 consensus_peers.cc:487] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 101: this message will repeat every 5th retry.
I20260619 06:29:44.724107 8492 raft_consensus.cc:2726] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260619 06:29:44.747506 7929 consensus_peers.cc:487] T 98eb40b379a24876b6334fff708de671 P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 106: this message will repeat every 5th retry.
I20260619 06:29:44.747911 8492 raft_consensus.cc:482] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:29:44.748059 8492 raft_consensus.cc:504] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } } peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } }
I20260619 06:29:44.748682 8492 leader_election.cc:288] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499), 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063)
I20260619 06:29:44.749233 7861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08686b31ffd64266bcdbd6f5eb29a87d" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 163 } } ignore_live_leader: false dest_uuid: "996381a7495d4720a6f6be44a1d4781b" is_pre_election: true
I20260619 06:29:44.749125 7990 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08686b31ffd64266bcdbd6f5eb29a87d" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 163 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1" is_pre_election: true
I20260619 06:29:44.753820 8458 leader_election.cc:302] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b46f2dae92104884b86705d6bbc20003; no voters: 3fc4e58423894a27a7b94de5c6013cf1, 996381a7495d4720a6f6be44a1d4781b
I20260619 06:29:44.754199 8492 raft_consensus.cc:2726] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 06:29:44.805064 8464 tablet_bootstrap.cc:492] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003: Bootstrap replayed 1/1 log segments. Stats: ops{read=161 overwritten=0 applied=161 ignored=0} inserts{seen=1391 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260619 06:29:44.805693 8464 tablet_bootstrap.cc:492] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003: Bootstrap complete.
I20260619 06:29:44.807682 8464 ts_tablet_manager.cc:1397] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003: Time spent bootstrapping tablet: real 0.712s user 0.254s sys 0.036s
I20260619 06:29:44.808532 8464 raft_consensus.cc:348] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:44.808843 8464 raft_consensus.cc:729] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b46f2dae92104884b86705d6bbc20003, State: Initialized, Role: FOLLOWER
I20260619 06:29:44.809120 8464 consensus_queue.cc:260] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 161, Last appended: 1.161, Last appended by leader: 161, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:44.809821 8464 ts_tablet_manager.cc:1428] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260619 06:29:44.810099 8464 tablet_bootstrap.cc:492] T f5c2224f852746c8893931fd3ff27126 P b46f2dae92104884b86705d6bbc20003: Bootstrap starting.
I20260619 06:29:44.847575 8492 raft_consensus.cc:482] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:29:44.847821 8492 raft_consensus.cc:504] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:44.848503 8492 leader_election.cc:288] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063), 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499)
I20260619 06:29:44.849275 7993 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3e5e97eabdf42cf8e46ccb4b61c5fb7" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 162 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1" is_pre_election: true
I20260619 06:29:44.854671 7861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3e5e97eabdf42cf8e46ccb4b61c5fb7" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 162 } } ignore_live_leader: false dest_uuid: "996381a7495d4720a6f6be44a1d4781b" is_pre_election: true
I20260619 06:29:44.855579 8458 leader_election.cc:302] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b46f2dae92104884b86705d6bbc20003; no voters: 3fc4e58423894a27a7b94de5c6013cf1, 996381a7495d4720a6f6be44a1d4781b
I20260619 06:29:44.856596 8492 raft_consensus.cc:2726] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260619 06:29:45.122709 7799 consensus_peers.cc:487] T 8e2da70288694680bec48ac95c14656f P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 111: this message will repeat every 5th retry.
I20260619 06:29:45.186519 8492 raft_consensus.cc:482] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:29:45.186689 8492 raft_consensus.cc:504] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:45.187330 8492 leader_election.cc:288] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063), 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499)
I20260619 06:29:45.191490 7862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cffdcc0e99c47aead56bbaea58d3e4d" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 161 } } ignore_live_leader: false dest_uuid: "996381a7495d4720a6f6be44a1d4781b" is_pre_election: true
I20260619 06:29:45.203061 7990 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cffdcc0e99c47aead56bbaea58d3e4d" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 161 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1" is_pre_election: true
I20260619 06:29:45.218428 8464 tablet_bootstrap.cc:492] T f5c2224f852746c8893931fd3ff27126 P b46f2dae92104884b86705d6bbc20003: Bootstrap replayed 1/1 log segments. Stats: ops{read=162 overwritten=0 applied=162 ignored=0} inserts{seen=1322 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260619 06:29:45.219051 8464 tablet_bootstrap.cc:492] T f5c2224f852746c8893931fd3ff27126 P b46f2dae92104884b86705d6bbc20003: Bootstrap complete.
I20260619 06:29:45.220325 8464 ts_tablet_manager.cc:1397] T f5c2224f852746c8893931fd3ff27126 P b46f2dae92104884b86705d6bbc20003: Time spent bootstrapping tablet: real 0.410s user 0.309s sys 0.028s
I20260619 06:29:45.221079 8464 raft_consensus.cc:348] T f5c2224f852746c8893931fd3ff27126 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:45.221398 8464 raft_consensus.cc:729] T f5c2224f852746c8893931fd3ff27126 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b46f2dae92104884b86705d6bbc20003, State: Initialized, Role: FOLLOWER
I20260619 06:29:45.221680 8464 consensus_queue.cc:260] T f5c2224f852746c8893931fd3ff27126 P b46f2dae92104884b86705d6bbc20003 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 162, Last appended: 1.162, Last appended by leader: 162, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:45.222304 8464 ts_tablet_manager.cc:1428] T f5c2224f852746c8893931fd3ff27126 P b46f2dae92104884b86705d6bbc20003: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
W20260619 06:29:45.246410 7799 consensus_peers.cc:487] T f5c2224f852746c8893931fd3ff27126 P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 111: this message will repeat every 5th retry.
I20260619 06:29:45.263578 8458 leader_election.cc:302] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b46f2dae92104884b86705d6bbc20003; no voters: 3fc4e58423894a27a7b94de5c6013cf1, 996381a7495d4720a6f6be44a1d4781b
I20260619 06:29:45.264086 8492 raft_consensus.cc:2726] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 06:29:45.343283 8492 raft_consensus.cc:482] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:29:45.343448 8492 raft_consensus.cc:504] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:45.344061 8492 leader_election.cc:288] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063), 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499)
I20260619 06:29:45.344918 7862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e2da70288694680bec48ac95c14656f" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 161 } } ignore_live_leader: false dest_uuid: "996381a7495d4720a6f6be44a1d4781b" is_pre_election: true
I20260619 06:29:45.357826 7991 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e2da70288694680bec48ac95c14656f" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 161 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1" is_pre_election: true
I20260619 06:29:45.364190 8458 leader_election.cc:302] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b46f2dae92104884b86705d6bbc20003; no voters: 3fc4e58423894a27a7b94de5c6013cf1, 996381a7495d4720a6f6be44a1d4781b
I20260619 06:29:45.364636 8492 raft_consensus.cc:2726] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260619 06:29:45.381740 7799 consensus_peers.cc:487] T 08686b31ffd64266bcdbd6f5eb29a87d P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 111: this message will repeat every 5th retry.
I20260619 06:29:45.401459 8608 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.96.1:33323 every 8 connection(s)
I20260619 06:29:45.401778 8435 rpc_server.cc:307] RPC server started. Bound to: 127.7.96.1:33323
I20260619 06:29:45.403571 8435 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1781850565061855-7552-0/minicluster-data/ts-0/data/info.pb
I20260619 06:29:45.410883 7552 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu as pid 8435
I20260619 06:29:45.415067 8492 raft_consensus.cc:482] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:29:45.415227 8492 raft_consensus.cc:504] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } } peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } }
I20260619 06:29:45.415897 8492 leader_election.cc:288] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499), 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063)
W20260619 06:29:45.435315 8612 tablet_replica_mm_ops.cc:318] Log GC is disabled (check --enable_log_gc)
I20260619 06:29:45.458552 7860 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08686b31ffd64266bcdbd6f5eb29a87d" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 163 } } ignore_live_leader: false dest_uuid: "996381a7495d4720a6f6be44a1d4781b" is_pre_election: true
I20260619 06:29:45.475215 7991 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08686b31ffd64266bcdbd6f5eb29a87d" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 163 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1" is_pre_election: true
I20260619 06:29:45.507301 8458 leader_election.cc:302] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b46f2dae92104884b86705d6bbc20003; no voters: 3fc4e58423894a27a7b94de5c6013cf1, 996381a7495d4720a6f6be44a1d4781b
I20260619 06:29:45.510628 8492 raft_consensus.cc:2726] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 06:29:45.522785 8492 raft_consensus.cc:482] T f5c2224f852746c8893931fd3ff27126 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:29:45.522960 8492 raft_consensus.cc:504] T f5c2224f852746c8893931fd3ff27126 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:45.523527 8492 leader_election.cc:288] T f5c2224f852746c8893931fd3ff27126 P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063), 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499)
I20260619 06:29:45.542052 7860 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5c2224f852746c8893931fd3ff27126" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 162 } } ignore_live_leader: false dest_uuid: "996381a7495d4720a6f6be44a1d4781b" is_pre_election: true
I20260619 06:29:45.553756 7992 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5c2224f852746c8893931fd3ff27126" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 162 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1" is_pre_election: true
I20260619 06:29:45.559641 8458 leader_election.cc:302] T f5c2224f852746c8893931fd3ff27126 P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b46f2dae92104884b86705d6bbc20003; no voters: 3fc4e58423894a27a7b94de5c6013cf1, 996381a7495d4720a6f6be44a1d4781b
I20260619 06:29:45.559669 8609 heartbeater.cc:347] Connected to a master server at 127.7.96.62:40917
I20260619 06:29:45.560029 8609 heartbeater.cc:464] Registering TS with master...
I20260619 06:29:45.562424 8609 heartbeater.cc:511] Master 127.7.96.62:40917 requested a full tablet report, sending...
I20260619 06:29:45.562631 8492 raft_consensus.cc:2726] T f5c2224f852746c8893931fd3ff27126 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 06:29:45.565754 8361 ts_manager.cc:194] Registered new tserver with Master: b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323)
I20260619 06:29:45.569003 8361 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.96.1:53057
I20260619 06:29:45.593761 8492 raft_consensus.cc:482] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:29:45.594086 8492 raft_consensus.cc:504] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:45.595180 8492 leader_election.cc:288] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063), 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499)
I20260619 06:29:45.595852 7862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cffdcc0e99c47aead56bbaea58d3e4d" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 161 } } ignore_live_leader: false dest_uuid: "996381a7495d4720a6f6be44a1d4781b" is_pre_election: true
I20260619 06:29:45.601828 7991 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cffdcc0e99c47aead56bbaea58d3e4d" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 161 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1" is_pre_election: true
I20260619 06:29:45.612782 8458 leader_election.cc:302] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b46f2dae92104884b86705d6bbc20003; no voters: 3fc4e58423894a27a7b94de5c6013cf1, 996381a7495d4720a6f6be44a1d4781b
I20260619 06:29:45.613242 8492 raft_consensus.cc:2726] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 06:29:45.719434 8609 heartbeater.cc:503] Master 127.7.96.62:40917 was elected leader, sending a full tablet report...
I20260619 06:29:47.818954 8556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.7.96.3:46325 (request call id 0) took 2293 ms. Trace:
I20260619 06:29:47.836505 8492 raft_consensus.cc:482] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3fc4e58423894a27a7b94de5c6013cf1)
I20260619 06:29:47.836720 8492 raft_consensus.cc:504] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:47.838616 7860 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98eb40b379a24876b6334fff708de671" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 936 } } ignore_live_leader: false dest_uuid: "996381a7495d4720a6f6be44a1d4781b" is_pre_election: true
I20260619 06:29:47.839959 8492 leader_election.cc:288] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063), 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499)
I20260619 06:29:47.839926 7990 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98eb40b379a24876b6334fff708de671" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 936 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1" is_pre_election: true
I20260619 06:29:47.855055 8458 leader_election.cc:302] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b46f2dae92104884b86705d6bbc20003; no voters: 3fc4e58423894a27a7b94de5c6013cf1, 996381a7495d4720a6f6be44a1d4781b
I20260619 06:29:47.872613 8492 raft_consensus.cc:2726] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 06:29:48.063944 8558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.7.96.2:56233 (request call id 1) took 2574 ms. Trace:
I20260619 06:29:48.080857 8619 raft_consensus.cc:482] T f5c2224f852746c8893931fd3ff27126 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 996381a7495d4720a6f6be44a1d4781b)
I20260619 06:29:48.114154 8619 raft_consensus.cc:504] T f5c2224f852746c8893931fd3ff27126 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:48.147049 7860 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5c2224f852746c8893931fd3ff27126" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 941 } } ignore_live_leader: false dest_uuid: "996381a7495d4720a6f6be44a1d4781b" is_pre_election: true
I20260619 06:29:48.149423 8619 leader_election.cc:288] T f5c2224f852746c8893931fd3ff27126 P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063), 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499)
I20260619 06:29:48.160073 7990 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5c2224f852746c8893931fd3ff27126" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 941 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1" is_pre_election: true
I20260619 06:29:48.172964 8458 leader_election.cc:302] T f5c2224f852746c8893931fd3ff27126 P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b46f2dae92104884b86705d6bbc20003; no voters: 3fc4e58423894a27a7b94de5c6013cf1, 996381a7495d4720a6f6be44a1d4781b
I20260619 06:29:48.174140 8619 raft_consensus.cc:2726] T f5c2224f852746c8893931fd3ff27126 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 06:29:48.304827 8619 raft_consensus.cc:482] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3fc4e58423894a27a7b94de5c6013cf1)
I20260619 06:29:48.305003 8619 raft_consensus.cc:504] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:48.307297 8619 leader_election.cc:288] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063), 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499)
I20260619 06:29:48.309816 7861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98eb40b379a24876b6334fff708de671" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 936 } } ignore_live_leader: false dest_uuid: "996381a7495d4720a6f6be44a1d4781b" is_pre_election: true
I20260619 06:29:48.322945 7992 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98eb40b379a24876b6334fff708de671" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 936 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1" is_pre_election: true
I20260619 06:29:48.344173 8458 leader_election.cc:302] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b46f2dae92104884b86705d6bbc20003; no voters: 3fc4e58423894a27a7b94de5c6013cf1, 996381a7495d4720a6f6be44a1d4781b
I20260619 06:29:48.350551 8619 raft_consensus.cc:2726] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260619 06:29:48.388955 8646 log.cc:924] Time spent T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003: Append to log took a long time: real 0.067s user 0.001s sys 0.001s
I20260619 06:29:48.404237 8557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.7.96.2:56233 (request call id 2) took 2879 ms. Trace:
I20260619 06:29:48.423583 8632 raft_consensus.cc:482] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 996381a7495d4720a6f6be44a1d4781b)
I20260619 06:29:48.438545 8632 raft_consensus.cc:504] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } } peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } }
I20260619 06:29:48.497793 7860 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08686b31ffd64266bcdbd6f5eb29a87d" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 941 } } ignore_live_leader: false dest_uuid: "996381a7495d4720a6f6be44a1d4781b" is_pre_election: true
I20260619 06:29:48.499037 8632 leader_election.cc:288] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499), 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063)
I20260619 06:29:48.505142 8631 raft_consensus.cc:482] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 996381a7495d4720a6f6be44a1d4781b)
I20260619 06:29:48.507477 8631 raft_consensus.cc:504] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:48.508210 8505 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:41904 (request call id 14) took 2885 ms. Trace:
I20260619 06:29:48.513921 7863 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e2da70288694680bec48ac95c14656f" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 939 } } ignore_live_leader: false dest_uuid: "996381a7495d4720a6f6be44a1d4781b" is_pre_election: true
I20260619 06:29:48.516672 7991 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08686b31ffd64266bcdbd6f5eb29a87d" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 941 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1" is_pre_election: true
I20260619 06:29:48.534711 8631 leader_election.cc:288] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063), 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499)
I20260619 06:29:48.512471 8505 rpcz_store.cc:276] 0619 06:29:45.620713 (+ 0us) service_pool.cc:170] Inserting onto call queue
0619 06:29:45.620768 (+ 55us) service_pool.cc:227] Handling call
0619 06:29:48.066816 (+2446048us) spinlock_profiling.cc:243] Waited 2.44 s on lock 0x615000043e24. stack: 00007ff742e9066e 00007ff742e90430 00007ff741f175ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007ff74e398630 00007ff751f70c7f 00007ff74cadc016 00007ff74cadbd45 00007ff7499cc9be 00007ff7499cb79e 00007ff7499d1b25 00007ff7499d254f 00007ff7499d2378 00000000009edb7c
0619 06:29:48.491229 (+424413us) spinlock_profiling.cc:243] Waited 424 ms on lock 0x6150000436a4. stack: 00007ff742e9066e 00007ff742e90430 00007ff741f175ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007ff74e398630 00007ff751f70c7f 00007ff74cadc016 00007ff74cadbd45 00007ff7499cc9be 00007ff7499cb79e 00007ff7499d1b25 00007ff7499d254f 00007ff7499d2378 00000000009edb7c
0619 06:29:48.502611 (+ 11382us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x6150000431a4. stack: 00007ff742e9066e 00007ff742e90430 00007ff741f175ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007ff74e398630 00007ff751f70c7f 00007ff74cadc016 00007ff74cadbd45 00007ff7499cc9be 00007ff7499cb79e 00007ff7499d1b25 00007ff7499d254f 00007ff7499d2378 00000000009edb7c
0619 06:29:48.505754 (+ 3143us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":6600994688}
I20260619 06:29:48.561707 8554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.7.96.3:46325 (request call id 1) took 3021 ms. Trace:
I20260619 06:29:48.561947 8620 raft_consensus.cc:482] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3fc4e58423894a27a7b94de5c6013cf1)
I20260619 06:29:48.562173 8620 raft_consensus.cc:504] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:48.562640 8458 leader_election.cc:302] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b46f2dae92104884b86705d6bbc20003; no voters: 3fc4e58423894a27a7b94de5c6013cf1, 996381a7495d4720a6f6be44a1d4781b
I20260619 06:29:48.568277 7991 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e2da70288694680bec48ac95c14656f" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 939 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1" is_pre_election: true
I20260619 06:29:48.608717 8631 raft_consensus.cc:2726] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 06:29:48.609184 8632 raft_consensus.cc:482] T f5c2224f852746c8893931fd3ff27126 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 996381a7495d4720a6f6be44a1d4781b)
I20260619 06:29:48.592648 8560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.7.96.2:56233 (request call id 0) took 3112 ms. Trace:
W20260619 06:29:48.611887 8458 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.96.3:37499, user_credentials={real_user=slave}} blocked reactor thread for 48941.4us
I20260619 06:29:48.624997 8632 raft_consensus.cc:504] T f5c2224f852746c8893931fd3ff27126 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:48.625623 8632 leader_election.cc:288] T f5c2224f852746c8893931fd3ff27126 P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063), 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499)
I20260619 06:29:48.626822 7860 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5c2224f852746c8893931fd3ff27126" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 941 } } ignore_live_leader: false dest_uuid: "996381a7495d4720a6f6be44a1d4781b" is_pre_election: true
I20260619 06:29:48.634210 8458 leader_election.cc:302] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b46f2dae92104884b86705d6bbc20003; no voters: 3fc4e58423894a27a7b94de5c6013cf1, 996381a7495d4720a6f6be44a1d4781b
I20260619 06:29:48.634949 7860 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cffdcc0e99c47aead56bbaea58d3e4d" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 937 } } ignore_live_leader: false dest_uuid: "996381a7495d4720a6f6be44a1d4781b" is_pre_election: true
I20260619 06:29:48.635015 7990 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5c2224f852746c8893931fd3ff27126" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 941 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1" is_pre_election: true
I20260619 06:29:48.635625 7990 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cffdcc0e99c47aead56bbaea58d3e4d" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 937 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1" is_pre_election: true
I20260619 06:29:48.650592 8458 leader_election.cc:302] T f5c2224f852746c8893931fd3ff27126 P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b46f2dae92104884b86705d6bbc20003; no voters: 3fc4e58423894a27a7b94de5c6013cf1, 996381a7495d4720a6f6be44a1d4781b
I20260619 06:29:48.672906 8632 raft_consensus.cc:2726] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 06:29:48.678613 8458 leader_election.cc:302] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b46f2dae92104884b86705d6bbc20003; no voters: 3fc4e58423894a27a7b94de5c6013cf1, 996381a7495d4720a6f6be44a1d4781b
I20260619 06:29:48.685822 8631 raft_consensus.cc:2726] T f5c2224f852746c8893931fd3ff27126 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 06:29:48.686561 8620 leader_election.cc:288] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063), 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499)
I20260619 06:29:48.689517 8632 raft_consensus.cc:2726] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260619 06:29:48.723948 8649 log.cc:924] Time spent T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003: Append to log took a long time: real 0.093s user 0.002s sys 0.000s
I20260619 06:29:48.864152 8621 raft_consensus.cc:482] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3fc4e58423894a27a7b94de5c6013cf1)
I20260619 06:29:48.864363 8621 raft_consensus.cc:504] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:48.866669 8621 leader_election.cc:288] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063), 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499)
I20260619 06:29:48.870290 7861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3e5e97eabdf42cf8e46ccb4b61c5fb7" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 945 } } ignore_live_leader: false dest_uuid: "996381a7495d4720a6f6be44a1d4781b" is_pre_election: true
I20260619 06:29:48.879889 8553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.7.96.3:46325 (request call id 2) took 3300 ms. Trace:
I20260619 06:29:48.881510 7992 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3e5e97eabdf42cf8e46ccb4b61c5fb7" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 945 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1" is_pre_election: true
I20260619 06:29:48.891278 8458 leader_election.cc:302] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b46f2dae92104884b86705d6bbc20003; no voters: 3fc4e58423894a27a7b94de5c6013cf1, 996381a7495d4720a6f6be44a1d4781b
I20260619 06:29:48.891731 8621 raft_consensus.cc:2726] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 06:29:49.013116 8621 raft_consensus.cc:482] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 996381a7495d4720a6f6be44a1d4781b)
I20260619 06:29:49.013289 8621 raft_consensus.cc:504] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } } peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } }
I20260619 06:29:49.014487 7860 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08686b31ffd64266bcdbd6f5eb29a87d" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 941 } } ignore_live_leader: false dest_uuid: "996381a7495d4720a6f6be44a1d4781b" is_pre_election: true
I20260619 06:29:49.015606 8621 leader_election.cc:288] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499), 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063)
I20260619 06:29:49.016841 7993 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08686b31ffd64266bcdbd6f5eb29a87d" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 941 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1" is_pre_election: true
I20260619 06:29:49.025136 8458 leader_election.cc:302] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b46f2dae92104884b86705d6bbc20003; no voters: 3fc4e58423894a27a7b94de5c6013cf1, 996381a7495d4720a6f6be44a1d4781b
I20260619 06:29:49.038520 8631 raft_consensus.cc:482] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 996381a7495d4720a6f6be44a1d4781b)
I20260619 06:29:49.038704 8620 raft_consensus.cc:482] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3fc4e58423894a27a7b94de5c6013cf1)
I20260619 06:29:49.043085 8631 raft_consensus.cc:504] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:49.043926 8621 raft_consensus.cc:482] T f5c2224f852746c8893931fd3ff27126 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 996381a7495d4720a6f6be44a1d4781b)
I20260619 06:29:49.044800 7863 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e2da70288694680bec48ac95c14656f" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 939 } } ignore_live_leader: false dest_uuid: "996381a7495d4720a6f6be44a1d4781b" is_pre_election: true
I20260619 06:29:49.045666 8620 raft_consensus.cc:504] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:49.047160 7863 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98eb40b379a24876b6334fff708de671" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 936 } } ignore_live_leader: false dest_uuid: "996381a7495d4720a6f6be44a1d4781b" is_pre_election: true
I20260619 06:29:49.048518 7993 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e2da70288694680bec48ac95c14656f" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 939 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1" is_pre_election: true
I20260619 06:29:49.048645 7991 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98eb40b379a24876b6334fff708de671" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 936 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1" is_pre_election: true
I20260619 06:29:49.049456 8632 raft_consensus.cc:2726] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 06:29:49.052979 8458 leader_election.cc:302] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b46f2dae92104884b86705d6bbc20003; no voters: 3fc4e58423894a27a7b94de5c6013cf1, 996381a7495d4720a6f6be44a1d4781b
I20260619 06:29:49.054592 8632 raft_consensus.cc:2726] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 06:29:49.055226 8621 raft_consensus.cc:504] T f5c2224f852746c8893931fd3ff27126 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:49.055781 8621 leader_election.cc:288] T f5c2224f852746c8893931fd3ff27126 P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063), 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499)
I20260619 06:29:49.062031 8631 leader_election.cc:288] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063), 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499)
I20260619 06:29:49.062950 8620 leader_election.cc:288] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063), 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499)
I20260619 06:29:49.074581 8458 leader_election.cc:302] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b46f2dae92104884b86705d6bbc20003; no voters: 3fc4e58423894a27a7b94de5c6013cf1, 996381a7495d4720a6f6be44a1d4781b
I20260619 06:29:49.075510 7863 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5c2224f852746c8893931fd3ff27126" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 941 } } ignore_live_leader: false dest_uuid: "996381a7495d4720a6f6be44a1d4781b" is_pre_election: true
I20260619 06:29:49.082541 7991 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5c2224f852746c8893931fd3ff27126" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 941 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1" is_pre_election: true
I20260619 06:29:49.084255 8631 raft_consensus.cc:2726] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 06:29:49.084842 8458 leader_election.cc:302] T f5c2224f852746c8893931fd3ff27126 P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b46f2dae92104884b86705d6bbc20003; no voters: 3fc4e58423894a27a7b94de5c6013cf1, 996381a7495d4720a6f6be44a1d4781b
I20260619 06:29:49.087713 8620 raft_consensus.cc:482] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3fc4e58423894a27a7b94de5c6013cf1)
I20260619 06:29:49.089892 8631 raft_consensus.cc:2726] T f5c2224f852746c8893931fd3ff27126 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 06:29:49.090019 8620 raft_consensus.cc:504] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:49.107702 7863 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cffdcc0e99c47aead56bbaea58d3e4d" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 937 } } ignore_live_leader: false dest_uuid: "996381a7495d4720a6f6be44a1d4781b" is_pre_election: true
I20260619 06:29:49.114807 8620 leader_election.cc:288] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063), 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499)
I20260619 06:29:49.122423 7991 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cffdcc0e99c47aead56bbaea58d3e4d" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 937 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1" is_pre_election: true
I20260619 06:29:49.144874 8458 leader_election.cc:302] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b46f2dae92104884b86705d6bbc20003; no voters: 3fc4e58423894a27a7b94de5c6013cf1, 996381a7495d4720a6f6be44a1d4781b
I20260619 06:29:49.145362 8620 raft_consensus.cc:2726] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 06:29:49.268640 8620 raft_consensus.cc:482] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3fc4e58423894a27a7b94de5c6013cf1)
I20260619 06:29:49.268839 8620 raft_consensus.cc:504] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:49.295107 7861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3e5e97eabdf42cf8e46ccb4b61c5fb7" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 945 } } ignore_live_leader: false dest_uuid: "996381a7495d4720a6f6be44a1d4781b" is_pre_election: true
I20260619 06:29:49.295831 8620 leader_election.cc:288] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063), 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499)
I20260619 06:29:49.314464 7991 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3e5e97eabdf42cf8e46ccb4b61c5fb7" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 945 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1" is_pre_election: true
I20260619 06:29:49.327534 8458 leader_election.cc:302] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b46f2dae92104884b86705d6bbc20003; no voters: 3fc4e58423894a27a7b94de5c6013cf1, 996381a7495d4720a6f6be44a1d4781b
I20260619 06:29:49.342440 8620 raft_consensus.cc:2726] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 06:29:49.357772 8620 raft_consensus.cc:482] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 996381a7495d4720a6f6be44a1d4781b)
I20260619 06:29:49.357944 8620 raft_consensus.cc:504] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:49.358811 7861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e2da70288694680bec48ac95c14656f" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 939 } } ignore_live_leader: false dest_uuid: "996381a7495d4720a6f6be44a1d4781b" is_pre_election: true
I20260619 06:29:49.358893 7993 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e2da70288694680bec48ac95c14656f" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 939 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1" is_pre_election: true
I20260619 06:29:49.359416 8620 leader_election.cc:288] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063), 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499)
I20260619 06:29:49.363667 8458 leader_election.cc:302] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b46f2dae92104884b86705d6bbc20003; no voters: 3fc4e58423894a27a7b94de5c6013cf1, 996381a7495d4720a6f6be44a1d4781b
I20260619 06:29:49.364198 8620 raft_consensus.cc:2726] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 06:29:49.529819 8620 raft_consensus.cc:482] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3fc4e58423894a27a7b94de5c6013cf1)
I20260619 06:29:49.530021 8620 raft_consensus.cc:504] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:49.530666 8620 leader_election.cc:288] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063), 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499)
I20260619 06:29:49.531656 7860 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cffdcc0e99c47aead56bbaea58d3e4d" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 937 } } ignore_live_leader: false dest_uuid: "996381a7495d4720a6f6be44a1d4781b" is_pre_election: true
I20260619 06:29:49.552054 7990 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cffdcc0e99c47aead56bbaea58d3e4d" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 937 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1" is_pre_election: true
I20260619 06:29:49.572608 8458 leader_election.cc:302] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b46f2dae92104884b86705d6bbc20003; no voters: 3fc4e58423894a27a7b94de5c6013cf1, 996381a7495d4720a6f6be44a1d4781b
I20260619 06:29:49.572892 8620 raft_consensus.cc:2726] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 06:29:49.695302 8620 raft_consensus.cc:482] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3fc4e58423894a27a7b94de5c6013cf1)
I20260619 06:29:49.695472 8620 raft_consensus.cc:504] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:49.696578 7860 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3e5e97eabdf42cf8e46ccb4b61c5fb7" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 945 } } ignore_live_leader: false dest_uuid: "996381a7495d4720a6f6be44a1d4781b" is_pre_election: true
I20260619 06:29:49.699826 8620 leader_election.cc:288] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063), 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499)
I20260619 06:29:49.713325 7992 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3e5e97eabdf42cf8e46ccb4b61c5fb7" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 945 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1" is_pre_election: true
I20260619 06:29:49.718583 8620 raft_consensus.cc:482] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 996381a7495d4720a6f6be44a1d4781b)
I20260619 06:29:49.722584 8620 raft_consensus.cc:504] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } } peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } }
I20260619 06:29:49.723276 8620 leader_election.cc:288] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499), 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063)
I20260619 06:29:49.724522 7860 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08686b31ffd64266bcdbd6f5eb29a87d" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 941 } } ignore_live_leader: false dest_uuid: "996381a7495d4720a6f6be44a1d4781b" is_pre_election: true
I20260619 06:29:49.731356 8458 leader_election.cc:302] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b46f2dae92104884b86705d6bbc20003; no voters: 3fc4e58423894a27a7b94de5c6013cf1, 996381a7495d4720a6f6be44a1d4781b
I20260619 06:29:49.732833 7990 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08686b31ffd64266bcdbd6f5eb29a87d" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 941 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1" is_pre_election: true
I20260619 06:29:49.734454 8620 raft_consensus.cc:2726] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 06:29:49.747134 8458 leader_election.cc:302] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b46f2dae92104884b86705d6bbc20003; no voters: 3fc4e58423894a27a7b94de5c6013cf1, 996381a7495d4720a6f6be44a1d4781b
I20260619 06:29:49.751662 8620 raft_consensus.cc:2726] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 06:29:49.929879 8620 raft_consensus.cc:482] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3fc4e58423894a27a7b94de5c6013cf1)
I20260619 06:29:49.930122 8620 raft_consensus.cc:504] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:49.931447 7861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cffdcc0e99c47aead56bbaea58d3e4d" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 937 } } ignore_live_leader: false dest_uuid: "996381a7495d4720a6f6be44a1d4781b" is_pre_election: true
I20260619 06:29:49.937276 8620 leader_election.cc:288] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063), 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499)
I20260619 06:29:49.942936 7991 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cffdcc0e99c47aead56bbaea58d3e4d" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 937 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1" is_pre_election: true
I20260619 06:29:49.947543 8458 leader_election.cc:302] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b46f2dae92104884b86705d6bbc20003; no voters: 3fc4e58423894a27a7b94de5c6013cf1, 996381a7495d4720a6f6be44a1d4781b
I20260619 06:29:49.948006 8620 raft_consensus.cc:2726] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 06:29:49.961476 8620 raft_consensus.cc:482] T f5c2224f852746c8893931fd3ff27126 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 996381a7495d4720a6f6be44a1d4781b)
I20260619 06:29:49.961635 8620 raft_consensus.cc:504] T f5c2224f852746c8893931fd3ff27126 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:49.962339 8620 leader_election.cc:288] T f5c2224f852746c8893931fd3ff27126 P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063), 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499)
I20260619 06:29:49.963114 7860 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5c2224f852746c8893931fd3ff27126" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 941 } } ignore_live_leader: false dest_uuid: "996381a7495d4720a6f6be44a1d4781b" is_pre_election: true
I20260619 06:29:49.986704 7991 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5c2224f852746c8893931fd3ff27126" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 941 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1" is_pre_election: true
I20260619 06:29:49.992871 8458 leader_election.cc:302] T f5c2224f852746c8893931fd3ff27126 P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b46f2dae92104884b86705d6bbc20003; no voters: 3fc4e58423894a27a7b94de5c6013cf1, 996381a7495d4720a6f6be44a1d4781b
I20260619 06:29:49.993819 8620 raft_consensus.cc:2726] T f5c2224f852746c8893931fd3ff27126 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 06:29:50.007332 8620 raft_consensus.cc:482] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3fc4e58423894a27a7b94de5c6013cf1)
I20260619 06:29:50.007486 8620 raft_consensus.cc:504] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:50.009898 7861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98eb40b379a24876b6334fff708de671" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 936 } } ignore_live_leader: false dest_uuid: "996381a7495d4720a6f6be44a1d4781b" is_pre_election: true
I20260619 06:29:50.020429 7991 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98eb40b379a24876b6334fff708de671" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 936 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1" is_pre_election: true
I20260619 06:29:50.030172 8458 leader_election.cc:302] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b46f2dae92104884b86705d6bbc20003; no voters: 3fc4e58423894a27a7b94de5c6013cf1, 996381a7495d4720a6f6be44a1d4781b
I20260619 06:29:50.031869 8620 leader_election.cc:288] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063), 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499)
I20260619 06:29:50.042523 8620 raft_consensus.cc:2726] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 06:29:50.083420 8620 raft_consensus.cc:482] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3fc4e58423894a27a7b94de5c6013cf1)
I20260619 06:29:50.083607 8620 raft_consensus.cc:504] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:50.085111 8620 leader_election.cc:288] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063), 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499)
W20260619 06:29:50.102856 8458 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.96.3:37499, user_credentials={real_user=slave}} blocked reactor thread for 76857us
I20260619 06:29:50.103382 7860 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3e5e97eabdf42cf8e46ccb4b61c5fb7" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 945 } } ignore_live_leader: false dest_uuid: "996381a7495d4720a6f6be44a1d4781b" is_pre_election: true
I20260619 06:29:50.104650 8653 raft_consensus.cc:482] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 996381a7495d4720a6f6be44a1d4781b)
I20260619 06:29:50.104857 8653 raft_consensus.cc:504] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:50.105682 8653 leader_election.cc:288] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063), 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499)
I20260619 06:29:50.107708 7990 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3e5e97eabdf42cf8e46ccb4b61c5fb7" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 945 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1" is_pre_election: true
I20260619 06:29:50.110044 7860 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e2da70288694680bec48ac95c14656f" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 939 } } ignore_live_leader: false dest_uuid: "996381a7495d4720a6f6be44a1d4781b" is_pre_election: true
I20260619 06:29:50.203233 8458 leader_election.cc:302] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b46f2dae92104884b86705d6bbc20003; no voters: 3fc4e58423894a27a7b94de5c6013cf1, 996381a7495d4720a6f6be44a1d4781b
I20260619 06:29:50.204295 8653 raft_consensus.cc:2726] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 06:29:50.212047 7990 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e2da70288694680bec48ac95c14656f" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 939 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1" is_pre_election: true
I20260619 06:29:50.214632 8458 leader_election.cc:302] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b46f2dae92104884b86705d6bbc20003; no voters: 3fc4e58423894a27a7b94de5c6013cf1, 996381a7495d4720a6f6be44a1d4781b
I20260619 06:29:50.214982 8653 raft_consensus.cc:2726] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 06:29:48.079370 8558 rpcz_store.cc:276] 0619 06:29:45.482671 (+ 0us) service_pool.cc:170] Inserting onto call queue
0619 06:29:45.485435 (+ 2764us) service_pool.cc:227] Handling call
0619 06:29:45.592431 (+106996us) raft_consensus.cc:1457] Updating replica for 779 ops
0619 06:29:45.722659 (+130228us) raft_consensus.cc:1520] Early marking committed up to index 0
0619 06:29:45.722666 (+ 7us) raft_consensus.cc:1525] Triggering prepare for 779 ops
0619 06:29:45.723100 (+ 434us) write_op.cc:270] Start()
0619 06:29:45.723593 (+ 493us) write_op.cc:276] Timestamp: P: 1781850571581449 usec, L: 0
0619 06:29:45.741776 (+ 18183us) write_op.cc:270] Start()
0619 06:29:45.741813 (+ 37us) write_op.cc:276] Timestamp: P: 1781850571591646 usec, L: 0
0619 06:29:45.742409 (+ 596us) write_op.cc:270] Start()
0619 06:29:45.742462 (+ 53us) write_op.cc:276] Timestamp: P: 1781850571596032 usec, L: 0
0619 06:29:45.742752 (+ 290us) write_op.cc:270] Start()
0619 06:29:45.742779 (+ 27us) write_op.cc:276] Timestamp: P: 1781850571642692 usec, L: 0
0619 06:29:45.743022 (+ 243us) write_op.cc:270] Start()
0619 06:29:45.743050 (+ 28us) write_op.cc:276] Timestamp: P: 1781850571644659 usec, L: 0
0619 06:29:45.743233 (+ 183us) write_op.cc:270] Start()
0619 06:29:45.743266 (+ 33us) write_op.cc:276] Timestamp: P: 1781850571649935 usec, L: 0
0619 06:29:45.743448 (+ 182us) write_op.cc:270] Start()
0619 06:29:45.743506 (+ 58us) write_op.cc:276] Timestamp: P: 1781850571660764 usec, L: 0
0619 06:29:45.744020 (+ 514us) write_op.cc:270] Start()
0619 06:29:45.744043 (+ 23us) write_op.cc:276] Timestamp: P: 1781850571741473 usec, L: 0
0619 06:29:45.744202 (+ 159us) write_op.cc:270] Start()
0619 06:29:45.744226 (+ 24us) write_op.cc:276] Timestamp: P: 1781850571742209 usec, L: 0
0619 06:29:45.744406 (+ 180us) write_op.cc:270] Start()
0619 06:29:45.744433 (+ 27us) write_op.cc:276] Timestamp: P: 1781850571742901 usec, L: 0
0619 06:29:45.744614 (+ 181us) write_op.cc:270] Start()
0619 06:29:45.744639 (+ 25us) write_op.cc:276] Timestamp: P: 1781850571753266 usec, L: 0
0619 06:29:45.744858 (+ 219us) write_op.cc:270] Start()
0619 06:29:45.744887 (+ 29us) write_op.cc:276] Timestamp: P: 1781850571771905 usec, L: 0
0619 06:29:45.745053 (+ 166us) write_op.cc:270] Start()
0619 06:29:45.745100 (+ 47us) write_op.cc:276] Timestamp: P: 1781850571773410 usec, L: 0
0619 06:29:45.745276 (+ 176us) write_op.cc:270] Start()
0619 06:29:45.745306 (+ 30us) write_op.cc:276] Timestamp: P: 1781850571777949 usec, L: 0
0619 06:29:45.745472 (+ 166us) write_op.cc:270] Start()
0619 06:29:45.745496 (+ 24us) write_op.cc:276] Timestamp: P: 1781850571805795 usec, L: 0
0619 06:29:45.745670 (+ 174us) write_op.cc:270] Start()
0619 06:29:45.745712 (+ 42us) write_op.cc:276] Timestamp: P: 1781850571820439 usec, L: 0
0619 06:29:45.745878 (+ 166us) write_op.cc:270] Start()
0619 06:29:45.745914 (+ 36us) write_op.cc:276] Timestamp: P: 1781850571826348 usec, L: 0
0619 06:29:45.746095 (+ 181us) write_op.cc:270] Start()
0619 06:29:45.746124 (+ 29us) write_op.cc:276] Timestamp: P: 1781850571839835 usec, L: 0
0619 06:29:45.746285 (+ 161us) write_op.cc:270] Start()
0619 06:29:45.746310 (+ 25us) write_op.cc:276] Timestamp: P: 1781850571857098 usec, L: 0
0619 06:29:45.746761 (+ 451us) write_op.cc:270] Start()
0619 06:29:45.746788 (+ 27us) write_op.cc:276] Timestamp: P: 1781850571863078 usec, L: 0
0619 06:29:45.747339 (+ 551us) write_op.cc:270] Start()
0619 06:29:45.747362 (+ 23us) write_op.cc:276] Timestamp: P: 1781850571872346 usec, L: 0
0619 06:29:45.747508 (+ 146us) write_op.cc:270] Start()
0619 06:29:45.747528 (+ 20us) write_op.cc:276] Timestamp: P: 1781850571891858 usec, L: 0
0619 06:29:45.747685 (+ 157us) write_op.cc:270] Start()
0619 06:29:45.747714 (+ 29us) write_op.cc:276] Timestamp: P: 1781850571905490 usec, L: 0
0619 06:29:45.751229 (+ 3515us) write_op.cc:270] Start()
0619 06:29:45.751259 (+ 30us) write_op.cc:276] Timestamp: P: 1781850571916168 usec, L: 0
0619 06:29:45.751439 (+ 180us) write_op.cc:270] Start()
0619 06:29:45.751462 (+ 23us) write_op.cc:276] Timestamp: P: 1781850571922693 usec, L: 0
0619 06:29:45.751667 (+ 205us) write_op.cc:270] Start()
0619 06:29:45.751691 (+ 24us) write_op.cc:276] Timestamp: P: 1781850571956671 usec, L: 0
0619 06:29:45.751905 (+ 214us) write_op.cc:270] Start()
0619 06:29:45.751937 (+ 32us) write_op.cc:276] Timestamp: P: 1781850571971189 usec, L: 0
0619 06:29:45.752076 (+ 139us) write_op.cc:270] Start()
0619 06:29:45.752095 (+ 19us) write_op.cc:276] Timestamp: P: 1781850571979166 usec, L: 0
0619 06:29:45.752249 (+ 154us) write_op.cc:270] Start()
0619 06:29:45.752270 (+ 21us) write_op.cc:276] Timestamp: P: 1781850571987874 usec, L: 0
0619 06:29:45.752419 (+ 149us) write_op.cc:270] Start()
0619 06:29:45.752442 (+ 23us) write_op.cc:276] Timestamp: P: 1781850572004326 usec, L: 0
0619 06:29:45.752595 (+ 153us) write_op.cc:270] Start()
0619 06:29:45.752616 (+ 21us) write_op.cc:276] Timestamp: P: 1781850572023727 usec, L: 0
0619 06:29:45.752784 (+ 168us) write_op.cc:270] Start()
0619 06:29:45.752804 (+ 20us) write_op.cc:276] Timestamp: P: 1781850572049722 usec, L: 0
0619 06:29:45.752985 (+ 181us) write_op.cc:270] Start()
0619 06:29:45.753005 (+ 20us) write_op.cc:276] Timestamp: P: 1781850572064355 usec, L: 0
0619 06:29:45.753150 (+ 145us) write_op.cc:270] Start()
0619 06:29:45.753173 (+ 23us) write_op.cc:276] Timestamp: P: 1781850572074492 usec, L: 0
0619 06:29:45.753327 (+ 154us) write_op.cc:270] Start()
0619 06:29:45.753348 (+ 21us) write_op.cc:276] Timestamp: P: 1781850572086109 usec, L: 0
0619 06:29:45.753516 (+ 168us) write_op.cc:270] Start()
0619 06:29:45.753535 (+ 19us) write_op.cc:276] Timestamp: P: 1781850572086681 usec, L: 0
0619 06:29:45.753685 (+ 150us) write_op.cc:270] Start()
0619 06:29:45.753761 (+ 76us) write_op.cc:276] Timestamp: P: 1781850572111907 usec, L: 0
0619 06:29:45.753913 (+ 152us) write_op.cc:270] Start()
0619 06:29:45.753934 (+ 21us) write_op.cc:276] Timestamp: P: 1781850572125196 usec, L: 0
0619 06:29:45.754084 (+ 150us) write_op.cc:270] Start()
0619 06:29:45.754105 (+ 21us) write_op.cc:276] Timestamp: P: 1781850572141956 usec, L: 0
0619 06:29:45.754253 (+ 148us) write_op.cc:270] Start()
0619 06:29:45.754277 (+ 24us) write_op.cc:276] Timestamp: P: 1781850572151638 usec, L: 0
0619 06:29:45.754480 (+ 203us) write_op.cc:270] Start()
0619 06:29:45.766068 (+ 11588us) write_op.cc:276] Timestamp: P: 1781850572176756 usec, L: 0
0619 06:29:45.769674 (+ 3606us) write_op.cc:270] Start()
0619 06:29:45.769698 (+ 24us) write_op.cc:276] Timestamp: P: 1781850572178932 usec, L: 0
0619 06:29:45.770251 (+ 553us) write_op.cc:270] Start()
0619 06:29:45.770275 (+ 24us) write_op.cc:276] Timestamp: P: 1781850572211483 usec, L: 0
0619 06:29:45.770783 (+ 508us) write_op.cc:270] Start()
0619 06:29:45.770808 (+ 25us) write_op.cc:276] Timestamp: P: 1781850572216388 usec, L: 0
0619 06:29:45.772184 (+ 1376us) write_op.cc:270] Start()
0619 06:29:45.772203 (+ 19us) write_op.cc:276] Timestamp: P: 1781850572233017 usec, L: 0
0619 06:29:45.772337 (+ 134us) write_op.cc:270] Start()
0619 06:29:45.772356 (+ 19us) write_op.cc:276] Timestamp: P: 1781850572258128 usec, L: 0
0619 06:29:45.782570 (+ 10214us) write_op.cc:270] Start()
0619 06:29:45.782591 (+ 21us) write_op.cc:276] Timestamp: P: 1781850572259429 usec, L: 0
0619 06:29:45.782787 (+ 196us) write_op.cc:270] Start()
0619 06:29:45.782809 (+ 22us) write_op.cc:276] Timestamp: P: 1781850572294697 usec, L: 0
0619 06:29:45.782945 (+ 136us) write_op.cc:270] Start()
0619 06:29:45.782965 (+ 20us) write_op.cc:276] Timestamp: P: 1781850572298900 usec, L: 0
0619 06:29:45.783101 (+ 136us) write_op.cc:270] Start()
0619 06:29:45.783122 (+ 21us) write_op.cc:276] Timestamp: P: 1781850572303101 usec, L: 0
0619 06:29:45.783350 (+ 228us) write_op.cc:270] Start()
0619 06:29:45.783372 (+ 22us) write_op.cc:276] Timestamp: P: 1781850572318900 usec, L: 0
0619 06:29:45.783538 (+ 166us) write_op.cc:270] Start()
0619 06:29:45.783559 (+ 21us) write_op.cc:276] Timestamp: P: 1781850572333515 usec, L: 0
0619 06:29:45.783750 (+ 191us) write_op.cc:270] Start()
0619 06:29:45.783774 (+ 24us) write_op.cc:276] Timestamp: P: 1781850572336367 usec, L: 0
0619 06:29:45.783926 (+ 152us) write_op.cc:270] Start()
0619 06:29:45.783950 (+ 24us) write_op.cc:276] Timestamp: P: 1781850572348904 usec, L: 0
0619 06:29:45.784089 (+ 139us) write_op.cc:270] Start()
0619 06:29:45.784112 (+ 23us) write_op.cc:276] Timestamp: P: 1781850572373380 usec, L: 0
0619 06:29:45.784315 (+ 203us) write_op.cc:270] Start()
0619 06:29:45.784337 (+ 22us) write_op.cc:276] Timestamp: P: 1781850572385552 usec, L: 0
0619 06:29:45.784479 (+ 142us) write_op.cc:270] Start()
0619 06:29:45.784502 (+ 23us) write_op.cc:276] Timestamp: P: 1781850572397245 usec, L: 0
0619 06:29:45.784671 (+ 169us) write_op.cc:270] Start()
0619 06:29:45.784692 (+ 21us) write_op.cc:276] Timestamp: P: 1781850572403526 usec, L: 0
0619 06:29:45.784863 (+ 171us) write_op.cc:270] Start()
0619 06:29:45.784883 (+ 20us) write_op.cc:276] Timestamp: P: 1781850572409399 usec, L: 0
0619 06:29:45.785010 (+ 127us) write_op.cc:270] Start()
0619 06:29:45.785075 (+ 65us) write_op.cc:276] Timestamp: P: 1781850572436146 usec, L: 0
0619 06:29:45.785234 (+ 159us) write_op.cc:270] Start()
0619 06:29:45.785260 (+ 26us) write_op.cc:276] Timestamp: P: 1781850572447487 usec, L: 0
0619 06:29:45.785406 (+ 146us) write_op.cc:270] Start()
0619 06:29:45.785428 (+ 22us) write_op.cc:276] Timestamp: P: 1781850572458093 usec, L: 0
0619 06:29:45.785561 (+ 133us) write_op.cc:270] Start()
0619 06:29:45.785581 (+ 20us) write_op.cc:276] Timestamp: P: 1781850572461950 usec, L: 0
0619 06:29:45.785752 (+ 171us) write_op.cc:270] Start()
0619 06:29:45.785776 (+ 24us) write_op.cc:276] Timestamp: P: 1781850572473147 usec, L: 0
0619 06:29:45.785964 (+ 188us) write_op.cc:270] Start()
0619 06:29:45.785985 (+ 21us) write_op.cc:276] Timestamp: P: 1781850572496523 usec, L: 0
0619 06:29:45.786152 (+ 167us) write_op.cc:270] Start()
0619 06:29:45.786176 (+ 24us) write_op.cc:276] Timestamp: P: 1781850572519857 usec, L: 0
0619 06:29:45.786319 (+ 143us) write_op.cc:270] Start()
0619 06:29:45.786339 (+ 20us) write_op.cc:276] Timestamp: P: 1781850572521171 usec, L: 0
0619 06:29:45.819611 (+ 33272us) write_op.cc:270] Start()
0619 06:29:45.819643 (+ 32us) write_op.cc:276] Timestamp: P: 1781850572525105 usec, L: 0
0619 06:29:45.819830 (+ 187us) write_op.cc:270] Start()
0619 06:29:45.819851 (+ 21us) write_op.cc:276] Timestamp: P: 1781850572537947 usec, L: 0
0619 06:29:45.820226 (+ 375us) write_op.cc:270] Start()
0619 06:29:45.825171 (+ 4945us) write_op.cc:276] Timestamp: P: 1781850572551538 usec, L: 0
0619 06:29:45.837142 (+ 11971us) write_op.cc:270] Start()
0619 06:29:45.837170 (+ 28us) write_op.cc:276] Timestamp: P: 1781850572575377 usec, L: 0
0619 06:29:45.837831 (+ 661us) write_op.cc:270] Start()
0619 06:29:45.838204 (+ 373us) write_op.cc:276] Timestamp: P: 1781850572581825 usec, L: 0
0619 06:29:45.843812 (+ 5608us) write_op.cc:270] Start()
0619 06:29:45.843881 (+ 69us) write_op.cc:276] Timestamp: P: 1781850572585024 usec, L: 0
0619 06:29:45.845287 (+ 1406us) write_op.cc:270] Start()
0619 06:29:45.845312 (+ 25us) write_op.cc:276] Timestamp: P: 1781850572590115 usec, L: 0
0619 06:29:45.845448 (+ 136us) write_op.cc:270] Start()
0619 06:29:45.845467 (+ 19us) write_op.cc:276] Timestamp: P: 1781850572607612 usec, L: 0
0619 06:29:45.846387 (+ 920us) write_op.cc:270] Start()
0619 06:29:45.846417 (+ 30us) write_op.cc:276] Timestamp: P: 1781850572633496 usec, L: 0
0619 06:29:45.916804 (+ 70387us) write_op.cc:270] Start()
0619 06:29:45.916840 (+ 36us) write_op.cc:276] Timestamp: P: 1781850572639647 usec, L: 0
0619 06:29:45.918246 (+ 1406us) write_op.cc:270] Start()
0619 06:29:45.918279 (+ 33us) write_op.cc:276] Timestamp: P: 1781850572640289 usec, L: 0
0619 06:29:45.918431 (+ 152us) write_op.cc:270] Start()
0619 06:29:45.918531 (+ 100us) write_op.cc:276] Timestamp: P: 1781850572663375 usec, L: 0
0619 06:29:45.918699 (+ 168us) write_op.cc:270] Start()
0619 06:29:45.918718 (+ 19us) write_op.cc:276] Timestamp: P: 1781850572700819 usec, L: 0
0619 06:29:45.918843 (+ 125us) write_op.cc:270] Start()
0619 06:29:45.918863 (+ 20us) write_op.cc:276] Timestamp: P: 1781850572701486 usec, L: 0
0619 06:29:45.918986 (+ 123us) write_op.cc:270] Start()
0619 06:29:45.919006 (+ 20us) write_op.cc:276] Timestamp: P: 1781850572705263 usec, L: 0
0619 06:29:45.919167 (+ 161us) write_op.cc:270] Start()
0619 06:29:45.919187 (+ 20us) write_op.cc:276] Timestamp: P: 1781850572727330 usec, L: 0
0619 06:29:45.919343 (+ 156us) write_op.cc:270] Start()
0619 06:29:45.919364 (+ 21us) write_op.cc:276] Timestamp: P: 1781850572742733 usec, L: 0
0619 06:29:45.936838 (+ 17474us) write_op.cc:270] Start()
0619 06:29:45.936859 (+ 21us) write_op.cc:276] Timestamp: P: 1781850572743326 usec, L: 0
0619 06:29:45.936980 (+ 121us) write_op.cc:270] Start()
0619 06:29:45.937058 (+ 78us) write_op.cc:276] Timestamp: P: 1781850572758141 usec, L: 0
0619 06:29:45.946638 (+ 9580us) write_op.cc:270] Start()
0619 06:29:45.946675 (+ 37us) write_op.cc:276] Timestamp: P: 1781850572771924 usec, L: 0
0619 06:29:45.949554 (+ 2879us) write_op.cc:270] Start()
0619 06:29:45.949586 (+ 32us) write_op.cc:276] Timestamp: P: 1781850572784354 usec, L: 0
0619 06:29:45.950743 (+ 1157us) write_op.cc:270] Start()
0619 06:29:45.950785 (+ 42us) write_op.cc:276] Timestamp: P: 1781850572788453 usec, L: 0
0619 06:29:45.950972 (+ 187us) write_op.cc:270] Start()
0619 06:29:45.950999 (+ 27us) write_op.cc:276] Timestamp: P: 1781850572803119 usec, L: 0
0619 06:29:45.972488 (+ 21489us) write_op.cc:270] Start()
0619 06:29:45.972523 (+ 35us) write_op.cc:276] Timestamp: P: 1781850572817392 usec, L: 0
0619 06:29:45.972737 (+ 214us) write_op.cc:270] Start()
0619 06:29:45.972773 (+ 36us) write_op.cc:276] Timestamp: P: 1781850572845394 usec, L: 0
0619 06:29:45.974544 (+ 1771us) write_op.cc:270] Start()
0619 06:29:45.974577 (+ 33us) write_op.cc:276] Timestamp: P: 1781850572847546 usec, L: 0
0619 06:29:45.974775 (+ 198us) write_op.cc:270] Start()
0619 06:29:45.974800 (+ 25us) write_op.cc:276] Timestamp: P: 1781850572884505 usec, L: 0
0619 06:29:45.974956 (+ 156us) write_op.cc:270] Start()
0619 06:29:45.974979 (+ 23us) write_op.cc:276] Timestamp: P: 1781850572885344 usec, L: 0
0619 06:29:45.975549 (+ 570us) write_op.cc:270] Start()
0619 06:29:45.975581 (+ 32us) write_op.cc:276] Timestamp: P: 1781850572904222 usec, L: 0
0619 06:29:45.975772 (+ 191us) write_op.cc:270] Start()
0619 06:29:45.975798 (+ 26us) write_op.cc:276] Timestamp: P: 1781850572915615 usec, L: 0
0619 06:29:45.975944 (+ 146us) write_op.cc:270] Start()
0619 06:29:45.975967 (+ 23us) write_op.cc:276] Timestamp: P: 1781850572919980 usec, L: 0
0619 06:29:45.976162 (+ 195us) write_op.cc:270] Start()
0619 06:29:45.976186 (+ 24us) write_op.cc:276] Timestamp: P: 1781850572926554 usec, L: 0
0619 06:29:45.976334 (+ 148us) write_op.cc:270] Start()
0619 06:29:45.976358 (+ 24us) write_op.cc:276] Timestamp: P: 1781850572950367 usec, L: 0
0619 06:29:45.976922 (+ 564us) write_op.cc:270] Start()
0619 06:29:45.976955 (+ 33us) write_op.cc:276] Timestamp: P: 1781850572958584 usec, L: 0
0619 06:29:46.007347 (+ 30392us) write_op.cc:270] Start()
0619 06:29:46.007367 (+ 20us) write_op.cc:276] Timestamp: P: 1781850572961358 usec, L: 0
0619 06:29:46.014661 (+ 7294us) write_op.cc:270] Start()
0619 06:29:46.014686 (+ 25us) write_op.cc:276] Timestamp: P: 1781850572980188 usec, L: 0
0619 06:29:46.047231 (+ 32545us) write_op.cc:270] Start()
0619 06:29:46.047266 (+ 35us) write_op.cc:276] Timestamp: P: 1781850573001056 usec, L: 0
0619 06:29:46.049132 (+ 1866us) write_op.cc:270] Start()
0619 06:29:46.049156 (+ 24us) write_op.cc:276] Timestamp: P: 1781850573016596 usec, L: 0
0619 06:29:46.050006 (+ 850us) write_op.cc:270] Start()
0619 06:29:46.050028 (+ 22us) write_op.cc:276] Timestamp: P: 1781850573020518 usec, L: 0
0619 06:29:46.050170 (+ 142us) write_op.cc:270] Start()
0619 06:29:46.050190 (+ 20us) write_op.cc:276] Timestamp: P: 1781850573028556 usec, L: 0
0619 06:29:46.050340 (+ 150us) write_op.cc:270] Start()
0619 06:29:46.050362 (+ 22us) write_op.cc:276] Timestamp: P: 1781850573039232 usec, L: 0
0619 06:29:46.050524 (+ 162us) write_op.cc:270] Start()
0619 06:29:46.050544 (+ 20us) write_op.cc:276] Timestamp: P: 1781850573070937 usec, L: 0
0619 06:29:46.050695 (+ 151us) write_op.cc:270] Start()
0619 06:29:46.050716 (+ 21us) write_op.cc:276] Timestamp: P: 1781850573080903 usec, L: 0
0619 06:29:46.050880 (+ 164us) write_op.cc:270] Start()
0619 06:29:46.050901 (+ 21us) write_op.cc:276] Timestamp: P: 1781850573085234 usec, L: 0
0619 06:29:46.051080 (+ 179us) write_op.cc:270] Start()
0619 06:29:46.051103 (+ 23us) write_op.cc:276] Timestamp: P: 1781850573087499 usec, L: 0
0619 06:29:46.051232 (+ 129us) write_op.cc:270] Start()
0619 06:29:46.051252 (+ 20us) write_op.cc:276] Timestamp: P: 1781850573120753 usec, L: 0
0619 06:29:46.051400 (+ 148us) write_op.cc:270] Start()
0619 06:29:46.051419 (+ 19us) write_op.cc:276] Timestamp: P: 1781850573144019 usec, L: 0
0619 06:29:46.051544 (+ 125us) write_op.cc:270] Start()
0619 06:29:46.051563 (+ 19us) write_op.cc:276] Timestamp: P: 1781850573144694 usec, L: 0
0619 06:29:46.051710 (+ 147us) write_op.cc:270] Start()
0619 06:29:46.051732 (+ 22us) write_op.cc:276] Timestamp: P: 1781850573166328 usec, L: 0
0619 06:29:46.051872 (+ 140us) write_op.cc:270] Start()
0619 06:29:46.051893 (+ 21us) write_op.cc:276] Timestamp: P: 1781850573174199 usec, L: 0
0619 06:29:46.052027 (+ 134us) write_op.cc:270] Start()
0619 06:29:46.052042 (+ 15us) write_op.cc:276] Timestamp: P: 1781850573180713 usec, L: 0
0619 06:29:46.052128 (+ 86us) write_op.cc:270] Start()
0619 06:29:46.052140 (+ 12us) write_op.cc:276] Timestamp: P: 1781850573205176 usec, L: 0
0619 06:29:46.052219 (+ 79us) write_op.cc:270] Start()
0619 06:29:46.052230 (+ 11us) write_op.cc:276] Timestamp: P: 1781850573206446 usec, L: 0
0619 06:29:46.052323 (+ 93us) write_op.cc:270] Start()
0619 06:29:46.052335 (+ 12us) write_op.cc:276] Timestamp: P: 1781850573220567 usec, L: 0
0619 06:29:46.052417 (+ 82us) write_op.cc:270] Start()
0619 06:29:46.052428 (+ 11us) write_op.cc:276] Timestamp: P: 1781850573237522 usec, L: 0
0619 06:29:46.052501 (+ 73us) write_op.cc:270] Start()
0619 06:29:46.052511 (+ 10us) write_op.cc:276] Timestamp: P: 1781850573256079 usec, L: 0
0619 06:29:46.052609 (+ 98us) write_op.cc:270] Start()
0619 06:29:46.052621 (+ 12us) write_op.cc:276] Timestamp: P: 1781850573272766 usec, L: 0
0619 06:29:46.052708 (+ 87us) write_op.cc:270] Start()
0619 06:29:46.052719 (+ 11us) write_op.cc:276] Timestamp: P: 1781850573290463 usec, L: 0
0619 06:29:46.052803 (+ 84us) write_op.cc:270] Start()
0619 06:29:46.052815 (+ 12us) write_op.cc:276] Timestamp: P: 1781850573302858 usec, L: 0
0619 06:29:46.052890 (+ 75us) write_op.cc:270] Start()
0619 06:29:46.052901 (+ 11us) write_op.cc:276] Timestamp: P: 1781850573314166 usec, L: 0
0619 06:29:46.053628 (+ 727us) write_op.cc:270] Start()
0619 06:29:46.053652 (+ 24us) write_op.cc:276] Timestamp: P: 1781850573326992 usec, L: 0
0619 06:29:46.078867 (+ 25215us) write_op.cc:270] Start()
0619 06:29:46.078901 (+ 34us) write_op.cc:276] Timestamp: P: 1781850573331997 usec, L: 0
0619 06:29:46.079094 (+ 193us) write_op.cc:270] Start()
0619 06:29:46.079120 (+ 26us) write_op.cc:276] Timestamp: P: 1781850573356630 usec, L: 0
0619 06:29:46.086627 (+ 7507us) write_op.cc:270] Start()
0619 06:29:46.089393 (+ 2766us) write_op.cc:276] Timestamp: P: 1781850573370304 usec, L: 0
0619 06:29:46.089572 (+ 179us) write_op.cc:270] Start()
0619 06:29:46.089599 (+ 27us) write_op.cc:276] Timestamp: P: 1781850573376441 usec, L: 0
0619 06:29:46.093205 (+ 3606us) write_op.cc:270] Start()
0619 06:29:46.093237 (+ 32us) write_op.cc:276] Timestamp: P: 1781850573380160 usec, L: 0
0619 06:29:46.099079 (+ 5842us) write_op.cc:270] Start()
0619 06:29:46.099107 (+ 28us) write_op.cc:276] Timestamp: P: 1781850573403317 usec, L: 0
0619 06:29:46.099268 (+ 161us) write_op.cc:270] Start()
0619 06:29:46.099291 (+ 23us) write_op.cc:276] Timestamp: P: 1781850573414119 usec, L: 0
0619 06:29:46.100084 (+ 793us) write_op.cc:270] Start()
0619 06:29:46.100113 (+ 29us) write_op.cc:276] Timestamp: P: 1781850573415324 usec, L: 0
0619 06:29:46.105607 (+ 5494us) write_op.cc:270] Start()
0619 06:29:46.105623 (+ 16us) write_op.cc:276] Timestamp: P: 1781850573429573 usec, L: 0
0619 06:29:46.105752 (+ 129us) write_op.cc:270] Start()
0619 06:29:46.105771 (+ 19us) write_op.cc:276] Timestamp: P: 1781850573455030 usec, L: 0
0619 06:29:46.107192 (+ 1421us) write_op.cc:270] Start()
0619 06:29:46.107219 (+ 27us) write_op.cc:276] Timestamp: P: 1781850573469349 usec, L: 0
0619 06:29:46.108878 (+ 1659us) write_op.cc:270] Start()
0619 06:29:46.108910 (+ 32us) write_op.cc:276] Timestamp: P: 1781850573474922 usec, L: 0
0619 06:29:46.109928 (+ 1018us) write_op.cc:270] Start()
0619 06:29:46.109948 (+ 20us) write_op.cc:276] Timestamp: P: 1781850573488283 usec, L: 0
0619 06:29:46.110140 (+ 192us) write_op.cc:270] Start()
0619 06:29:46.110166 (+ 26us) write_op.cc:276] Timestamp: P: 1781850573507553 usec, L: 0
0619 06:29:46.110335 (+ 169us) write_op.cc:270] Start()
0619 06:29:46.110359 (+ 24us) write_op.cc:276] Timestamp: P: 1781850573509510 usec, L: 0
0619 06:29:46.114247 (+ 3888us) write_op.cc:270] Start()
0619 06:29:46.114284 (+ 37us) write_op.cc:276] Timestamp: P: 1781850573510443 usec, L: 0
0619 06:29:46.115015 (+ 731us) write_op.cc:270] Start()
0619 06:29:46.115040 (+ 25us) write_op.cc:276] Timestamp: P: 1781850573520441 usec, L: 0
0619 06:29:46.149490 (+ 34450us) write_op.cc:270] Start()
0619 06:29:46.149514 (+ 24us) write_op.cc:276] Timestamp: P: 1781850573561419 usec, L: 0
0619 06:29:46.150025 (+ 511us) write_op.cc:270] Start()
0619 06:29:46.150047 (+ 22us) write_op.cc:276] Timestamp: P: 1781850573562177 usec, L: 0
0619 06:29:46.150424 (+ 377us) write_op.cc:270] Start()
0619 06:29:46.150453 (+ 29us) write_op.cc:276] Timestamp: P: 1781850573563683 usec, L: 0
0619 06:29:46.150669 (+ 216us) write_op.cc:270] Start()
0619 06:29:46.150691 (+ 22us) write_op.cc:276] Timestamp: P: 1781850573570997 usec, L: 0
0619 06:29:46.150863 (+ 172us) write_op.cc:270] Start()
0619 06:29:46.150884 (+ 21us) write_op.cc:276] Timestamp: P: 1781850573608232 usec, L: 0
0619 06:29:46.151020 (+ 136us) write_op.cc:270] Start()
0619 06:29:46.151039 (+ 19us) write_op.cc:276] Timestamp: P: 1781850573622348 usec, L: 0
0619 06:29:46.151157 (+ 118us) write_op.cc:270] Start()
0619 06:29:46.151176 (+ 19us) write_op.cc:276] Timestamp: P: 1781850573634821 usec, L: 0
0619 06:29:46.162133 (+ 10957us) write_op.cc:270] Start()
0619 06:29:46.162158 (+ 25us) write_op.cc:276] Timestamp: P: 1781850573638203 usec, L: 0
0619 06:29:46.162316 (+ 158us) write_op.cc:270] Start()
0619 06:29:46.162335 (+ 19us) write_op.cc:276] Timestamp: P: 1781850573658474 usec, L: 0
0619 06:29:46.162465 (+ 130us) write_op.cc:270] Start()
0619 06:29:46.162483 (+ 18us) write_op.cc:276] Timestamp: P: 1781850573670324 usec, L: 0
0619 06:29:46.162637 (+ 154us) write_op.cc:270] Start()
0619 06:29:46.162715 (+ 78us) write_op.cc:276] Timestamp: P: 1781850573677398 usec, L: 0
0619 06:29:46.162874 (+ 159us) write_op.cc:270] Start()
0619 06:29:46.162908 (+ 34us) write_op.cc:276] Timestamp: P: 1781850573708909 usec, L: 0
0619 06:29:46.165173 (+ 2265us) write_op.cc:270] Start()
0619 06:29:46.165197 (+ 24us) write_op.cc:276] Timestamp: P: 1781850573710666 usec, L: 0
0619 06:29:46.167012 (+ 1815us) write_op.cc:270] Start()
0619 06:29:46.167033 (+ 21us) write_op.cc:276] Timestamp: P: 1781850573736549 usec, L: 0
0619 06:29:46.167204 (+ 171us) write_op.cc:270] Start()
0619 06:29:46.167222 (+ 18us) write_op.cc:276] Timestamp: P: 1781850573737180 usec, L: 0
0619 06:29:46.167371 (+ 149us) write_op.cc:270] Start()
0619 06:29:46.167392 (+ 21us) write_op.cc:276] Timestamp: P: 1781850573743480 usec, L: 0
0619 06:29:46.167512 (+ 120us) write_op.cc:270] Start()
0619 06:29:46.167529 (+ 17us) write_op.cc:276] Timestamp: P: 1781850573763118 usec, L: 0
0619 06:29:46.167672 (+ 143us) write_op.cc:270] Start()
0619 06:29:46.167692 (+ 20us) write_op.cc:276] Timestamp: P: 1781850573790992 usec, L: 0
0619 06:29:46.167825 (+ 133us) write_op.cc:270] Start()
0619 06:29:46.167844 (+ 19us) write_op.cc:276] Timestamp: P: 1781850573802638 usec, L: 0
0619 06:29:46.167974 (+ 130us) write_op.cc:270] Start()
0619 06:29:46.167993 (+ 19us) write_op.cc:276] Timestamp: P: 1781850573809871 usec, L: 0
0619 06:29:46.168113 (+ 120us) write_op.cc:270] Start()
0619 06:29:46.168132 (+ 19us) write_op.cc:276] Timestamp: P: 1781850573814865 usec, L: 0
0619 06:29:46.168304 (+ 172us) write_op.cc:270] Start()
0619 06:29:46.169932 (+ 1628us) write_op.cc:276] Timestamp: P: 1781850573827852 usec, L: 0
0619 06:29:46.170115 (+ 183us) write_op.cc:270] Start()
0619 06:29:46.170134 (+ 19us) write_op.cc:276] Timestamp: P: 1781850573837372 usec, L: 0
0619 06:29:46.171950 (+ 1816us) spinlock_profiling.cc:243] Waited 931 us on lock 0x60f00000add8. stack: 00007ff742e9066e 00007ff742e90430 00007ff741f175ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007ff74b98dc35 00007ff74e404e49 00007ff74e3ac5c9 00007ff74e3a9ee9 00007ff751f50a6c 00007ff74c83bfa6 00007ff74c83bcd5 00007ff7499cc9be 00007ff7499cb79e 00007ff7499d1b25
0619 06:29:46.172042 (+ 92us) write_op.cc:270] Start()
0619 06:29:46.172064 (+ 22us) write_op.cc:276] Timestamp: P: 1781850573852275 usec, L: 0
0619 06:29:46.172254 (+ 190us) write_op.cc:270] Start()
0619 06:29:46.172285 (+ 31us) write_op.cc:276] Timestamp: P: 1781850573867909 usec, L: 0
0619 06:29:46.172427 (+ 142us) write_op.cc:270] Start()
0619 06:29:46.172447 (+ 20us) write_op.cc:276] Timestamp: P: 1781850573883754 usec, L: 0
0619 06:29:46.172567 (+ 120us) write_op.cc:270] Start()
0619 06:29:46.172585 (+ 18us) write_op.cc:276] Timestamp: P: 1781850573906222 usec, L: 0
0619 06:29:46.172725 (+ 140us) write_op.cc:270] Start()
0619 06:29:46.172747 (+ 22us) write_op.cc:276] Timestamp: P: 1781850573906887 usec, L: 0
0619 06:29:46.172874 (+ 127us) write_op.cc:270] Start()
0619 06:29:46.172893 (+ 19us) write_op.cc:276] Timestamp: P: 1781850573907538 usec, L: 0
0619 06:29:46.173031 (+ 138us) write_op.cc:270] Start()
0619 06:29:46.173063 (+ 32us) write_op.cc:276] Timestamp: P: 1781850573936425 usec, L: 0
0619 06:29:46.173200 (+ 137us) write_op.cc:270] Start()
0619 06:29:46.173219 (+ 19us) write_op.cc:276] Timestamp: P: 1781850573954269 usec, L: 0
0619 06:29:46.173401 (+ 182us) write_op.cc:270] Start()
0619 06:29:46.173426 (+ 25us) write_op.cc:276] Timestamp: P: 1781850573958897 usec, L: 0
0619 06:29:46.173552 (+ 126us) write_op.cc:270] Start()
0619 06:29:46.173570 (+ 18us) write_op.cc:276] Timestamp: P: 1781850573962396 usec, L: 0
0619 06:29:46.178659 (+ 5089us) write_op.cc:270] Start()
0619 06:29:46.178683 (+ 24us) write_op.cc:276] Timestamp: P: 1781850573969585 usec, L: 0
0619 06:29:46.180873 (+ 2190us) write_op.cc:270] Start()
0619 06:29:46.180895 (+ 22us) write_op.cc:276] Timestamp: P: 1781850573986720 usec, L: 0
0619 06:29:46.198981 (+ 18086us) write_op.cc:270] Start()
0619 06:29:46.199005 (+ 24us) write_op.cc:276] Timestamp: P: 1781850574020450 usec, L: 0
0619 06:29:46.199153 (+ 148us) write_op.cc:270] Start()
0619 06:29:46.199172 (+ 19us) write_op.cc:276] Timestamp: P: 1781850574022081 usec, L: 0
0619 06:29:46.199323 (+ 151us) write_op.cc:270] Start()
0619 06:29:46.199342 (+ 19us) write_op.cc:276] Timestamp: P: 1781850574027200 usec, L: 0
0619 06:29:46.200199 (+ 857us) write_op.cc:270] Start()
0619 06:29:46.200221 (+ 22us) write_op.cc:276] Timestamp: P: 1781850574058963 usec, L: 0
0619 06:29:46.200360 (+ 139us) write_op.cc:270] Start()
0619 06:29:46.200380 (+ 20us) write_op.cc:276] Timestamp: P: 1781850574072668 usec, L: 0
0619 06:29:46.204363 (+ 3983us) write_op.cc:270] Start()
0619 06:29:46.204384 (+ 21us) write_op.cc:276] Timestamp: P: 1781850574076292 usec, L: 0
0619 06:29:46.204504 (+ 120us) write_op.cc:270] Start()
0619 06:29:46.204520 (+ 16us) write_op.cc:276] Timestamp: P: 1781850574076911 usec, L: 0
0619 06:29:46.204643 (+ 123us) write_op.cc:270] Start()
0619 06:29:46.204663 (+ 20us) write_op.cc:276] Timestamp: P: 1781850574100995 usec, L: 0
0619 06:29:46.204783 (+ 120us) write_op.cc:270] Start()
0619 06:29:46.204805 (+ 22us) write_op.cc:276] Timestamp: P: 1781850574124063 usec, L: 0
0619 06:29:46.205085 (+ 280us) write_op.cc:270] Start()
0619 06:29:46.205109 (+ 24us) write_op.cc:276] Timestamp: P: 1781850574131867 usec, L: 0
0619 06:29:46.205230 (+ 121us) write_op.cc:270] Start()
0619 06:29:46.205251 (+ 21us) write_op.cc:276] Timestamp: P: 1781850574133146 usec, L: 0
0619 06:29:46.212390 (+ 7139us) write_op.cc:270] Start()
0619 06:29:46.212406 (+ 16us) write_op.cc:276] Timestamp: P: 1781850574134150 usec, L: 0
0619 06:29:46.214531 (+ 2125us) write_op.cc:270] Start()
0619 06:29:46.214559 (+ 28us) write_op.cc:276] Timestamp: P: 1781850574171634 usec, L: 0
0619 06:29:46.214772 (+ 213us) write_op.cc:270] Start()
0619 06:29:46.214795 (+ 23us) write_op.cc:276] Timestamp: P: 1781850574187212 usec, L: 0
0619 06:29:46.214944 (+ 149us) write_op.cc:270] Sta
I20260619 06:29:50.528903 8653 raft_consensus.cc:482] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 996381a7495d4720a6f6be44a1d4781b)
I20260619 06:29:50.531360 8653 raft_consensus.cc:504] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } } peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } }
I20260619 06:29:50.532050 8653 leader_election.cc:288] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499), 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063)
I20260619 06:29:50.534909 7863 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08686b31ffd64266bcdbd6f5eb29a87d" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 941 } } ignore_live_leader: false dest_uuid: "996381a7495d4720a6f6be44a1d4781b" is_pre_election: true
I20260619 06:29:50.547214 7990 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08686b31ffd64266bcdbd6f5eb29a87d" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 941 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1" is_pre_election: true
I20260619 06:29:50.550945 8458 leader_election.cc:302] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b46f2dae92104884b86705d6bbc20003; no voters: 3fc4e58423894a27a7b94de5c6013cf1, 996381a7495d4720a6f6be44a1d4781b
I20260619 06:29:50.552083 8653 raft_consensus.cc:2726] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 06:29:50.765287 8653 raft_consensus.cc:482] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 996381a7495d4720a6f6be44a1d4781b)
I20260619 06:29:50.766726 8653 raft_consensus.cc:504] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:50.767467 8653 leader_election.cc:288] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063), 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499)
I20260619 06:29:50.769791 7860 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e2da70288694680bec48ac95c14656f" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 939 } } ignore_live_leader: false dest_uuid: "996381a7495d4720a6f6be44a1d4781b" is_pre_election: true
I20260619 06:29:50.775694 7992 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e2da70288694680bec48ac95c14656f" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 939 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1" is_pre_election: true
I20260619 06:29:50.790397 8458 leader_election.cc:302] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b46f2dae92104884b86705d6bbc20003; no voters: 3fc4e58423894a27a7b94de5c6013cf1, 996381a7495d4720a6f6be44a1d4781b
I20260619 06:29:50.795791 8653 raft_consensus.cc:2726] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 06:29:48.629314 8560 rpcz_store.cc:276] 0619 06:29:45.460062 (+ 0us) service_pool.cc:170] Inserting onto call queue
0619 06:29:45.467022 (+ 6960us) service_pool.cc:227] Handling call
0619 06:29:45.594558 (+127536us) raft_consensus.cc:1457] Updating replica for 778 ops
0619 06:29:45.773155 (+178597us) raft_consensus.cc:1520] Early marking committed up to index 0
0619 06:29:45.773161 (+ 6us) raft_consensus.cc:1525] Triggering prepare for 778 ops
0619 06:29:45.774053 (+ 892us) write_op.cc:270] Start()
0619 06:29:45.774077 (+ 24us) write_op.cc:276] Timestamp: P: 1781850571576555 usec, L: 0
0619 06:29:45.812100 (+ 38023us) write_op.cc:270] Start()
0619 06:29:45.812125 (+ 25us) write_op.cc:276] Timestamp: P: 1781850571580093 usec, L: 0
0619 06:29:45.818697 (+ 6572us) write_op.cc:270] Start()
0619 06:29:45.818729 (+ 32us) write_op.cc:276] Timestamp: P: 1781850571593194 usec, L: 0
0619 06:29:45.818954 (+ 225us) write_op.cc:270] Start()
0619 06:29:45.818981 (+ 27us) write_op.cc:276] Timestamp: P: 1781850571597488 usec, L: 0
0619 06:29:45.819729 (+ 748us) write_op.cc:270] Start()
0619 06:29:45.819751 (+ 22us) write_op.cc:276] Timestamp: P: 1781850571652305 usec, L: 0
0619 06:29:45.820641 (+ 890us) write_op.cc:270] Start()
0619 06:29:45.820672 (+ 31us) write_op.cc:276] Timestamp: P: 1781850571652953 usec, L: 0
0619 06:29:45.820848 (+ 176us) write_op.cc:270] Start()
0619 06:29:45.820896 (+ 48us) write_op.cc:276] Timestamp: P: 1781850571654540 usec, L: 0
0619 06:29:45.823887 (+ 2991us) write_op.cc:270] Start()
0619 06:29:45.823917 (+ 30us) write_op.cc:276] Timestamp: P: 1781850571658002 usec, L: 0
0619 06:29:45.824070 (+ 153us) write_op.cc:270] Start()
0619 06:29:45.824089 (+ 19us) write_op.cc:276] Timestamp: P: 1781850571692904 usec, L: 0
0619 06:29:45.836604 (+ 12515us) write_op.cc:270] Start()
0619 06:29:45.836630 (+ 26us) write_op.cc:276] Timestamp: P: 1781850571716515 usec, L: 0
0619 06:29:45.839220 (+ 2590us) write_op.cc:270] Start()
0619 06:29:45.839252 (+ 32us) write_op.cc:276] Timestamp: P: 1781850571719976 usec, L: 0
0619 06:29:45.839472 (+ 220us) write_op.cc:270] Start()
0619 06:29:45.839496 (+ 24us) write_op.cc:276] Timestamp: P: 1781850571756464 usec, L: 0
0619 06:29:45.839653 (+ 157us) write_op.cc:270] Start()
0619 06:29:45.839668 (+ 15us) write_op.cc:276] Timestamp: P: 1781850571775159 usec, L: 0
0619 06:29:45.840355 (+ 687us) write_op.cc:270] Start()
0619 06:29:45.840380 (+ 25us) write_op.cc:276] Timestamp: P: 1781850571777393 usec, L: 0
0619 06:29:45.840561 (+ 181us) write_op.cc:270] Start()
0619 06:29:45.840582 (+ 21us) write_op.cc:276] Timestamp: P: 1781850571778723 usec, L: 0
0619 06:29:45.840721 (+ 139us) write_op.cc:270] Start()
0619 06:29:45.840739 (+ 18us) write_op.cc:276] Timestamp: P: 1781850571804822 usec, L: 0
0619 06:29:45.840860 (+ 121us) write_op.cc:270] Start()
0619 06:29:45.840881 (+ 21us) write_op.cc:276] Timestamp: P: 1781850571824495 usec, L: 0
0619 06:29:45.842329 (+ 1448us) write_op.cc:270] Start()
0619 06:29:45.842352 (+ 23us) write_op.cc:276] Timestamp: P: 1781850571835812 usec, L: 0
0619 06:29:45.842490 (+ 138us) write_op.cc:270] Start()
0619 06:29:45.842547 (+ 57us) write_op.cc:276] Timestamp: P: 1781850571840461 usec, L: 0
0619 06:29:45.842681 (+ 134us) write_op.cc:270] Start()
0619 06:29:45.842700 (+ 19us) write_op.cc:276] Timestamp: P: 1781850571858050 usec, L: 0
0619 06:29:45.842881 (+ 181us) write_op.cc:270] Start()
0619 06:29:45.842902 (+ 21us) write_op.cc:276] Timestamp: P: 1781850571863234 usec, L: 0
0619 06:29:45.843042 (+ 140us) write_op.cc:270] Start()
0619 06:29:45.843061 (+ 19us) write_op.cc:276] Timestamp: P: 1781850571880118 usec, L: 0
0619 06:29:45.843685 (+ 624us) write_op.cc:270] Start()
0619 06:29:45.843710 (+ 25us) write_op.cc:276] Timestamp: P: 1781850571894364 usec, L: 0
0619 06:29:45.843856 (+ 146us) write_op.cc:270] Start()
0619 06:29:45.843876 (+ 20us) write_op.cc:276] Timestamp: P: 1781850571906446 usec, L: 0
0619 06:29:45.844484 (+ 608us) write_op.cc:270] Start()
0619 06:29:45.844512 (+ 28us) write_op.cc:276] Timestamp: P: 1781850571914814 usec, L: 0
0619 06:29:45.916805 (+ 72293us) write_op.cc:270] Start()
0619 06:29:45.916839 (+ 34us) write_op.cc:276] Timestamp: P: 1781850571923620 usec, L: 0
0619 06:29:45.917097 (+ 258us) write_op.cc:270] Start()
0619 06:29:45.917120 (+ 23us) write_op.cc:276] Timestamp: P: 1781850571951923 usec, L: 0
0619 06:29:45.917308 (+ 188us) write_op.cc:270] Start()
0619 06:29:45.917330 (+ 22us) write_op.cc:276] Timestamp: P: 1781850571963838 usec, L: 0
0619 06:29:45.917526 (+ 196us) write_op.cc:270] Start()
0619 06:29:45.917550 (+ 24us) write_op.cc:276] Timestamp: P: 1781850571971454 usec, L: 0
0619 06:29:45.917688 (+ 138us) write_op.cc:270] Start()
0619 06:29:45.917711 (+ 23us) write_op.cc:276] Timestamp: P: 1781850571978200 usec, L: 0
0619 06:29:45.917856 (+ 145us) write_op.cc:270] Start()
0619 06:29:45.917877 (+ 21us) write_op.cc:276] Timestamp: P: 1781850572003248 usec, L: 0
0619 06:29:45.918018 (+ 141us) write_op.cc:270] Start()
0619 06:29:45.918037 (+ 19us) write_op.cc:276] Timestamp: P: 1781850572043554 usec, L: 0
0619 06:29:45.936738 (+ 18701us) write_op.cc:270] Start()
0619 06:29:45.936765 (+ 27us) write_op.cc:276] Timestamp: P: 1781850572048786 usec, L: 0
0619 06:29:45.936906 (+ 141us) write_op.cc:270] Start()
0619 06:29:45.936924 (+ 18us) write_op.cc:276] Timestamp: P: 1781850572071068 usec, L: 0
0619 06:29:45.937049 (+ 125us) write_op.cc:270] Start()
0619 06:29:45.937065 (+ 16us) write_op.cc:276] Timestamp: P: 1781850572072403 usec, L: 0
0619 06:29:45.937225 (+ 160us) write_op.cc:270] Start()
0619 06:29:45.937247 (+ 22us) write_op.cc:276] Timestamp: P: 1781850572074346 usec, L: 0
0619 06:29:45.937411 (+ 164us) write_op.cc:270] Start()
0619 06:29:45.962997 (+ 25586us) write_op.cc:276] Timestamp: P: 1781850572086551 usec, L: 0
0619 06:29:45.963226 (+ 229us) write_op.cc:270] Start()
0619 06:29:45.963251 (+ 25us) write_op.cc:276] Timestamp: P: 1781850572111542 usec, L: 0
0619 06:29:45.963376 (+ 125us) write_op.cc:270] Start()
0619 06:29:45.963395 (+ 19us) write_op.cc:276] Timestamp: P: 1781850572123669 usec, L: 0
0619 06:29:45.963535 (+ 140us) write_op.cc:270] Start()
0619 06:29:45.963554 (+ 19us) write_op.cc:276] Timestamp: P: 1781850572142549 usec, L: 0
0619 06:29:45.963702 (+ 148us) write_op.cc:270] Start()
0619 06:29:45.963721 (+ 19us) write_op.cc:276] Timestamp: P: 1781850572144259 usec, L: 0
0619 06:29:45.963861 (+ 140us) write_op.cc:270] Start()
0619 06:29:45.963883 (+ 22us) write_op.cc:276] Timestamp: P: 1781850572178305 usec, L: 0
0619 06:29:45.964039 (+ 156us) write_op.cc:270] Start()
0619 06:29:45.964057 (+ 18us) write_op.cc:276] Timestamp: P: 1781850572182817 usec, L: 0
0619 06:29:45.964181 (+ 124us) write_op.cc:270] Start()
0619 06:29:45.964200 (+ 19us) write_op.cc:276] Timestamp: P: 1781850572213974 usec, L: 0
0619 06:29:45.964333 (+ 133us) write_op.cc:270] Start()
0619 06:29:45.964352 (+ 19us) write_op.cc:276] Timestamp: P: 1781850572216868 usec, L: 0
0619 06:29:45.964477 (+ 125us) write_op.cc:270] Start()
0619 06:29:45.964494 (+ 17us) write_op.cc:276] Timestamp: P: 1781850572238249 usec, L: 0
0619 06:29:45.964642 (+ 148us) write_op.cc:270] Start()
0619 06:29:45.964666 (+ 24us) write_op.cc:276] Timestamp: P: 1781850572259323 usec, L: 0
0619 06:29:45.964814 (+ 148us) write_op.cc:270] Start()
0619 06:29:45.964833 (+ 19us) write_op.cc:276] Timestamp: P: 1781850572261221 usec, L: 0
0619 06:29:45.964948 (+ 115us) write_op.cc:270] Start()
0619 06:29:45.964969 (+ 21us) write_op.cc:276] Timestamp: P: 1781850572288536 usec, L: 0
0619 06:29:45.965107 (+ 138us) write_op.cc:270] Start()
0619 06:29:45.965131 (+ 24us) write_op.cc:276] Timestamp: P: 1781850572300408 usec, L: 0
0619 06:29:45.988054 (+ 22923us) write_op.cc:270] Start()
0619 06:29:45.988079 (+ 25us) write_op.cc:276] Timestamp: P: 1781850572304596 usec, L: 0
0619 06:29:45.988228 (+ 149us) write_op.cc:270] Start()
0619 06:29:45.988248 (+ 20us) write_op.cc:276] Timestamp: P: 1781850572327138 usec, L: 0
0619 06:29:45.996328 (+ 8080us) write_op.cc:270] Start()
0619 06:29:45.996361 (+ 33us) write_op.cc:276] Timestamp: P: 1781850572335673 usec, L: 0
0619 06:29:45.996673 (+ 312us) write_op.cc:270] Start()
0619 06:29:45.996691 (+ 18us) write_op.cc:276] Timestamp: P: 1781850572337834 usec, L: 0
0619 06:29:46.002161 (+ 5470us) write_op.cc:270] Start()
0619 06:29:46.002187 (+ 26us) write_op.cc:276] Timestamp: P: 1781850572346227 usec, L: 0
0619 06:29:46.003827 (+ 1640us) write_op.cc:270] Start()
0619 06:29:46.003853 (+ 26us) write_op.cc:276] Timestamp: P: 1781850572372689 usec, L: 0
0619 06:29:46.006000 (+ 2147us) write_op.cc:270] Start()
0619 06:29:46.006018 (+ 18us) write_op.cc:276] Timestamp: P: 1781850572393819 usec, L: 0
0619 06:29:46.009308 (+ 3290us) write_op.cc:270] Start()
0619 06:29:46.009332 (+ 24us) write_op.cc:276] Timestamp: P: 1781850572397012 usec, L: 0
0619 06:29:46.011411 (+ 2079us) write_op.cc:270] Start()
0619 06:29:46.011432 (+ 21us) write_op.cc:276] Timestamp: P: 1781850572404568 usec, L: 0
0619 06:29:46.011836 (+ 404us) write_op.cc:270] Start()
0619 06:29:46.011884 (+ 48us) write_op.cc:276] Timestamp: P: 1781850572414344 usec, L: 0
0619 06:29:46.045416 (+ 33532us) write_op.cc:270] Start()
0619 06:29:46.045439 (+ 23us) write_op.cc:276] Timestamp: P: 1781850572440848 usec, L: 0
0619 06:29:46.045599 (+ 160us) write_op.cc:270] Start()
0619 06:29:46.045620 (+ 21us) write_op.cc:276] Timestamp: P: 1781850572449527 usec, L: 0
0619 06:29:46.045759 (+ 139us) write_op.cc:270] Start()
0619 06:29:46.045780 (+ 21us) write_op.cc:276] Timestamp: P: 1781850572460832 usec, L: 0
0619 06:29:46.045949 (+ 169us) write_op.cc:270] Start()
0619 06:29:46.045972 (+ 23us) write_op.cc:276] Timestamp: P: 1781850572466302 usec, L: 0
0619 06:29:46.055021 (+ 9049us) write_op.cc:270] Start()
0619 06:29:46.055054 (+ 33us) write_op.cc:276] Timestamp: P: 1781850572474105 usec, L: 0
0619 06:29:46.055667 (+ 613us) write_op.cc:270] Start()
0619 06:29:46.055694 (+ 27us) write_op.cc:276] Timestamp: P: 1781850572502562 usec, L: 0
0619 06:29:46.056649 (+ 955us) write_op.cc:270] Start()
0619 06:29:46.056681 (+ 32us) write_op.cc:276] Timestamp: P: 1781850572516078 usec, L: 0
0619 06:29:46.056835 (+ 154us) write_op.cc:270] Start()
0619 06:29:46.056850 (+ 15us) write_op.cc:276] Timestamp: P: 1781850572522023 usec, L: 0
0619 06:29:46.071976 (+ 15126us) write_op.cc:270] Start()
0619 06:29:46.074004 (+ 2028us) write_op.cc:276] Timestamp: P: 1781850572526079 usec, L: 0
0619 06:29:46.077613 (+ 3609us) write_op.cc:270] Start()
0619 06:29:46.077638 (+ 25us) write_op.cc:276] Timestamp: P: 1781850572536452 usec, L: 0
0619 06:29:46.077790 (+ 152us) write_op.cc:270] Start()
0619 06:29:46.077812 (+ 22us) write_op.cc:276] Timestamp: P: 1781850572548787 usec, L: 0
0619 06:29:46.077950 (+ 138us) write_op.cc:270] Start()
0619 06:29:46.077971 (+ 21us) write_op.cc:276] Timestamp: P: 1781850572575593 usec, L: 0
0619 06:29:46.078145 (+ 174us) write_op.cc:270] Start()
0619 06:29:46.078174 (+ 29us) write_op.cc:276] Timestamp: P: 1781850572584752 usec, L: 0
0619 06:29:46.088675 (+ 10501us) write_op.cc:270] Start()
0619 06:29:46.088698 (+ 23us) write_op.cc:276] Timestamp: P: 1781850572586055 usec, L: 0
0619 06:29:46.091986 (+ 3288us) write_op.cc:270] Start()
0619 06:29:46.092017 (+ 31us) write_op.cc:276] Timestamp: P: 1781850572598212 usec, L: 0
0619 06:29:46.092187 (+ 170us) write_op.cc:270] Start()
0619 06:29:46.092211 (+ 24us) write_op.cc:276] Timestamp: P: 1781850572612134 usec, L: 0
0619 06:29:46.093530 (+ 1319us) write_op.cc:270] Start()
0619 06:29:46.093556 (+ 26us) write_op.cc:276] Timestamp: P: 1781850572637097 usec, L: 0
0619 06:29:46.093714 (+ 158us) write_op.cc:270] Start()
0619 06:29:46.093730 (+ 16us) write_op.cc:276] Timestamp: P: 1781850572640276 usec, L: 0
0619 06:29:46.093851 (+ 121us) write_op.cc:270] Start()
0619 06:29:46.093908 (+ 57us) write_op.cc:276] Timestamp: P: 1781850572656447 usec, L: 0
0619 06:29:46.094120 (+ 212us) write_op.cc:270] Start()
0619 06:29:46.094149 (+ 29us) write_op.cc:276] Timestamp: P: 1781850572663892 usec, L: 0
0619 06:29:46.094343 (+ 194us) write_op.cc:270] Start()
0619 06:29:46.094368 (+ 25us) write_op.cc:276] Timestamp: P: 1781850572700183 usec, L: 0
0619 06:29:46.094543 (+ 175us) write_op.cc:270] Start()
0619 06:29:46.094568 (+ 25us) write_op.cc:276] Timestamp: P: 1781850572701475 usec, L: 0
0619 06:29:46.094723 (+ 155us) write_op.cc:270] Start()
0619 06:29:46.094746 (+ 23us) write_op.cc:276] Timestamp: P: 1781850572706428 usec, L: 0
0619 06:29:46.094882 (+ 136us) write_op.cc:270] Start()
0619 06:29:46.094904 (+ 22us) write_op.cc:276] Timestamp: P: 1781850572720405 usec, L: 0
0619 06:29:46.095063 (+ 159us) write_op.cc:270] Start()
0619 06:29:46.095087 (+ 24us) write_op.cc:276] Timestamp: P: 1781850572742225 usec, L: 0
0619 06:29:46.095231 (+ 144us) write_op.cc:270] Start()
0619 06:29:46.095253 (+ 22us) write_op.cc:276] Timestamp: P: 1781850572743356 usec, L: 0
0619 06:29:46.095400 (+ 147us) write_op.cc:270] Start()
0619 06:29:46.095422 (+ 22us) write_op.cc:276] Timestamp: P: 1781850572757685 usec, L: 0
0619 06:29:46.095605 (+ 183us) write_op.cc:270] Start()
0619 06:29:46.095628 (+ 23us) write_op.cc:276] Timestamp: P: 1781850572773970 usec, L: 0
0619 06:29:46.095768 (+ 140us) write_op.cc:270] Start()
0619 06:29:46.095790 (+ 22us) write_op.cc:276] Timestamp: P: 1781850572783449 usec, L: 0
0619 06:29:46.095944 (+ 154us) write_op.cc:270] Start()
0619 06:29:46.095967 (+ 23us) write_op.cc:276] Timestamp: P: 1781850572789925 usec, L: 0
0619 06:29:46.096113 (+ 146us) write_op.cc:270] Start()
0619 06:29:46.096134 (+ 21us) write_op.cc:276] Timestamp: P: 1781850572802976 usec, L: 0
0619 06:29:46.096284 (+ 150us) write_op.cc:270] Start()
0619 06:29:46.096306 (+ 22us) write_op.cc:276] Timestamp: P: 1781850572817412 usec, L: 0
0619 06:29:46.096459 (+ 153us) write_op.cc:270] Start()
0619 06:29:46.096481 (+ 22us) write_op.cc:276] Timestamp: P: 1781850572846927 usec, L: 0
0619 06:29:46.096628 (+ 147us) write_op.cc:270] Start()
0619 06:29:46.096649 (+ 21us) write_op.cc:276] Timestamp: P: 1781850572848343 usec, L: 0
0619 06:29:46.096780 (+ 131us) write_op.cc:270] Start()
0619 06:29:46.096801 (+ 21us) write_op.cc:276] Timestamp: P: 1781850572849162 usec, L: 0
0619 06:29:46.097047 (+ 246us) write_op.cc:270] Start()
0619 06:29:46.097074 (+ 27us) write_op.cc:276] Timestamp: P: 1781850572856386 usec, L: 0
0619 06:29:46.097241 (+ 167us) write_op.cc:270] Start()
0619 06:29:46.097275 (+ 34us) write_op.cc:276] Timestamp: P: 1781850572904292 usec, L: 0
0619 06:29:46.105020 (+ 7745us) write_op.cc:270] Start()
0619 06:29:46.105045 (+ 25us) write_op.cc:276] Timestamp: P: 1781850572913471 usec, L: 0
0619 06:29:46.106128 (+ 1083us) write_op.cc:270] Start()
0619 06:29:46.106144 (+ 16us) write_op.cc:276] Timestamp: P: 1781850572915666 usec, L: 0
0619 06:29:46.106277 (+ 133us) write_op.cc:270] Start()
0619 06:29:46.106293 (+ 16us) write_op.cc:276] Timestamp: P: 1781850572927440 usec, L: 0
0619 06:29:46.119461 (+ 13168us) write_op.cc:270] Start()
0619 06:29:46.119484 (+ 23us) write_op.cc:276] Timestamp: P: 1781850572948876 usec, L: 0
0619 06:29:46.141305 (+ 21821us) write_op.cc:270] Start()
0619 06:29:46.141338 (+ 33us) write_op.cc:276] Timestamp: P: 1781850572958596 usec, L: 0
0619 06:29:46.141530 (+ 192us) write_op.cc:270] Start()
0619 06:29:46.141555 (+ 25us) write_op.cc:276] Timestamp: P: 1781850572961984 usec, L: 0
0619 06:29:46.141716 (+ 161us) write_op.cc:270] Start()
0619 06:29:46.141739 (+ 23us) write_op.cc:276] Timestamp: P: 1781850572969339 usec, L: 0
0619 06:29:46.141890 (+ 151us) write_op.cc:270] Start()
0619 06:29:46.141913 (+ 23us) write_op.cc:276] Timestamp: P: 1781850573001734 usec, L: 0
0619 06:29:46.142120 (+ 207us) write_op.cc:270] Start()
0619 06:29:46.142144 (+ 24us) write_op.cc:276] Timestamp: P: 1781850573016065 usec, L: 0
0619 06:29:46.142312 (+ 168us) write_op.cc:270] Start()
0619 06:29:46.142336 (+ 24us) write_op.cc:276] Timestamp: P: 1781850573024988 usec, L: 0
0619 06:29:46.142515 (+ 179us) write_op.cc:270] Start()
0619 06:29:46.142558 (+ 43us) write_op.cc:276] Timestamp: P: 1781850573025671 usec, L: 0
0619 06:29:46.142716 (+ 158us) write_op.cc:270] Start()
0619 06:29:46.142737 (+ 21us) write_op.cc:276] Timestamp: P: 1781850573041924 usec, L: 0
0619 06:29:46.142911 (+ 174us) write_op.cc:270] Start()
0619 06:29:46.142938 (+ 27us) write_op.cc:276] Timestamp: P: 1781850573071899 usec, L: 0
0619 06:29:46.143124 (+ 186us) write_op.cc:270] Start()
0619 06:29:46.143148 (+ 24us) write_op.cc:276] Timestamp: P: 1781850573081333 usec, L: 0
0619 06:29:46.143348 (+ 200us) write_op.cc:270] Start()
0619 06:29:46.143367 (+ 19us) write_op.cc:276] Timestamp: P: 1781850573082440 usec, L: 0
0619 06:29:46.143538 (+ 171us) write_op.cc:270] Start()
0619 06:29:46.143562 (+ 24us) write_op.cc:276] Timestamp: P: 1781850573087695 usec, L: 0
0619 06:29:46.143737 (+ 175us) write_op.cc:270] Start()
0619 06:29:46.143760 (+ 23us) write_op.cc:276] Timestamp: P: 1781850573122906 usec, L: 0
0619 06:29:46.143944 (+ 184us) write_op.cc:270] Start()
0619 06:29:46.143969 (+ 25us) write_op.cc:276] Timestamp: P: 1781850573146136 usec, L: 0
0619 06:29:46.144125 (+ 156us) write_op.cc:270] Start()
0619 06:29:46.144149 (+ 24us) write_op.cc:276] Timestamp: P: 1781850573153283 usec, L: 0
0619 06:29:46.144301 (+ 152us) write_op.cc:270] Start()
0619 06:29:46.144316 (+ 15us) write_op.cc:276] Timestamp: P: 1781850573168298 usec, L: 0
0619 06:29:46.144438 (+ 122us) write_op.cc:270] Start()
0619 06:29:46.144455 (+ 17us) write_op.cc:276] Timestamp: P: 1781850573183143 usec, L: 0
0619 06:29:46.144628 (+ 173us) write_op.cc:270] Start()
0619 06:29:46.144653 (+ 25us) write_op.cc:276] Timestamp: P: 1781850573192455 usec, L: 0
0619 06:29:46.144826 (+ 173us) write_op.cc:270] Start()
0619 06:29:46.144849 (+ 23us) write_op.cc:276] Timestamp: P: 1781850573204647 usec, L: 0
0619 06:29:46.144978 (+ 129us) write_op.cc:270] Start()
0619 06:29:46.144998 (+ 20us) write_op.cc:276] Timestamp: P: 1781850573208677 usec, L: 0
0619 06:29:46.145144 (+ 146us) write_op.cc:270] Start()
0619 06:29:46.145174 (+ 30us) write_op.cc:276] Timestamp: P: 1781850573220576 usec, L: 0
0619 06:29:46.145370 (+ 196us) write_op.cc:270] Start()
0619 06:29:46.145395 (+ 25us) write_op.cc:276] Timestamp: P: 1781850573237532 usec, L: 0
0619 06:29:46.145552 (+ 157us) write_op.cc:270] Start()
0619 06:29:46.145569 (+ 17us) write_op.cc:276] Timestamp: P: 1781850573256141 usec, L: 0
0619 06:29:46.145722 (+ 153us) write_op.cc:270] Start()
0619 06:29:46.145746 (+ 24us) write_op.cc:276] Timestamp: P: 1781850573280335 usec, L: 0
0619 06:29:46.145964 (+ 218us) write_op.cc:270] Start()
0619 06:29:46.152575 (+ 6611us) write_op.cc:276] Timestamp: P: 1781850573282249 usec, L: 0
0619 06:29:46.152762 (+ 187us) write_op.cc:270] Start()
0619 06:29:46.152786 (+ 24us) write_op.cc:276] Timestamp: P: 1781850573284985 usec, L: 0
0619 06:29:46.152984 (+ 198us) write_op.cc:270] Start()
0619 06:29:46.153005 (+ 21us) write_op.cc:276] Timestamp: P: 1781850573301659 usec, L: 0
0619 06:29:46.162164 (+ 9159us) write_op.cc:270] Start()
0619 06:29:46.162182 (+ 18us) write_op.cc:276] Timestamp: P: 1781850573327155 usec, L: 0
0619 06:29:46.162335 (+ 153us) write_op.cc:270] Start()
0619 06:29:46.162351 (+ 16us) write_op.cc:276] Timestamp: P: 1781850573333563 usec, L: 0
0619 06:29:46.162465 (+ 114us) write_op.cc:270] Start()
0619 06:29:46.162542 (+ 77us) write_op.cc:276] Timestamp: P: 1781850573355219 usec, L: 0
0619 06:29:46.162725 (+ 183us) write_op.cc:270] Start()
0619 06:29:46.162742 (+ 17us) write_op.cc:276] Timestamp: P: 1781850573371499 usec, L: 0
0619 06:29:46.162874 (+ 132us) write_op.cc:270] Start()
0619 06:29:46.162899 (+ 25us) write_op.cc:276] Timestamp: P: 1781850573377084 usec, L: 0
0619 06:29:46.163066 (+ 167us) write_op.cc:270] Start()
0619 06:29:46.163086 (+ 20us) write_op.cc:276] Timestamp: P: 1781850573385445 usec, L: 0
0619 06:29:46.163223 (+ 137us) write_op.cc:270] Start()
0619 06:29:46.163242 (+ 19us) write_op.cc:276] Timestamp: P: 1781850573417083 usec, L: 0
0619 06:29:46.163385 (+ 143us) write_op.cc:270] Start()
0619 06:29:46.163403 (+ 18us) write_op.cc:276] Timestamp: P: 1781850573424387 usec, L: 0
0619 06:29:46.163546 (+ 143us) write_op.cc:270] Start()
0619 06:29:46.163566 (+ 20us) write_op.cc:276] Timestamp: P: 1781850573428336 usec, L: 0
0619 06:29:46.163698 (+ 132us) write_op.cc:270] Start()
0619 06:29:46.163717 (+ 19us) write_op.cc:276] Timestamp: P: 1781850573429831 usec, L: 0
0619 06:29:46.164808 (+ 1091us) write_op.cc:270] Start()
0619 06:29:46.164834 (+ 26us) write_op.cc:276] Timestamp: P: 1781850573458070 usec, L: 0
0619 06:29:46.166358 (+ 1524us) write_op.cc:270] Start()
0619 06:29:46.166382 (+ 24us) write_op.cc:276] Timestamp: P: 1781850573475561 usec, L: 0
0619 06:29:46.171367 (+ 4985us) write_op.cc:270] Start()
0619 06:29:46.171393 (+ 26us) write_op.cc:276] Timestamp: P: 1781850573476765 usec, L: 0
0619 06:29:46.178142 (+ 6749us) write_op.cc:270] Start()
0619 06:29:46.178170 (+ 28us) write_op.cc:276] Timestamp: P: 1781850573478069 usec, L: 0
0619 06:29:46.178319 (+ 149us) write_op.cc:270] Start()
0619 06:29:46.178341 (+ 22us) write_op.cc:276] Timestamp: P: 1781850573505480 usec, L: 0
0619 06:29:46.181280 (+ 2939us) write_op.cc:270] Start()
0619 06:29:46.181306 (+ 26us) write_op.cc:276] Timestamp: P: 1781850573513271 usec, L: 0
0619 06:29:46.193758 (+ 12452us) write_op.cc:270] Start()
0619 06:29:46.193798 (+ 40us) write_op.cc:276] Timestamp: P: 1781850573515149 usec, L: 0
0619 06:29:46.193994 (+ 196us) write_op.cc:270] Start()
0619 06:29:46.194015 (+ 21us) write_op.cc:276] Timestamp: P: 1781850573524628 usec, L: 0
0619 06:29:46.197075 (+ 3060us) write_op.cc:270] Start()
0619 06:29:46.197099 (+ 24us) write_op.cc:276] Timestamp: P: 1781850573554747 usec, L: 0
0619 06:29:46.199648 (+ 2549us) write_op.cc:270] Start()
0619 06:29:46.199675 (+ 27us) write_op.cc:276] Timestamp: P: 1781850573560510 usec, L: 0
0619 06:29:46.199830 (+ 155us) write_op.cc:270] Start()
0619 06:29:46.199851 (+ 21us) write_op.cc:276] Timestamp: P: 1781850573564923 usec, L: 0
0619 06:29:46.204285 (+ 4434us) write_op.cc:270] Start()
0619 06:29:46.204313 (+ 28us) write_op.cc:276] Timestamp: P: 1781850573574908 usec, L: 0
0619 06:29:46.204471 (+ 158us) write_op.cc:270] Start()
0619 06:29:46.204489 (+ 18us) write_op.cc:276] Timestamp: P: 1781850573608993 usec, L: 0
0619 06:29:46.204941 (+ 452us) write_op.cc:270] Start()
0619 06:29:46.204963 (+ 22us) write_op.cc:276] Timestamp: P: 1781850573623964 usec, L: 0
0619 06:29:46.205870 (+ 907us) write_op.cc:270] Start()
0619 06:29:46.205898 (+ 28us) write_op.cc:276] Timestamp: P: 1781850573634096 usec, L: 0
0619 06:29:46.206928 (+ 1030us) write_op.cc:270] Start()
0619 06:29:46.206955 (+ 27us) write_op.cc:276] Timestamp: P: 1781850573635499 usec, L: 0
0619 06:29:46.207130 (+ 175us) write_op.cc:270] Start()
0619 06:29:46.207152 (+ 22us) write_op.cc:276] Timestamp: P: 1781850573659508 usec, L: 0
0619 06:29:46.211108 (+ 3956us) write_op.cc:270] Start()
0619 06:29:46.211125 (+ 17us) write_op.cc:276] Timestamp: P: 1781850573671135 usec, L: 0
0619 06:29:46.218724 (+ 7599us) write_op.cc:270] Start()
0619 06:29:46.218756 (+ 32us) write_op.cc:276] Timestamp: P: 1781850573677630 usec, L: 0
0619 06:29:46.220059 (+ 1303us) write_op.cc:270] Start()
0619 06:29:46.220080 (+ 21us) write_op.cc:276] Timestamp: P: 1781850573708779 usec, L: 0
0619 06:29:46.220446 (+ 366us) write_op.cc:270] Start()
0619 06:29:46.220467 (+ 21us) write_op.cc:276] Timestamp: P: 1781850573710603 usec, L: 0
0619 06:29:46.225364 (+ 4897us) write_op.cc:270] Start()
0619 06:29:46.227992 (+ 2628us) write_op.cc:276] Timestamp: P: 1781850573741057 usec, L: 0
0619 06:29:46.230895 (+ 2903us) write_op.cc:270] Start()
0619 06:29:46.230921 (+ 26us) write_op.cc:276] Timestamp: P: 1781850573741710 usec, L: 0
0619 06:29:46.231075 (+ 154us) write_op.cc:270] Start()
0619 06:29:46.231099 (+ 24us) write_op.cc:276] Timestamp: P: 1781850573742359 usec, L: 0
0619 06:29:46.233744 (+ 2645us) write_op.cc:270] Start()
0619 06:29:46.233767 (+ 23us) write_op.cc:276] Timestamp: P: 1781850573763395 usec, L: 0
0619 06:29:46.234518 (+ 751us) write_op.cc:270] Start()
0619 06:29:46.234542 (+ 24us) write_op.cc:276] Timestamp: P: 1781850573779136 usec, L: 0
0619 06:29:46.244956 (+ 10414us) write_op.cc:270] Start()
0619 06:29:46.244972 (+ 16us) write_op.cc:276] Timestamp: P: 1781850573800456 usec, L: 0
0619 06:29:46.254472 (+ 9500us) write_op.cc:270] Start()
0619 06:29:46.254519 (+ 47us) write_op.cc:276] Timestamp: P: 1781850573808735 usec, L: 0
0619 06:29:46.263627 (+ 9108us) write_op.cc:270] Start()
0619 06:29:46.265223 (+ 1596us) write_op.cc:276] Timestamp: P: 1781850573814817 usec, L: 0
0619 06:29:46.265444 (+ 221us) write_op.cc:270] Start()
0619 06:29:46.265465 (+ 21us) write_op.cc:276] Timestamp: P: 1781850573830909 usec, L: 0
0619 06:29:46.265614 (+ 149us) write_op.cc:270] Start()
0619 06:29:46.265635 (+ 21us) write_op.cc:276] Timestamp: P: 1781850573837722 usec, L: 0
0619 06:29:46.265777 (+ 142us) write_op.cc:270] Start()
0619 06:29:46.265797 (+ 20us) write_op.cc:276] Timestamp: P: 1781850573850558 usec, L: 0
0619 06:29:46.265949 (+ 152us) write_op.cc:270] Start()
0619 06:29:46.265970 (+ 21us) write_op.cc:276] Timestamp: P: 1781850573863083 usec, L: 0
0619 06:29:46.266097 (+ 127us) write_op.cc:270] Start()
0619 06:29:46.266117 (+ 20us) write_op.cc:276] Timestamp: P: 1781850573884580 usec, L: 0
0619 06:29:46.266258 (+ 141us) write_op.cc:270] Start()
0619 06:29:46.266292 (+ 34us) write_op.cc:276] Timestamp: P: 1781850573905566 usec, L: 0
0619 06:29:46.266440 (+ 148us) write_op.cc:270] Start()
0619 06:29:46.266458 (+ 18us) write_op.cc:276] Timestamp: P: 1781850573906710 usec, L: 0
0619 06:29:46.266606 (+ 148us) write_op.cc:270] Start()
0619 06:29:46.266625 (+ 19us) write_op.cc:276] Timestamp: P: 1781850573908362 usec, L: 0
0619 06:29:46.270200 (+ 3575us) write_op.cc:270] Start()
0619 06:29:46.270224 (+ 24us) write_op.cc:276] Timestamp: P: 1781850573936068 usec, L: 0
0619 06:29:46.270371 (+ 147us) write_op.cc:270] Start()
0619 06:29:46.270396 (+ 25us) write_op.cc:276] Timestamp: P: 1781850573955146 usec, L: 0
0619 06:29:46.272807 (+ 2411us) write_op.cc:270] Start()
0619 06:29:46.272831 (+ 24us) write_op.cc:276] Timestamp: P: 1781850573956626 usec, L: 0
0619 06:29:46.281235 (+ 8404us) write_op.cc:270] Start()
0619 06:29:46.281258 (+ 23us) write_op.cc:276] Timestamp: P: 1781850573967876 usec, L: 0
0619 06:29:46.282448 (+ 1190us) write_op.cc:270] Start()
0619 06:29:46.282471 (+ 23us) write_op.cc:276] Timestamp: P: 1781850573969759 usec, L: 0
0619 06:29:46.282627 (+ 156us) write_op.cc:270] Start()
0619 06:29:46.282643 (+ 16us) write_op.cc:276] Timestamp: P: 1781850573986950 usec, L: 0
0619 06:29:46.282752 (+ 109us) write_op.cc:270] Start()
0619 06:29:46.282770 (+ 18us) write_op.cc:276] Timestamp: P: 1781850574018408 usec, L: 0
0619 06:29:46.282947 (+ 177us) write_op.cc:270] Start()
0619 06:29:46.282967 (+ 20us) write_op.cc:276] Timestamp: P: 1781850574021478 usec, L: 0
0619 06:29:46.311895 (+ 28928us) write_op.cc:270] Start()
0619 06:29:46.311918 (+ 23us) write_op.cc:276] Timestamp: P: 1781850574026610 usec, L: 0
0619 06:29:46.313111 (+ 1193us) write_op.cc:270] Start()
0619 06:29:46.313126 (+ 15us) write_op.cc:276] Timestamp: P: 1781850574029331 usec, L: 0
0619 06:29:46.315155 (+ 2029us) write_op.cc:270] Start()
0619 06:29:46.315181 (+ 26us) write_op.cc:276] Timestamp: P: 1781850574073383 usec, L: 0
0619 06:29:46.332045 (+ 16864us) write_op.cc:270] Start()
0619 06:29:46.332068 (+ 23us) write_op.cc:276] Timestamp: P: 1781850574075839 usec, L: 0
0619 06:29:46.337691 (+ 5623us) write_op.cc:270] Start()
0619 06:29:46.337717 (+ 26us) write_op.cc:276] Timestamp: P: 1781850574080097 usec, L: 0
0619 06:29:46.337885 (+ 168us) write_op.cc:270] Start()
0619 06:29:46.337907 (+ 22us) write_op.cc:276] Timestamp: P: 1781850574101724 usec, L: 0
0619 06:29:46.338049 (+ 142us) write_op.cc:270] Start()
0619 06:29:46.338071 (+ 22us) write_op.cc:276] Timestamp: P: 1781850574123617 usec, L: 0
0619 06:29:46.338581 (+ 510us) write_op.cc:270] Start()
0619 06:29:46.338609 (+ 28us) write_op.cc:276] Timestamp: P: 1781850574132066 usec, L: 0
0619 06:29:46.338768 (+ 159us) write_op.cc:270] Start()
0619 06:29:46.338790 (+ 22us) write_op.cc:276] Timestamp: P: 1781850574143102 usec, L: 0
0619 06:29:46.339084 (+ 294us) write_op.cc:270] Start()
0619 06:29:46.339109 (+ 25us) write_op.cc:276] Timestamp: P: 1781850574144065 usec, L: 0
0619 06:29:46.339232 (+ 123us) write_op.cc:270] Start()
0619 06:29:46.339253 (+ 21us) write_op.cc:276] Timestamp: P: 1781850574171082 usec, L: 0
0619 06:29:46.339427 (+ 174us) write_op.cc:270] Start()
0619 06:29:46.339447 (+ 20us) write_op.cc:276] Timestamp: P: 1781850574187858 usec, L: 0
0619 06:29:46.339863 (+ 416us) write_op.cc:270] Start()
0619 06:29:46.339899 (+ 36us) write_op.cc:276] Timestamp: P: 1781850574190964 usec, L: 0
0619 06:29:46.340077 (+ 178us) write_op.cc:270] Start()
0619 06:29:46.340111 (+ 34us) write_op.cc:276] Timestamp: P: 17818505
I20260619 06:29:50.970876 8653 raft_consensus.cc:482] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3fc4e58423894a27a7b94de5c6013cf1)
I20260619 06:29:50.979535 8653 raft_consensus.cc:504] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:50.980314 8653 leader_election.cc:288] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063), 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499)
I20260619 06:29:50.980852 7863 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98eb40b379a24876b6334fff708de671" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 936 } } ignore_live_leader: false dest_uuid: "996381a7495d4720a6f6be44a1d4781b" is_pre_election: true
I20260619 06:29:51.001530 7991 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98eb40b379a24876b6334fff708de671" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 936 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1" is_pre_election: true
I20260619 06:29:51.006420 8458 leader_election.cc:302] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b46f2dae92104884b86705d6bbc20003; no voters: 3fc4e58423894a27a7b94de5c6013cf1, 996381a7495d4720a6f6be44a1d4781b
I20260619 06:29:51.014433 8653 raft_consensus.cc:2726] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 06:29:48.447640 8557 rpcz_store.cc:276] 0619 06:29:45.511621 (+ 0us) service_pool.cc:170] Inserting onto call queue
0619 06:29:45.511676 (+ 55us) service_pool.cc:227] Handling call
0619 06:29:45.683512 (+171836us) raft_consensus.cc:1457] Updating replica for 778 ops
0619 06:29:45.769336 (+ 85824us) raft_consensus.cc:1520] Early marking committed up to index 163
0619 06:29:45.819111 (+ 49775us) raft_consensus.cc:1525] Triggering prepare for 778 ops
0619 06:29:45.819789 (+ 678us) write_op.cc:270] Start()
0619 06:29:45.819819 (+ 30us) write_op.cc:276] Timestamp: P: 1781850571594546 usec, L: 0
0619 06:29:45.928932 (+109113us) write_op.cc:270] Start()
0619 06:29:45.928958 (+ 26us) write_op.cc:276] Timestamp: P: 1781850571598061 usec, L: 0
0619 06:29:45.936208 (+ 7250us) write_op.cc:270] Start()
0619 06:29:45.936234 (+ 26us) write_op.cc:276] Timestamp: P: 1781850571644310 usec, L: 0
0619 06:29:45.941182 (+ 4948us) write_op.cc:270] Start()
0619 06:29:45.941209 (+ 27us) write_op.cc:276] Timestamp: P: 1781850571650253 usec, L: 0
0619 06:29:45.950634 (+ 9425us) write_op.cc:270] Start()
0619 06:29:45.950663 (+ 29us) write_op.cc:276] Timestamp: P: 1781850571650943 usec, L: 0
0619 06:29:45.983185 (+ 32522us) write_op.cc:270] Start()
0619 06:29:45.983217 (+ 32us) write_op.cc:276] Timestamp: P: 1781850571668567 usec, L: 0
0619 06:29:45.983373 (+ 156us) write_op.cc:270] Start()
0619 06:29:45.983409 (+ 36us) write_op.cc:276] Timestamp: P: 1781850571692915 usec, L: 0
0619 06:29:45.985300 (+ 1891us) write_op.cc:270] Start()
0619 06:29:45.985326 (+ 26us) write_op.cc:276] Timestamp: P: 1781850571715528 usec, L: 0
0619 06:29:45.985482 (+ 156us) write_op.cc:270] Start()
0619 06:29:45.985503 (+ 21us) write_op.cc:276] Timestamp: P: 1781850571717683 usec, L: 0
0619 06:29:45.995295 (+ 9792us) write_op.cc:270] Start()
0619 06:29:45.995316 (+ 21us) write_op.cc:276] Timestamp: P: 1781850571756863 usec, L: 0
0619 06:29:45.996623 (+ 1307us) write_op.cc:270] Start()
0619 06:29:45.996646 (+ 23us) write_op.cc:276] Timestamp: P: 1781850571772686 usec, L: 0
0619 06:29:45.996789 (+ 143us) write_op.cc:270] Start()
0619 06:29:45.996814 (+ 25us) write_op.cc:276] Timestamp: P: 1781850571777278 usec, L: 0
0619 06:29:46.002878 (+ 6064us) write_op.cc:270] Start()
0619 06:29:46.002904 (+ 26us) write_op.cc:276] Timestamp: P: 1781850571778040 usec, L: 0
0619 06:29:46.005946 (+ 3042us) write_op.cc:270] Start()
0619 06:29:46.005971 (+ 25us) write_op.cc:276] Timestamp: P: 1781850571808896 usec, L: 0
0619 06:29:46.006778 (+ 807us) write_op.cc:270] Start()
0619 06:29:46.006801 (+ 23us) write_op.cc:276] Timestamp: P: 1781850571830433 usec, L: 0
0619 06:29:46.010089 (+ 3288us) write_op.cc:270] Start()
0619 06:29:46.011228 (+ 1139us) write_op.cc:276] Timestamp: P: 1781850571832676 usec, L: 0
0619 06:29:46.011829 (+ 601us) write_op.cc:270] Start()
0619 06:29:46.011880 (+ 51us) write_op.cc:276] Timestamp: P: 1781850571841802 usec, L: 0
0619 06:29:46.045058 (+ 33178us) write_op.cc:270] Start()
0619 06:29:46.045092 (+ 34us) write_op.cc:276] Timestamp: P: 1781850571856786 usec, L: 0
0619 06:29:46.045267 (+ 175us) write_op.cc:270] Start()
0619 06:29:46.045292 (+ 25us) write_op.cc:276] Timestamp: P: 1781850571862319 usec, L: 0
0619 06:29:46.046741 (+ 1449us) write_op.cc:270] Start()
0619 06:29:46.046764 (+ 23us) write_op.cc:276] Timestamp: P: 1781850571873153 usec, L: 0
0619 06:29:46.049318 (+ 2554us) write_op.cc:270] Start()
0619 06:29:46.049335 (+ 17us) write_op.cc:276] Timestamp: P: 1781850571892623 usec, L: 0
0619 06:29:46.053266 (+ 3931us) write_op.cc:270] Start()
0619 06:29:46.053280 (+ 14us) write_op.cc:276] Timestamp: P: 1781850571905482 usec, L: 0
0619 06:29:46.053850 (+ 570us) write_op.cc:270] Start()
0619 06:29:46.053871 (+ 21us) write_op.cc:276] Timestamp: P: 1781850571915421 usec, L: 0
0619 06:29:46.053991 (+ 120us) write_op.cc:270] Start()
0619 06:29:46.054004 (+ 13us) write_op.cc:276] Timestamp: P: 1781850571927837 usec, L: 0
0619 06:29:46.055233 (+ 1229us) write_op.cc:270] Start()
0619 06:29:46.055272 (+ 39us) write_op.cc:276] Timestamp: P: 1781850571955813 usec, L: 0
0619 06:29:46.056140 (+ 868us) write_op.cc:270] Start()
0619 06:29:46.056168 (+ 28us) write_op.cc:276] Timestamp: P: 1781850571972808 usec, L: 0
0619 06:29:46.056381 (+ 213us) write_op.cc:270] Start()
0619 06:29:46.056405 (+ 24us) write_op.cc:276] Timestamp: P: 1781850571976921 usec, L: 0
0619 06:29:46.057553 (+ 1148us) write_op.cc:270] Start()
0619 06:29:46.057591 (+ 38us) write_op.cc:276] Timestamp: P: 1781850571986024 usec, L: 0
0619 06:29:46.057811 (+ 220us) write_op.cc:270] Start()
0619 06:29:46.057837 (+ 26us) write_op.cc:276] Timestamp: P: 1781850572004167 usec, L: 0
0619 06:29:46.058002 (+ 165us) write_op.cc:270] Start()
0619 06:29:46.058025 (+ 23us) write_op.cc:276] Timestamp: P: 1781850572024953 usec, L: 0
0619 06:29:46.058172 (+ 147us) write_op.cc:270] Start()
0619 06:29:46.058216 (+ 44us) write_op.cc:276] Timestamp: P: 1781850572052355 usec, L: 0
0619 06:29:46.058387 (+ 171us) write_op.cc:270] Start()
0619 06:29:46.058410 (+ 23us) write_op.cc:276] Timestamp: P: 1781850572070330 usec, L: 0
0619 06:29:46.058634 (+ 224us) write_op.cc:270] Start()
0619 06:29:46.058658 (+ 24us) write_op.cc:276] Timestamp: P: 1781850572078647 usec, L: 0
0619 06:29:46.058813 (+ 155us) write_op.cc:270] Start()
0619 06:29:46.058836 (+ 23us) write_op.cc:276] Timestamp: P: 1781850572082626 usec, L: 0
0619 06:29:46.059010 (+ 174us) write_op.cc:270] Start()
0619 06:29:46.059032 (+ 22us) write_op.cc:276] Timestamp: P: 1781850572086101 usec, L: 0
0619 06:29:46.059179 (+ 147us) write_op.cc:270] Start()
0619 06:29:46.059202 (+ 23us) write_op.cc:276] Timestamp: P: 1781850572111311 usec, L: 0
0619 06:29:46.059380 (+ 178us) write_op.cc:270] Start()
0619 06:29:46.059420 (+ 40us) write_op.cc:276] Timestamp: P: 1781850572124480 usec, L: 0
0619 06:29:46.059585 (+ 165us) write_op.cc:270] Start()
0619 06:29:46.059607 (+ 22us) write_op.cc:276] Timestamp: P: 1781850572150668 usec, L: 0
0619 06:29:46.059774 (+ 167us) write_op.cc:270] Start()
0619 06:29:46.059799 (+ 25us) write_op.cc:276] Timestamp: P: 1781850572157658 usec, L: 0
0619 06:29:46.059955 (+ 156us) write_op.cc:270] Start()
0619 06:29:46.059978 (+ 23us) write_op.cc:276] Timestamp: P: 1781850572177335 usec, L: 0
0619 06:29:46.060131 (+ 153us) write_op.cc:270] Start()
0619 06:29:46.060154 (+ 23us) write_op.cc:276] Timestamp: P: 1781850572183459 usec, L: 0
0619 06:29:46.060314 (+ 160us) write_op.cc:270] Start()
0619 06:29:46.060356 (+ 42us) write_op.cc:276] Timestamp: P: 1781850572213316 usec, L: 0
0619 06:29:46.071649 (+ 11293us) write_op.cc:270] Start()
0619 06:29:46.071674 (+ 25us) write_op.cc:276] Timestamp: P: 1781850572215794 usec, L: 0
0619 06:29:46.076310 (+ 4636us) write_op.cc:270] Start()
0619 06:29:46.076339 (+ 29us) write_op.cc:276] Timestamp: P: 1781850572233724 usec, L: 0
0619 06:29:46.086726 (+ 10387us) write_op.cc:270] Start()
0619 06:29:46.086749 (+ 23us) write_op.cc:276] Timestamp: P: 1781850572258838 usec, L: 0
0619 06:29:46.098640 (+ 11891us) write_op.cc:270] Start()
0619 06:29:46.098663 (+ 23us) write_op.cc:276] Timestamp: P: 1781850572272659 usec, L: 0
0619 06:29:46.098804 (+ 141us) write_op.cc:270] Start()
0619 06:29:46.098821 (+ 17us) write_op.cc:276] Timestamp: P: 1781850572291472 usec, L: 0
0619 06:29:46.100961 (+ 2140us) write_op.cc:270] Start()
0619 06:29:46.100984 (+ 23us) write_op.cc:276] Timestamp: P: 1781850572302379 usec, L: 0
0619 06:29:46.101134 (+ 150us) write_op.cc:270] Start()
0619 06:29:46.101156 (+ 22us) write_op.cc:276] Timestamp: P: 1781850572303950 usec, L: 0
0619 06:29:46.105939 (+ 4783us) write_op.cc:270] Start()
0619 06:29:46.105962 (+ 23us) write_op.cc:276] Timestamp: P: 1781850572319643 usec, L: 0
0619 06:29:46.119081 (+ 13119us) write_op.cc:270] Start()
0619 06:29:46.125672 (+ 6591us) write_op.cc:276] Timestamp: P: 1781850572321987 usec, L: 0
0619 06:29:46.140953 (+ 15281us) write_op.cc:270] Start()
0619 06:29:46.140988 (+ 35us) write_op.cc:276] Timestamp: P: 1781850572339310 usec, L: 0
0619 06:29:46.146169 (+ 5181us) write_op.cc:270] Start()
0619 06:29:46.146194 (+ 25us) write_op.cc:276] Timestamp: P: 1781850572346896 usec, L: 0
0619 06:29:46.147352 (+ 1158us) write_op.cc:270] Start()
0619 06:29:46.147370 (+ 18us) write_op.cc:276] Timestamp: P: 1781850572370709 usec, L: 0
0619 06:29:46.150025 (+ 2655us) write_op.cc:270] Start()
0619 06:29:46.150052 (+ 27us) write_op.cc:276] Timestamp: P: 1781850572391121 usec, L: 0
0619 06:29:46.150588 (+ 536us) write_op.cc:270] Start()
0619 06:29:46.150620 (+ 32us) write_op.cc:276] Timestamp: P: 1781850572399125 usec, L: 0
0619 06:29:46.150803 (+ 183us) write_op.cc:270] Start()
0619 06:29:46.150826 (+ 23us) write_op.cc:276] Timestamp: P: 1781850572401772 usec, L: 0
0619 06:29:46.151002 (+ 176us) write_op.cc:270] Start()
0619 06:29:46.151023 (+ 21us) write_op.cc:276] Timestamp: P: 1781850572413154 usec, L: 0
0619 06:29:46.151148 (+ 125us) write_op.cc:270] Start()
0619 06:29:46.151170 (+ 22us) write_op.cc:276] Timestamp: P: 1781850572432652 usec, L: 0
0619 06:29:46.151380 (+ 210us) write_op.cc:270] Start()
0619 06:29:46.151447 (+ 67us) write_op.cc:276] Timestamp: P: 1781850572445064 usec, L: 0
0619 06:29:46.151604 (+ 157us) write_op.cc:270] Start()
0619 06:29:46.151627 (+ 23us) write_op.cc:276] Timestamp: P: 1781850572458872 usec, L: 0
0619 06:29:46.151786 (+ 159us) write_op.cc:270] Start()
0619 06:29:46.151809 (+ 23us) write_op.cc:276] Timestamp: P: 1781850572466967 usec, L: 0
0619 06:29:46.151969 (+ 160us) write_op.cc:270] Start()
0619 06:29:46.151995 (+ 26us) write_op.cc:276] Timestamp: P: 1781850572473427 usec, L: 0
0619 06:29:46.154152 (+ 2157us) write_op.cc:270] Start()
0619 06:29:46.154170 (+ 18us) write_op.cc:276] Timestamp: P: 1781850572496542 usec, L: 0
0619 06:29:46.155502 (+ 1332us) write_op.cc:270] Start()
0619 06:29:46.155527 (+ 25us) write_op.cc:276] Timestamp: P: 1781850572515735 usec, L: 0
0619 06:29:46.155686 (+ 159us) write_op.cc:270] Start()
0619 06:29:46.155708 (+ 22us) write_op.cc:276] Timestamp: P: 1781850572520311 usec, L: 0
0619 06:29:46.155862 (+ 154us) write_op.cc:270] Start()
0619 06:29:46.155886 (+ 24us) write_op.cc:276] Timestamp: P: 1781850572523430 usec, L: 0
0619 06:29:46.156027 (+ 141us) write_op.cc:270] Start()
0619 06:29:46.156047 (+ 20us) write_op.cc:276] Timestamp: P: 1781850572539918 usec, L: 0
0619 06:29:46.164350 (+ 8303us) write_op.cc:270] Start()
0619 06:29:46.169791 (+ 5441us) write_op.cc:276] Timestamp: P: 1781850572549399 usec, L: 0
0619 06:29:46.169992 (+ 201us) write_op.cc:270] Start()
0619 06:29:46.170011 (+ 19us) write_op.cc:276] Timestamp: P: 1781850572576402 usec, L: 0
0619 06:29:46.170130 (+ 119us) write_op.cc:270] Start()
0619 06:29:46.170144 (+ 14us) write_op.cc:276] Timestamp: P: 1781850572584319 usec, L: 0
0619 06:29:46.173728 (+ 3584us) write_op.cc:270] Start()
0619 06:29:46.173747 (+ 19us) write_op.cc:276] Timestamp: P: 1781850572585392 usec, L: 0
0619 06:29:46.175212 (+ 1465us) write_op.cc:270] Start()
0619 06:29:46.175231 (+ 19us) write_op.cc:276] Timestamp: P: 1781850572589826 usec, L: 0
0619 06:29:46.175395 (+ 164us) write_op.cc:270] Start()
0619 06:29:46.175413 (+ 18us) write_op.cc:276] Timestamp: P: 1781850572607747 usec, L: 0
0619 06:29:46.175559 (+ 146us) write_op.cc:270] Start()
0619 06:29:46.175582 (+ 23us) write_op.cc:276] Timestamp: P: 1781850572640224 usec, L: 0
0619 06:29:46.175723 (+ 141us) write_op.cc:270] Start()
0619 06:29:46.175741 (+ 18us) write_op.cc:276] Timestamp: P: 1781850572641018 usec, L: 0
0619 06:29:46.178995 (+ 3254us) write_op.cc:270] Start()
0619 06:29:46.179018 (+ 23us) write_op.cc:276] Timestamp: P: 1781850572642130 usec, L: 0
0619 06:29:46.179158 (+ 140us) write_op.cc:270] Start()
0619 06:29:46.179177 (+ 19us) write_op.cc:276] Timestamp: P: 1781850572663334 usec, L: 0
0619 06:29:46.179315 (+ 138us) write_op.cc:270] Start()
0619 06:29:46.205596 (+ 26281us) write_op.cc:276] Timestamp: P: 1781850572700517 usec, L: 0
0619 06:29:46.211101 (+ 5505us) write_op.cc:270] Start()
0619 06:29:46.211125 (+ 24us) write_op.cc:276] Timestamp: P: 1781850572701972 usec, L: 0
0619 06:29:46.211810 (+ 685us) write_op.cc:270] Start()
0619 06:29:46.211834 (+ 24us) write_op.cc:276] Timestamp: P: 1781850572719678 usec, L: 0
0619 06:29:46.212523 (+ 689us) write_op.cc:270] Start()
0619 06:29:46.212543 (+ 20us) write_op.cc:276] Timestamp: P: 1781850572727992 usec, L: 0
0619 06:29:46.212824 (+ 281us) write_op.cc:270] Start()
0619 06:29:46.212846 (+ 22us) write_op.cc:276] Timestamp: P: 1781850572741616 usec, L: 0
0619 06:29:46.212995 (+ 149us) write_op.cc:270] Start()
0619 06:29:46.213014 (+ 19us) write_op.cc:276] Timestamp: P: 1781850572743370 usec, L: 0
0619 06:29:46.218577 (+ 5563us) write_op.cc:270] Start()
0619 06:29:46.218603 (+ 26us) write_op.cc:276] Timestamp: P: 1781850572760063 usec, L: 0
0619 06:29:46.219041 (+ 438us) write_op.cc:270] Start()
0619 06:29:46.219065 (+ 24us) write_op.cc:276] Timestamp: P: 1781850572772185 usec, L: 0
0619 06:29:46.219207 (+ 142us) write_op.cc:270] Start()
0619 06:29:46.219229 (+ 22us) write_op.cc:276] Timestamp: P: 1781850572783120 usec, L: 0
0619 06:29:46.219383 (+ 154us) write_op.cc:270] Start()
0619 06:29:46.219403 (+ 20us) write_op.cc:276] Timestamp: P: 1781850572791594 usec, L: 0
0619 06:29:46.219528 (+ 125us) write_op.cc:270] Start()
0619 06:29:46.219548 (+ 20us) write_op.cc:276] Timestamp: P: 1781850572803600 usec, L: 0
0619 06:29:46.224168 (+ 4620us) write_op.cc:270] Start()
0619 06:29:46.224188 (+ 20us) write_op.cc:276] Timestamp: P: 1781850572817764 usec, L: 0
0619 06:29:46.224363 (+ 175us) write_op.cc:270] Start()
0619 06:29:46.224383 (+ 20us) write_op.cc:276] Timestamp: P: 1781850572846377 usec, L: 0
0619 06:29:46.224533 (+ 150us) write_op.cc:270] Start()
0619 06:29:46.224552 (+ 19us) write_op.cc:276] Timestamp: P: 1781850572847676 usec, L: 0
0619 06:29:46.227339 (+ 2787us) write_op.cc:270] Start()
0619 06:29:46.227364 (+ 25us) write_op.cc:276] Timestamp: P: 1781850572887558 usec, L: 0
0619 06:29:46.233265 (+ 5901us) write_op.cc:270] Start()
0619 06:29:46.233284 (+ 19us) write_op.cc:276] Timestamp: P: 1781850572888294 usec, L: 0
0619 06:29:46.234051 (+ 767us) write_op.cc:270] Start()
0619 06:29:46.234076 (+ 25us) write_op.cc:276] Timestamp: P: 1781850572905863 usec, L: 0
0619 06:29:46.240648 (+ 6572us) write_op.cc:270] Start()
0619 06:29:46.240672 (+ 24us) write_op.cc:276] Timestamp: P: 1781850572914149 usec, L: 0
0619 06:29:46.243253 (+ 2581us) write_op.cc:270] Start()
0619 06:29:46.243285 (+ 32us) write_op.cc:276] Timestamp: P: 1781850572917843 usec, L: 0
0619 06:29:46.243405 (+ 120us) write_op.cc:270] Start()
0619 06:29:46.243423 (+ 18us) write_op.cc:276] Timestamp: P: 1781850572928460 usec, L: 0
0619 06:29:46.243549 (+ 126us) write_op.cc:270] Start()
0619 06:29:46.243564 (+ 15us) write_op.cc:276] Timestamp: P: 1781850572955969 usec, L: 0
0619 06:29:46.243703 (+ 139us) write_op.cc:270] Start()
0619 06:29:46.243722 (+ 19us) write_op.cc:276] Timestamp: P: 1781850572962119 usec, L: 0
0619 06:29:46.244339 (+ 617us) write_op.cc:270] Start()
0619 06:29:46.244364 (+ 25us) write_op.cc:276] Timestamp: P: 1781850572972132 usec, L: 0
0619 06:29:46.245362 (+ 998us) write_op.cc:270] Start()
0619 06:29:46.245381 (+ 19us) write_op.cc:276] Timestamp: P: 1781850572973167 usec, L: 0
0619 06:29:46.245514 (+ 133us) write_op.cc:270] Start()
0619 06:29:46.245533 (+ 19us) write_op.cc:276] Timestamp: P: 1781850573003239 usec, L: 0
0619 06:29:46.245680 (+ 147us) write_op.cc:270] Start()
0619 06:29:46.245700 (+ 20us) write_op.cc:276] Timestamp: P: 1781850573016737 usec, L: 0
0619 06:29:46.245884 (+ 184us) write_op.cc:270] Start()
0619 06:29:46.245902 (+ 18us) write_op.cc:276] Timestamp: P: 1781850573021335 usec, L: 0
0619 06:29:46.246053 (+ 151us) write_op.cc:270] Start()
0619 06:29:46.246071 (+ 18us) write_op.cc:276] Timestamp: P: 1781850573030120 usec, L: 0
0619 06:29:46.246253 (+ 182us) write_op.cc:270] Start()
0619 06:29:46.246275 (+ 22us) write_op.cc:276] Timestamp: P: 1781850573040453 usec, L: 0
0619 06:29:46.246421 (+ 146us) write_op.cc:270] Start()
0619 06:29:46.246439 (+ 18us) write_op.cc:276] Timestamp: P: 1781850573071704 usec, L: 0
0619 06:29:46.246595 (+ 156us) write_op.cc:270] Start()
0619 06:29:46.246614 (+ 19us) write_op.cc:276] Timestamp: P: 1781850573081913 usec, L: 0
0619 06:29:46.249830 (+ 3216us) write_op.cc:270] Start()
0619 06:29:46.249850 (+ 20us) write_op.cc:276] Timestamp: P: 1781850573085972 usec, L: 0
0619 06:29:46.249974 (+ 124us) write_op.cc:270] Start()
0619 06:29:46.249992 (+ 18us) write_op.cc:276] Timestamp: P: 1781850573088213 usec, L: 0
0619 06:29:46.253892 (+ 3900us) write_op.cc:270] Start()
0619 06:29:46.253918 (+ 26us) write_op.cc:276] Timestamp: P: 1781850573119671 usec, L: 0
0619 06:29:46.263440 (+ 9522us) write_op.cc:270] Start()
0619 06:29:46.263456 (+ 16us) write_op.cc:276] Timestamp: P: 1781850573146820 usec, L: 0
0619 06:29:46.272818 (+ 9362us) write_op.cc:270] Start()
0619 06:29:46.272834 (+ 16us) write_op.cc:276] Timestamp: P: 1781850573153692 usec, L: 0
0619 06:29:46.273481 (+ 647us) write_op.cc:270] Start()
0619 06:29:46.273503 (+ 22us) write_op.cc:276] Timestamp: P: 1781850573173468 usec, L: 0
0619 06:29:46.274646 (+ 1143us) write_op.cc:270] Start()
0619 06:29:46.274673 (+ 27us) write_op.cc:276] Timestamp: P: 1781850573184483 usec, L: 0
0619 06:29:46.276355 (+ 1682us) write_op.cc:270] Start()
0619 06:29:46.276375 (+ 20us) write_op.cc:276] Timestamp: P: 1781850573186611 usec, L: 0
0619 06:29:46.277763 (+ 1388us) write_op.cc:270] Start()
0619 06:29:46.277783 (+ 20us) write_op.cc:276] Timestamp: P: 1781850573205662 usec, L: 0
0619 06:29:46.278778 (+ 995us) write_op.cc:270] Start()
0619 06:29:46.278803 (+ 25us) write_op.cc:276] Timestamp: P: 1781850573208825 usec, L: 0
0619 06:29:46.281494 (+ 2691us) write_op.cc:270] Start()
0619 06:29:46.281517 (+ 23us) write_op.cc:276] Timestamp: P: 1781850573222063 usec, L: 0
0619 06:29:46.282947 (+ 1430us) write_op.cc:270] Start()
0619 06:29:46.282967 (+ 20us) write_op.cc:276] Timestamp: P: 1781850573237476 usec, L: 0
0619 06:29:46.291248 (+ 8281us) write_op.cc:270] Start()
0619 06:29:46.291275 (+ 27us) write_op.cc:276] Timestamp: P: 1781850573256331 usec, L: 0
0619 06:29:46.294198 (+ 2923us) write_op.cc:270] Start()
0619 06:29:46.294216 (+ 18us) write_op.cc:276] Timestamp: P: 1781850573281848 usec, L: 0
0619 06:29:46.311645 (+ 17429us) write_op.cc:270] Start()
0619 06:29:46.311689 (+ 44us) write_op.cc:276] Timestamp: P: 1781850573291895 usec, L: 0
0619 06:29:46.312903 (+ 1214us) write_op.cc:270] Start()
0619 06:29:46.312919 (+ 16us) write_op.cc:276] Timestamp: P: 1781850573301058 usec, L: 0
0619 06:29:46.331331 (+ 18412us) write_op.cc:270] Start()
0619 06:29:46.331359 (+ 28us) write_op.cc:276] Timestamp: P: 1781850573307102 usec, L: 0
0619 06:29:46.331516 (+ 157us) write_op.cc:270] Start()
0619 06:29:46.331559 (+ 43us) write_op.cc:276] Timestamp: P: 1781850573327764 usec, L: 0
0619 06:29:46.341568 (+ 10009us) write_op.cc:270] Start()
0619 06:29:46.341590 (+ 22us) write_op.cc:276] Timestamp: P: 1781850573347368 usec, L: 0
0619 06:29:46.362198 (+ 20608us) write_op.cc:270] Start()
0619 06:29:46.362225 (+ 27us) write_op.cc:276] Timestamp: P: 1781850573353724 usec, L: 0
0619 06:29:46.362397 (+ 172us) write_op.cc:270] Start()
0619 06:29:46.362419 (+ 22us) write_op.cc:276] Timestamp: P: 1781850573374260 usec, L: 0
0619 06:29:46.362583 (+ 164us) write_op.cc:270] Start()
0619 06:29:46.362627 (+ 44us) write_op.cc:276] Timestamp: P: 1781850573378709 usec, L: 0
0619 06:29:46.362773 (+ 146us) write_op.cc:270] Start()
0619 06:29:46.362796 (+ 23us) write_op.cc:276] Timestamp: P: 1781850573380656 usec, L: 0
0619 06:29:46.362954 (+ 158us) write_op.cc:270] Start()
0619 06:29:46.362979 (+ 25us) write_op.cc:276] Timestamp: P: 1781850573415298 usec, L: 0
0619 06:29:46.371399 (+ 8420us) write_op.cc:270] Start()
0619 06:29:46.371423 (+ 24us) write_op.cc:276] Timestamp: P: 1781850573417131 usec, L: 0
0619 06:29:46.371558 (+ 135us) write_op.cc:270] Start()
0619 06:29:46.371578 (+ 20us) write_op.cc:276] Timestamp: P: 1781850573424059 usec, L: 0
0619 06:29:46.371716 (+ 138us) write_op.cc:270] Start()
0619 06:29:46.371736 (+ 20us) write_op.cc:276] Timestamp: P: 1781850573431539 usec, L: 0
0619 06:29:46.371920 (+ 184us) write_op.cc:270] Start()
0619 06:29:46.371942 (+ 22us) write_op.cc:276] Timestamp: P: 1781850573455063 usec, L: 0
0619 06:29:46.372085 (+ 143us) write_op.cc:270] Start()
0619 06:29:46.372110 (+ 25us) write_op.cc:276] Timestamp: P: 1781850573476169 usec, L: 0
0619 06:29:46.372252 (+ 142us) write_op.cc:270] Start()
0619 06:29:46.372290 (+ 38us) write_op.cc:276] Timestamp: P: 1781850573477442 usec, L: 0
0619 06:29:46.372433 (+ 143us) write_op.cc:270] Start()
0619 06:29:46.372454 (+ 21us) write_op.cc:276] Timestamp: P: 1781850573484973 usec, L: 0
0619 06:29:46.372598 (+ 144us) write_op.cc:270] Start()
0619 06:29:46.372618 (+ 20us) write_op.cc:276] Timestamp: P: 1781850573509979 usec, L: 0
0619 06:29:46.372757 (+ 139us) write_op.cc:270] Start()
0619 06:29:46.372789 (+ 32us) write_op.cc:276] Timestamp: P: 1781850573510793 usec, L: 0
0619 06:29:46.372915 (+ 126us) write_op.cc:270] Start()
0619 06:29:46.372934 (+ 19us) write_op.cc:276] Timestamp: P: 1781850573512578 usec, L: 0
0619 06:29:46.373067 (+ 133us) write_op.cc:270] Start()
0619 06:29:46.373086 (+ 19us) write_op.cc:276] Timestamp: P: 1781850573516288 usec, L: 0
0619 06:29:46.373227 (+ 141us) write_op.cc:270] Start()
0619 06:29:46.373246 (+ 19us) write_op.cc:276] Timestamp: P: 1781850573555567 usec, L: 0
0619 06:29:46.373434 (+ 188us) write_op.cc:270] Start()
0619 06:29:46.373455 (+ 21us) write_op.cc:276] Timestamp: P: 1781850573560690 usec, L: 0
0619 06:29:46.373592 (+ 137us) write_op.cc:270] Start()
0619 06:29:46.373614 (+ 22us) write_op.cc:276] Timestamp: P: 1781850573562737 usec, L: 0
0619 06:29:46.373742 (+ 128us) write_op.cc:270] Start()
0619 06:29:46.373762 (+ 20us) write_op.cc:276] Timestamp: P: 1781850573575609 usec, L: 0
0619 06:29:46.373907 (+ 145us) write_op.cc:270] Start()
0619 06:29:46.373925 (+ 18us) write_op.cc:276] Timestamp: P: 1781850573609041 usec, L: 0
0619 06:29:46.374059 (+ 134us) write_op.cc:270] Start()
0619 06:29:46.374078 (+ 19us) write_op.cc:276] Timestamp: P: 1781850573626084 usec, L: 0
0619 06:29:46.374204 (+ 126us) write_op.cc:270] Start()
0619 06:29:46.379018 (+ 4814us) write_op.cc:276] Timestamp: P: 1781850573634573 usec, L: 0
0619 06:29:46.379167 (+ 149us) write_op.cc:270] Start()
0619 06:29:46.379192 (+ 25us) write_op.cc:276] Timestamp: P: 1781850573636808 usec, L: 0
0619 06:29:46.385881 (+ 6689us) write_op.cc:270] Start()
0619 06:29:46.385907 (+ 26us) write_op.cc:276] Timestamp: P: 1781850573659451 usec, L: 0
0619 06:29:46.386061 (+ 154us) write_op.cc:270] Start()
0619 06:29:46.386082 (+ 21us) write_op.cc:276] Timestamp: P: 1781850573663653 usec, L: 0
0619 06:29:46.386236 (+ 154us) write_op.cc:270] Start()
0619 06:29:46.386257 (+ 21us) write_op.cc:276] Timestamp: P: 1781850573678281 usec, L: 0
0619 06:29:46.386460 (+ 203us) write_op.cc:270] Start()
0619 06:29:46.386582 (+ 122us) write_op.cc:276] Timestamp: P: 1781850573709910 usec, L: 0
0619 06:29:46.386733 (+ 151us) write_op.cc:270] Start()
0619 06:29:46.386755 (+ 22us) write_op.cc:276] Timestamp: P: 1781850573712164 usec, L: 0
0619 06:29:46.386899 (+ 144us) write_op.cc:270] Start()
0619 06:29:46.386920 (+ 21us) write_op.cc:276] Timestamp: P: 1781850573736588 usec, L: 0
0619 06:29:46.387055 (+ 135us) write_op.cc:270] Start()
0619 06:29:46.387079 (+ 24us) write_op.cc:276] Timestamp: P: 1781850573741701 usec, L: 0
0619 06:29:46.387233 (+ 154us) write_op.cc:270] Start()
0619 06:29:46.387254 (+ 21us) write_op.cc:276] Timestamp: P: 1781850573743527 usec, L: 0
0619 06:29:46.387432 (+ 178us) write_op.cc:270] Start()
0619 06:29:46.387455 (+ 23us) write_op.cc:276] Timestamp: P: 1781850573762966 usec, L: 0
0619 06:29:46.387584 (+ 129us) write_op.cc:270] Start()
0619 06:29:46.387605 (+ 21us) write_op.cc:276] Timestamp: P: 1781850573780571 usec, L: 0
0619 06:29:46.387741 (+ 136us) write_op.cc:270] Start()
0619 06:29:46.387761 (+ 20us) write_op.cc:276] Timestamp: P: 1781850573804767 usec, L: 0
0619 06:29:46.387911 (+ 150us) write_op.cc:270] Start()
0619 06:29:46.387932 (+ 21us) write_op.cc:276] Timestamp: P: 1781850573807899 usec, L: 0
0619 06:29:46.388062 (+ 130us) write_op.cc:270] Start()
0619 06:29:46.388082 (+ 20us) write_op.cc:276] Timestamp: P: 1781850573817463 usec, L: 0
0619 06:29:46.388230 (+ 148us) write_op.cc:270] Start()
0619 06:29:46.388249 (+ 19us) write_op.cc:276] Timestamp: P: 1781850573829262 usec, L: 0
0619 06:29:46.388404 (+ 155us) write_op.cc:270] Start()
0619 06:29:46.388513 (+ 109us) write_op.cc:276] Timestamp: P: 1781850573840419 usec, L: 0
0619 06:29:46.388693 (+ 180us) write_op.cc:270] Start()
0619 06:29:46.388713 (+ 20us) write_op.cc:276] Timestamp: P: 1781850573854785 usec, L: 0
0619 06:29:46.388896 (+ 183us) write_op.cc:270] Start()
0619 06:29:46.388917 (+ 21us) write_op.cc:276] Timestamp: P: 1781850573867410 usec, L: 0
0619 06:29:46.389059 (+ 142us) write_op.cc:270] Start()
0619 06:29:46.389080 (+ 21us) write_op.cc:276] Timestamp: P: 1781850573883794 usec, L: 0
0619 06:29:46.389215 (+ 135us) write_op.cc:270] Start()
0619 06:29:46.389235 (+ 20us) write_op.cc:276] Timestamp: P: 1781850573896230 usec, L: 0
0619 06:29:46.396992 (+ 7757us) write_op.cc:270] Start()
0619 06:29:46.397015 (+ 23us) write_op.cc:276] Timestamp: P: 1781850573907932 usec, L: 0
0619 06:29:46.438777 (+ 41762us) write_op.cc:270] Start()
0619 06:29:46.438909 (+ 132us) write_op.cc:276] Timestamp: P: 1781850573908528 usec, L: 0
0619 06:29:46.463061 (+ 24152us) write_op.cc:270] Start()
0619 06:29:46.463082 (+ 21us) write_op.cc:276] Timestamp: P: 1781850573929922 usec, L: 0
0619 06:29:46.463209 (+ 127us) write_op.cc:270] Start()
0619 06:29:46.463228 (+ 19us) write_op.cc:276] Timestamp: P: 1781850573960456 usec, L: 0
0619 06:29:46.464087 (+ 859us) write_op.cc:270] Start()
0619 06:29:46.464112 (+ 25us) write_op.cc:276] Timestamp: P: 1781850573961648 usec, L: 0
0619 06:29:46.464732 (+ 620us) write_op.cc:270] Start()
0619 06:29:46.464756 (+ 24us) write_op.cc:276] Timestamp: P: 1781850573966502 usec, L: 0
0619 06:29:46.464937 (+ 181us) write_op.cc:270] Start()
0619 06:29:46.464961 (+ 24us) write_op.cc:276] Timestamp: P: 1781850573971406 usec, L: 0
0619 06:29:46.470312 (+ 5351us) write_op.cc:270] Start()
0619 06:29:46.470340 (+ 28us) write_op.cc:276] Timestamp: P: 1781850573988712 usec, L: 0
0619 06:29:46.470508 (+ 168us) write_op.cc:270] Start()
0619 06:29:46.470531 (+ 23us) write_op.cc:276] Timestamp: P: 1781850574021401 usec, L: 0
0619 06:29:46.470664 (+ 133us) write_op.cc:270] Start()
0619 06:29:46.470684 (+ 20us) write_op.cc:276] Timestamp: P: 1781850574022918 usec, L: 0
0619 06:29:46.470838 (+ 154us) write_op.cc:270] Start()
0619 06:29:46.470852 (+ 14us) write_op.cc:276] Timestamp: P: 1781850574027442 usec, L: 0
0619 06:29:46.475621 (+ 4769us) write_op.cc:270] Start()
0619 06:29:46.475644 (+ 23us) write_op.cc:276] Timestamp: P: 1781850574030786 usec, L: 0
0619 06:29:46.475821 (+ 177us) write_op.cc:270] Start()
0619 06:29:46.475963 (+ 142us) write_op.cc:276] Timestamp: P: 1781850574077390 usec, L: 0
0619 06:29:46.476126 (+ 163us) write_op.cc:270] Start()
0619 06:29:46.476149 (+ 23us) write_op.cc:276] Timestamp: P: 1781850574083482 usec, L: 0
0619 06:29:46.476269 (+ 120us) write_op.cc:270] Start()
0619 06:29:46.476287 (+ 18us) write_op.cc:276] Timestamp: P: 1781850574084650 usec, L: 0
0619 06:29:46.480606 (+ 4319us) write_op.cc:270] Start()
0619 06:29:46.480629 (+ 23us) write_op.cc:276] Timestamp: P: 1781850574101104 usec, L: 0
0619 06:29:46.481035 (+ 406us) write_op.cc:270] Start()
0619 06:29:46.481050 (+ 15us) write_op.cc:276] Timestamp: P: 1781850574125170 usec, L: 0
0619 06:29:46.481582 (+ 532us) write_op.cc:270] Start()
0619 06:29:46.481601 (+ 19us) write_op.cc:276] Timestamp: P: 1781850574134333 usec, L: 0
0619 06:29:46.481741 (+ 140us) write_op.cc:270] Start()
0619 06:29:46.481762 (+ 21us) write_op.cc:276] Timestamp: P: 1781850574135124 usec, L: 0
0619 06:29:46.481915 (+ 153us) write_op.cc:270] Start()
0619 06:29:46.481934 (+ 19us) write_op.cc:276] Timestamp: P: 1781850574135947 usec, L: 0
0619 06:29:46.482060 (+ 126us) write_op.cc:270] Start()
0619 06:29:46.482078 (+ 18us) write_op.cc:276] Timestamp: P: 1781850574171727 usec, L: 0
0619 06:29:46.482214 (+ 136us) write_op.cc:270] Start()
0619 06:29:46.482234 (+ 20us) write_op.cc:276] Timestamp: P: 1781850574186487 usec, L: 0
0619 06:29:46.482366 (+ 132us) write_op.cc:270] Start()
0619 06:29:46.482386 (+ 20us) write_op.cc:276] Timestamp: P: 1781850574188477 usec, L: 0
0619 06:29:46.482542 (+ 156us) write_op.cc:270] Start()
0619 06:29:46.482564 (+ 22us) write_op.cc:276] Timestamp: P: 1781850574191494 usec, L: 0
0619 06:29:46.482708 (+ 144us) write_op.cc:270] Start()
0619 06:29:46.482725 (+ 17us) write_op.cc:276] Timestamp: P: 1781850574233450 usec, L: 0
0619 06:29:46.488494 (+ 5769us) write_op.cc:270] Start()
0619 06:29:46.488518 (+ 24us) write_op.cc:276] Timestamp: P: 178185
I20260619 06:29:48.561976 8554 rpcz_store.cc:276] 0619 06:29:45.540489 (+ 0us) service_pool.cc:170] Inserting onto call queue
0619 06:29:45.540543 (+ 54us) service_pool.cc:227] Handling call
0619 06:29:45.644522 (+103979us) raft_consensus.cc:1457] Updating replica for 776 ops
0619 06:29:45.756196 (+111674us) raft_consensus.cc:1520] Early marking committed up to index 0
0619 06:29:45.756201 (+ 5us) raft_consensus.cc:1525] Triggering prepare for 776 ops
0619 06:29:45.756287 (+ 86us) write_op.cc:270] Start()
0619 06:29:45.756314 (+ 27us) write_op.cc:276] Timestamp: P: 1781850571582883 usec, L: 0
0619 06:29:45.758451 (+ 2137us) write_op.cc:270] Start()
0619 06:29:45.758475 (+ 24us) write_op.cc:276] Timestamp: P: 1781850571603525 usec, L: 0
0619 06:29:45.758717 (+ 242us) write_op.cc:270] Start()
0619 06:29:45.758751 (+ 34us) write_op.cc:276] Timestamp: P: 1781850571610627 usec, L: 0
0619 06:29:45.770084 (+ 11333us) write_op.cc:270] Start()
0619 06:29:45.770110 (+ 26us) write_op.cc:276] Timestamp: P: 1781850571611260 usec, L: 0
0619 06:29:45.770998 (+ 888us) write_op.cc:270] Start()
0619 06:29:45.771020 (+ 22us) write_op.cc:276] Timestamp: P: 1781850571642545 usec, L: 0
0619 06:29:45.771476 (+ 456us) write_op.cc:270] Start()
0619 06:29:45.771503 (+ 27us) write_op.cc:276] Timestamp: P: 1781850571651441 usec, L: 0
0619 06:29:45.771964 (+ 461us) write_op.cc:270] Start()
0619 06:29:45.772012 (+ 48us) write_op.cc:276] Timestamp: P: 1781850571653772 usec, L: 0
0619 06:29:45.773601 (+ 1589us) write_op.cc:270] Start()
0619 06:29:45.773625 (+ 24us) write_op.cc:276] Timestamp: P: 1781850571660769 usec, L: 0
0619 06:29:45.773802 (+ 177us) write_op.cc:270] Start()
0619 06:29:45.774209 (+ 407us) write_op.cc:276] Timestamp: P: 1781850571703291 usec, L: 0
0619 06:29:45.774438 (+ 229us) write_op.cc:270] Start()
0619 06:29:45.774460 (+ 22us) write_op.cc:276] Timestamp: P: 1781850571714958 usec, L: 0
0619 06:29:45.775019 (+ 559us) write_op.cc:270] Start()
0619 06:29:45.775042 (+ 23us) write_op.cc:276] Timestamp: P: 1781850571724496 usec, L: 0
0619 06:29:45.778841 (+ 3799us) write_op.cc:270] Start()
0619 06:29:45.778871 (+ 30us) write_op.cc:276] Timestamp: P: 1781850571750257 usec, L: 0
0619 06:29:45.779038 (+ 167us) write_op.cc:270] Start()
0619 06:29:45.779061 (+ 23us) write_op.cc:276] Timestamp: P: 1781850571782678 usec, L: 0
0619 06:29:45.779224 (+ 163us) write_op.cc:270] Start()
0619 06:29:45.779247 (+ 23us) write_op.cc:276] Timestamp: P: 1781850571784668 usec, L: 0
0619 06:29:45.779391 (+ 144us) write_op.cc:270] Start()
0619 06:29:45.779411 (+ 20us) write_op.cc:276] Timestamp: P: 1781850571785476 usec, L: 0
0619 06:29:45.779544 (+ 133us) write_op.cc:270] Start()
0619 06:29:45.779565 (+ 21us) write_op.cc:276] Timestamp: P: 1781850571812009 usec, L: 0
0619 06:29:45.779751 (+ 186us) write_op.cc:270] Start()
0619 06:29:45.779781 (+ 30us) write_op.cc:276] Timestamp: P: 1781850571823672 usec, L: 0
0619 06:29:45.779926 (+ 145us) write_op.cc:270] Start()
0619 06:29:45.779946 (+ 20us) write_op.cc:276] Timestamp: P: 1781850571834851 usec, L: 0
0619 06:29:45.780072 (+ 126us) write_op.cc:270] Start()
0619 06:29:45.780090 (+ 18us) write_op.cc:276] Timestamp: P: 1781850571844324 usec, L: 0
0619 06:29:45.780325 (+ 235us) write_op.cc:270] Start()
0619 06:29:45.780357 (+ 32us) write_op.cc:276] Timestamp: P: 1781850571860124 usec, L: 0
0619 06:29:45.780549 (+ 192us) write_op.cc:270] Start()
0619 06:29:45.780571 (+ 22us) write_op.cc:276] Timestamp: P: 1781850571874065 usec, L: 0
0619 06:29:45.780781 (+ 210us) write_op.cc:270] Start()
0619 06:29:45.780805 (+ 24us) write_op.cc:276] Timestamp: P: 1781850571883696 usec, L: 0
0619 06:29:45.780967 (+ 162us) write_op.cc:270] Start()
0619 06:29:45.780989 (+ 22us) write_op.cc:276] Timestamp: P: 1781850571901240 usec, L: 0
0619 06:29:45.781147 (+ 158us) write_op.cc:270] Start()
0619 06:29:45.781169 (+ 22us) write_op.cc:276] Timestamp: P: 1781850571909889 usec, L: 0
0619 06:29:45.781349 (+ 180us) write_op.cc:270] Start()
0619 06:29:45.781373 (+ 24us) write_op.cc:276] Timestamp: P: 1781850571919542 usec, L: 0
0619 06:29:45.781563 (+ 190us) write_op.cc:270] Start()
0619 06:29:45.781585 (+ 22us) write_op.cc:276] Timestamp: P: 1781850571923621 usec, L: 0
0619 06:29:45.781740 (+ 155us) write_op.cc:270] Start()
0619 06:29:45.781766 (+ 26us) write_op.cc:276] Timestamp: P: 1781850571952111 usec, L: 0
0619 06:29:45.781924 (+ 158us) write_op.cc:270] Start()
0619 06:29:45.781945 (+ 21us) write_op.cc:276] Timestamp: P: 1781850571968823 usec, L: 0
0619 06:29:45.782079 (+ 134us) write_op.cc:270] Start()
0619 06:29:45.782098 (+ 19us) write_op.cc:276] Timestamp: P: 1781850571973255 usec, L: 0
0619 06:29:45.782233 (+ 135us) write_op.cc:270] Start()
0619 06:29:45.782254 (+ 21us) write_op.cc:276] Timestamp: P: 1781850571977822 usec, L: 0
0619 06:29:45.782387 (+ 133us) write_op.cc:270] Start()
0619 06:29:45.782406 (+ 19us) write_op.cc:276] Timestamp: P: 1781850572003744 usec, L: 0
0619 06:29:45.819909 (+ 37503us) write_op.cc:270] Start()
0619 06:29:45.819929 (+ 20us) write_op.cc:276] Timestamp: P: 1781850572041181 usec, L: 0
0619 06:29:45.820631 (+ 702us) write_op.cc:270] Start()
0619 06:29:45.820658 (+ 27us) write_op.cc:276] Timestamp: P: 1781850572054699 usec, L: 0
0619 06:29:45.820866 (+ 208us) write_op.cc:270] Start()
0619 06:29:45.820890 (+ 24us) write_op.cc:276] Timestamp: P: 1781850572075979 usec, L: 0
0619 06:29:45.833251 (+ 12361us) write_op.cc:270] Start()
0619 06:29:45.833280 (+ 29us) write_op.cc:276] Timestamp: P: 1781850572078452 usec, L: 0
0619 06:29:45.837515 (+ 4235us) write_op.cc:270] Start()
0619 06:29:45.837541 (+ 26us) write_op.cc:276] Timestamp: P: 1781850572079097 usec, L: 0
0619 06:29:45.837693 (+ 152us) write_op.cc:270] Start()
0619 06:29:45.838458 (+ 765us) write_op.cc:276] Timestamp: P: 1781850572079781 usec, L: 0
0619 06:29:45.845644 (+ 7186us) write_op.cc:270] Start()
0619 06:29:45.845666 (+ 22us) write_op.cc:276] Timestamp: P: 1781850572118796 usec, L: 0
0619 06:29:45.845779 (+ 113us) write_op.cc:270] Start()
0619 06:29:45.845792 (+ 13us) write_op.cc:276] Timestamp: P: 1781850572132925 usec, L: 0
0619 06:29:45.851341 (+ 5549us) write_op.cc:270] Start()
0619 06:29:45.851364 (+ 23us) write_op.cc:276] Timestamp: P: 1781850572154185 usec, L: 0
0619 06:29:45.852796 (+ 1432us) write_op.cc:270] Start()
0619 06:29:45.852827 (+ 31us) write_op.cc:276] Timestamp: P: 1781850572167335 usec, L: 0
0619 06:29:45.917002 (+ 64175us) write_op.cc:270] Start()
0619 06:29:45.917034 (+ 32us) write_op.cc:276] Timestamp: P: 1781850572185959 usec, L: 0
0619 06:29:45.917271 (+ 237us) write_op.cc:270] Start()
0619 06:29:45.917297 (+ 26us) write_op.cc:276] Timestamp: P: 1781850572186631 usec, L: 0
0619 06:29:45.917444 (+ 147us) write_op.cc:270] Start()
0619 06:29:45.917467 (+ 23us) write_op.cc:276] Timestamp: P: 1781850572218990 usec, L: 0
0619 06:29:45.917614 (+ 147us) write_op.cc:270] Start()
0619 06:29:45.917634 (+ 20us) write_op.cc:276] Timestamp: P: 1781850572222485 usec, L: 0
0619 06:29:45.917793 (+ 159us) write_op.cc:270] Start()
0619 06:29:45.917819 (+ 26us) write_op.cc:276] Timestamp: P: 1781850572238441 usec, L: 0
0619 06:29:45.917989 (+ 170us) write_op.cc:270] Start()
0619 06:29:45.918011 (+ 22us) write_op.cc:276] Timestamp: P: 1781850572264421 usec, L: 0
0619 06:29:45.918178 (+ 167us) write_op.cc:270] Start()
0619 06:29:45.918204 (+ 26us) write_op.cc:276] Timestamp: P: 1781850572265807 usec, L: 0
0619 06:29:45.927241 (+ 9037us) write_op.cc:270] Start()
0619 06:29:45.927270 (+ 29us) write_op.cc:276] Timestamp: P: 1781850572288439 usec, L: 0
0619 06:29:45.927985 (+ 715us) write_op.cc:270] Start()
0619 06:29:45.937628 (+ 9643us) write_op.cc:276] Timestamp: P: 1781850572304185 usec, L: 0
0619 06:29:45.988613 (+ 50985us) write_op.cc:270] Start()
0619 06:29:45.988638 (+ 25us) write_op.cc:276] Timestamp: P: 1781850572306949 usec, L: 0
0619 06:29:45.995558 (+ 6920us) write_op.cc:270] Start()
0619 06:29:46.000576 (+ 5018us) write_op.cc:276] Timestamp: P: 1781850572334150 usec, L: 0
0619 06:29:46.002360 (+ 1784us) write_op.cc:270] Start()
0619 06:29:46.002381 (+ 21us) write_op.cc:276] Timestamp: P: 1781850572340365 usec, L: 0
0619 06:29:46.006099 (+ 3718us) write_op.cc:270] Start()
0619 06:29:46.006116 (+ 17us) write_op.cc:276] Timestamp: P: 1781850572346419 usec, L: 0
0619 06:29:46.006215 (+ 99us) write_op.cc:270] Start()
0619 06:29:46.006227 (+ 12us) write_op.cc:276] Timestamp: P: 1781850572349033 usec, L: 0
0619 06:29:46.008426 (+ 2199us) write_op.cc:270] Start()
0619 06:29:46.008465 (+ 39us) write_op.cc:276] Timestamp: P: 1781850572377193 usec, L: 0
0619 06:29:46.009476 (+ 1011us) write_op.cc:270] Start()
0619 06:29:46.009496 (+ 20us) write_op.cc:276] Timestamp: P: 1781850572400969 usec, L: 0
0619 06:29:46.010172 (+ 676us) write_op.cc:270] Start()
0619 06:29:46.010186 (+ 14us) write_op.cc:276] Timestamp: P: 1781850572401630 usec, L: 0
0619 06:29:46.044998 (+ 34812us) write_op.cc:270] Start()
0619 06:29:46.045034 (+ 36us) write_op.cc:276] Timestamp: P: 1781850572419376 usec, L: 0
0619 06:29:46.045219 (+ 185us) write_op.cc:270] Start()
0619 06:29:46.045280 (+ 61us) write_op.cc:276] Timestamp: P: 1781850572421435 usec, L: 0
0619 06:29:46.045448 (+ 168us) write_op.cc:270] Start()
0619 06:29:46.045467 (+ 19us) write_op.cc:276] Timestamp: P: 1781850572442655 usec, L: 0
0619 06:29:46.045597 (+ 130us) write_op.cc:270] Start()
0619 06:29:46.045616 (+ 19us) write_op.cc:276] Timestamp: P: 1781850572450862 usec, L: 0
0619 06:29:46.045739 (+ 123us) write_op.cc:270] Start()
0619 06:29:46.045757 (+ 18us) write_op.cc:276] Timestamp: P: 1781850572465512 usec, L: 0
0619 06:29:46.053621 (+ 7864us) write_op.cc:270] Start()
0619 06:29:46.053651 (+ 30us) write_op.cc:276] Timestamp: P: 1781850572467894 usec, L: 0
0619 06:29:46.072246 (+ 18595us) write_op.cc:270] Start()
0619 06:29:46.072293 (+ 47us) write_op.cc:276] Timestamp: P: 1781850572477609 usec, L: 0
0619 06:29:46.075746 (+ 3453us) write_op.cc:270] Start()
0619 06:29:46.077380 (+ 1634us) write_op.cc:276] Timestamp: P: 1781850572492357 usec, L: 0
0619 06:29:46.079347 (+ 1967us) write_op.cc:270] Start()
0619 06:29:46.079373 (+ 26us) write_op.cc:276] Timestamp: P: 1781850572517529 usec, L: 0
0619 06:29:46.079530 (+ 157us) write_op.cc:270] Start()
0619 06:29:46.079561 (+ 31us) write_op.cc:276] Timestamp: P: 1781850572525523 usec, L: 0
0619 06:29:46.083080 (+ 3519us) write_op.cc:270] Start()
0619 06:29:46.083104 (+ 24us) write_op.cc:276] Timestamp: P: 1781850572528424 usec, L: 0
0619 06:29:46.083295 (+ 191us) write_op.cc:270] Start()
0619 06:29:46.083342 (+ 47us) write_op.cc:276] Timestamp: P: 1781850572542765 usec, L: 0
0619 06:29:46.083480 (+ 138us) write_op.cc:270] Start()
0619 06:29:46.083501 (+ 21us) write_op.cc:276] Timestamp: P: 1781850572550157 usec, L: 0
0619 06:29:46.083653 (+ 152us) write_op.cc:270] Start()
0619 06:29:46.083670 (+ 17us) write_op.cc:276] Timestamp: P: 1781850572576513 usec, L: 0
0619 06:29:46.085065 (+ 1395us) write_op.cc:270] Start()
0619 06:29:46.085088 (+ 23us) write_op.cc:276] Timestamp: P: 1781850572588138 usec, L: 0
0619 06:29:46.085230 (+ 142us) write_op.cc:270] Start()
0619 06:29:46.085249 (+ 19us) write_op.cc:276] Timestamp: P: 1781850572593870 usec, L: 0
0619 06:29:46.085403 (+ 154us) write_op.cc:270] Start()
0619 06:29:46.085424 (+ 21us) write_op.cc:276] Timestamp: P: 1781850572598586 usec, L: 0
0619 06:29:46.085550 (+ 126us) write_op.cc:270] Start()
0619 06:29:46.085567 (+ 17us) write_op.cc:276] Timestamp: P: 1781850572611612 usec, L: 0
0619 06:29:46.086976 (+ 1409us) write_op.cc:270] Start()
0619 06:29:46.086996 (+ 20us) write_op.cc:276] Timestamp: P: 1781850572643870 usec, L: 0
0619 06:29:46.087159 (+ 163us) write_op.cc:270] Start()
0619 06:29:46.087185 (+ 26us) write_op.cc:276] Timestamp: P: 1781850572645246 usec, L: 0
0619 06:29:46.087385 (+ 200us) write_op.cc:270] Start()
0619 06:29:46.087435 (+ 50us) write_op.cc:276] Timestamp: P: 1781850572671585 usec, L: 0
0619 06:29:46.087605 (+ 170us) write_op.cc:270] Start()
0619 06:29:46.087627 (+ 22us) write_op.cc:276] Timestamp: P: 1781850572676143 usec, L: 0
0619 06:29:46.087785 (+ 158us) write_op.cc:270] Start()
0619 06:29:46.087810 (+ 25us) write_op.cc:276] Timestamp: P: 1781850572703997 usec, L: 0
0619 06:29:46.087964 (+ 154us) write_op.cc:270] Start()
0619 06:29:46.087986 (+ 22us) write_op.cc:276] Timestamp: P: 1781850572706456 usec, L: 0
0619 06:29:46.088128 (+ 142us) write_op.cc:270] Start()
0619 06:29:46.088148 (+ 20us) write_op.cc:276] Timestamp: P: 1781850572707109 usec, L: 0
0619 06:29:46.088304 (+ 156us) write_op.cc:270] Start()
0619 06:29:46.088326 (+ 22us) write_op.cc:276] Timestamp: P: 1781850572722964 usec, L: 0
0619 06:29:46.090471 (+ 2145us) write_op.cc:270] Start()
0619 06:29:46.090523 (+ 52us) write_op.cc:276] Timestamp: P: 1781850572745940 usec, L: 0
0619 06:29:46.090742 (+ 219us) write_op.cc:270] Start()
0619 06:29:46.090780 (+ 38us) write_op.cc:276] Timestamp: P: 1781850572748813 usec, L: 0
0619 06:29:46.099462 (+ 8682us) write_op.cc:270] Start()
0619 06:29:46.099487 (+ 25us) write_op.cc:276] Timestamp: P: 1781850572765825 usec, L: 0
0619 06:29:46.100583 (+ 1096us) write_op.cc:270] Start()
0619 06:29:46.100629 (+ 46us) write_op.cc:276] Timestamp: P: 1781850572777702 usec, L: 0
0619 06:29:46.100796 (+ 167us) write_op.cc:270] Start()
0619 06:29:46.100821 (+ 25us) write_op.cc:276] Timestamp: P: 1781850572794220 usec, L: 0
0619 06:29:46.107747 (+ 6926us) write_op.cc:270] Start()
0619 06:29:46.107778 (+ 31us) write_op.cc:276] Timestamp: P: 1781850572794895 usec, L: 0
0619 06:29:46.115483 (+ 7705us) write_op.cc:270] Start()
0619 06:29:46.115507 (+ 24us) write_op.cc:276] Timestamp: P: 1781850572819725 usec, L: 0
0619 06:29:46.115642 (+ 135us) write_op.cc:270] Start()
0619 06:29:46.115672 (+ 30us) write_op.cc:276] Timestamp: P: 1781850572820735 usec, L: 0
0619 06:29:46.115813 (+ 141us) write_op.cc:270] Start()
0619 06:29:46.115835 (+ 22us) write_op.cc:276] Timestamp: P: 1781850572852105 usec, L: 0
0619 06:29:46.115971 (+ 136us) write_op.cc:270] Start()
0619 06:29:46.115994 (+ 23us) write_op.cc:276] Timestamp: P: 1781850572857748 usec, L: 0
0619 06:29:46.116139 (+ 145us) write_op.cc:270] Start()
0619 06:29:46.116160 (+ 21us) write_op.cc:276] Timestamp: P: 1781850572859390 usec, L: 0
0619 06:29:46.116347 (+ 187us) write_op.cc:270] Start()
0619 06:29:46.116371 (+ 24us) write_op.cc:276] Timestamp: P: 1781850572861481 usec, L: 0
0619 06:29:46.116510 (+ 139us) write_op.cc:270] Start()
0619 06:29:46.116530 (+ 20us) write_op.cc:276] Timestamp: P: 1781850572903595 usec, L: 0
0619 06:29:46.116685 (+ 155us) write_op.cc:270] Start()
0619 06:29:46.116705 (+ 20us) write_op.cc:276] Timestamp: P: 1781850572913576 usec, L: 0
0619 06:29:46.116905 (+ 200us) write_op.cc:270] Start()
0619 06:29:46.116950 (+ 45us) write_op.cc:276] Timestamp: P: 1781850572929911 usec, L: 0
0619 06:29:46.117126 (+ 176us) write_op.cc:270] Start()
0619 06:29:46.117151 (+ 25us) write_op.cc:276] Timestamp: P: 1781850572941185 usec, L: 0
0619 06:29:46.117327 (+ 176us) write_op.cc:270] Start()
0619 06:29:46.117351 (+ 24us) write_op.cc:276] Timestamp: P: 1781850572952695 usec, L: 0
0619 06:29:46.134774 (+ 17423us) write_op.cc:270] Start()
0619 06:29:46.134809 (+ 35us) write_op.cc:276] Timestamp: P: 1781850572963957 usec, L: 0
0619 06:29:46.134972 (+ 163us) write_op.cc:270] Start()
0619 06:29:46.134998 (+ 26us) write_op.cc:276] Timestamp: P: 1781850572967131 usec, L: 0
0619 06:29:46.135162 (+ 164us) write_op.cc:270] Start()
0619 06:29:46.135187 (+ 25us) write_op.cc:276] Timestamp: P: 1781850572988885 usec, L: 0
0619 06:29:46.135384 (+ 197us) write_op.cc:270] Start()
0619 06:29:46.135406 (+ 22us) write_op.cc:276] Timestamp: P: 1781850573002667 usec, L: 0
0619 06:29:46.147563 (+ 12157us) write_op.cc:270] Start()
0619 06:29:46.147585 (+ 22us) write_op.cc:276] Timestamp: P: 1781850573023300 usec, L: 0
0619 06:29:46.149005 (+ 1420us) write_op.cc:270] Start()
0619 06:29:46.149023 (+ 18us) write_op.cc:276] Timestamp: P: 1781850573026904 usec, L: 0
0619 06:29:46.149778 (+ 755us) write_op.cc:270] Start()
0619 06:29:46.149796 (+ 18us) write_op.cc:276] Timestamp: P: 1781850573032816 usec, L: 0
0619 06:29:46.156513 (+ 6717us) write_op.cc:270] Start()
0619 06:29:46.156538 (+ 25us) write_op.cc:276] Timestamp: P: 1781850573052614 usec, L: 0
0619 06:29:46.156696 (+ 158us) write_op.cc:270] Start()
0619 06:29:46.156717 (+ 21us) write_op.cc:276] Timestamp: P: 1781850573074701 usec, L: 0
0619 06:29:46.158686 (+ 1969us) write_op.cc:270] Start()
0619 06:29:46.158710 (+ 24us) write_op.cc:276] Timestamp: P: 1781850573089690 usec, L: 0
0619 06:29:46.161641 (+ 2931us) write_op.cc:270] Start()
0619 06:29:46.161664 (+ 23us) write_op.cc:276] Timestamp: P: 1781850573090773 usec, L: 0
0619 06:29:46.161829 (+ 165us) write_op.cc:270] Start()
0619 06:29:46.161850 (+ 21us) write_op.cc:276] Timestamp: P: 1781850573092851 usec, L: 0
0619 06:29:46.166830 (+ 4980us) write_op.cc:270] Start()
0619 06:29:46.166854 (+ 24us) write_op.cc:276] Timestamp: P: 1781850573127670 usec, L: 0
0619 06:29:46.167011 (+ 157us) write_op.cc:270] Start()
0619 06:29:46.167033 (+ 22us) write_op.cc:276] Timestamp: P: 1781850573144144 usec, L: 0
0619 06:29:46.170522 (+ 3489us) write_op.cc:270] Start()
0619 06:29:46.170548 (+ 26us) write_op.cc:276] Timestamp: P: 1781850573153881 usec, L: 0
0619 06:29:46.170687 (+ 139us) write_op.cc:270] Start()
0619 06:29:46.170706 (+ 19us) write_op.cc:276] Timestamp: P: 1781850573168973 usec, L: 0
0619 06:29:46.170865 (+ 159us) write_op.cc:270] Start()
0619 06:29:46.170884 (+ 19us) write_op.cc:276] Timestamp: P: 1781850573177790 usec, L: 0
0619 06:29:46.171017 (+ 133us) write_op.cc:270] Start()
0619 06:29:46.171036 (+ 19us) write_op.cc:276] Timestamp: P: 1781850573200780 usec, L: 0
0619 06:29:46.173923 (+ 2887us) write_op.cc:270] Start()
0619 06:29:46.173943 (+ 20us) write_op.cc:276] Timestamp: P: 1781850573213106 usec, L: 0
0619 06:29:46.174932 (+ 989us) write_op.cc:270] Start()
0619 06:29:46.174952 (+ 20us) write_op.cc:276] Timestamp: P: 1781850573213843 usec, L: 0
0619 06:29:46.180616 (+ 5664us) write_op.cc:270] Start()
0619 06:29:46.180640 (+ 24us) write_op.cc:276] Timestamp: P: 1781850573222738 usec, L: 0
0619 06:29:46.200531 (+ 19891us) write_op.cc:270] Start()
0619 06:29:46.206369 (+ 5838us) write_op.cc:276] Timestamp: P: 1781850573249837 usec, L: 0
0619 06:29:46.212310 (+ 5941us) spinlock_profiling.cc:243] Waited 1.91 ms on lock 0x60f00000add8. stack: 00007ff742e9066e 00007ff742e90430 00007ff741f175ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007ff74b98dc35 00007ff74e404e49 00007ff74e3ac5c9 00007ff74e3a9ee9 00007ff751f50a6c 00007ff74c83bfa6 00007ff74c83bcd5 00007ff7499cc9be 00007ff7499cb79e 00007ff7499d1b25
0619 06:29:46.212379 (+ 69us) write_op.cc:270] Start()
0619 06:29:46.212398 (+ 19us) write_op.cc:276] Timestamp: P: 1781850573261767 usec, L: 0
0619 06:29:46.212841 (+ 443us) write_op.cc:270] Start()
0619 06:29:46.212857 (+ 16us) write_op.cc:276] Timestamp: P: 1781850573281912 usec, L: 0
0619 06:29:46.213082 (+ 225us) write_op.cc:270] Start()
0619 06:29:46.213108 (+ 26us) write_op.cc:276] Timestamp: P: 1781850573287389 usec, L: 0
0619 06:29:46.216691 (+ 3583us) write_op.cc:270] Start()
0619 06:29:46.216710 (+ 19us) write_op.cc:276] Timestamp: P: 1781850573288038 usec, L: 0
0619 06:29:46.220910 (+ 4200us) write_op.cc:270] Start()
0619 06:29:46.220961 (+ 51us) write_op.cc:276] Timestamp: P: 1781850573301144 usec, L: 0
0619 06:29:46.232994 (+ 12033us) write_op.cc:270] Start()
0619 06:29:46.233020 (+ 26us) write_op.cc:276] Timestamp: P: 1781850573329711 usec, L: 0
0619 06:29:46.233337 (+ 317us) write_op.cc:270] Start()
0619 06:29:46.233356 (+ 19us) write_op.cc:276] Timestamp: P: 1781850573341819 usec, L: 0
0619 06:29:46.244605 (+ 11249us) write_op.cc:270] Start()
0619 06:29:46.244633 (+ 28us) write_op.cc:276] Timestamp: P: 1781850573355779 usec, L: 0
0619 06:29:46.246942 (+ 2309us) write_op.cc:270] Start()
0619 06:29:46.246965 (+ 23us) write_op.cc:276] Timestamp: P: 1781850573374117 usec, L: 0
0619 06:29:46.247103 (+ 138us) write_op.cc:270] Start()
0619 06:29:46.247126 (+ 23us) write_op.cc:276] Timestamp: P: 1781850573382190 usec, L: 0
0619 06:29:46.249856 (+ 2730us) write_op.cc:270] Start()
0619 06:29:46.249873 (+ 17us) write_op.cc:276] Timestamp: P: 1781850573383668 usec, L: 0
0619 06:29:46.253344 (+ 3471us) write_op.cc:270] Start()
0619 06:29:46.253365 (+ 21us) write_op.cc:276] Timestamp: P: 1781850573418282 usec, L: 0
0619 06:29:46.261186 (+ 7821us) write_op.cc:270] Start()
0619 06:29:46.261210 (+ 24us) write_op.cc:276] Timestamp: P: 1781850573420528 usec, L: 0
0619 06:29:46.261369 (+ 159us) write_op.cc:270] Start()
0619 06:29:46.261392 (+ 23us) write_op.cc:276] Timestamp: P: 1781850573426266 usec, L: 0
0619 06:29:46.261540 (+ 148us) write_op.cc:270] Start()
0619 06:29:46.261562 (+ 22us) write_op.cc:276] Timestamp: P: 1781850573435104 usec, L: 0
0619 06:29:46.261694 (+ 132us) write_op.cc:270] Start()
0619 06:29:46.262841 (+ 1147us) write_op.cc:276] Timestamp: P: 1781850573462674 usec, L: 0
0619 06:29:46.263678 (+ 837us) write_op.cc:270] Start()
0619 06:29:46.263696 (+ 18us) write_op.cc:276] Timestamp: P: 1781850573476728 usec, L: 0
0619 06:29:46.263838 (+ 142us) write_op.cc:270] Start()
0619 06:29:46.266893 (+ 3055us) write_op.cc:276] Timestamp: P: 1781850573477491 usec, L: 0
0619 06:29:46.269161 (+ 2268us) write_op.cc:270] Start()
0619 06:29:46.269181 (+ 20us) write_op.cc:276] Timestamp: P: 1781850573485362 usec, L: 0
0619 06:29:46.269304 (+ 123us) write_op.cc:270] Start()
0619 06:29:46.269323 (+ 19us) write_op.cc:276] Timestamp: P: 1781850573516270 usec, L: 0
0619 06:29:46.271980 (+ 2657us) write_op.cc:270] Start()
0619 06:29:46.272011 (+ 31us) write_op.cc:276] Timestamp: P: 1781850573517598 usec, L: 0
0619 06:29:46.272161 (+ 150us) write_op.cc:270] Start()
0619 06:29:46.272181 (+ 20us) write_op.cc:276] Timestamp: P: 1781850573518446 usec, L: 0
0619 06:29:46.278374 (+ 6193us) write_op.cc:270] Start()
0619 06:29:46.278396 (+ 22us) write_op.cc:276] Timestamp: P: 1781850573525555 usec, L: 0
0619 06:29:46.279108 (+ 712us) write_op.cc:270] Start()
0619 06:29:46.279131 (+ 23us) write_op.cc:276] Timestamp: P: 1781850573555913 usec, L: 0
0619 06:29:46.280779 (+ 1648us) write_op.cc:270] Start()
0619 06:29:46.280802 (+ 23us) write_op.cc:276] Timestamp: P: 1781850573567666 usec, L: 0
0619 06:29:46.282464 (+ 1662us) write_op.cc:270] Start()
0619 06:29:46.282618 (+ 154us) write_op.cc:276] Timestamp: P: 1781850573568284 usec, L: 0
0619 06:29:46.282751 (+ 133us) write_op.cc:270] Start()
0619 06:29:46.282779 (+ 28us) write_op.cc:276] Timestamp: P: 1781850573575883 usec, L: 0
0619 06:29:46.287867 (+ 5088us) write_op.cc:270] Start()
0619 06:29:46.290724 (+ 2857us) write_op.cc:276] Timestamp: P: 1781850573610154 usec, L: 0
0619 06:29:46.290877 (+ 153us) write_op.cc:270] Start()
0619 06:29:46.290900 (+ 23us) write_op.cc:276] Timestamp: P: 1781850573627612 usec, L: 0
0619 06:29:46.292148 (+ 1248us) write_op.cc:270] Start()
0619 06:29:46.292173 (+ 25us) write_op.cc:276] Timestamp: P: 1781850573631299 usec, L: 0
0619 06:29:46.292414 (+ 241us) write_op.cc:270] Start()
0619 06:29:46.292437 (+ 23us) write_op.cc:276] Timestamp: P: 1781850573641756 usec, L: 0
0619 06:29:46.292613 (+ 176us) write_op.cc:270] Start()
0619 06:29:46.292633 (+ 20us) write_op.cc:276] Timestamp: P: 1781850573672739 usec, L: 0
0619 06:29:46.292777 (+ 144us) write_op.cc:270] Start()
0619 06:29:46.292797 (+ 20us) write_op.cc:276] Timestamp: P: 1781850573679614 usec, L: 0
0619 06:29:46.292919 (+ 122us) write_op.cc:270] Start()
0619 06:29:46.292936 (+ 17us) write_op.cc:276] Timestamp: P: 1781850573680250 usec, L: 0
0619 06:29:46.293062 (+ 126us) write_op.cc:270] Start()
0619 06:29:46.293079 (+ 17us) write_op.cc:276] Timestamp: P: 1781850573714133 usec, L: 0
0619 06:29:46.293205 (+ 126us) write_op.cc:270] Start()
0619 06:29:46.293224 (+ 19us) write_op.cc:276] Timestamp: P: 1781850573715934 usec, L: 0
0619 06:29:46.293375 (+ 151us) write_op.cc:270] Start()
0619 06:29:46.293393 (+ 18us) write_op.cc:276] Timestamp: P: 1781850573738891 usec, L: 0
0619 06:29:46.293542 (+ 149us) write_op.cc:270] Start()
0619 06:29:46.293563 (+ 21us) write_op.cc:276] Timestamp: P: 1781850573746360 usec, L: 0
0619 06:29:46.293683 (+ 120us) write_op.cc:270] Start()
0619 06:29:46.293707 (+ 24us) write_op.cc:276] Timestamp: P: 1781850573746963 usec, L: 0
0619 06:29:46.293874 (+ 167us) write_op.cc:270] Start()
0619 06:29:46.293893 (+ 19us) write_op.cc:276] Timestamp: P: 1781850573770124 usec, L: 0
0619 06:29:46.308385 (+ 14492us) write_op.cc:270] Start()
0619 06:29:46.308410 (+ 25us) write_op.cc:276] Timestamp: P: 1781850573784207 usec, L: 0
0619 06:29:46.308587 (+ 177us) write_op.cc:270] Start()
0619 06:29:46.309416 (+ 829us) write_op.cc:276] Timestamp: P: 1781850573802158 usec, L: 0
0619 06:29:46.363592 (+ 54176us) write_op.cc:270] Start()
0619 06:29:46.363619 (+ 27us) write_op.cc:276] Timestamp: P: 1781850573809571 usec, L: 0
0619 06:29:46.370056 (+ 6437us) write_op.cc:270] Start()
0619 06:29:46.370265 (+ 209us) write_op.cc:276] Timestamp: P: 1781850573824458 usec, L: 0
0619 06:29:46.418647 (+ 48382us) write_op.cc:270] Start()
0619 06:29:46.418667 (+ 20us) write_op.cc:276] Timestamp: P: 1781850573840615 usec, L: 0
0619 06:29:46.418817 (+ 150us) write_op.cc:270] Start()
0619 06:29:46.418837 (+ 20us) write_op.cc:276] Timestamp: P: 1781850573841335 usec, L: 0
0619 06:29:46.418967 (+ 130us) write_op.cc:270] Start()
0619 06:29:46.418986 (+ 19us) write_op.cc:276] Timestamp: P: 1781850573858516 usec, L: 0
0619 06:29:46.419121 (+ 135us) write_op.cc:270] Start()
0619 06:29:46.419142 (+ 21us) write_op.cc:276] Timestamp: P: 1781850573874291 usec, L: 0
0619 06:29:46.419292 (+ 150us) write_op.cc:270] Start()
0619 06:29:46.419313 (+ 21us) write_op.cc:276] Timestamp: P: 1781850573888238 usec, L: 0
0619 06:29:46.419458 (+ 145us) write_op.cc:270] Start()
0619 06:29:46.419479 (+ 21us) write_op.cc:276] Timestamp: P: 1781850573910003 usec, L: 0
0619 06:29:46.419618 (+ 139us) write_op.cc:270] Start()
0619 06:29:46.419642 (+ 24us) write_op.cc:276] Timestamp: P: 1781850573911058 usec, L: 0
0619 06:29:46.419817 (+ 175us) write_op.cc:270] Start()
0619 06:29:46.419840 (+ 23us) write_op.cc:276] Timestamp: P: 1781850573911849 usec, L: 0
0619 06:29:46.419974 (+ 134us) write_op.cc:270] Start()
0619 06:29:46.419993 (+ 19us) write_op.cc:276] Timestamp: P: 1781850573936489 usec, L: 0
0619 06:29:46.432347 (+ 12354us) write_op.cc:270] Start()
0619 06:29:46.432367 (+ 20us) write_op.cc:276] Timestamp: P: 1781850573955636 usec, L: 0
0619 06:29:46.432767 (+ 400us) write_op.cc:270] Start()
0619 06:29:46.432791 (+ 24us) write_op.cc:276] Timestamp: P: 1781850573956884 usec, L: 0
0619 06:29:46.432976 (+ 185us) write_op.cc:270] Start()
0619 06:29:46.432996 (+ 20us) write_op.cc:276] Timestamp: P: 1781850573981744 usec, L: 0
0619 06:29:46.433130 (+ 134us) write_op.cc:270] Start()
0619 06:29:46.433147 (+ 17us) write_op.cc:276] Timestamp: P: 1781850573983474 usec, L: 0
0619 06:29:46.433294 (+ 147us) write_op.cc:270] Start()
0619 06:29:46.433313 (+ 19us) write_op.cc:276] Timestamp: P: 1781850573995068 usec, L: 0
0619 06:29:46.433484 (+ 171us) write_op.cc:270] Start()
0619 06:29:46.433502 (+ 18us) write_op.cc:276] Timestamp: P: 1781850574028044 usec, L: 0
0619 06:29:46.433645 (+ 143us) write_op.cc:270] Start()
0619 06:29:46.433664 (+ 19us) write_op.cc:276] Timestamp: P: 1781850574029994 usec, L: 0
0619 06:29:46.458672 (+ 25008us) write_op.cc:270] Start()
0619 06:29:46.458698 (+ 26us) write_op.cc:276] Timestamp: P: 1781850574034520 usec, L: 0
0619 06:29:46.458852 (+ 154us) write_op.cc:270] Start()
0619 06:29:46.458873 (+ 21us) write_op.cc:276] Timestamp: P: 1781850574063106 usec, L: 0
0619 06:29:46.459063 (+ 190us) write_op.cc:270] Start()
0619 06:29:46.459082 (+ 19us) write_op.cc:276] Timestamp: P: 1781850574078794 usec, L: 0
0619 06:29:46.459214 (+ 132us) write_op.cc:270] Start()
0619 06:29:46.459234 (+ 20us) write_op.cc:276] Timestamp: P: 1781850574079532 usec, L: 0
0619 06:29:46.459385 (+ 151us) write_op.cc:270] Start()
0619 06:29:46.459405 (+ 20us) write_op.cc:276] Timestamp: P: 1781850574082009 usec, L: 0
0619 06:29:46.459542 (+ 137us) write_op.cc:270] Start()
0619 06:29:46.459575 (+ 33us) write_op.cc:276] Timestamp: P: 1781850574104767 usec, L: 0
0619 06:29:46.459712 (+ 137us) write_op.cc:270] Start()
0619 06:29:46.459743 (+ 31us) write_op.cc:276] Timestamp: P: 1781850574138357 usec, L: 0
0619 06:29:46.459877 (+ 134us) write_op.cc:270] Start()
0619 06:29:46.459895 (+ 18us) write_op.cc:276] Timestamp: P: 1781850574139676 usec, L: 0
0619 06:29:46.460028 (+ 133us) write_op.cc:270] Start()
0619 06:29:46.460046 (+ 18us) write_op.cc:276] Timestamp: P: 1781850574140959 usec, L: 0
0619 06:29:46.460161 (+ 115us) write_op.cc:270] Start()
0619 06:29:46.460178 (+ 17us) write_op.cc:276] Timestamp: P: 1781850574143199 usec, L: 0
0619 06:29:46.460335 (+ 157us) write_op.cc:270] Start()
0619 06:29:46.460356 (+ 21us) write_op.cc:276] Timestamp: P: 1781850574178373 usec, L: 0
0619 06:29:46.460528 (+ 172us) write_op.cc:270] St
I20260619 06:29:51.285661 8657 raft_consensus.cc:482] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3fc4e58423894a27a7b94de5c6013cf1)
I20260619 06:29:51.298877 8658 raft_consensus.cc:482] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3fc4e58423894a27a7b94de5c6013cf1)
I20260619 06:29:51.350865 8658 raft_consensus.cc:504] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:51.407500 7993 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3e5e97eabdf42cf8e46ccb4b61c5fb7" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 945 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1" is_pre_election: true
I20260619 06:29:51.408646 7862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3e5e97eabdf42cf8e46ccb4b61c5fb7" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 945 } } ignore_live_leader: false dest_uuid: "996381a7495d4720a6f6be44a1d4781b" is_pre_election: true
I20260619 06:29:51.437240 8458 leader_election.cc:302] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b46f2dae92104884b86705d6bbc20003; no voters: 3fc4e58423894a27a7b94de5c6013cf1, 996381a7495d4720a6f6be44a1d4781b
I20260619 06:29:51.309897 8657 raft_consensus.cc:504] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:51.452176 8658 leader_election.cc:288] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063), 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499)
I20260619 06:29:51.464849 8658 raft_consensus.cc:2726] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 06:29:51.474875 8657 leader_election.cc:288] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063), 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499)
W20260619 06:29:51.515645 8458 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.96.2:37063, user_credentials={real_user=slave}} blocked reactor thread for 69796.8us
I20260619 06:29:51.517483 7862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cffdcc0e99c47aead56bbaea58d3e4d" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 937 } } ignore_live_leader: false dest_uuid: "996381a7495d4720a6f6be44a1d4781b" is_pre_election: true
I20260619 06:29:51.517933 7992 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cffdcc0e99c47aead56bbaea58d3e4d" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 937 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1" is_pre_election: true
I20260619 06:29:51.526834 8458 leader_election.cc:302] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b46f2dae92104884b86705d6bbc20003; no voters: 3fc4e58423894a27a7b94de5c6013cf1, 996381a7495d4720a6f6be44a1d4781b
I20260619 06:29:48.920910 8553 rpcz_store.cc:276] 0619 06:29:45.560490 (+ 0us) service_pool.cc:170] Inserting onto call queue
0619 06:29:45.560542 (+ 52us) service_pool.cc:227] Handling call
0619 06:29:45.710160 (+149618us) raft_consensus.cc:1457] Updating replica for 783 ops
0619 06:29:45.928653 (+218493us) raft_consensus.cc:1520] Early marking committed up to index 162
0619 06:29:46.002849 (+ 74196us) raft_consensus.cc:1525] Triggering prepare for 783 ops
0619 06:29:46.009841 (+ 6992us) write_op.cc:270] Start()
0619 06:29:46.009865 (+ 24us) write_op.cc:276] Timestamp: P: 1781850571583684 usec, L: 0
0619 06:29:46.148309 (+138444us) write_op.cc:270] Start()
0619 06:29:46.148333 (+ 24us) write_op.cc:276] Timestamp: P: 1781850571599542 usec, L: 0
0619 06:29:46.149551 (+ 1218us) write_op.cc:270] Start()
0619 06:29:46.149574 (+ 23us) write_op.cc:276] Timestamp: P: 1781850571602733 usec, L: 0
0619 06:29:46.152984 (+ 3410us) write_op.cc:270] Start()
0619 06:29:46.153005 (+ 21us) write_op.cc:276] Timestamp: P: 1781850571647572 usec, L: 0
0619 06:29:46.160245 (+ 7240us) write_op.cc:270] Start()
0619 06:29:46.160280 (+ 35us) write_op.cc:276] Timestamp: P: 1781850571651357 usec, L: 0
0619 06:29:46.160456 (+ 176us) write_op.cc:270] Start()
0619 06:29:46.160477 (+ 21us) write_op.cc:276] Timestamp: P: 1781850571652582 usec, L: 0
0619 06:29:46.160614 (+ 137us) write_op.cc:270] Start()
0619 06:29:46.160656 (+ 42us) write_op.cc:276] Timestamp: P: 1781850571662123 usec, L: 0
0619 06:29:46.160809 (+ 153us) write_op.cc:270] Start()
0619 06:29:46.160828 (+ 19us) write_op.cc:276] Timestamp: P: 1781850571698664 usec, L: 0
0619 06:29:46.160960 (+ 132us) write_op.cc:270] Start()
0619 06:29:46.160981 (+ 21us) write_op.cc:276] Timestamp: P: 1781850571715415 usec, L: 0
0619 06:29:46.161137 (+ 156us) write_op.cc:270] Start()
0619 06:29:46.161159 (+ 22us) write_op.cc:276] Timestamp: P: 1781850571722635 usec, L: 0
0619 06:29:46.161310 (+ 151us) write_op.cc:270] Start()
0619 06:29:46.161331 (+ 21us) write_op.cc:276] Timestamp: P: 1781850571753852 usec, L: 0
0619 06:29:46.161466 (+ 135us) write_op.cc:270] Start()
0619 06:29:46.161486 (+ 20us) write_op.cc:276] Timestamp: P: 1781850571774754 usec, L: 0
0619 06:29:46.163859 (+ 2373us) write_op.cc:270] Start()
0619 06:29:46.163879 (+ 20us) write_op.cc:276] Timestamp: P: 1781850571782731 usec, L: 0
0619 06:29:46.164044 (+ 165us) write_op.cc:270] Start()
0619 06:29:46.164064 (+ 20us) write_op.cc:276] Timestamp: P: 1781850571787252 usec, L: 0
0619 06:29:46.168549 (+ 4485us) write_op.cc:270] Start()
0619 06:29:46.168572 (+ 23us) write_op.cc:276] Timestamp: P: 1781850571812687 usec, L: 0
0619 06:29:46.174727 (+ 6155us) write_op.cc:270] Start()
0619 06:29:46.174753 (+ 26us) write_op.cc:276] Timestamp: P: 1781850571833814 usec, L: 0
0619 06:29:46.175108 (+ 355us) write_op.cc:270] Start()
0619 06:29:46.175150 (+ 42us) write_op.cc:276] Timestamp: P: 1781850571835106 usec, L: 0
0619 06:29:46.175321 (+ 171us) write_op.cc:270] Start()
0619 06:29:46.175347 (+ 26us) write_op.cc:276] Timestamp: P: 1781850571844349 usec, L: 0
0619 06:29:46.175473 (+ 126us) write_op.cc:270] Start()
0619 06:29:46.175491 (+ 18us) write_op.cc:276] Timestamp: P: 1781850571861085 usec, L: 0
0619 06:29:46.175622 (+ 131us) write_op.cc:270] Start()
0619 06:29:46.175639 (+ 17us) write_op.cc:276] Timestamp: P: 1781850571862344 usec, L: 0
0619 06:29:46.175766 (+ 127us) write_op.cc:270] Start()
0619 06:29:46.175782 (+ 16us) write_op.cc:276] Timestamp: P: 1781850571883687 usec, L: 0
0619 06:29:46.175937 (+ 155us) write_op.cc:270] Start()
0619 06:29:46.175957 (+ 20us) write_op.cc:276] Timestamp: P: 1781850571899733 usec, L: 0
0619 06:29:46.176095 (+ 138us) write_op.cc:270] Start()
0619 06:29:46.176125 (+ 30us) write_op.cc:276] Timestamp: P: 1781850571914336 usec, L: 0
0619 06:29:46.176237 (+ 112us) write_op.cc:270] Start()
0619 06:29:46.176271 (+ 34us) write_op.cc:276] Timestamp: P: 1781850571915400 usec, L: 0
0619 06:29:46.176488 (+ 217us) write_op.cc:270] Start()
0619 06:29:46.176513 (+ 25us) write_op.cc:276] Timestamp: P: 1781850571927216 usec, L: 0
0619 06:29:46.181785 (+ 5272us) write_op.cc:270] Start()
0619 06:29:46.181810 (+ 25us) write_op.cc:276] Timestamp: P: 1781850571953289 usec, L: 0
0619 06:29:46.181983 (+ 173us) write_op.cc:270] Start()
0619 06:29:46.182007 (+ 24us) write_op.cc:276] Timestamp: P: 1781850571968278 usec, L: 0
0619 06:29:46.183022 (+ 1015us) write_op.cc:270] Start()
0619 06:29:46.183051 (+ 29us) write_op.cc:276] Timestamp: P: 1781850571973788 usec, L: 0
0619 06:29:46.192189 (+ 9138us) write_op.cc:270] Start()
0619 06:29:46.192209 (+ 20us) write_op.cc:276] Timestamp: P: 1781850571979123 usec, L: 0
0619 06:29:46.198565 (+ 6356us) write_op.cc:270] Start()
0619 06:29:46.198591 (+ 26us) write_op.cc:276] Timestamp: P: 1781850572003144 usec, L: 0
0619 06:29:46.198765 (+ 174us) write_op.cc:270] Start()
0619 06:29:46.198787 (+ 22us) write_op.cc:276] Timestamp: P: 1781850572024501 usec, L: 0
0619 06:29:46.206584 (+ 7797us) write_op.cc:270] Start()
0619 06:29:46.206607 (+ 23us) write_op.cc:276] Timestamp: P: 1781850572052389 usec, L: 0
0619 06:29:46.212158 (+ 5551us) write_op.cc:270] Start()
0619 06:29:46.212183 (+ 25us) write_op.cc:276] Timestamp: P: 1781850572073138 usec, L: 0
0619 06:29:46.220237 (+ 8054us) write_op.cc:270] Start()
0619 06:29:46.220258 (+ 21us) write_op.cc:276] Timestamp: P: 1781850572076592 usec, L: 0
0619 06:29:46.225083 (+ 4825us) write_op.cc:270] Start()
0619 06:29:46.225105 (+ 22us) write_op.cc:276] Timestamp: P: 1781850572090928 usec, L: 0
0619 06:29:46.226639 (+ 1534us) write_op.cc:270] Start()
0619 06:29:46.226663 (+ 24us) write_op.cc:276] Timestamp: P: 1781850572092088 usec, L: 0
0619 06:29:46.226875 (+ 212us) write_op.cc:270] Start()
0619 06:29:46.235596 (+ 8721us) write_op.cc:276] Timestamp: P: 1781850572117006 usec, L: 0
0619 06:29:46.235772 (+ 176us) write_op.cc:270] Start()
0619 06:29:46.235794 (+ 22us) write_op.cc:276] Timestamp: P: 1781850572131822 usec, L: 0
0619 06:29:46.235982 (+ 188us) write_op.cc:270] Start()
0619 06:29:46.236011 (+ 29us) write_op.cc:276] Timestamp: P: 1781850572175358 usec, L: 0
0619 06:29:46.236145 (+ 134us) write_op.cc:270] Start()
0619 06:29:46.236164 (+ 19us) write_op.cc:276] Timestamp: P: 1781850572181607 usec, L: 0
0619 06:29:46.236302 (+ 138us) write_op.cc:270] Start()
0619 06:29:46.236323 (+ 21us) write_op.cc:276] Timestamp: P: 1781850572185320 usec, L: 0
0619 06:29:46.236440 (+ 117us) write_op.cc:270] Start()
0619 06:29:46.236457 (+ 17us) write_op.cc:276] Timestamp: P: 1781850572201404 usec, L: 0
0619 06:29:46.236589 (+ 132us) write_op.cc:270] Start()
0619 06:29:46.236610 (+ 21us) write_op.cc:276] Timestamp: P: 1781850572214952 usec, L: 0
0619 06:29:46.236749 (+ 139us) write_op.cc:270] Start()
0619 06:29:46.236770 (+ 21us) write_op.cc:276] Timestamp: P: 1781850572220198 usec, L: 0
0619 06:29:46.236911 (+ 141us) write_op.cc:270] Start()
0619 06:29:46.236932 (+ 21us) write_op.cc:276] Timestamp: P: 1781850572236989 usec, L: 0
0619 06:29:46.237088 (+ 156us) write_op.cc:270] Start()
0619 06:29:46.237107 (+ 19us) write_op.cc:276] Timestamp: P: 1781850572263783 usec, L: 0
0619 06:29:46.237239 (+ 132us) write_op.cc:270] Start()
0619 06:29:46.237258 (+ 19us) write_op.cc:276] Timestamp: P: 1781850572265310 usec, L: 0
0619 06:29:46.237417 (+ 159us) write_op.cc:270] Start()
0619 06:29:46.237435 (+ 18us) write_op.cc:276] Timestamp: P: 1781850572294612 usec, L: 0
0619 06:29:46.237570 (+ 135us) write_op.cc:270] Start()
0619 06:29:46.237589 (+ 19us) write_op.cc:276] Timestamp: P: 1781850572306231 usec, L: 0
0619 06:29:46.237745 (+ 156us) write_op.cc:270] Start()
0619 06:29:46.237765 (+ 20us) write_op.cc:276] Timestamp: P: 1781850572308391 usec, L: 0
0619 06:29:46.244723 (+ 6958us) write_op.cc:270] Start()
0619 06:29:46.244736 (+ 13us) write_op.cc:276] Timestamp: P: 1781850572326516 usec, L: 0
0619 06:29:46.247616 (+ 2880us) write_op.cc:270] Start()
0619 06:29:46.247640 (+ 24us) write_op.cc:276] Timestamp: P: 1781850572333108 usec, L: 0
0619 06:29:46.249681 (+ 2041us) write_op.cc:270] Start()
0619 06:29:46.249704 (+ 23us) write_op.cc:276] Timestamp: P: 1781850572346102 usec, L: 0
0619 06:29:46.253569 (+ 3865us) write_op.cc:270] Start()
0619 06:29:46.253587 (+ 18us) write_op.cc:276] Timestamp: P: 1781850572355775 usec, L: 0
0619 06:29:46.266752 (+ 13165us) write_op.cc:270] Start()
0619 06:29:46.266772 (+ 20us) write_op.cc:276] Timestamp: P: 1781850572377554 usec, L: 0
0619 06:29:46.267584 (+ 812us) write_op.cc:270] Start()
0619 06:29:46.267608 (+ 24us) write_op.cc:276] Timestamp: P: 1781850572391609 usec, L: 0
0619 06:29:46.267776 (+ 168us) write_op.cc:270] Start()
0619 06:29:46.267800 (+ 24us) write_op.cc:276] Timestamp: P: 1781850572419187 usec, L: 0
0619 06:29:46.267944 (+ 144us) write_op.cc:270] Start()
0619 06:29:46.267974 (+ 30us) write_op.cc:276] Timestamp: P: 1781850572420105 usec, L: 0
0619 06:29:46.268119 (+ 145us) write_op.cc:270] Start()
0619 06:29:46.268139 (+ 20us) write_op.cc:276] Timestamp: P: 1781850572420787 usec, L: 0
0619 06:29:46.268260 (+ 121us) write_op.cc:270] Start()
0619 06:29:46.268793 (+ 533us) write_op.cc:276] Timestamp: P: 1781850572442470 usec, L: 0
0619 06:29:46.268946 (+ 153us) write_op.cc:270] Start()
0619 06:29:46.269010 (+ 64us) write_op.cc:276] Timestamp: P: 1781850572443067 usec, L: 0
0619 06:29:46.277623 (+ 8613us) write_op.cc:270] Start()
0619 06:29:46.277645 (+ 22us) write_op.cc:276] Timestamp: P: 1781850572465504 usec, L: 0
0619 06:29:46.279108 (+ 1463us) write_op.cc:270] Start()
0619 06:29:46.279131 (+ 23us) write_op.cc:276] Timestamp: P: 1781850572475082 usec, L: 0
0619 06:29:46.283180 (+ 4049us) write_op.cc:270] Start()
0619 06:29:46.283219 (+ 39us) write_op.cc:276] Timestamp: P: 1781850572475727 usec, L: 0
0619 06:29:46.285977 (+ 2758us) write_op.cc:270] Start()
0619 06:29:46.286003 (+ 26us) write_op.cc:276] Timestamp: P: 1781850572498720 usec, L: 0
0619 06:29:46.286160 (+ 157us) write_op.cc:270] Start()
0619 06:29:46.286180 (+ 20us) write_op.cc:276] Timestamp: P: 1781850572516953 usec, L: 0
0619 06:29:46.286333 (+ 153us) write_op.cc:270] Start()
0619 06:29:46.286352 (+ 19us) write_op.cc:276] Timestamp: P: 1781850572525106 usec, L: 0
0619 06:29:46.286546 (+ 194us) write_op.cc:270] Start()
0619 06:29:46.286566 (+ 20us) write_op.cc:276] Timestamp: P: 1781850572526224 usec, L: 0
0619 06:29:46.286724 (+ 158us) write_op.cc:270] Start()
0619 06:29:46.286739 (+ 15us) write_op.cc:276] Timestamp: P: 1781850572543384 usec, L: 0
0619 06:29:46.286860 (+ 121us) write_op.cc:270] Start()
0619 06:29:46.286879 (+ 19us) write_op.cc:276] Timestamp: P: 1781850572555053 usec, L: 0
0619 06:29:46.291859 (+ 4980us) write_op.cc:270] Start()
0619 06:29:46.291881 (+ 22us) write_op.cc:276] Timestamp: P: 1781850572578634 usec, L: 0
0619 06:29:46.294040 (+ 2159us) write_op.cc:270] Start()
0619 06:29:46.294063 (+ 23us) write_op.cc:276] Timestamp: P: 1781850572588956 usec, L: 0
0619 06:29:46.306436 (+ 12373us) write_op.cc:270] Start()
0619 06:29:46.306463 (+ 27us) write_op.cc:276] Timestamp: P: 1781850572593909 usec, L: 0
0619 06:29:46.306662 (+ 199us) write_op.cc:270] Start()
0619 06:29:46.306686 (+ 24us) write_op.cc:276] Timestamp: P: 1781850572595276 usec, L: 0
0619 06:29:46.306828 (+ 142us) write_op.cc:270] Start()
0619 06:29:46.307869 (+ 1041us) write_op.cc:276] Timestamp: P: 1781850572613410 usec, L: 0
0619 06:29:46.308020 (+ 151us) write_op.cc:270] Start()
0619 06:29:46.308043 (+ 23us) write_op.cc:276] Timestamp: P: 1781850572644573 usec, L: 0
0619 06:29:46.308737 (+ 694us) write_op.cc:270] Start()
0619 06:29:46.308759 (+ 22us) write_op.cc:276] Timestamp: P: 1781850572645299 usec, L: 0
0619 06:29:46.308929 (+ 170us) write_op.cc:270] Start()
0619 06:29:46.308949 (+ 20us) write_op.cc:276] Timestamp: P: 1781850572647718 usec, L: 0
0619 06:29:46.309095 (+ 146us) write_op.cc:270] Start()
0619 06:29:46.310212 (+ 1117us) write_op.cc:276] Timestamp: P: 1781850572672332 usec, L: 0
0619 06:29:46.310420 (+ 208us) write_op.cc:270] Start()
0619 06:29:46.310443 (+ 23us) write_op.cc:276] Timestamp: P: 1781850572706038 usec, L: 0
0619 06:29:46.310600 (+ 157us) write_op.cc:270] Start()
0619 06:29:46.310621 (+ 21us) write_op.cc:276] Timestamp: P: 1781850572708508 usec, L: 0
0619 06:29:46.310752 (+ 131us) write_op.cc:270] Start()
0619 06:29:46.310772 (+ 20us) write_op.cc:276] Timestamp: P: 1781850572710940 usec, L: 0
0619 06:29:46.310904 (+ 132us) write_op.cc:270] Start()
0619 06:29:46.310922 (+ 18us) write_op.cc:276] Timestamp: P: 1781850572739908 usec, L: 0
0619 06:29:46.311057 (+ 135us) write_op.cc:270] Start()
0619 06:29:46.311077 (+ 20us) write_op.cc:276] Timestamp: P: 1781850572745464 usec, L: 0
0619 06:29:46.311229 (+ 152us) write_op.cc:270] Start()
0619 06:29:46.311250 (+ 21us) write_op.cc:276] Timestamp: P: 1781850572747260 usec, L: 0
0619 06:29:46.311430 (+ 180us) write_op.cc:270] Start()
0619 06:29:46.346558 (+ 35128us) write_op.cc:276] Timestamp: P: 1781850572767680 usec, L: 0
0619 06:29:46.352862 (+ 6304us) write_op.cc:270] Start()
0619 06:29:46.352888 (+ 26us) write_op.cc:276] Timestamp: P: 1781850572777825 usec, L: 0
0619 06:29:46.353776 (+ 888us) write_op.cc:270] Start()
0619 06:29:46.353800 (+ 24us) write_op.cc:276] Timestamp: P: 1781850572793572 usec, L: 0
0619 06:29:46.364442 (+ 10642us) write_op.cc:270] Start()
0619 06:29:46.364465 (+ 23us) write_op.cc:276] Timestamp: P: 1781850572795175 usec, L: 0
0619 06:29:46.366265 (+ 1800us) write_op.cc:270] Start()
0619 06:29:46.366297 (+ 32us) write_op.cc:276] Timestamp: P: 1781850572819734 usec, L: 0
0619 06:29:46.366531 (+ 234us) write_op.cc:270] Start()
0619 06:29:46.366558 (+ 27us) write_op.cc:276] Timestamp: P: 1781850572821142 usec, L: 0
0619 06:29:46.367619 (+ 1061us) write_op.cc:270] Start()
0619 06:29:46.367647 (+ 28us) write_op.cc:276] Timestamp: P: 1781850572849863 usec, L: 0
0619 06:29:46.367806 (+ 159us) write_op.cc:270] Start()
0619 06:29:46.367831 (+ 25us) write_op.cc:276] Timestamp: P: 1781850572856444 usec, L: 0
0619 06:29:46.367983 (+ 152us) write_op.cc:270] Start()
0619 06:29:46.368006 (+ 23us) write_op.cc:276] Timestamp: P: 1781850572859963 usec, L: 0
0619 06:29:46.369421 (+ 1415us) write_op.cc:270] Start()
0619 06:29:46.369443 (+ 22us) write_op.cc:276] Timestamp: P: 1781850572861693 usec, L: 0
0619 06:29:46.390404 (+ 20961us) write_op.cc:270] Start()
0619 06:29:46.390428 (+ 24us) write_op.cc:276] Timestamp: P: 1781850572913005 usec, L: 0
0619 06:29:46.390631 (+ 203us) write_op.cc:270] Start()
0619 06:29:46.390659 (+ 28us) write_op.cc:276] Timestamp: P: 1781850572914204 usec, L: 0
0619 06:29:46.390809 (+ 150us) write_op.cc:270] Start()
0619 06:29:46.390830 (+ 21us) write_op.cc:276] Timestamp: P: 1781850572922074 usec, L: 0
0619 06:29:46.390992 (+ 162us) write_op.cc:270] Start()
0619 06:29:46.391013 (+ 21us) write_op.cc:276] Timestamp: P: 1781850572930364 usec, L: 0
0619 06:29:46.391134 (+ 121us) write_op.cc:270] Start()
0619 06:29:46.391149 (+ 15us) write_op.cc:276] Timestamp: P: 1781850572964621 usec, L: 0
0619 06:29:46.391251 (+ 102us) write_op.cc:270] Start()
0619 06:29:46.391266 (+ 15us) write_op.cc:276] Timestamp: P: 1781850572965278 usec, L: 0
0619 06:29:46.391414 (+ 148us) write_op.cc:270] Start()
0619 06:29:46.391598 (+ 184us) write_op.cc:276] Timestamp: P: 1781850572966598 usec, L: 0
0619 06:29:46.391760 (+ 162us) write_op.cc:270] Start()
0619 06:29:46.391798 (+ 38us) write_op.cc:276] Timestamp: P: 1781850572967221 usec, L: 0
0619 06:29:46.391943 (+ 145us) write_op.cc:270] Start()
0619 06:29:46.391994 (+ 51us) write_op.cc:276] Timestamp: P: 1781850573002971 usec, L: 0
0619 06:29:46.392112 (+ 118us) write_op.cc:270] Start()
0619 06:29:46.392129 (+ 17us) write_op.cc:276] Timestamp: P: 1781850573023971 usec, L: 0
0619 06:29:46.392401 (+ 272us) write_op.cc:270] Start()
0619 06:29:46.392420 (+ 19us) write_op.cc:276] Timestamp: P: 1781850573025056 usec, L: 0
0619 06:29:46.392569 (+ 149us) write_op.cc:270] Start()
0619 06:29:46.392586 (+ 17us) write_op.cc:276] Timestamp: P: 1781850573031323 usec, L: 0
0619 06:29:46.392824 (+ 238us) write_op.cc:270] Start()
0619 06:29:46.392842 (+ 18us) write_op.cc:276] Timestamp: P: 1781850573052630 usec, L: 0
0619 06:29:46.392954 (+ 112us) write_op.cc:270] Start()
0619 06:29:46.392969 (+ 15us) write_op.cc:276] Timestamp: P: 1781850573074001 usec, L: 0
0619 06:29:46.393071 (+ 102us) write_op.cc:270] Start()
0619 06:29:46.393086 (+ 15us) write_op.cc:276] Timestamp: P: 1781850573090785 usec, L: 0
0619 06:29:46.393333 (+ 247us) write_op.cc:270] Start()
0619 06:29:46.393355 (+ 22us) write_op.cc:276] Timestamp: P: 1781850573092419 usec, L: 0
0619 06:29:46.393493 (+ 138us) write_op.cc:270] Start()
0619 06:29:46.393509 (+ 16us) write_op.cc:276] Timestamp: P: 1781850573092969 usec, L: 0
0619 06:29:46.393634 (+ 125us) write_op.cc:270] Start()
0619 06:29:46.393650 (+ 16us) write_op.cc:276] Timestamp: P: 1781850573128341 usec, L: 0
0619 06:29:46.393902 (+ 252us) write_op.cc:270] Start()
0619 06:29:46.393926 (+ 24us) write_op.cc:276] Timestamp: P: 1781850573144743 usec, L: 0
0619 06:29:46.394085 (+ 159us) write_op.cc:270] Start()
0619 06:29:46.394102 (+ 17us) write_op.cc:276] Timestamp: P: 1781850573155214 usec, L: 0
0619 06:29:46.394216 (+ 114us) write_op.cc:270] Start()
0619 06:29:46.394231 (+ 15us) write_op.cc:276] Timestamp: P: 1781850573176178 usec, L: 0
0619 06:29:46.394355 (+ 124us) write_op.cc:270] Start()
0619 06:29:46.394372 (+ 17us) write_op.cc:276] Timestamp: P: 1781850573188068 usec, L: 0
0619 06:29:46.394512 (+ 140us) write_op.cc:270] Start()
0619 06:29:46.394530 (+ 18us) write_op.cc:276] Timestamp: P: 1781850573199975 usec, L: 0
0619 06:29:46.394643 (+ 113us) write_op.cc:270] Start()
0619 06:29:46.394659 (+ 16us) write_op.cc:276] Timestamp: P: 1781850573212808 usec, L: 0
0619 06:29:46.394788 (+ 129us) write_op.cc:270] Start()
0619 06:29:46.394803 (+ 15us) write_op.cc:276] Timestamp: P: 1781850573213460 usec, L: 0
0619 06:29:46.394933 (+ 130us) write_op.cc:270] Start()
0619 06:29:46.394950 (+ 17us) write_op.cc:276] Timestamp: P: 1781850573223442 usec, L: 0
0619 06:29:46.395052 (+ 102us) write_op.cc:270] Start()
0619 06:29:46.395069 (+ 17us) write_op.cc:276] Timestamp: P: 1781850573254214 usec, L: 0
0619 06:29:46.395193 (+ 124us) write_op.cc:270] Start()
0619 06:29:46.395211 (+ 18us) write_op.cc:276] Timestamp: P: 1781850573263357 usec, L: 0
0619 06:29:46.395327 (+ 116us) write_op.cc:270] Start()
0619 06:29:46.395351 (+ 24us) write_op.cc:276] Timestamp: P: 1781850573283568 usec, L: 0
0619 06:29:46.395476 (+ 125us) write_op.cc:270] Start()
0619 06:29:46.395492 (+ 16us) write_op.cc:276] Timestamp: P: 1781850573288073 usec, L: 0
0619 06:29:46.395608 (+ 116us) write_op.cc:270] Start()
0619 06:29:46.395624 (+ 16us) write_op.cc:276] Timestamp: P: 1781850573301823 usec, L: 0
0619 06:29:46.395718 (+ 94us) write_op.cc:270] Start()
0619 06:29:46.395733 (+ 15us) write_op.cc:276] Timestamp: P: 1781850573306197 usec, L: 0
0619 06:29:46.395891 (+ 158us) write_op.cc:270] Start()
0619 06:29:46.395916 (+ 25us) write_op.cc:276] Timestamp: P: 1781850573329516 usec, L: 0
0619 06:29:46.396105 (+ 189us) write_op.cc:270] Start()
0619 06:29:46.396126 (+ 21us) write_op.cc:276] Timestamp: P: 1781850573341926 usec, L: 0
0619 06:29:46.396264 (+ 138us) write_op.cc:270] Start()
0619 06:29:46.396284 (+ 20us) write_op.cc:276] Timestamp: P: 1781850573355341 usec, L: 0
0619 06:29:46.396450 (+ 166us) write_op.cc:270] Start()
0619 06:29:46.396492 (+ 42us) write_op.cc:276] Timestamp: P: 1781850573382145 usec, L: 0
0619 06:29:46.396627 (+ 135us) write_op.cc:270] Start()
0619 06:29:46.396646 (+ 19us) write_op.cc:276] Timestamp: P: 1781850573383083 usec, L: 0
0619 06:29:46.396785 (+ 139us) write_op.cc:270] Start()
0619 06:29:46.417789 (+ 21004us) write_op.cc:276] Timestamp: P: 1781850573386988 usec, L: 0
0619 06:29:46.417971 (+ 182us) write_op.cc:270] Start()
0619 06:29:46.417995 (+ 24us) write_op.cc:276] Timestamp: P: 1781850573407203 usec, L: 0
0619 06:29:46.418129 (+ 134us) write_op.cc:270] Start()
0619 06:29:46.418148 (+ 19us) write_op.cc:276] Timestamp: P: 1781850573417209 usec, L: 0
0619 06:29:46.418284 (+ 136us) write_op.cc:270] Start()
0619 06:29:46.418308 (+ 24us) write_op.cc:276] Timestamp: P: 1781850573420103 usec, L: 0
0619 06:29:46.418461 (+ 153us) write_op.cc:270] Start()
0619 06:29:46.418481 (+ 20us) write_op.cc:276] Timestamp: P: 1781850573435183 usec, L: 0
0619 06:29:46.426677 (+ 8196us) write_op.cc:270] Start()
0619 06:29:46.426700 (+ 23us) write_op.cc:276] Timestamp: P: 1781850573461856 usec, L: 0
0619 06:29:46.426863 (+ 163us) write_op.cc:270] Start()
0619 06:29:46.426885 (+ 22us) write_op.cc:276] Timestamp: P: 1781850573480647 usec, L: 0
0619 06:29:46.427023 (+ 138us) write_op.cc:270] Start()
0619 06:29:46.427044 (+ 21us) write_op.cc:276] Timestamp: P: 1781850573481979 usec, L: 0
0619 06:29:46.427228 (+ 184us) write_op.cc:270] Start()
0619 06:29:46.427249 (+ 21us) write_op.cc:276] Timestamp: P: 1781850573483782 usec, L: 0
0619 06:29:46.427396 (+ 147us) write_op.cc:270] Start()
0619 06:29:46.427418 (+ 22us) write_op.cc:276] Timestamp: P: 1781850573515550 usec, L: 0
0619 06:29:46.427556 (+ 138us) write_op.cc:270] Start()
0619 06:29:46.427580 (+ 24us) write_op.cc:276] Timestamp: P: 1781850573518582 usec, L: 0
0619 06:29:46.427719 (+ 139us) write_op.cc:270] Start()
0619 06:29:46.427758 (+ 39us) write_op.cc:276] Timestamp: P: 1781850573519198 usec, L: 0
0619 06:29:46.427914 (+ 156us) write_op.cc:270] Start()
0619 06:29:46.427937 (+ 23us) write_op.cc:276] Timestamp: P: 1781850573519799 usec, L: 0
0619 06:29:46.428130 (+ 193us) write_op.cc:270] Start()
0619 06:29:46.428152 (+ 22us) write_op.cc:276] Timestamp: P: 1781850573556706 usec, L: 0
0619 06:29:46.428303 (+ 151us) write_op.cc:270] Start()
0619 06:29:46.428322 (+ 19us) write_op.cc:276] Timestamp: P: 1781850573568131 usec, L: 0
0619 06:29:46.430609 (+ 2287us) write_op.cc:270] Start()
0619 06:29:46.430631 (+ 22us) write_op.cc:276] Timestamp: P: 1781850573568793 usec, L: 0
0619 06:29:46.430782 (+ 151us) write_op.cc:270] Start()
0619 06:29:46.430829 (+ 47us) write_op.cc:276] Timestamp: P: 1781850573572020 usec, L: 0
0619 06:29:46.431031 (+ 202us) write_op.cc:270] Start()
0619 06:29:46.431053 (+ 22us) write_op.cc:276] Timestamp: P: 1781850573612609 usec, L: 0
0619 06:29:46.431229 (+ 176us) write_op.cc:270] Start()
0619 06:29:46.431251 (+ 22us) write_op.cc:276] Timestamp: P: 1781850573630017 usec, L: 0
0619 06:29:46.431393 (+ 142us) write_op.cc:270] Start()
0619 06:29:46.431411 (+ 18us) write_op.cc:276] Timestamp: P: 1781850573640325 usec, L: 0
0619 06:29:46.431599 (+ 188us) write_op.cc:270] Start()
0619 06:29:46.431616 (+ 17us) write_op.cc:276] Timestamp: P: 1781850573649531 usec, L: 0
0619 06:29:46.431728 (+ 112us) write_op.cc:270] Start()
0619 06:29:46.431747 (+ 19us) write_op.cc:276] Timestamp: P: 1781850573670163 usec, L: 0
0619 06:29:46.431905 (+ 158us) write_op.cc:270] Start()
0619 06:29:46.431961 (+ 56us) write_op.cc:276] Timestamp: P: 1781850573676981 usec, L: 0
0619 06:29:46.432103 (+ 142us) write_op.cc:270] Start()
0619 06:29:46.432125 (+ 22us) write_op.cc:276] Timestamp: P: 1781850573680156 usec, L: 0
0619 06:29:46.433049 (+ 924us) write_op.cc:270] Start()
0619 06:29:46.433068 (+ 19us) write_op.cc:276] Timestamp: P: 1781850573717182 usec, L: 0
0619 06:29:46.433192 (+ 124us) write_op.cc:270] Start()
0619 06:29:46.433209 (+ 17us) write_op.cc:276] Timestamp: P: 1781850573720808 usec, L: 0
0619 06:29:46.433372 (+ 163us) write_op.cc:270] Start()
0619 06:29:46.433389 (+ 17us) write_op.cc:276] Timestamp: P: 1781850573738970 usec, L: 0
0619 06:29:46.433525 (+ 136us) write_op.cc:270] Start()
0619 06:29:46.433542 (+ 17us) write_op.cc:276] Timestamp: P: 1781850573745732 usec, L: 0
0619 06:29:46.433650 (+ 108us) write_op.cc:270] Start()
0619 06:29:46.433665 (+ 15us) write_op.cc:276] Timestamp: P: 1781850573755991 usec, L: 0
0619 06:29:46.433835 (+ 170us) write_op.cc:270] Start()
0619 06:29:46.433854 (+ 19us) write_op.cc:276] Timestamp: P: 1781850573769356 usec, L: 0
0619 06:29:46.435961 (+ 2107us) write_op.cc:270] Start()
0619 06:29:46.435989 (+ 28us) write_op.cc:276] Timestamp: P: 1781850573784750 usec, L: 0
0619 06:29:46.436209 (+ 220us) write_op.cc:270] Start()
0619 06:29:46.436230 (+ 21us) write_op.cc:276] Timestamp: P: 1781850573803510 usec, L: 0
0619 06:29:46.436370 (+ 140us) write_op.cc:270] Start()
0619 06:29:46.436390 (+ 20us) write_op.cc:276] Timestamp: P: 1781850573806229 usec, L: 0
0619 06:29:46.436715 (+ 325us) write_op.cc:270] Start()
0619 06:29:46.436749 (+ 34us) write_op.cc:276] Timestamp: P: 1781850573822579 usec, L: 0
0619 06:29:46.436954 (+ 205us) write_op.cc:270] Start()
0619 06:29:46.473420 (+ 36466us) write_op.cc:276] Timestamp: P: 1781850573842108 usec, L: 0
0619 06:29:46.475055 (+ 1635us) write_op.cc:270] Start()
0619 06:29:46.475079 (+ 24us) write_op.cc:276] Timestamp: P: 1781850573850071 usec, L: 0
0619 06:29:46.477688 (+ 2609us) write_op.cc:270] Start()
0619 06:29:46.477713 (+ 25us) write_op.cc:276] Timestamp: P: 1781850573859868 usec, L: 0
0619 06:29:46.480864 (+ 3151us) write_op.cc:270] Start()
0619 06:29:46.480882 (+ 18us) write_op.cc:276] Timestamp: P: 1781850573874271 usec, L: 0
0619 06:29:46.483819 (+ 2937us) write_op.cc:270] Start()
0619 06:29:46.483859 (+ 40us) write_op.cc:276] Timestamp: P: 1781850573888406 usec, L: 0
0619 06:29:46.487566 (+ 3707us) write_op.cc:270] Start()
0619 06:29:46.487579 (+ 13us) write_op.cc:276] Timestamp: P: 1781850573896501 usec, L: 0
0619 06:29:46.490583 (+ 3004us) write_op.cc:270] Start()
0619 06:29:46.490599 (+ 16us) write_op.cc:276] Timestamp: P: 1781850573911177 usec, L: 0
0619 06:29:46.493939 (+ 3340us) write_op.cc:270] Start()
0619 06:29:46.493961 (+ 22us) write_op.cc:276] Timestamp: P: 1781850573913262 usec, L: 0
0619 06:29:46.494606 (+ 645us) write_op.cc:270] Start()
0619 06:29:46.494626 (+ 20us) write_op.cc:276] Timestamp: P: 1781850573935135 usec, L: 0
0619 06:29:46.502577 (+ 7951us) write_op.cc:270] Start()
0619 06:29:46.502604 (+ 27us) write_op.cc:276] Timestamp: P: 1781850573958014 usec, L: 0
0619 06:29:46.502739 (+ 135us) write_op.cc:270] Start()
0619 06:29:46.505474 (+ 2735us) write_op.cc:276] Timestamp: P: 1781850573965182 usec, L: 0
0619 06:29:46.505626 (+ 152us) write_op.cc:270] Start()
0619 06:29:46.505643 (+ 17us) write_op.cc:276] Timestamp: P: 1781850573979822 usec, L: 0
0619 06:29:46.506246 (+ 603us) write_op.cc:270] Start()
0619 06:29:46.506266 (+ 20us) write_op.cc:276] Timestamp: P: 1781850573981768 usec, L: 0
0619 06:29:46.506388 (+ 122us) write_op.cc:270] Start()
0619 06:29:46.506404 (+ 16us) write_op.cc:276] Timestamp: P: 1781850573995686 usec, L: 0
0619 06:29:46.506539 (+ 135us) write_op.cc:270] Start()
0619 06:29:46.506556 (+ 17us) write_op.cc:276] Timestamp: P: 1781850574029540 usec, L: 0
0619 06:29:46.506670 (+ 114us) write_op.cc:270] Start()
0619 06:29:46.506686 (+ 16us) write_op.cc:276] Timestamp: P: 1781850574038887 usec, L: 0
0619 06:29:46.507522 (+ 836us) write_op.cc:270] Start()
0619 06:29:46.507541 (+ 19us) write_op.cc:276] Timestamp: P: 1781850574042058 usec, L: 0
0619 06:29:46.507656 (+ 115us) write_op.cc:270] Start()
0619 06:29:46.507674 (+ 18us) write_op.cc:276] Timestamp: P: 1781850574051548 usec, L: 0
0619 06:29:46.507828 (+ 154us) write_op.cc:270] Start()
0619 06:29:46.507847 (+ 19us) write_op.cc:276] Timestamp: P: 1781850574078845 usec, L: 0
0619 06:29:46.507972 (+ 125us) write_op.cc:270] Start()
0619 06:29:46.507989 (+ 17us) write_op.cc:276] Timestamp: P: 1781850574081420 usec, L: 0
0619 06:29:46.508128 (+ 139us) write_op.cc:270] Start()
0619 06:29:46.508147 (+ 19us) write_op.cc:276] Timestamp: P: 1781850574099167 usec, L: 0
0619 06:29:46.508270 (+ 123us) write_op.cc:270] Start()
0619 06:29:46.508289 (+ 19us) write_op.cc:276] Timestamp: P: 1781850574104105 usec, L: 0
0619 06:29:46.508433 (+ 144us) write_op.cc:270] Start()
0619 06:29:46.508450 (+ 17us) write_op.cc:276] Timestamp: P: 1781850574137620 usec, L: 0
0619 06:29:46.508621 (+ 171us) write_op.cc:270] Start()
0619 06:29:46.508641 (+ 20us) write_op.cc:276] Timestamp: P: 1781850574138886 usec, L: 0
0619 06:29:46.508796 (+ 155us) write_op.cc:270] Start()
0619 06:29:46.508815 (+ 19us) write_op.cc:276] Timestamp: P: 1781850574140745 usec, L: 0
0619 06:29:46.508966 (+ 151us) write_op.cc:270] Start()
0619 06:29:46.508987 (+ 21us) write_op.cc:276] Timestamp: P: 1781850574142076 usec, L: 0
0619 06:29:46.509121 (+ 134us) write_op.cc:270] Start()
0619 06:29:46.509140 (+ 19us) write_op.cc:276] Timestamp: P: 1781850574179414 usec, L: 0
0619 06:29:46.509280 (+ 140us) write_op.cc:270] Start()
0619 06:29:46.509301 (+ 21us) write_op.cc:276] Timestamp: P: 1781850574192724 usec, L: 0
0619 06:29:46.509457 (+ 156us) write_op.cc:270] Start()
0619 06:29:46.509483 (+ 26us) write_op.cc:276] Timestamp: P: 1781850574194145 usec, L: 0
0619 06:29:46.509659 (+ 176us) write_op.cc:270] Start()
0619 06:29:46.509678 (+ 19us) write_op.cc:276] Timestamp: P: 1781850574216232 usec, L: 0
0619 06:29:46.509815 (+ 137us) write_op.cc:270] Start()
0619 06:29:46.509835 (+ 20us) write_op.cc:276] Timestamp: P: 178185
I20260619 06:29:47.820492 8556 rpcz_store.cc:276] 0619 06:29:45.525638 (+ 0us) service_pool.cc:170] Inserting onto call queue
0619 06:29:45.525685 (+ 47us) service_pool.cc:227] Handling call
0619 06:29:45.645891 (+120206us) raft_consensus.cc:1457] Updating replica for 775 ops
0619 06:29:45.787910 (+142019us) raft_consensus.cc:1520] Early marking committed up to index 0
0619 06:29:45.787915 (+ 5us) raft_consensus.cc:1525] Triggering prepare for 775 ops
0619 06:29:45.788059 (+ 144us) write_op.cc:270] Start()
0619 06:29:45.788086 (+ 27us) write_op.cc:276] Timestamp: P: 1781850571582411 usec, L: 0
0619 06:29:45.788295 (+ 209us) write_op.cc:270] Start()
0619 06:29:45.788321 (+ 26us) write_op.cc:276] Timestamp: P: 1781850571584460 usec, L: 0
0619 06:29:45.788506 (+ 185us) write_op.cc:270] Start()
0619 06:29:45.788532 (+ 26us) write_op.cc:276] Timestamp: P: 1781850571597800 usec, L: 0
0619 06:29:45.788679 (+ 147us) write_op.cc:270] Start()
0619 06:29:45.788699 (+ 20us) write_op.cc:276] Timestamp: P: 1781850571602097 usec, L: 0
0619 06:29:45.788865 (+ 166us) write_op.cc:270] Start()
0619 06:29:45.788887 (+ 22us) write_op.cc:276] Timestamp: P: 1781850571643002 usec, L: 0
0619 06:29:45.789036 (+ 149us) write_op.cc:270] Start()
0619 06:29:45.789058 (+ 22us) write_op.cc:276] Timestamp: P: 1781850571650766 usec, L: 0
0619 06:29:45.789196 (+ 138us) write_op.cc:270] Start()
0619 06:29:45.789244 (+ 48us) write_op.cc:276] Timestamp: P: 1781850571653204 usec, L: 0
0619 06:29:45.789400 (+ 156us) write_op.cc:270] Start()
0619 06:29:45.789422 (+ 22us) write_op.cc:276] Timestamp: P: 1781850571677053 usec, L: 0
0619 06:29:45.789576 (+ 154us) write_op.cc:270] Start()
0619 06:29:45.789598 (+ 22us) write_op.cc:276] Timestamp: P: 1781850571697668 usec, L: 0
0619 06:29:45.789778 (+ 180us) write_op.cc:270] Start()
0619 06:29:45.789800 (+ 22us) write_op.cc:276] Timestamp: P: 1781850571715216 usec, L: 0
0619 06:29:45.789946 (+ 146us) write_op.cc:270] Start()
0619 06:29:45.789966 (+ 20us) write_op.cc:276] Timestamp: P: 1781850571717311 usec, L: 0
0619 06:29:45.790110 (+ 144us) write_op.cc:270] Start()
0619 06:29:45.790131 (+ 21us) write_op.cc:276] Timestamp: P: 1781850571755919 usec, L: 0
0619 06:29:45.790279 (+ 148us) write_op.cc:270] Start()
0619 06:29:45.790302 (+ 23us) write_op.cc:276] Timestamp: P: 1781850571782029 usec, L: 0
0619 06:29:45.790434 (+ 132us) write_op.cc:270] Start()
0619 06:29:45.790476 (+ 42us) write_op.cc:276] Timestamp: P: 1781850571783320 usec, L: 0
0619 06:29:45.790678 (+ 202us) write_op.cc:270] Start()
0619 06:29:45.790701 (+ 23us) write_op.cc:276] Timestamp: P: 1781850571787243 usec, L: 0
0619 06:29:45.790857 (+ 156us) write_op.cc:270] Start()
0619 06:29:45.790880 (+ 23us) write_op.cc:276] Timestamp: P: 1781850571812580 usec, L: 0
0619 06:29:45.791025 (+ 145us) write_op.cc:270] Start()
0619 06:29:45.791051 (+ 26us) write_op.cc:276] Timestamp: P: 1781850571824244 usec, L: 0
0619 06:29:45.791227 (+ 176us) write_op.cc:270] Start()
0619 06:29:45.791250 (+ 23us) write_op.cc:276] Timestamp: P: 1781850571834695 usec, L: 0
0619 06:29:45.791385 (+ 135us) write_op.cc:270] Start()
0619 06:29:45.791407 (+ 22us) write_op.cc:276] Timestamp: P: 1781850571843732 usec, L: 0
0619 06:29:45.791551 (+ 144us) write_op.cc:270] Start()
0619 06:29:45.791583 (+ 32us) write_op.cc:276] Timestamp: P: 1781850571860791 usec, L: 0
0619 06:29:45.791730 (+ 147us) write_op.cc:270] Start()
0619 06:29:45.791765 (+ 35us) write_op.cc:276] Timestamp: P: 1781850571865686 usec, L: 0
0619 06:29:45.791905 (+ 140us) write_op.cc:270] Start()
0619 06:29:45.791924 (+ 19us) write_op.cc:276] Timestamp: P: 1781850571884379 usec, L: 0
0619 06:29:45.792070 (+ 146us) write_op.cc:270] Start()
0619 06:29:45.792091 (+ 21us) write_op.cc:276] Timestamp: P: 1781850571899715 usec, L: 0
0619 06:29:45.792230 (+ 139us) write_op.cc:270] Start()
0619 06:29:45.792252 (+ 22us) write_op.cc:276] Timestamp: P: 1781850571918113 usec, L: 0
0619 06:29:45.792432 (+ 180us) write_op.cc:270] Start()
0619 06:29:45.792455 (+ 23us) write_op.cc:276] Timestamp: P: 1781850571922179 usec, L: 0
0619 06:29:45.792666 (+ 211us) write_op.cc:270] Start()
0619 06:29:45.792689 (+ 23us) write_op.cc:276] Timestamp: P: 1781850571927239 usec, L: 0
0619 06:29:45.792862 (+ 173us) write_op.cc:270] Start()
0619 06:29:45.792884 (+ 22us) write_op.cc:276] Timestamp: P: 1781850571954691 usec, L: 0
0619 06:29:45.793021 (+ 137us) write_op.cc:270] Start()
0619 06:29:45.793042 (+ 21us) write_op.cc:276] Timestamp: P: 1781850571974604 usec, L: 0
0619 06:29:45.793175 (+ 133us) write_op.cc:270] Start()
0619 06:29:45.793194 (+ 19us) write_op.cc:276] Timestamp: P: 1781850571976384 usec, L: 0
0619 06:29:45.793308 (+ 114us) write_op.cc:270] Start()
0619 06:29:45.793326 (+ 18us) write_op.cc:276] Timestamp: P: 1781850571986114 usec, L: 0
0619 06:29:45.793489 (+ 163us) write_op.cc:270] Start()
0619 06:29:45.793510 (+ 21us) write_op.cc:276] Timestamp: P: 1781850572002418 usec, L: 0
0619 06:29:45.793659 (+ 149us) write_op.cc:270] Start()
0619 06:29:45.793698 (+ 39us) write_op.cc:276] Timestamp: P: 1781850572029353 usec, L: 0
0619 06:29:45.793947 (+ 249us) write_op.cc:270] Start()
0619 06:29:45.793974 (+ 27us) write_op.cc:276] Timestamp: P: 1781850572049076 usec, L: 0
0619 06:29:45.794119 (+ 145us) write_op.cc:270] Start()
0619 06:29:45.794139 (+ 20us) write_op.cc:276] Timestamp: P: 1781850572076405 usec, L: 0
0619 06:29:45.794306 (+ 167us) write_op.cc:270] Start()
0619 06:29:45.794328 (+ 22us) write_op.cc:276] Timestamp: P: 1781850572085083 usec, L: 0
0619 06:29:45.794464 (+ 136us) write_op.cc:270] Start()
0619 06:29:45.794485 (+ 21us) write_op.cc:276] Timestamp: P: 1781850572092029 usec, L: 0
0619 06:29:45.794645 (+ 160us) write_op.cc:270] Start()
0619 06:29:45.794714 (+ 69us) write_op.cc:276] Timestamp: P: 1781850572092596 usec, L: 0
0619 06:29:45.794881 (+ 167us) write_op.cc:270] Start()
0619 06:29:45.794907 (+ 26us) write_op.cc:276] Timestamp: P: 1781850572117713 usec, L: 0
0619 06:29:45.795046 (+ 139us) write_op.cc:270] Start()
0619 06:29:45.795064 (+ 18us) write_op.cc:276] Timestamp: P: 1781850572130466 usec, L: 0
0619 06:29:45.795188 (+ 124us) write_op.cc:270] Start()
0619 06:29:45.795206 (+ 18us) write_op.cc:276] Timestamp: P: 1781850572165080 usec, L: 0
0619 06:29:45.795662 (+ 456us) write_op.cc:270] Start()
0619 06:29:45.795688 (+ 26us) write_op.cc:276] Timestamp: P: 1781850572167412 usec, L: 0
0619 06:29:45.795850 (+ 162us) write_op.cc:270] Start()
0619 06:29:45.795870 (+ 20us) write_op.cc:276] Timestamp: P: 1781850572186058 usec, L: 0
0619 06:29:45.796003 (+ 133us) write_op.cc:270] Start()
0619 06:29:45.796023 (+ 20us) write_op.cc:276] Timestamp: P: 1781850572202059 usec, L: 0
0619 06:29:45.796154 (+ 131us) write_op.cc:270] Start()
0619 06:29:45.796175 (+ 21us) write_op.cc:276] Timestamp: P: 1781850572213696 usec, L: 0
0619 06:29:45.796347 (+ 172us) write_op.cc:270] Start()
0619 06:29:45.796369 (+ 22us) write_op.cc:276] Timestamp: P: 1781850572221069 usec, L: 0
0619 06:29:45.796516 (+ 147us) write_op.cc:270] Start()
0619 06:29:45.796535 (+ 19us) write_op.cc:276] Timestamp: P: 1781850572237771 usec, L: 0
0619 06:29:45.796725 (+ 190us) write_op.cc:270] Start()
0619 06:29:45.796760 (+ 35us) write_op.cc:276] Timestamp: P: 1781850572265146 usec, L: 0
0619 06:29:45.796911 (+ 151us) write_op.cc:270] Start()
0619 06:29:45.796933 (+ 22us) write_op.cc:276] Timestamp: P: 1781850572266206 usec, L: 0
0619 06:29:45.797056 (+ 123us) write_op.cc:270] Start()
0619 06:29:45.797076 (+ 20us) write_op.cc:276] Timestamp: P: 1781850572293158 usec, L: 0
0619 06:29:45.797201 (+ 125us) write_op.cc:270] Start()
0619 06:29:45.797219 (+ 18us) write_op.cc:276] Timestamp: P: 1781850572306165 usec, L: 0
0619 06:29:45.797379 (+ 160us) write_op.cc:270] Start()
0619 06:29:45.797400 (+ 21us) write_op.cc:276] Timestamp: P: 1781850572306910 usec, L: 0
0619 06:29:45.797543 (+ 143us) write_op.cc:270] Start()
0619 06:29:45.797563 (+ 20us) write_op.cc:276] Timestamp: P: 1781850572333736 usec, L: 0
0619 06:29:45.797715 (+ 152us) write_op.cc:270] Start()
0619 06:29:45.797735 (+ 20us) write_op.cc:276] Timestamp: P: 1781850572334361 usec, L: 0
0619 06:29:45.797891 (+ 156us) write_op.cc:270] Start()
0619 06:29:45.797913 (+ 22us) write_op.cc:276] Timestamp: P: 1781850572347077 usec, L: 0
0619 06:29:45.798060 (+ 147us) write_op.cc:270] Start()
0619 06:29:45.798079 (+ 19us) write_op.cc:276] Timestamp: P: 1781850572351529 usec, L: 0
0619 06:29:45.798220 (+ 141us) write_op.cc:270] Start()
0619 06:29:45.798242 (+ 22us) write_op.cc:276] Timestamp: P: 1781850572377273 usec, L: 0
0619 06:29:45.798375 (+ 133us) write_op.cc:270] Start()
0619 06:29:45.798397 (+ 22us) write_op.cc:276] Timestamp: P: 1781850572394123 usec, L: 0
0619 06:29:45.798557 (+ 160us) write_op.cc:270] Start()
0619 06:29:45.798580 (+ 23us) write_op.cc:276] Timestamp: P: 1781850572400398 usec, L: 0
0619 06:29:45.798756 (+ 176us) write_op.cc:270] Start()
0619 06:29:45.798779 (+ 23us) write_op.cc:276] Timestamp: P: 1781850572419314 usec, L: 0
0619 06:29:45.798966 (+ 187us) write_op.cc:270] Start()
0619 06:29:45.799019 (+ 53us) write_op.cc:276] Timestamp: P: 1781850572421223 usec, L: 0
0619 06:29:45.799150 (+ 131us) write_op.cc:270] Start()
0619 06:29:45.799170 (+ 20us) write_op.cc:276] Timestamp: P: 1781850572434417 usec, L: 0
0619 06:29:45.799302 (+ 132us) write_op.cc:270] Start()
0619 06:29:45.799325 (+ 23us) write_op.cc:276] Timestamp: P: 1781850572450104 usec, L: 0
0619 06:29:45.799494 (+ 169us) write_op.cc:270] Start()
0619 06:29:45.799515 (+ 21us) write_op.cc:276] Timestamp: P: 1781850572465532 usec, L: 0
0619 06:29:45.799679 (+ 164us) write_op.cc:270] Start()
0619 06:29:45.799701 (+ 22us) write_op.cc:276] Timestamp: P: 1781850572466110 usec, L: 0
0619 06:29:45.799893 (+ 192us) write_op.cc:270] Start()
0619 06:29:45.799918 (+ 25us) write_op.cc:276] Timestamp: P: 1781850572477075 usec, L: 0
0619 06:29:45.800063 (+ 145us) write_op.cc:270] Start()
0619 06:29:45.800083 (+ 20us) write_op.cc:276] Timestamp: P: 1781850572499837 usec, L: 0
0619 06:29:45.800209 (+ 126us) write_op.cc:270] Start()
0619 06:29:45.800233 (+ 24us) write_op.cc:276] Timestamp: P: 1781850572517561 usec, L: 0
0619 06:29:45.800362 (+ 129us) write_op.cc:270] Start()
0619 06:29:45.800381 (+ 19us) write_op.cc:276] Timestamp: P: 1781850572525727 usec, L: 0
0619 06:29:45.800518 (+ 137us) write_op.cc:270] Start()
0619 06:29:45.800538 (+ 20us) write_op.cc:276] Timestamp: P: 1781850572527838 usec, L: 0
0619 06:29:45.800698 (+ 160us) write_op.cc:270] Start()
0619 06:29:45.800719 (+ 21us) write_op.cc:276] Timestamp: P: 1781850572543395 usec, L: 0
0619 06:29:45.800894 (+ 175us) write_op.cc:270] Start()
0619 06:29:45.800922 (+ 28us) write_op.cc:276] Timestamp: P: 1781850572554698 usec, L: 0
0619 06:29:45.801077 (+ 155us) write_op.cc:270] Start()
0619 06:29:45.801099 (+ 22us) write_op.cc:276] Timestamp: P: 1781850572578493 usec, L: 0
0619 06:29:45.801255 (+ 156us) write_op.cc:270] Start()
0619 06:29:45.801276 (+ 21us) write_op.cc:276] Timestamp: P: 1781850572588394 usec, L: 0
0619 06:29:45.801414 (+ 138us) write_op.cc:270] Start()
0619 06:29:45.801434 (+ 20us) write_op.cc:276] Timestamp: P: 1781850572594497 usec, L: 0
0619 06:29:45.801584 (+ 150us) write_op.cc:270] Start()
0619 06:29:45.801605 (+ 21us) write_op.cc:276] Timestamp: P: 1781850572598189 usec, L: 0
0619 06:29:45.801764 (+ 159us) write_op.cc:270] Start()
0619 06:29:45.801785 (+ 21us) write_op.cc:276] Timestamp: P: 1781850572611487 usec, L: 0
0619 06:29:45.802564 (+ 779us) write_op.cc:270] Start()
0619 06:29:45.802592 (+ 28us) write_op.cc:276] Timestamp: P: 1781850572644607 usec, L: 0
0619 06:29:45.802772 (+ 180us) write_op.cc:270] Start()
0619 06:29:45.802796 (+ 24us) write_op.cc:276] Timestamp: P: 1781850572646505 usec, L: 0
0619 06:29:45.802957 (+ 161us) write_op.cc:270] Start()
0619 06:29:45.802994 (+ 37us) write_op.cc:276] Timestamp: P: 1781850572671408 usec, L: 0
0619 06:29:45.803150 (+ 156us) write_op.cc:270] Start()
0619 06:29:45.803173 (+ 23us) write_op.cc:276] Timestamp: P: 1781850572671982 usec, L: 0
0619 06:29:45.803306 (+ 133us) write_op.cc:270] Start()
0619 06:29:45.803326 (+ 20us) write_op.cc:276] Timestamp: P: 1781850572706571 usec, L: 0
0619 06:29:45.803474 (+ 148us) write_op.cc:270] Start()
0619 06:29:45.803495 (+ 21us) write_op.cc:276] Timestamp: P: 1781850572707245 usec, L: 0
0619 06:29:45.803621 (+ 126us) write_op.cc:270] Start()
0619 06:29:45.803640 (+ 19us) write_op.cc:276] Timestamp: P: 1781850572723619 usec, L: 0
0619 06:29:45.803780 (+ 140us) write_op.cc:270] Start()
0619 06:29:45.803800 (+ 20us) write_op.cc:276] Timestamp: P: 1781850572739767 usec, L: 0
0619 06:29:45.803937 (+ 137us) write_op.cc:270] Start()
0619 06:29:45.803956 (+ 19us) write_op.cc:276] Timestamp: P: 1781850572745496 usec, L: 0
0619 06:29:45.804087 (+ 131us) write_op.cc:270] Start()
0619 06:29:45.804108 (+ 21us) write_op.cc:276] Timestamp: P: 1781850572748884 usec, L: 0
0619 06:29:45.804297 (+ 189us) write_op.cc:270] Start()
0619 06:29:45.804323 (+ 26us) write_op.cc:276] Timestamp: P: 1781850572767844 usec, L: 0
0619 06:29:45.804466 (+ 143us) write_op.cc:270] Start()
0619 06:29:45.804487 (+ 21us) write_op.cc:276] Timestamp: P: 1781850572779278 usec, L: 0
0619 06:29:45.804649 (+ 162us) write_op.cc:270] Start()
0619 06:29:45.804671 (+ 22us) write_op.cc:276] Timestamp: P: 1781850572793389 usec, L: 0
0619 06:29:45.804835 (+ 164us) write_op.cc:270] Start()
0619 06:29:45.804855 (+ 20us) write_op.cc:276] Timestamp: P: 1781850572794850 usec, L: 0
0619 06:29:45.804986 (+ 131us) write_op.cc:270] Start()
0619 06:29:45.805006 (+ 20us) write_op.cc:276] Timestamp: P: 1781850572820295 usec, L: 0
0619 06:29:45.805120 (+ 114us) write_op.cc:270] Start()
0619 06:29:45.805139 (+ 19us) write_op.cc:276] Timestamp: P: 1781850572821626 usec, L: 0
0619 06:29:45.805274 (+ 135us) write_op.cc:270] Start()
0619 06:29:45.805297 (+ 23us) write_op.cc:276] Timestamp: P: 1781850572850710 usec, L: 0
0619 06:29:45.805423 (+ 126us) write_op.cc:270] Start()
0619 06:29:45.805445 (+ 22us) write_op.cc:276] Timestamp: P: 1781850572854116 usec, L: 0
0619 06:29:45.805595 (+ 150us) write_op.cc:270] Start()
0619 06:29:45.805615 (+ 20us) write_op.cc:276] Timestamp: P: 1781850572859605 usec, L: 0
0619 06:29:45.805784 (+ 169us) write_op.cc:270] Start()
0619 06:29:45.805804 (+ 20us) write_op.cc:276] Timestamp: P: 1781850572863109 usec, L: 0
0619 06:29:45.805922 (+ 118us) write_op.cc:270] Start()
0619 06:29:45.805940 (+ 18us) write_op.cc:276] Timestamp: P: 1781850572907831 usec, L: 0
0619 06:29:45.806069 (+ 129us) write_op.cc:270] Start()
0619 06:29:45.806090 (+ 21us) write_op.cc:276] Timestamp: P: 1781850572918943 usec, L: 0
0619 06:29:45.806244 (+ 154us) write_op.cc:270] Start()
0619 06:29:45.806264 (+ 20us) write_op.cc:276] Timestamp: P: 1781850572921513 usec, L: 0
0619 06:29:45.806392 (+ 128us) write_op.cc:270] Start()
0619 06:29:45.806410 (+ 18us) write_op.cc:276] Timestamp: P: 1781850572930951 usec, L: 0
0619 06:29:45.820253 (+ 13843us) write_op.cc:270] Start()
0619 06:29:45.820278 (+ 25us) write_op.cc:276] Timestamp: P: 1781850572964275 usec, L: 0
0619 06:29:45.838017 (+ 17739us) write_op.cc:270] Start()
0619 06:29:45.838043 (+ 26us) write_op.cc:276] Timestamp: P: 1781850572964901 usec, L: 0
0619 06:29:45.838537 (+ 494us) write_op.cc:270] Start()
0619 06:29:45.838563 (+ 26us) write_op.cc:276] Timestamp: P: 1781850572976697 usec, L: 0
0619 06:29:45.839252 (+ 689us) write_op.cc:270] Start()
0619 06:29:45.839276 (+ 24us) write_op.cc:276] Timestamp: P: 1781850572977633 usec, L: 0
0619 06:29:45.839615 (+ 339us) write_op.cc:270] Start()
0619 06:29:45.839663 (+ 48us) write_op.cc:276] Timestamp: P: 1781850573001987 usec, L: 0
0619 06:29:45.839814 (+ 151us) write_op.cc:270] Start()
0619 06:29:45.839832 (+ 18us) write_op.cc:276] Timestamp: P: 1781850573023290 usec, L: 0
0619 06:29:45.840654 (+ 822us) write_op.cc:270] Start()
0619 06:29:45.840684 (+ 30us) write_op.cc:276] Timestamp: P: 1781850573026205 usec, L: 0
0619 06:29:45.840855 (+ 171us) write_op.cc:270] Start()
0619 06:29:45.840874 (+ 19us) write_op.cc:276] Timestamp: P: 1781850573031979 usec, L: 0
0619 06:29:45.841071 (+ 197us) write_op.cc:270] Start()
0619 06:29:45.841091 (+ 20us) write_op.cc:276] Timestamp: P: 1781850573053300 usec, L: 0
0619 06:29:45.841287 (+ 196us) write_op.cc:270] Start()
0619 06:29:45.841306 (+ 19us) write_op.cc:276] Timestamp: P: 1781850573075724 usec, L: 0
0619 06:29:45.841437 (+ 131us) write_op.cc:270] Start()
0619 06:29:45.841455 (+ 18us) write_op.cc:276] Timestamp: P: 1781850573090071 usec, L: 0
0619 06:29:45.841596 (+ 141us) write_op.cc:270] Start()
0619 06:29:45.841617 (+ 21us) write_op.cc:276] Timestamp: P: 1781850573091748 usec, L: 0
0619 06:29:45.844305 (+ 2688us) write_op.cc:270] Start()
0619 06:29:45.844330 (+ 25us) write_op.cc:276] Timestamp: P: 1781850573092526 usec, L: 0
0619 06:29:45.844824 (+ 494us) write_op.cc:270] Start()
0619 06:29:45.844850 (+ 26us) write_op.cc:276] Timestamp: P: 1781850573122791 usec, L: 0
0619 06:29:45.845958 (+ 1108us) write_op.cc:270] Start()
0619 06:29:45.845983 (+ 25us) write_op.cc:276] Timestamp: P: 1781850573146510 usec, L: 0
0619 06:29:45.846454 (+ 471us) write_op.cc:270] Start()
0619 06:29:45.846473 (+ 19us) write_op.cc:276] Timestamp: P: 1781850573155859 usec, L: 0
0619 06:29:45.846644 (+ 171us) write_op.cc:270] Start()
0619 06:29:45.846665 (+ 21us) write_op.cc:276] Timestamp: P: 1781850573175267 usec, L: 0
0619 06:29:45.846832 (+ 167us) write_op.cc:270] Start()
0619 06:29:45.846853 (+ 21us) write_op.cc:276] Timestamp: P: 1781850573186304 usec, L: 0
0619 06:29:45.846987 (+ 134us) write_op.cc:270] Start()
0619 06:29:45.847009 (+ 22us) write_op.cc:276] Timestamp: P: 1781850573188437 usec, L: 0
0619 06:29:45.847139 (+ 130us) write_op.cc:270] Start()
0619 06:29:45.847158 (+ 19us) write_op.cc:276] Timestamp: P: 1781850573212134 usec, L: 0
0619 06:29:45.847305 (+ 147us) write_op.cc:270] Start()
0619 06:29:45.847332 (+ 27us) write_op.cc:276] Timestamp: P: 1781850573222646 usec, L: 0
0619 06:29:45.847492 (+ 160us) write_op.cc:270] Start()
0619 06:29:45.847513 (+ 21us) write_op.cc:276] Timestamp: P: 1781850573223223 usec, L: 0
0619 06:29:45.847653 (+ 140us) write_op.cc:270] Start()
0619 06:29:45.847672 (+ 19us) write_op.cc:276] Timestamp: P: 1781850573251726 usec, L: 0
0619 06:29:45.847807 (+ 135us) write_op.cc:270] Start()
0619 06:29:45.847825 (+ 18us) write_op.cc:276] Timestamp: P: 1781850573263230 usec, L: 0
0619 06:29:45.847964 (+ 139us) write_op.cc:270] Start()
0619 06:29:45.847984 (+ 20us) write_op.cc:276] Timestamp: P: 1781850573273144 usec, L: 0
0619 06:29:45.848130 (+ 146us) write_op.cc:270] Start()
0619 06:29:45.848146 (+ 16us) write_op.cc:276] Timestamp: P: 1781850573293271 usec, L: 0
0619 06:29:45.848266 (+ 120us) write_op.cc:270] Start()
0619 06:29:45.848285 (+ 19us) write_op.cc:276] Timestamp: P: 1781850573301191 usec, L: 0
0619 06:29:45.919512 (+ 71227us) write_op.cc:270] Start()
0619 06:29:45.919537 (+ 25us) write_op.cc:276] Timestamp: P: 1781850573306329 usec, L: 0
0619 06:29:45.919745 (+ 208us) write_op.cc:270] Start()
0619 06:29:45.919768 (+ 23us) write_op.cc:276] Timestamp: P: 1781850573329688 usec, L: 0
0619 06:29:45.919945 (+ 177us) write_op.cc:270] Start()
0619 06:29:45.919970 (+ 25us) write_op.cc:276] Timestamp: P: 1781850573348939 usec, L: 0
0619 06:29:45.920914 (+ 944us) write_op.cc:270] Start()
0619 06:29:45.926649 (+ 5735us) write_op.cc:276] Timestamp: P: 1781850573355729 usec, L: 0
0619 06:29:45.928048 (+ 1399us) write_op.cc:270] Start()
0619 06:29:45.928075 (+ 27us) write_op.cc:276] Timestamp: P: 1781850573382882 usec, L: 0
0619 06:29:45.928234 (+ 159us) write_op.cc:270] Start()
0619 06:29:45.928262 (+ 28us) write_op.cc:276] Timestamp: P: 1781850573383678 usec, L: 0
0619 06:29:45.928470 (+ 208us) write_op.cc:270] Start()
0619 06:29:45.928490 (+ 20us) write_op.cc:276] Timestamp: P: 1781850573385760 usec, L: 0
0619 06:29:45.928794 (+ 304us) write_op.cc:270] Start()
0619 06:29:45.928815 (+ 21us) write_op.cc:276] Timestamp: P: 1781850573407702 usec, L: 0
0619 06:29:45.936423 (+ 7608us) write_op.cc:270] Start()
0619 06:29:45.936447 (+ 24us) write_op.cc:276] Timestamp: P: 1781850573419846 usec, L: 0
0619 06:29:45.947545 (+ 11098us) write_op.cc:270] Start()
0619 06:29:45.947623 (+ 78us) write_op.cc:276] Timestamp: P: 1781850573434913 usec, L: 0
0619 06:29:45.947842 (+ 219us) write_op.cc:270] Start()
0619 06:29:45.947865 (+ 23us) write_op.cc:276] Timestamp: P: 1781850573435801 usec, L: 0
0619 06:29:45.948007 (+ 142us) write_op.cc:270] Start()
0619 06:29:45.948026 (+ 19us) write_op.cc:276] Timestamp: P: 1781850573455086 usec, L: 0
0619 06:29:45.948163 (+ 137us) write_op.cc:270] Start()
0619 06:29:45.948182 (+ 19us) write_op.cc:276] Timestamp: P: 1781850573476439 usec, L: 0
0619 06:29:45.948338 (+ 156us) write_op.cc:270] Start()
0619 06:29:45.948357 (+ 19us) write_op.cc:276] Timestamp: P: 1781850573482481 usec, L: 0
0619 06:29:45.948821 (+ 464us) write_op.cc:270] Start()
0619 06:29:45.948844 (+ 23us) write_op.cc:276] Timestamp: P: 1781850573486962 usec, L: 0
0619 06:29:45.949079 (+ 235us) write_op.cc:270] Start()
0619 06:29:45.949105 (+ 26us) write_op.cc:276] Timestamp: P: 1781850573515539 usec, L: 0
0619 06:29:45.950768 (+ 1663us) write_op.cc:270] Start()
0619 06:29:45.950793 (+ 25us) write_op.cc:276] Timestamp: P: 1781850573516453 usec, L: 0
0619 06:29:45.984220 (+ 33427us) write_op.cc:270] Start()
0619 06:29:45.984246 (+ 26us) write_op.cc:276] Timestamp: P: 1781850573521145 usec, L: 0
0619 06:29:45.994640 (+ 10394us) write_op.cc:270] Start()
0619 06:29:45.994664 (+ 24us) write_op.cc:276] Timestamp: P: 1781850573521734 usec, L: 0
0619 06:29:45.994800 (+ 136us) write_op.cc:270] Start()
0619 06:29:45.994818 (+ 18us) write_op.cc:276] Timestamp: P: 1781850573556716 usec, L: 0
0619 06:29:45.994964 (+ 146us) write_op.cc:270] Start()
0619 06:29:45.994983 (+ 19us) write_op.cc:276] Timestamp: P: 1781850573567394 usec, L: 0
0619 06:29:45.995124 (+ 141us) write_op.cc:270] Start()
0619 06:29:45.995143 (+ 19us) write_op.cc:276] Timestamp: P: 1781850573569849 usec, L: 0
0619 06:29:46.001190 (+ 6047us) write_op.cc:270] Start()
0619 06:29:46.001226 (+ 36us) write_op.cc:276] Timestamp: P: 1781850573572433 usec, L: 0
0619 06:29:46.004061 (+ 2835us) write_op.cc:270] Start()
0619 06:29:46.004086 (+ 25us) write_op.cc:276] Timestamp: P: 1781850573613104 usec, L: 0
0619 06:29:46.004234 (+ 148us) write_op.cc:270] Start()
0619 06:29:46.004268 (+ 34us) write_op.cc:276] Timestamp: P: 1781850573630755 usec, L: 0
0619 06:29:46.009147 (+ 4879us) write_op.cc:270] Start()
0619 06:29:46.009172 (+ 25us) write_op.cc:276] Timestamp: P: 1781850573638555 usec, L: 0
0619 06:29:46.009860 (+ 688us) write_op.cc:270] Start()
0619 06:29:46.009890 (+ 30us) write_op.cc:276] Timestamp: P: 1781850573651059 usec, L: 0
0619 06:29:46.010058 (+ 168us) write_op.cc:270] Start()
0619 06:29:46.010106 (+ 48us) write_op.cc:276] Timestamp: P: 1781850573667187 usec, L: 0
0619 06:29:46.046357 (+ 36251us) write_op.cc:270] Start()
0619 06:29:46.046383 (+ 26us) write_op.cc:276] Timestamp: P: 1781850573672777 usec, L: 0
0619 06:29:46.049283 (+ 2900us) write_op.cc:270] Start()
0619 06:29:46.049307 (+ 24us) write_op.cc:276] Timestamp: P: 1781850573682887 usec, L: 0
0619 06:29:46.053092 (+ 3785us) write_op.cc:270] Start()
0619 06:29:46.053107 (+ 15us) write_op.cc:276] Timestamp: P: 1781850573714617 usec, L: 0
0619 06:29:46.053738 (+ 631us) write_op.cc:270] Start()
0619 06:29:46.055483 (+ 1745us) write_op.cc:276] Timestamp: P: 1781850573717738 usec, L: 0
0619 06:29:46.070178 (+ 14695us) write_op.cc:270] Start()
0619 06:29:46.070206 (+ 28us) write_op.cc:276] Timestamp: P: 1781850573745775 usec, L: 0
0619 06:29:46.070429 (+ 223us) write_op.cc:270] Start()
0619 06:29:46.070456 (+ 27us) write_op.cc:276] Timestamp: P: 1781850573746939 usec, L: 0
0619 06:29:46.070627 (+ 171us) write_op.cc:270] Start()
0619 06:29:46.070657 (+ 30us) write_op.cc:276] Timestamp: P: 1781850573756623 usec, L: 0
0619 06:29:46.072500 (+ 1843us) write_op.cc:270] Start()
0619 06:29:46.072527 (+ 27us) write_op.cc:276] Timestamp: P: 1781850573772916 usec, L: 0
0619 06:29:46.073845 (+ 1318us) write_op.cc:270] Start()
0619 06:29:46.073869 (+ 24us) write_op.cc:276] Timestamp: P: 1781850573798071 usec, L: 0
0619 06:29:46.075867 (+ 1998us) write_op.cc:270] Start()
0619 06:29:46.075893 (+ 26us) write_op.cc:276] Timestamp: P: 1781850573801429 usec, L: 0
0619 06:29:46.083941 (+ 8048us) write_op.cc:270] Start()
0619 06:29:46.083970 (+ 29us) write_op.cc:276] Timestamp: P: 1781850573803305 usec, L: 0
0619 06:29:46.088463 (+ 4493us) write_op.cc:270] Start()
0619 06:29:46.088559 (+ 96us) write_op.cc:276] Timestamp: P: 1781850573821957 usec, L: 0
0619 06:29:46.090557 (+ 1998us) write_op.cc:270] Start()
0619 06:29:46.090576 (+ 19us) write_op.cc:276] Timestamp: P: 1781850573840460 usec, L: 0
0619 06:29:46.090751 (+ 175us) write_op.cc:270] Start()
0619 06:29:46.090778 (+ 27us) write_op.cc:276] Timestamp: P: 1781850573849555 usec, L: 0
0619 06:29:46.090940 (+ 162us) write_op.cc:270] Start()
0619 06:29:46.090965 (+ 25us) write_op.cc:276] Timestamp: P: 1781850573861668 usec, L: 0
0619 06:29:46.092381 (+ 1416us) write_op.cc:270] Start()
0619 06:29:46.092400 (+ 19us) write_op.cc:276] Timestamp: P: 1781850573874442 usec, L: 0
0619 06:29:46.092948 (+ 548us) write_op.cc:270] Start()
0619 06:29:46.092978 (+ 30us) write_op.cc:276] Timestamp: P: 1781850573887461 usec, L: 0
0619 06:29:46.101406 (+ 8428us) write_op.cc:270] Start()
0619 06:29:46.101434 (+ 28us) write_op.cc:276] Timestamp: P: 1781850573895949 usec, L: 0
0619 06:29:46.105378 (+ 3944us) write_op.cc:270] Start()
0619 06:29:46.105419 (+ 41us) write_op.cc:276] Timestamp: P: 1781850573910954 usec, L: 0
0619 06:29:46.105589 (+ 170us) write_op.cc:270] Start()
0619 06:29:46.105610 (+ 21us) write_op.cc:276] Timestamp: P: 1781850573913301 usec, L: 0
0619 06:29:46.106098 (+ 488us) write_op.cc:270] Start()
0619 06:29:46.106118 (+ 20us) write_op.cc:276] Timestamp: P: 1781850573934816 usec, L: 0
0619 06:29:46.106251 (+ 133us) write_op.cc:270] Start()
0619 06:29:46.106270 (+ 19us) write_op.cc:276] Timestamp: P: 1781850573959692 usec, L: 0
0619 06:29:46.107023 (+ 753us) write_op.cc:270] Start()
0619 06:29:46.107048 (+ 25us) write_op.cc:276] Timestamp: P: 1781850573966241 usec, L: 0
0619 06:29:46.118638 (+ 11590us) write_op.cc:270] Start()
0619 06:29:46.118662 (+ 24us) write_op.cc:276] Timestamp: P: 1781850573977967 usec, L: 0
0619 06:29:46.119708 (+ 1046us) write_op.cc:270] Start()
0619 06:29:46.119730 (+ 22us) write_op.cc:276] Timestamp: P: 1781850573982818 usec, L: 0
0619 06:29:46.119867 (+ 137us) write_op.cc:270] Start()
0619 06:29:46.119886 (+ 19us) write_op.cc:276] Timestamp: P: 1781850573996324 usec, L: 0
0619 06:29:46.120013 (+ 127us) write_op.cc:270] Start()
0619 06:29:46.120032 (+ 19us) write_op.cc:276] Timestamp: P: 1781850574031335 usec, L: 0
0619 06:29:46.125254 (+ 5222us) write_op.cc:270] Start()
0619 06:29:46.125311 (+ 57us) write_op.cc:276] Timestamp: P: 1781850574033019 usec, L: 0
0619 06:29:46.127769 (+ 2458us) write_op.cc:270] Start()
0619 06:29:46.127815 (+ 46us) write_op.cc:276] Timestamp: P: 1781850574036004 usec, L: 0
0619 06:29:46.128029 (+ 214us) write_op.cc:270] Start()
0619 06:29:46.128058 (+ 29us) write_op.cc:276] Timestamp: P: 1781850574063166 usec, L: 0
0619 06:29:46.128220 (+ 162us) write_op.cc:270] Start()
0619 06:29:46.128244 (+ 24us) write_op.cc:276] Timestamp: P: 1781850574078810 usec, L: 0
0619 06:29:46.128420 (+ 176us) write_op.cc:270] Start()
0619 06:29:46.128445 (+ 25us) write_op.cc:276] Timestamp: P: 1781850574080275 usec, L: 0
0619 06:29:46.128673 (+ 228us) write_op.cc:270] Start()
0619 06:29:46.128697 (+ 24us) write_op.cc:276] Timestamp: P: 1781850574082860 usec, L: 0
0619 06:29:46.128892 (+ 195us) write_op.cc:270] Start()
0619 06:29:46.128917 (+ 25us) write_op.cc:276] Timestamp: P: 1781850574105070 usec, L: 0
0619 06:29:46.129060 (+ 143us) write_op.cc:270] Start()
0619 06:29:46.129077 (+ 17us) write_op.cc:276] Timestamp: P: 1781850574137137 usec, L: 0
0619 06:29:46.129247 (+ 170us) write_op.cc:270] Start()
0619 06:29:46.129285 (+ 38us) write_op.cc:276] Timestamp: P: 1781850574137811 usec, L: 0
0619 06:29:46.129434 (+ 149us) write_op.cc:270] Start()
0619 06:29:46.129458 (+ 24us) write_op.cc:276] Timestamp: P: 1781850574140296 usec, L: 0
0619 06:29:46.129640 (+ 182us) write_op.cc:270] Start()
0619 06:29:46.129667 (+ 27us) write_op.cc:276] Timestamp: P: 1781850574140948 usec, L: 0
0619 06:29:46.129822 (+ 155us) write_op.cc:270] Start()
0619 06:29:46.129844 (+ 22us) write_op.cc:276] Timestamp: P: 1781850574179288 usec, L: 0
0619 06:29:46.130042 (+ 198us) write_op.cc:270] Start()
0619 06:29:46.130070 (+ 28us) write_op.cc:276] Timestamp: P: 1781850574192166 usec, L: 0
0619 06:29:46.130233 (+ 163us) write_op.cc:270] Start()
0619 06:29:46.130286 (+ 53us) write_op.cc:276] Timestamp: P: 1781850574194393 usec, L: 0
0619 06:29:46.130451 (+ 165us) write_op.cc:270] Start()
0619 06:29:46.130475 (+ 24us) write_op.cc:276] Timestamp: P: 17818505
I20260619 06:29:52.210336 8653 raft_consensus.cc:482] T f5c2224f852746c8893931fd3ff27126 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 996381a7495d4720a6f6be44a1d4781b)
I20260619 06:29:52.216846 8653 raft_consensus.cc:504] T f5c2224f852746c8893931fd3ff27126 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:52.217690 8653 leader_election.cc:288] T f5c2224f852746c8893931fd3ff27126 P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063), 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499)
I20260619 06:29:52.222234 7862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5c2224f852746c8893931fd3ff27126" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 1219 } } ignore_live_leader: false dest_uuid: "996381a7495d4720a6f6be44a1d4781b" is_pre_election: true
I20260619 06:29:52.223661 7992 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5c2224f852746c8893931fd3ff27126" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 1219 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1" is_pre_election: true
I20260619 06:29:52.240010 8458 leader_election.cc:302] T f5c2224f852746c8893931fd3ff27126 P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b46f2dae92104884b86705d6bbc20003; no voters: 3fc4e58423894a27a7b94de5c6013cf1, 996381a7495d4720a6f6be44a1d4781b
I20260619 06:29:52.244714 8653 raft_consensus.cc:2726] T f5c2224f852746c8893931fd3ff27126 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 06:29:52.372272 8558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.7.96.2:56233 (request call id 3) took 1892 ms. Trace:
I20260619 06:29:52.652997 8665 raft_consensus.cc:482] T f5c2224f852746c8893931fd3ff27126 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 996381a7495d4720a6f6be44a1d4781b)
I20260619 06:29:52.653244 8665 raft_consensus.cc:504] T f5c2224f852746c8893931fd3ff27126 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:52.683811 7862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5c2224f852746c8893931fd3ff27126" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 1219 } } ignore_live_leader: false dest_uuid: "996381a7495d4720a6f6be44a1d4781b" is_pre_election: true
I20260619 06:29:52.685475 8665 leader_election.cc:288] T f5c2224f852746c8893931fd3ff27126 P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063), 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499)
I20260619 06:29:52.687348 7993 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5c2224f852746c8893931fd3ff27126" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 1219 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1" is_pre_election: true
I20260619 06:29:52.707643 8458 leader_election.cc:302] T f5c2224f852746c8893931fd3ff27126 P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b46f2dae92104884b86705d6bbc20003; no voters: 3fc4e58423894a27a7b94de5c6013cf1, 996381a7495d4720a6f6be44a1d4781b
I20260619 06:29:52.730536 8665 raft_consensus.cc:2726] T f5c2224f852746c8893931fd3ff27126 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 06:29:52.811364 8657 raft_consensus.cc:482] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 996381a7495d4720a6f6be44a1d4781b)
I20260619 06:29:52.811502 8560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.7.96.2:56233 (request call id 4) took 1832 ms. Trace:
I20260619 06:29:52.812389 8657 raft_consensus.cc:504] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:52.813118 8657 leader_election.cc:288] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063), 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499)
I20260619 06:29:52.813670 7860 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e2da70288694680bec48ac95c14656f" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 1245 } } ignore_live_leader: false dest_uuid: "996381a7495d4720a6f6be44a1d4781b" is_pre_election: true
I20260619 06:29:52.823190 7993 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e2da70288694680bec48ac95c14656f" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 1245 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1" is_pre_election: true
I20260619 06:29:52.838253 8458 leader_election.cc:302] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b46f2dae92104884b86705d6bbc20003; no voters: 3fc4e58423894a27a7b94de5c6013cf1, 996381a7495d4720a6f6be44a1d4781b
I20260619 06:29:52.838948 8657 raft_consensus.cc:2726] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 06:29:52.374404 8558 rpcz_store.cc:276] 0619 06:29:50.479471 (+ 0us) service_pool.cc:170] Inserting onto call queue
0619 06:29:50.481450 (+ 1979us) service_pool.cc:227] Handling call
0619 06:29:50.731500 (+250050us) raft_consensus.cc:1457] Updating replica for 278 ops
0619 06:29:50.858324 (+126824us) raft_consensus.cc:1520] Early marking committed up to index 941
0619 06:29:50.858415 (+ 91us) raft_consensus.cc:1525] Triggering prepare for 278 ops
0619 06:29:50.858542 (+ 127us) write_op.cc:270] Start()
0619 06:29:50.858570 (+ 28us) write_op.cc:276] Timestamp: P: 1781850585403531 usec, L: 0
0619 06:29:50.896552 (+ 37982us) write_op.cc:270] Start()
0619 06:29:50.896582 (+ 30us) write_op.cc:276] Timestamp: P: 1781850585418342 usec, L: 0
0619 06:29:50.910092 (+ 13510us) write_op.cc:270] Start()
0619 06:29:50.910121 (+ 29us) write_op.cc:276] Timestamp: P: 1781850585425038 usec, L: 0
0619 06:29:50.910299 (+ 178us) write_op.cc:270] Start()
0619 06:29:50.910325 (+ 26us) write_op.cc:276] Timestamp: P: 1781850585425674 usec, L: 0
0619 06:29:50.926612 (+ 16287us) write_op.cc:270] Start()
0619 06:29:50.926634 (+ 22us) write_op.cc:276] Timestamp: P: 1781850585504551 usec, L: 0
0619 06:29:50.932778 (+ 6144us) write_op.cc:270] Start()
0619 06:29:50.932811 (+ 33us) write_op.cc:276] Timestamp: P: 1781850585505140 usec, L: 0
0619 06:29:50.948411 (+ 15600us) write_op.cc:270] Start()
0619 06:29:50.949531 (+ 1120us) write_op.cc:276] Timestamp: P: 1781850585543077 usec, L: 0
0619 06:29:50.957353 (+ 7822us) write_op.cc:270] Start()
0619 06:29:50.957391 (+ 38us) write_op.cc:276] Timestamp: P: 1781850585545011 usec, L: 0
0619 06:29:50.957567 (+ 176us) write_op.cc:270] Start()
0619 06:29:50.957586 (+ 19us) write_op.cc:276] Timestamp: P: 1781850585573152 usec, L: 0
0619 06:29:50.957702 (+ 116us) write_op.cc:270] Start()
0619 06:29:50.957719 (+ 17us) write_op.cc:276] Timestamp: P: 1781850585609246 usec, L: 0
0619 06:29:50.957853 (+ 134us) write_op.cc:270] Start()
0619 06:29:50.957869 (+ 16us) write_op.cc:276] Timestamp: P: 1781850585625301 usec, L: 0
0619 06:29:50.957978 (+ 109us) write_op.cc:270] Start()
0619 06:29:50.957994 (+ 16us) write_op.cc:276] Timestamp: P: 1781850585643757 usec, L: 0
0619 06:29:50.958110 (+ 116us) write_op.cc:270] Start()
0619 06:29:50.958129 (+ 19us) write_op.cc:276] Timestamp: P: 1781850585668039 usec, L: 0
0619 06:29:50.958297 (+ 168us) write_op.cc:270] Start()
0619 06:29:50.958316 (+ 19us) write_op.cc:276] Timestamp: P: 1781850585674783 usec, L: 0
0619 06:29:50.958476 (+ 160us) write_op.cc:270] Start()
0619 06:29:50.958513 (+ 37us) write_op.cc:276] Timestamp: P: 1781850585701809 usec, L: 0
0619 06:29:50.958634 (+ 121us) write_op.cc:270] Start()
0619 06:29:50.958652 (+ 18us) write_op.cc:276] Timestamp: P: 1781850585725164 usec, L: 0
0619 06:29:50.958769 (+ 117us) write_op.cc:270] Start()
0619 06:29:50.958786 (+ 17us) write_op.cc:276] Timestamp: P: 1781850585726390 usec, L: 0
0619 06:29:50.958907 (+ 121us) write_op.cc:270] Start()
0619 06:29:50.958932 (+ 25us) write_op.cc:276] Timestamp: P: 1781850585728577 usec, L: 0
0619 06:29:50.959191 (+ 259us) write_op.cc:270] Start()
0619 06:29:50.959212 (+ 21us) write_op.cc:276] Timestamp: P: 1781850585739989 usec, L: 0
0619 06:29:50.959395 (+ 183us) write_op.cc:270] Start()
0619 06:29:50.959415 (+ 20us) write_op.cc:276] Timestamp: P: 1781850585796351 usec, L: 0
0619 06:29:50.959568 (+ 153us) write_op.cc:270] Start()
0619 06:29:50.959590 (+ 22us) write_op.cc:276] Timestamp: P: 1781850585801728 usec, L: 0
0619 06:29:50.959736 (+ 146us) write_op.cc:270] Start()
0619 06:29:50.959756 (+ 20us) write_op.cc:276] Timestamp: P: 1781850585804890 usec, L: 0
0619 06:29:50.984370 (+ 24614us) write_op.cc:270] Start()
0619 06:29:50.984397 (+ 27us) write_op.cc:276] Timestamp: P: 1781850585835874 usec, L: 0
0619 06:29:50.994086 (+ 9689us) write_op.cc:270] Start()
0619 06:29:50.994114 (+ 28us) write_op.cc:276] Timestamp: P: 1781850585889460 usec, L: 0
0619 06:29:50.996463 (+ 2349us) write_op.cc:270] Start()
0619 06:29:50.996493 (+ 30us) write_op.cc:276] Timestamp: P: 1781850585892692 usec, L: 0
0619 06:29:50.996661 (+ 168us) write_op.cc:270] Start()
0619 06:29:50.996680 (+ 19us) write_op.cc:276] Timestamp: P: 1781850585904756 usec, L: 0
0619 06:29:51.020674 (+ 23994us) write_op.cc:270] Start()
0619 06:29:51.020703 (+ 29us) write_op.cc:276] Timestamp: P: 1781850585906963 usec, L: 0
0619 06:29:51.020903 (+ 200us) write_op.cc:270] Start()
0619 06:29:51.020928 (+ 25us) write_op.cc:276] Timestamp: P: 1781850585958741 usec, L: 0
0619 06:29:51.023368 (+ 2440us) write_op.cc:270] Start()
0619 06:29:51.031416 (+ 8048us) write_op.cc:276] Timestamp: P: 1781850585965793 usec, L: 0
0619 06:29:51.036908 (+ 5492us) write_op.cc:270] Start()
0619 06:29:51.036935 (+ 27us) write_op.cc:276] Timestamp: P: 1781850585972919 usec, L: 0
0619 06:29:51.065617 (+ 28682us) write_op.cc:270] Start()
0619 06:29:51.065653 (+ 36us) write_op.cc:276] Timestamp: P: 1781850585976248 usec, L: 0
0619 06:29:51.068066 (+ 2413us) write_op.cc:270] Start()
0619 06:29:51.068097 (+ 31us) write_op.cc:276] Timestamp: P: 1781850586012240 usec, L: 0
0619 06:29:51.068323 (+ 226us) write_op.cc:270] Start()
0619 06:29:51.068348 (+ 25us) write_op.cc:276] Timestamp: P: 1781850586031045 usec, L: 0
0619 06:29:51.068528 (+ 180us) write_op.cc:270] Start()
0619 06:29:51.068551 (+ 23us) write_op.cc:276] Timestamp: P: 1781850586069051 usec, L: 0
0619 06:29:51.068738 (+ 187us) write_op.cc:270] Start()
0619 06:29:51.068762 (+ 24us) write_op.cc:276] Timestamp: P: 1781850586081321 usec, L: 0
0619 06:29:51.068951 (+ 189us) write_op.cc:270] Start()
0619 06:29:51.068974 (+ 23us) write_op.cc:276] Timestamp: P: 1781850586089609 usec, L: 0
0619 06:29:51.069119 (+ 145us) write_op.cc:270] Start()
0619 06:29:51.069140 (+ 21us) write_op.cc:276] Timestamp: P: 1781850586094690 usec, L: 0
0619 06:29:51.069294 (+ 154us) write_op.cc:270] Start()
0619 06:29:51.069317 (+ 23us) write_op.cc:276] Timestamp: P: 1781850586099159 usec, L: 0
0619 06:29:51.069456 (+ 139us) write_op.cc:270] Start()
0619 06:29:51.069478 (+ 22us) write_op.cc:276] Timestamp: P: 1781850586163086 usec, L: 0
0619 06:29:51.069618 (+ 140us) write_op.cc:270] Start()
0619 06:29:51.069640 (+ 22us) write_op.cc:276] Timestamp: P: 1781850586181220 usec, L: 0
0619 06:29:51.069783 (+ 143us) write_op.cc:270] Start()
0619 06:29:51.069805 (+ 22us) write_op.cc:276] Timestamp: P: 1781850586187170 usec, L: 0
0619 06:29:51.070208 (+ 403us) write_op.cc:270] Start()
0619 06:29:51.070236 (+ 28us) write_op.cc:276] Timestamp: P: 1781850586195205 usec, L: 0
0619 06:29:51.070478 (+ 242us) write_op.cc:270] Start()
0619 06:29:51.070537 (+ 59us) write_op.cc:276] Timestamp: P: 1781850586217798 usec, L: 0
0619 06:29:51.070685 (+ 148us) write_op.cc:270] Start()
0619 06:29:51.070706 (+ 21us) write_op.cc:276] Timestamp: P: 1781850586234047 usec, L: 0
0619 06:29:51.070869 (+ 163us) write_op.cc:270] Start()
0619 06:29:51.070891 (+ 22us) write_op.cc:276] Timestamp: P: 1781850586253167 usec, L: 0
0619 06:29:51.071036 (+ 145us) write_op.cc:270] Start()
0619 06:29:51.071057 (+ 21us) write_op.cc:276] Timestamp: P: 1781850586255894 usec, L: 0
0619 06:29:51.071188 (+ 131us) write_op.cc:270] Start()
0619 06:29:51.071207 (+ 19us) write_op.cc:276] Timestamp: P: 1781850586263914 usec, L: 0
0619 06:29:51.071358 (+ 151us) write_op.cc:270] Start()
0619 06:29:51.071458 (+ 100us) write_op.cc:276] Timestamp: P: 1781850586312117 usec, L: 0
0619 06:29:51.071632 (+ 174us) write_op.cc:270] Start()
0619 06:29:51.071654 (+ 22us) write_op.cc:276] Timestamp: P: 1781850586326287 usec, L: 0
0619 06:29:51.071797 (+ 143us) write_op.cc:270] Start()
0619 06:29:51.071818 (+ 21us) write_op.cc:276] Timestamp: P: 1781850586327488 usec, L: 0
0619 06:29:51.071995 (+ 177us) write_op.cc:270] Start()
0619 06:29:51.072016 (+ 21us) write_op.cc:276] Timestamp: P: 1781850586328359 usec, L: 0
0619 06:29:51.072150 (+ 134us) write_op.cc:270] Start()
0619 06:29:51.072171 (+ 21us) write_op.cc:276] Timestamp: P: 1781850586351027 usec, L: 0
0619 06:29:51.093172 (+ 21001us) write_op.cc:270] Start()
0619 06:29:51.093202 (+ 30us) write_op.cc:276] Timestamp: P: 1781850586412336 usec, L: 0
0619 06:29:51.093949 (+ 747us) write_op.cc:270] Start()
0619 06:29:51.093975 (+ 26us) write_op.cc:276] Timestamp: P: 1781850586413338 usec, L: 0
0619 06:29:51.108482 (+ 14507us) write_op.cc:270] Start()
0619 06:29:51.108509 (+ 27us) write_op.cc:276] Timestamp: P: 1781850586413964 usec, L: 0
0619 06:29:51.125184 (+ 16675us) write_op.cc:270] Start()
0619 06:29:51.125218 (+ 34us) write_op.cc:276] Timestamp: P: 1781850586448708 usec, L: 0
0619 06:29:51.132878 (+ 7660us) write_op.cc:270] Start()
0619 06:29:51.132912 (+ 34us) write_op.cc:276] Timestamp: P: 1781850586460856 usec, L: 0
0619 06:29:51.156726 (+ 23814us) write_op.cc:270] Start()
0619 06:29:51.156760 (+ 34us) write_op.cc:276] Timestamp: P: 1781850586463112 usec, L: 0
0619 06:29:51.175922 (+ 19162us) write_op.cc:270] Start()
0619 06:29:51.175953 (+ 31us) write_op.cc:276] Timestamp: P: 1781850586494831 usec, L: 0
0619 06:29:51.178628 (+ 2675us) write_op.cc:270] Start()
0619 06:29:51.184556 (+ 5928us) write_op.cc:276] Timestamp: P: 1781850586539282 usec, L: 0
0619 06:29:51.193332 (+ 8776us) write_op.cc:270] Start()
0619 06:29:51.193378 (+ 46us) write_op.cc:276] Timestamp: P: 1781850586539915 usec, L: 0
0619 06:29:51.194936 (+ 1558us) write_op.cc:270] Start()
0619 06:29:51.194980 (+ 44us) write_op.cc:276] Timestamp: P: 1781850586541973 usec, L: 0
0619 06:29:51.195238 (+ 258us) write_op.cc:270] Start()
0619 06:29:51.195270 (+ 32us) write_op.cc:276] Timestamp: P: 1781850586570657 usec, L: 0
0619 06:29:51.207200 (+ 11930us) write_op.cc:270] Start()
0619 06:29:51.207230 (+ 30us) write_op.cc:276] Timestamp: P: 1781850586589061 usec, L: 0
0619 06:29:51.218726 (+ 11496us) write_op.cc:270] Start()
0619 06:29:51.218769 (+ 43us) write_op.cc:276] Timestamp: P: 1781850586597071 usec, L: 0
0619 06:29:51.219041 (+ 272us) write_op.cc:270] Start()
0619 06:29:51.219074 (+ 33us) write_op.cc:276] Timestamp: P: 1781850586600454 usec, L: 0
0619 06:29:51.228542 (+ 9468us) write_op.cc:270] Start()
0619 06:29:51.228585 (+ 43us) write_op.cc:276] Timestamp: P: 1781850586606892 usec, L: 0
0619 06:29:51.231728 (+ 3143us) write_op.cc:270] Start()
0619 06:29:51.231768 (+ 40us) write_op.cc:276] Timestamp: P: 1781850586668869 usec, L: 0
0619 06:29:51.234356 (+ 2588us) write_op.cc:270] Start()
0619 06:29:51.238654 (+ 4298us) write_op.cc:276] Timestamp: P: 1781850586669557 usec, L: 0
0619 06:29:51.240799 (+ 2145us) write_op.cc:270] Start()
0619 06:29:51.240830 (+ 31us) write_op.cc:276] Timestamp: P: 1781850586672842 usec, L: 0
0619 06:29:51.249774 (+ 8944us) write_op.cc:270] Start()
0619 06:29:51.249804 (+ 30us) write_op.cc:276] Timestamp: P: 1781850586682971 usec, L: 0
0619 06:29:51.254351 (+ 4547us) write_op.cc:270] Start()
0619 06:29:51.254389 (+ 38us) write_op.cc:276] Timestamp: P: 1781850586752931 usec, L: 0
0619 06:29:51.254603 (+ 214us) write_op.cc:270] Start()
0619 06:29:51.254626 (+ 23us) write_op.cc:276] Timestamp: P: 1781850586753542 usec, L: 0
0619 06:29:51.254787 (+ 161us) write_op.cc:270] Start()
0619 06:29:51.254808 (+ 21us) write_op.cc:276] Timestamp: P: 1781850586757800 usec, L: 0
0619 06:29:51.255002 (+ 194us) write_op.cc:270] Start()
0619 06:29:51.255026 (+ 24us) write_op.cc:276] Timestamp: P: 1781850586765683 usec, L: 0
0619 06:29:51.255211 (+ 185us) write_op.cc:270] Start()
0619 06:29:51.255232 (+ 21us) write_op.cc:276] Timestamp: P: 1781850586800439 usec, L: 0
0619 06:29:51.255398 (+ 166us) write_op.cc:270] Start()
0619 06:29:51.255419 (+ 21us) write_op.cc:276] Timestamp: P: 1781850586814356 usec, L: 0
0619 06:29:51.283691 (+ 28272us) write_op.cc:270] Start()
0619 06:29:51.283724 (+ 33us) write_op.cc:276] Timestamp: P: 1781850586841550 usec, L: 0
0619 06:29:51.283929 (+ 205us) write_op.cc:270] Start()
0619 06:29:51.283952 (+ 23us) write_op.cc:276] Timestamp: P: 1781850586842160 usec, L: 0
0619 06:29:51.284359 (+ 407us) write_op.cc:270] Start()
0619 06:29:51.284395 (+ 36us) write_op.cc:276] Timestamp: P: 1781850586845046 usec, L: 0
0619 06:29:51.284603 (+ 208us) write_op.cc:270] Start()
0619 06:29:51.284640 (+ 37us) write_op.cc:276] Timestamp: P: 1781850586860399 usec, L: 0
0619 06:29:51.284882 (+ 242us) write_op.cc:270] Start()
0619 06:29:51.284908 (+ 26us) write_op.cc:276] Timestamp: P: 1781850586906696 usec, L: 0
0619 06:29:51.285360 (+ 452us) write_op.cc:270] Start()
0619 06:29:51.285395 (+ 35us) write_op.cc:276] Timestamp: P: 1781850586907631 usec, L: 0
0619 06:29:51.285608 (+ 213us) write_op.cc:270] Start()
0619 06:29:51.285635 (+ 27us) write_op.cc:276] Timestamp: P: 1781850586929317 usec, L: 0
0619 06:29:51.287013 (+ 1378us) write_op.cc:270] Start()
0619 06:29:51.287038 (+ 25us) write_op.cc:276] Timestamp: P: 1781850586933901 usec, L: 0
0619 06:29:51.287925 (+ 887us) write_op.cc:270] Start()
0619 06:29:51.301687 (+ 13762us) write_op.cc:276] Timestamp: P: 1781850586948064 usec, L: 0
0619 06:29:51.305117 (+ 3430us) write_op.cc:270] Start()
0619 06:29:51.305144 (+ 27us) write_op.cc:276] Timestamp: P: 1781850586963292 usec, L: 0
0619 06:29:51.305415 (+ 271us) write_op.cc:270] Start()
0619 06:29:51.305438 (+ 23us) write_op.cc:276] Timestamp: P: 1781850586985884 usec, L: 0
0619 06:29:51.305616 (+ 178us) write_op.cc:270] Start()
0619 06:29:51.305636 (+ 20us) write_op.cc:276] Timestamp: P: 1781850587007165 usec, L: 0
0619 06:29:51.305802 (+ 166us) write_op.cc:270] Start()
0619 06:29:51.305822 (+ 20us) write_op.cc:276] Timestamp: P: 1781850587030251 usec, L: 0
0619 06:29:51.305975 (+ 153us) write_op.cc:270] Start()
0619 06:29:51.305994 (+ 19us) write_op.cc:276] Timestamp: P: 1781850587047695 usec, L: 0
0619 06:29:51.306148 (+ 154us) write_op.cc:270] Start()
0619 06:29:51.306168 (+ 20us) write_op.cc:276] Timestamp: P: 1781850587050147 usec, L: 0
0619 06:29:51.306333 (+ 165us) write_op.cc:270] Start()
0619 06:29:51.306352 (+ 19us) write_op.cc:276] Timestamp: P: 1781850587079869 usec, L: 0
0619 06:29:51.326715 (+ 20363us) write_op.cc:270] Start()
0619 06:29:51.326750 (+ 35us) write_op.cc:276] Timestamp: P: 1781850587085784 usec, L: 0
0619 06:29:51.327070 (+ 320us) write_op.cc:270] Start()
0619 06:29:51.327097 (+ 27us) write_op.cc:276] Timestamp: P: 1781850587115980 usec, L: 0
0619 06:29:51.328166 (+ 1069us) write_op.cc:270] Start()
0619 06:29:51.328191 (+ 25us) write_op.cc:276] Timestamp: P: 1781850587141596 usec, L: 0
0619 06:29:51.328372 (+ 181us) write_op.cc:270] Start()
0619 06:29:51.328393 (+ 21us) write_op.cc:276] Timestamp: P: 1781850587181964 usec, L: 0
0619 06:29:51.333331 (+ 4938us) write_op.cc:270] Start()
0619 06:29:51.333360 (+ 29us) write_op.cc:276] Timestamp: P: 1781850587200967 usec, L: 0
0619 06:29:51.340469 (+ 7109us) write_op.cc:270] Start()
0619 06:29:51.340496 (+ 27us) write_op.cc:276] Timestamp: P: 1781850587231583 usec, L: 0
0619 06:29:51.352217 (+ 11721us) write_op.cc:270] Start()
0619 06:29:51.352249 (+ 32us) write_op.cc:276] Timestamp: P: 1781850587242978 usec, L: 0
0619 06:29:51.352495 (+ 246us) write_op.cc:270] Start()
0619 06:29:51.352516 (+ 21us) write_op.cc:276] Timestamp: P: 1781850587273254 usec, L: 0
0619 06:29:51.352709 (+ 193us) write_op.cc:270] Start()
0619 06:29:51.352728 (+ 19us) write_op.cc:276] Timestamp: P: 1781850587274002 usec, L: 0
0619 06:29:51.352894 (+ 166us) write_op.cc:270] Start()
0619 06:29:51.352911 (+ 17us) write_op.cc:276] Timestamp: P: 1781850587277489 usec, L: 0
0619 06:29:51.353111 (+ 200us) write_op.cc:270] Start()
0619 06:29:51.353129 (+ 18us) write_op.cc:276] Timestamp: P: 1781850587289464 usec, L: 0
0619 06:29:51.353308 (+ 179us) write_op.cc:270] Start()
0619 06:29:51.353327 (+ 19us) write_op.cc:276] Timestamp: P: 1781850587339996 usec, L: 0
0619 06:29:51.353529 (+ 202us) write_op.cc:270] Start()
0619 06:29:51.353547 (+ 18us) write_op.cc:276] Timestamp: P: 1781850587342428 usec, L: 0
0619 06:29:51.353719 (+ 172us) write_op.cc:270] Start()
0619 06:29:51.353736 (+ 17us) write_op.cc:276] Timestamp: P: 1781850587356675 usec, L: 0
0619 06:29:51.353942 (+ 206us) write_op.cc:270] Start()
0619 06:29:51.354005 (+ 63us) write_op.cc:276] Timestamp: P: 1781850587359391 usec, L: 0
0619 06:29:51.354183 (+ 178us) write_op.cc:270] Start()
0619 06:29:51.354212 (+ 29us) write_op.cc:276] Timestamp: P: 1781850587388925 usec, L: 0
0619 06:29:51.354389 (+ 177us) write_op.cc:270] Start()
0619 06:29:51.354407 (+ 18us) write_op.cc:276] Timestamp: P: 1781850587399726 usec, L: 0
0619 06:29:51.354598 (+ 191us) write_op.cc:270] Start()
0619 06:29:51.354622 (+ 24us) write_op.cc:276] Timestamp: P: 1781850587413563 usec, L: 0
0619 06:29:51.357640 (+ 3018us) write_op.cc:270] Start()
0619 06:29:51.357675 (+ 35us) write_op.cc:276] Timestamp: P: 1781850587458080 usec, L: 0
0619 06:29:51.358562 (+ 887us) write_op.cc:270] Start()
0619 06:29:51.358589 (+ 27us) write_op.cc:276] Timestamp: P: 1781850587465950 usec, L: 0
0619 06:29:51.367839 (+ 9250us) write_op.cc:270] Start()
0619 06:29:51.404713 (+ 36874us) write_op.cc:276] Timestamp: P: 1781850587482010 usec, L: 0
0619 06:29:51.419842 (+ 15129us) write_op.cc:270] Start()
0619 06:29:51.419875 (+ 33us) write_op.cc:276] Timestamp: P: 1781850587510547 usec, L: 0
0619 06:29:51.420067 (+ 192us) write_op.cc:270] Start()
0619 06:29:51.420089 (+ 22us) write_op.cc:276] Timestamp: P: 1781850587545262 usec, L: 0
0619 06:29:51.444665 (+ 24576us) write_op.cc:270] Start()
0619 06:29:51.444695 (+ 30us) write_op.cc:276] Timestamp: P: 1781850587546090 usec, L: 0
0619 06:29:51.447029 (+ 2334us) write_op.cc:270] Start()
0619 06:29:51.447056 (+ 27us) write_op.cc:276] Timestamp: P: 1781850587571579 usec, L: 0
0619 06:29:51.454323 (+ 7267us) write_op.cc:270] Start()
0619 06:29:51.454352 (+ 29us) write_op.cc:276] Timestamp: P: 1781850587576352 usec, L: 0
0619 06:29:51.465395 (+ 11043us) write_op.cc:270] Start()
0619 06:29:51.465427 (+ 32us) write_op.cc:276] Timestamp: P: 1781850587637707 usec, L: 0
0619 06:29:51.470673 (+ 5246us) write_op.cc:270] Start()
0619 06:29:51.470704 (+ 31us) write_op.cc:276] Timestamp: P: 1781850587640953 usec, L: 0
0619 06:29:51.475409 (+ 4705us) write_op.cc:270] Start()
0619 06:29:51.475437 (+ 28us) write_op.cc:276] Timestamp: P: 1781850587644302 usec, L: 0
0619 06:29:51.480889 (+ 5452us) write_op.cc:270] Start()
0619 06:29:51.480914 (+ 25us) write_op.cc:276] Timestamp: P: 1781850587697260 usec, L: 0
0619 06:29:51.488367 (+ 7453us) write_op.cc:270] Start()
0619 06:29:51.488408 (+ 41us) write_op.cc:276] Timestamp: P: 1781850587712098 usec, L: 0
0619 06:29:51.508966 (+ 20558us) write_op.cc:270] Start()
0619 06:29:51.508999 (+ 33us) write_op.cc:276] Timestamp: P: 1781850587728591 usec, L: 0
0619 06:29:51.518869 (+ 9870us) write_op.cc:270] Start()
0619 06:29:51.518917 (+ 48us) write_op.cc:276] Timestamp: P: 1781850587733556 usec, L: 0
0619 06:29:51.519125 (+ 208us) write_op.cc:270] Start()
0619 06:29:51.519151 (+ 26us) write_op.cc:276] Timestamp: P: 1781850587776382 usec, L: 0
0619 06:29:51.522175 (+ 3024us) write_op.cc:270] Start()
0619 06:29:51.524782 (+ 2607us) write_op.cc:276] Timestamp: P: 1781850587791909 usec, L: 0
0619 06:29:51.528032 (+ 3250us) write_op.cc:270] Start()
0619 06:29:51.528060 (+ 28us) write_op.cc:276] Timestamp: P: 1781850587819132 usec, L: 0
0619 06:29:51.528236 (+ 176us) write_op.cc:270] Start()
0619 06:29:51.528260 (+ 24us) write_op.cc:276] Timestamp: P: 1781850587822592 usec, L: 0
0619 06:29:51.529666 (+ 1406us) write_op.cc:270] Start()
0619 06:29:51.529733 (+ 67us) write_op.cc:276] Timestamp: P: 1781850587851201 usec, L: 0
0619 06:29:51.529945 (+ 212us) write_op.cc:270] Start()
0619 06:29:51.529968 (+ 23us) write_op.cc:276] Timestamp: P: 1781850587866032 usec, L: 0
0619 06:29:51.532144 (+ 2176us) write_op.cc:270] Start()
0619 06:29:51.532171 (+ 27us) write_op.cc:276] Timestamp: P: 1781850587871369 usec, L: 0
0619 06:29:51.536881 (+ 4710us) write_op.cc:270] Start()
0619 06:29:51.536908 (+ 27us) write_op.cc:276] Timestamp: P: 1781850587878176 usec, L: 0
0619 06:29:51.537723 (+ 815us) write_op.cc:270] Start()
0619 06:29:51.537764 (+ 41us) write_op.cc:276] Timestamp: P: 1781850587906885 usec, L: 0
0619 06:29:51.537959 (+ 195us) write_op.cc:270] Start()
0619 06:29:51.537984 (+ 25us) write_op.cc:276] Timestamp: P: 1781850587943266 usec, L: 0
0619 06:29:51.538176 (+ 192us) write_op.cc:270] Start()
0619 06:29:51.538200 (+ 24us) write_op.cc:276] Timestamp: P: 1781850587957842 usec, L: 0
0619 06:29:51.538422 (+ 222us) write_op.cc:270] Start()
0619 06:29:51.538443 (+ 21us) write_op.cc:276] Timestamp: P: 1781850587973633 usec, L: 0
0619 06:29:51.538643 (+ 200us) write_op.cc:270] Start()
0619 06:29:51.538667 (+ 24us) write_op.cc:276] Timestamp: P: 1781850587976015 usec, L: 0
0619 06:29:51.538853 (+ 186us) write_op.cc:270] Start()
0619 06:29:51.538875 (+ 22us) write_op.cc:276] Timestamp: P: 1781850587995022 usec, L: 0
0619 06:29:51.539091 (+ 216us) write_op.cc:270] Start()
0619 06:29:51.539113 (+ 22us) write_op.cc:276] Timestamp: P: 1781850588005205 usec, L: 0
0619 06:29:51.539309 (+ 196us) write_op.cc:270] Start()
0619 06:29:51.539334 (+ 25us) write_op.cc:276] Timestamp: P: 1781850588046777 usec, L: 0
0619 06:29:51.539570 (+ 236us) write_op.cc:270] Start()
0619 06:29:51.539595 (+ 25us) write_op.cc:276] Timestamp: P: 1781850588054572 usec, L: 0
0619 06:29:51.539792 (+ 197us) write_op.cc:270] Start()
0619 06:29:51.539816 (+ 24us) write_op.cc:276] Timestamp: P: 1781850588061322 usec, L: 0
0619 06:29:51.540124 (+ 308us) write_op.cc:270] Start()
0619 06:29:51.540146 (+ 22us) write_op.cc:276] Timestamp: P: 1781850588071009 usec, L: 0
0619 06:29:51.540333 (+ 187us) write_op.cc:270] Start()
0619 06:29:51.540357 (+ 24us) write_op.cc:276] Timestamp: P: 1781850588119221 usec, L: 0
0619 06:29:51.540571 (+ 214us) write_op.cc:270] Start()
0619 06:29:51.540595 (+ 24us) write_op.cc:276] Timestamp: P: 1781850588142146 usec, L: 0
0619 06:29:51.540810 (+ 215us) write_op.cc:270] Start()
0619 06:29:51.540843 (+ 33us) write_op.cc:276] Timestamp: P: 1781850588147568 usec, L: 0
0619 06:29:51.541039 (+ 196us) write_op.cc:270] Start()
0619 06:29:51.541090 (+ 51us) write_op.cc:276] Timestamp: P: 1781850588153954 usec, L: 0
0619 06:29:51.541335 (+ 245us) write_op.cc:270] Start()
0619 06:29:51.541359 (+ 24us) write_op.cc:276] Timestamp: P: 1781850588178614 usec, L: 0
0619 06:29:51.541563 (+ 204us) write_op.cc:270] Start()
0619 06:29:51.541586 (+ 23us) write_op.cc:276] Timestamp: P: 1781850588183565 usec, L: 0
0619 06:29:51.541945 (+ 359us) write_op.cc:270] Start()
0619 06:29:51.541972 (+ 27us) write_op.cc:276] Timestamp: P: 1781850588224974 usec, L: 0
0619 06:29:51.565239 (+ 23267us) write_op.cc:270] Start()
0619 06:29:51.565270 (+ 31us) write_op.cc:276] Timestamp: P: 1781850588228176 usec, L: 0
0619 06:29:51.572261 (+ 6991us) write_op.cc:270] Start()
0619 06:29:51.572286 (+ 25us) write_op.cc:276] Timestamp: P: 1781850588268902 usec, L: 0
0619 06:29:51.588802 (+ 16516us) write_op.cc:270] Start()
0619 06:29:51.588829 (+ 27us) write_op.cc:276] Timestamp: P: 1781850588271836 usec, L: 0
0619 06:29:51.605701 (+ 16872us) write_op.cc:270] Start()
0619 06:29:51.605728 (+ 27us) write_op.cc:276] Timestamp: P: 1781850588272456 usec, L: 0
0619 06:29:51.612228 (+ 6500us) write_op.cc:270] Start()
0619 06:29:51.612255 (+ 27us) write_op.cc:276] Timestamp: P: 1781850588310230 usec, L: 0
0619 06:29:51.620019 (+ 7764us) write_op.cc:270] Start()
0619 06:29:51.627106 (+ 7087us) write_op.cc:276] Timestamp: P: 1781850588340616 usec, L: 0
0619 06:29:51.629305 (+ 2199us) write_op.cc:270] Start()
0619 06:29:51.629329 (+ 24us) write_op.cc:276] Timestamp: P: 1781850588341210 usec, L: 0
0619 06:29:51.634026 (+ 4697us) write_op.cc:270] Start()
0619 06:29:51.634055 (+ 29us) write_op.cc:276] Timestamp: P: 1781850588359122 usec, L: 0
0619 06:29:51.648303 (+ 14248us) write_op.cc:270] Start()
0619 06:29:51.648336 (+ 33us) write_op.cc:276] Timestamp: P: 1781850588402996 usec, L: 0
0619 06:29:51.651144 (+ 2808us) write_op.cc:270] Start()
0619 06:29:51.651170 (+ 26us) write_op.cc:276] Timestamp: P: 1781850588432064 usec, L: 0
0619 06:29:51.653220 (+ 2050us) write_op.cc:270] Start()
0619 06:29:51.653241 (+ 21us) write_op.cc:276] Timestamp: P: 1781850588433275 usec, L: 0
0619 06:29:51.669417 (+ 16176us) write_op.cc:270] Start()
0619 06:29:51.669453 (+ 36us) write_op.cc:276] Timestamp: P: 1781850588441726 usec, L: 0
0619 06:29:51.669692 (+ 239us) write_op.cc:270] Start()
0619 06:29:51.669721 (+ 29us) write_op.cc:276] Timestamp: P: 1781850588476972 usec, L: 0
0619 06:29:51.674852 (+ 5131us) write_op.cc:270] Start()
0619 06:29:51.674876 (+ 24us) write_op.cc:276] Timestamp: P: 1781850588496617 usec, L: 0
0619 06:29:51.677420 (+ 2544us) write_op.cc:270] Start()
0619 06:29:51.677449 (+ 29us) write_op.cc:276] Timestamp: P: 1781850588498764 usec, L: 0
0619 06:29:51.686836 (+ 9387us) write_op.cc:270] Start()
0619 06:29:51.686859 (+ 23us) write_op.cc:276] Timestamp: P: 1781850588499642 usec, L: 0
0619 06:29:51.694776 (+ 7917us) write_op.cc:270] Start()
0619 06:29:51.694807 (+ 31us) write_op.cc:276] Timestamp: P: 1781850588534136 usec, L: 0
0619 06:29:51.703079 (+ 8272us) write_op.cc:270] Start()
0619 06:29:51.703102 (+ 23us) write_op.cc:276] Timestamp: P: 1781850588559524 usec, L: 0
0619 06:29:51.714341 (+ 11239us) write_op.cc:270] Start()
0619 06:29:51.716501 (+ 2160us) write_op.cc:276] Timestamp: P: 1781850588573137 usec, L: 0
0619 06:29:51.732272 (+ 15771us) write_op.cc:270] Start()
0619 06:29:51.732296 (+ 24us) write_op.cc:276] Timestamp: P: 1781850588599252 usec, L: 0
0619 06:29:51.732451 (+ 155us) write_op.cc:270] Start()
0619 06:29:51.732469 (+ 18us) write_op.cc:276] Timestamp: P: 1781850588607103 usec, L: 0
0619 06:29:51.734488 (+ 2019us) write_op.cc:270] Start()
0619 06:29:51.734531 (+ 43us) write_op.cc:276] Timestamp: P: 1781850588612319 usec, L: 0
0619 06:29:51.750112 (+ 15581us) write_op.cc:270] Start()
0619 06:29:51.750137 (+ 25us) write_op.cc:276] Timestamp: P: 1781850588644067 usec, L: 0
0619 06:29:51.750328 (+ 191us) write_op.cc:270] Start()
0619 06:29:51.750354 (+ 26us) write_op.cc:276] Timestamp: P: 1781850588653091 usec, L: 0
0619 06:29:51.750536 (+ 182us) write_op.cc:270] Start()
0619 06:29:51.750559 (+ 23us) write_op.cc:276] Timestamp: P: 1781850588657415 usec, L: 0
0619 06:29:51.750706 (+ 147us) write_op.cc:270] Start()
0619 06:29:51.750728 (+ 22us) write_op.cc:276] Timestamp: P: 1781850588674462 usec, L: 0
0619 06:29:51.750877 (+ 149us) write_op.cc:270] Start()
0619 06:29:51.750899 (+ 22us) write_op.cc:276] Timestamp: P: 1781850588708297 usec, L: 0
0619 06:29:51.764497 (+ 13598us) write_op.cc:270] Start()
0619 06:29:51.764529 (+ 32us) write_op.cc:276] Timestamp: P: 1781850588731775 usec, L: 0
0619 06:29:51.764733 (+ 204us) write_op.cc:270] Start()
0619 06:29:51.764758 (+ 25us) write_op.cc:276] Timestamp: P: 1781850588760646 usec, L: 0
0619 06:29:51.764935 (+ 177us) write_op.cc:270] Start()
0619 06:29:51.764958 (+ 23us) write_op.cc:276] Timestamp: P: 1781850588786682 usec, L: 0
0619 06:29:51.765151 (+ 193us) write_op.cc:270] Start()
0619 06:29:51.765177 (+ 26us) write_op.cc:276] Timestamp: P: 1781850588787397 usec, L: 0
0619 06:29:51.765353 (+ 176us) write_op.cc:270] Start()
0619 06:29:51.765379 (+ 26us) write_op.cc:276] Timestamp: P: 1781850588802020 usec, L: 0
0619 06:29:51.765590 (+ 211us) write_op.cc:270] Start()
0619 06:29:51.765615 (+ 25us) write_op.cc:276] Timestamp: P: 1781850588803794 usec, L: 0
0619 06:29:51.765799 (+ 184us) write_op.cc:270] Start()
0619 06:29:51.765823 (+ 24us) write_op.cc:276] Timestamp: P: 1781850588845964 usec, L: 0
0619 06:29:51.767031 (+ 1208us) write_op.cc:270] Start()
0619 06:29:51.767071 (+ 40us) write_op.cc:276] Timestamp: P: 1781850588846593 usec, L: 0
0619 06:29:51.774424 (+ 7353us) write_op.cc:270] Start()
0619 06:29:51.774451 (+ 27us) write_op.cc:276] Timestamp: P: 1781850588850711 usec, L: 0
0619 06:29:51.774637 (+ 186us) write_op.cc:270] Start()
0619 06:29:51.774663 (+ 26us) write_op.cc:276] Timestamp: P: 1781850588895313 usec, L: 0
0619 06:29:51.782305 (+ 7642us) write_op.cc:270] Start()
0619 06:29:51.782330 (+ 25us) write_op.cc:276] Timestamp: P: 1781850588899895 usec, L: 0
0619 06:29:51.784359 (+ 2029us) write_op.cc:270] Start()
0619 06:29:51.784378 (+ 19us) write_op.cc:276] Timestamp: P: 1781850588938065 usec, L: 0
0619 06:29:51.804040 (+ 19662us) write_op.cc:270] Start()
0619 06:29:51.804075 (+ 35us) write_op.cc:276] Timestamp: P: 1781850588945653 usec, L: 0
0619 06:29:51.804210 (+ 135us) write_op.cc:270] Start()
0619 06:29:51.804235 (+ 25us) write_op.cc:276] Timestamp: P: 1781850588958125 usec, L: 0
0619 06:29:51.804381 (+ 146us) write_op.cc:270] Start()
0619 06:29:51.804405 (+ 24us) write_op.cc:276] Timestamp: P: 1781850588986867 usec, L: 0
0619 06:29:51.804556 (+ 151us) write_op.cc:270] Start()
0619 06:29:51.804575 (+ 19us) write_op.cc:276] Timestamp: P: 1781850588999464 usec, L: 0
0619 06:29:51.804708 (+ 133us) write_op.cc:270] Start()
0619 06:29:51.804732 (+ 24us) write_op.cc:276] Timestamp: P: 1781850589025452 usec, L: 0
0619 06:29:51.804883 (+ 151us) write_op.cc:270] Start()
0619 06:29:51.804902 (+ 19us) write_op.cc:276] Timestamp: P: 178185
I20260619 06:29:52.890363 8659 raft_consensus.cc:482] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 996381a7495d4720a6f6be44a1d4781b)
I20260619 06:29:52.890460 8557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.7.96.2:56233 (request call id 5) took 1686 ms. Trace:
I20260619 06:29:52.890691 8659 raft_consensus.cc:504] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } } peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } }
I20260619 06:29:52.929220 7862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08686b31ffd64266bcdbd6f5eb29a87d" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 1252 } } ignore_live_leader: false dest_uuid: "996381a7495d4720a6f6be44a1d4781b" is_pre_election: true
I20260619 06:29:52.929677 8659 leader_election.cc:288] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499), 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063)
I20260619 06:29:52.934947 7992 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08686b31ffd64266bcdbd6f5eb29a87d" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 1252 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1" is_pre_election: true
I20260619 06:29:52.951030 8458 leader_election.cc:302] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b46f2dae92104884b86705d6bbc20003; no voters: 3fc4e58423894a27a7b94de5c6013cf1, 996381a7495d4720a6f6be44a1d4781b
I20260619 06:29:52.955108 8659 raft_consensus.cc:2726] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 06:29:53.216936 8660 raft_consensus.cc:2726] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 06:29:53.227226 8554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.7.96.3:46325 (request call id 3) took 2073 ms. Trace:
I20260619 06:29:53.248332 8660 raft_consensus.cc:482] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 996381a7495d4720a6f6be44a1d4781b)
I20260619 06:29:53.248523 8660 raft_consensus.cc:504] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:53.249258 8660 leader_election.cc:288] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063), 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499)
I20260619 06:29:53.250090 7992 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e2da70288694680bec48ac95c14656f" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 1245 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1" is_pre_election: true
I20260619 06:29:53.250695 7860 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e2da70288694680bec48ac95c14656f" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 1245 } } ignore_live_leader: false dest_uuid: "996381a7495d4720a6f6be44a1d4781b" is_pre_election: true
I20260619 06:29:53.251303 8653 raft_consensus.cc:482] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3fc4e58423894a27a7b94de5c6013cf1)
I20260619 06:29:53.251484 8458 leader_election.cc:302] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b46f2dae92104884b86705d6bbc20003; no voters: 3fc4e58423894a27a7b94de5c6013cf1, 996381a7495d4720a6f6be44a1d4781b
I20260619 06:29:53.251545 8653 raft_consensus.cc:504] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:53.252192 8653 leader_election.cc:288] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063), 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499)
I20260619 06:29:53.252346 8653 raft_consensus.cc:2726] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 06:29:53.251310 8553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.7.96.3:46325 (request call id 5) took 1601 ms. Trace:
I20260619 06:29:53.269492 7861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3e5e97eabdf42cf8e46ccb4b61c5fb7" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 1274 } } ignore_live_leader: false dest_uuid: "996381a7495d4720a6f6be44a1d4781b" is_pre_election: true
I20260619 06:29:53.270961 7993 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3e5e97eabdf42cf8e46ccb4b61c5fb7" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 1274 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1" is_pre_election: true
I20260619 06:29:53.271520 8458 leader_election.cc:302] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b46f2dae92104884b86705d6bbc20003; no voters: 3fc4e58423894a27a7b94de5c6013cf1, 996381a7495d4720a6f6be44a1d4781b
I20260619 06:29:53.271904 8660 raft_consensus.cc:2726] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 06:29:53.278545 8664 raft_consensus.cc:482] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3fc4e58423894a27a7b94de5c6013cf1)
I20260619 06:29:53.284879 8556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.7.96.3:46325 (request call id 4) took 1646 ms. Trace:
I20260619 06:29:53.280570 8664 raft_consensus.cc:504] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:53.298575 8664 leader_election.cc:288] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063), 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499)
I20260619 06:29:53.301095 8505 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:41904 (request call id 70) took 2529 ms. Trace:
I20260619 06:29:53.301216 8505 rpcz_store.cc:276] 0619 06:29:50.771301 (+ 0us) service_pool.cc:170] Inserting onto call queue
0619 06:29:50.771382 (+ 81us) service_pool.cc:227] Handling call
0619 06:29:52.218581 (+1447199us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x615000043e24. stack: 00007ff742e9066e 00007ff742e90430 00007ff741f175ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007ff74e398630 00007ff751f70c7f 00007ff74cadc016 00007ff74cadbd45 00007ff7499cc9be 00007ff7499cb79e 00007ff7499d1b25 00007ff7499d254f 00007ff7499d2378 00000000009edb7c
0619 06:29:52.930121 (+711540us) spinlock_profiling.cc:243] Waited 709 ms on lock 0x6150000436a4. stack: 00007ff742e9066e 00007ff742e90430 00007ff741f175ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007ff74e398630 00007ff751f70c7f 00007ff74cadc016 00007ff74cadbd45 00007ff7499cc9be 00007ff7499cb79e 00007ff7499d1b25 00007ff7499d254f 00007ff7499d2378 00000000009edb7c
0619 06:29:53.300675 (+370554us) spinlock_profiling.cc:243] Waited 370 ms on lock 0x615000042f24. stack: 00007ff742e9066e 00007ff742e90430 00007ff741f175ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007ff74e398630 00007ff751f70c7f 00007ff74cadc016 00007ff74cadbd45 00007ff7499cc9be 00007ff7499cb79e 00007ff7499d1b25 00007ff7499d254f 00007ff7499d2378 00000000009edb7c
0619 06:29:53.301027 (+ 352us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5809076608}
I20260619 06:29:53.303951 7861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98eb40b379a24876b6334fff708de671" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 1275 } } ignore_live_leader: false dest_uuid: "996381a7495d4720a6f6be44a1d4781b" is_pre_election: true
I20260619 06:29:53.312961 7990 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98eb40b379a24876b6334fff708de671" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 1275 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1" is_pre_election: true
I20260619 06:29:53.325448 8458 leader_election.cc:302] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b46f2dae92104884b86705d6bbc20003; no voters: 3fc4e58423894a27a7b94de5c6013cf1, 996381a7495d4720a6f6be44a1d4781b
I20260619 06:29:53.325752 8660 raft_consensus.cc:2726] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 06:29:52.860164 8560 rpcz_store.cc:276] 0619 06:29:50.979465 (+ 0us) service_pool.cc:170] Inserting onto call queue
0619 06:29:50.984629 (+ 5164us) service_pool.cc:227] Handling call
0619 06:29:51.206873 (+222244us) raft_consensus.cc:1457] Updating replica for 306 ops
0619 06:29:51.529199 (+322326us) raft_consensus.cc:1520] Early marking committed up to index 939
0619 06:29:51.529308 (+ 109us) raft_consensus.cc:1525] Triggering prepare for 306 ops
0619 06:29:51.529411 (+ 103us) write_op.cc:270] Start()
0619 06:29:51.529443 (+ 32us) write_op.cc:276] Timestamp: P: 1781850585304484 usec, L: 0
0619 06:29:51.531329 (+ 1886us) write_op.cc:270] Start()
0619 06:29:51.531357 (+ 28us) write_op.cc:276] Timestamp: P: 1781850585306692 usec, L: 0
0619 06:29:51.532572 (+ 1215us) write_op.cc:270] Start()
0619 06:29:51.532599 (+ 27us) write_op.cc:276] Timestamp: P: 1781850585404040 usec, L: 0
0619 06:29:51.532766 (+ 167us) write_op.cc:270] Start()
0619 06:29:51.532791 (+ 25us) write_op.cc:276] Timestamp: P: 1781850585418907 usec, L: 0
0619 06:29:51.532951 (+ 160us) write_op.cc:270] Start()
0619 06:29:51.532972 (+ 21us) write_op.cc:276] Timestamp: P: 1781850585420176 usec, L: 0
0619 06:29:51.533108 (+ 136us) write_op.cc:270] Start()
0619 06:29:51.533129 (+ 21us) write_op.cc:276] Timestamp: P: 1781850585427407 usec, L: 0
0619 06:29:51.533302 (+ 173us) write_op.cc:270] Start()
0619 06:29:51.533359 (+ 57us) write_op.cc:276] Timestamp: P: 1781850585505132 usec, L: 0
0619 06:29:51.533528 (+ 169us) write_op.cc:270] Start()
0619 06:29:51.533551 (+ 23us) write_op.cc:276] Timestamp: P: 1781850585509609 usec, L: 0
0619 06:29:51.533683 (+ 132us) write_op.cc:270] Start()
0619 06:29:51.533704 (+ 21us) write_op.cc:276] Timestamp: P: 1781850585543430 usec, L: 0
0619 06:29:51.533864 (+ 160us) write_op.cc:270] Start()
0619 06:29:51.533886 (+ 22us) write_op.cc:276] Timestamp: P: 1781850585544658 usec, L: 0
0619 06:29:51.534037 (+ 151us) write_op.cc:270] Start()
0619 06:29:51.534060 (+ 23us) write_op.cc:276] Timestamp: P: 1781850585565633 usec, L: 0
0619 06:29:51.534217 (+ 157us) write_op.cc:270] Start()
0619 06:29:51.534239 (+ 22us) write_op.cc:276] Timestamp: P: 1781850585609559 usec, L: 0
0619 06:29:51.534393 (+ 154us) write_op.cc:270] Start()
0619 06:29:51.534414 (+ 21us) write_op.cc:276] Timestamp: P: 1781850585627586 usec, L: 0
0619 06:29:51.534569 (+ 155us) write_op.cc:270] Start()
0619 06:29:51.534589 (+ 20us) write_op.cc:276] Timestamp: P: 1781850585642078 usec, L: 0
0619 06:29:51.534735 (+ 146us) write_op.cc:270] Start()
0619 06:29:51.534759 (+ 24us) write_op.cc:276] Timestamp: P: 1781850585646777 usec, L: 0
0619 06:29:51.535704 (+ 945us) write_op.cc:270] Start()
0619 06:29:51.535732 (+ 28us) write_op.cc:276] Timestamp: P: 1781850585674116 usec, L: 0
0619 06:29:51.535914 (+ 182us) write_op.cc:270] Start()
0619 06:29:51.535935 (+ 21us) write_op.cc:276] Timestamp: P: 1781850585700948 usec, L: 0
0619 06:29:51.536139 (+ 204us) write_op.cc:270] Start()
0619 06:29:51.536163 (+ 24us) write_op.cc:276] Timestamp: P: 1781850585724755 usec, L: 0
0619 06:29:51.536362 (+ 199us) write_op.cc:270] Start()
0619 06:29:51.536398 (+ 36us) write_op.cc:276] Timestamp: P: 1781850585725726 usec, L: 0
0619 06:29:51.536626 (+ 228us) write_op.cc:270] Start()
0619 06:29:51.536648 (+ 22us) write_op.cc:276] Timestamp: P: 1781850585727750 usec, L: 0
0619 06:29:51.550342 (+ 13694us) write_op.cc:270] Start()
0619 06:29:51.550408 (+ 66us) write_op.cc:276] Timestamp: P: 1781850585741137 usec, L: 0
0619 06:29:51.565820 (+ 15412us) write_op.cc:270] Start()
0619 06:29:51.565850 (+ 30us) write_op.cc:276] Timestamp: P: 1781850585795729 usec, L: 0
0619 06:29:51.566327 (+ 477us) write_op.cc:270] Start()
0619 06:29:51.568345 (+ 2018us) write_op.cc:276] Timestamp: P: 1781850585800258 usec, L: 0
0619 06:29:51.572984 (+ 4639us) write_op.cc:270] Start()
0619 06:29:51.573012 (+ 28us) write_op.cc:276] Timestamp: P: 1781850585804898 usec, L: 0
0619 06:29:51.587082 (+ 14070us) write_op.cc:270] Start()
0619 06:29:51.587109 (+ 27us) write_op.cc:276] Timestamp: P: 1781850585836501 usec, L: 0
0619 06:29:51.587314 (+ 205us) write_op.cc:270] Start()
0619 06:29:51.587341 (+ 27us) write_op.cc:276] Timestamp: P: 1781850585881013 usec, L: 0
0619 06:29:51.587552 (+ 211us) write_op.cc:270] Start()
0619 06:29:51.587578 (+ 26us) write_op.cc:276] Timestamp: P: 1781850585894707 usec, L: 0
0619 06:29:51.587779 (+ 201us) write_op.cc:270] Start()
0619 06:29:51.587803 (+ 24us) write_op.cc:276] Timestamp: P: 1781850585910801 usec, L: 0
0619 06:29:51.587999 (+ 196us) write_op.cc:270] Start()
0619 06:29:51.588023 (+ 24us) write_op.cc:276] Timestamp: P: 1781850585926277 usec, L: 0
0619 06:29:51.588209 (+ 186us) write_op.cc:270] Start()
0619 06:29:51.588232 (+ 23us) write_op.cc:276] Timestamp: P: 1781850585953936 usec, L: 0
0619 06:29:51.588414 (+ 182us) write_op.cc:270] Start()
0619 06:29:51.588436 (+ 22us) write_op.cc:276] Timestamp: P: 1781850585967577 usec, L: 0
0619 06:29:51.608704 (+ 20268us) write_op.cc:270] Start()
0619 06:29:51.608735 (+ 31us) write_op.cc:276] Timestamp: P: 1781850585974812 usec, L: 0
0619 06:29:51.610185 (+ 1450us) write_op.cc:270] Start()
0619 06:29:51.610212 (+ 27us) write_op.cc:276] Timestamp: P: 1781850585986188 usec, L: 0
0619 06:29:51.630183 (+ 19971us) write_op.cc:270] Start()
0619 06:29:51.630212 (+ 29us) write_op.cc:276] Timestamp: P: 1781850586015077 usec, L: 0
0619 06:29:51.632623 (+ 2411us) write_op.cc:270] Start()
0619 06:29:51.632652 (+ 29us) write_op.cc:276] Timestamp: P: 1781850586036522 usec, L: 0
0619 06:29:51.640470 (+ 7818us) write_op.cc:270] Start()
0619 06:29:51.640498 (+ 28us) write_op.cc:276] Timestamp: P: 1781850586077116 usec, L: 0
0619 06:29:51.648773 (+ 8275us) write_op.cc:270] Start()
0619 06:29:51.648801 (+ 28us) write_op.cc:276] Timestamp: P: 1781850586082685 usec, L: 0
0619 06:29:51.653778 (+ 4977us) write_op.cc:270] Start()
0619 06:29:51.653801 (+ 23us) write_op.cc:276] Timestamp: P: 1781850586091220 usec, L: 0
0619 06:29:51.653967 (+ 166us) write_op.cc:270] Start()
0619 06:29:51.653986 (+ 19us) write_op.cc:276] Timestamp: P: 1781850586096315 usec, L: 0
0619 06:29:51.654116 (+ 130us) write_op.cc:270] Start()
0619 06:29:51.654133 (+ 17us) write_op.cc:276] Timestamp: P: 1781850586100866 usec, L: 0
0619 06:29:51.655470 (+ 1337us) write_op.cc:270] Start()
0619 06:29:51.655493 (+ 23us) write_op.cc:276] Timestamp: P: 1781850586166606 usec, L: 0
0619 06:29:51.678988 (+ 23495us) write_op.cc:270] Start()
0619 06:29:51.679012 (+ 24us) write_op.cc:276] Timestamp: P: 1781850586179903 usec, L: 0
0619 06:29:51.687615 (+ 8603us) write_op.cc:270] Start()
0619 06:29:51.687638 (+ 23us) write_op.cc:276] Timestamp: P: 1781850586185022 usec, L: 0
0619 06:29:51.697852 (+ 10214us) write_op.cc:270] Start()
0619 06:29:51.697876 (+ 24us) write_op.cc:276] Timestamp: P: 1781850586191838 usec, L: 0
0619 06:29:51.698050 (+ 174us) write_op.cc:270] Start()
0619 06:29:51.698067 (+ 17us) write_op.cc:276] Timestamp: P: 1781850586218159 usec, L: 0
0619 06:29:51.698265 (+ 198us) write_op.cc:270] Start()
0619 06:29:51.698283 (+ 18us) write_op.cc:276] Timestamp: P: 1781850586236913 usec, L: 0
0619 06:29:51.698435 (+ 152us) write_op.cc:270] Start()
0619 06:29:51.698459 (+ 24us) write_op.cc:276] Timestamp: P: 1781850586251879 usec, L: 0
0619 06:29:51.698631 (+ 172us) write_op.cc:270] Start()
0619 06:29:51.698648 (+ 17us) write_op.cc:276] Timestamp: P: 1781850586257708 usec, L: 0
0619 06:29:51.698794 (+ 146us) write_op.cc:270] Start()
0619 06:29:51.698810 (+ 16us) write_op.cc:276] Timestamp: P: 1781850586264134 usec, L: 0
0619 06:29:51.699295 (+ 485us) write_op.cc:270] Start()
0619 06:29:51.699318 (+ 23us) write_op.cc:276] Timestamp: P: 1781850586310811 usec, L: 0
0619 06:29:51.699474 (+ 156us) write_op.cc:270] Start()
0619 06:29:51.699491 (+ 17us) write_op.cc:276] Timestamp: P: 1781850586325105 usec, L: 0
0619 06:29:51.699680 (+ 189us) write_op.cc:270] Start()
0619 06:29:51.699700 (+ 20us) write_op.cc:276] Timestamp: P: 1781850586326227 usec, L: 0
0619 06:29:51.699889 (+ 189us) write_op.cc:270] Start()
0619 06:29:51.699906 (+ 17us) write_op.cc:276] Timestamp: P: 1781850586326772 usec, L: 0
0619 06:29:51.700029 (+ 123us) write_op.cc:270] Start()
0619 06:29:51.700044 (+ 15us) write_op.cc:276] Timestamp: P: 1781850586347185 usec, L: 0
0619 06:29:51.700201 (+ 157us) write_op.cc:270] Start()
0619 06:29:51.700218 (+ 17us) write_op.cc:276] Timestamp: P: 1781850586378867 usec, L: 0
0619 06:29:51.700356 (+ 138us) write_op.cc:270] Start()
0619 06:29:51.700372 (+ 16us) write_op.cc:276] Timestamp: P: 1781850586382470 usec, L: 0
0619 06:29:51.700496 (+ 124us) write_op.cc:270] Start()
0619 06:29:51.700511 (+ 15us) write_op.cc:276] Timestamp: P: 1781850586400489 usec, L: 0
0619 06:29:51.700650 (+ 139us) write_op.cc:270] Start()
0619 06:29:51.700665 (+ 15us) write_op.cc:276] Timestamp: P: 1781850586449340 usec, L: 0
0619 06:29:51.700788 (+ 123us) write_op.cc:270] Start()
0619 06:29:51.700803 (+ 15us) write_op.cc:276] Timestamp: P: 1781850586462501 usec, L: 0
0619 06:29:51.700936 (+ 133us) write_op.cc:270] Start()
0619 06:29:51.700984 (+ 48us) write_op.cc:276] Timestamp: P: 1781850586474488 usec, L: 0
0619 06:29:51.701128 (+ 144us) write_op.cc:270] Start()
0619 06:29:51.701143 (+ 15us) write_op.cc:276] Timestamp: P: 1781850586513467 usec, L: 0
0619 06:29:51.701266 (+ 123us) write_op.cc:270] Start()
0619 06:29:51.701287 (+ 21us) write_op.cc:276] Timestamp: P: 1781850586533240 usec, L: 0
0619 06:29:51.701434 (+ 147us) write_op.cc:270] Start()
0619 06:29:51.701449 (+ 15us) write_op.cc:276] Timestamp: P: 1781850586544598 usec, L: 0
0619 06:29:51.701596 (+ 147us) write_op.cc:270] Start()
0619 06:29:51.701619 (+ 23us) write_op.cc:276] Timestamp: P: 1781850586547590 usec, L: 0
0619 06:29:51.701779 (+ 160us) write_op.cc:270] Start()
0619 06:29:51.701794 (+ 15us) write_op.cc:276] Timestamp: P: 1781850586570968 usec, L: 0
0619 06:29:51.701931 (+ 137us) write_op.cc:270] Start()
0619 06:29:51.701947 (+ 16us) write_op.cc:276] Timestamp: P: 1781850586592782 usec, L: 0
0619 06:29:51.703847 (+ 1900us) write_op.cc:270] Start()
0619 06:29:51.703867 (+ 20us) write_op.cc:276] Timestamp: P: 1781850586595990 usec, L: 0
0619 06:29:51.704020 (+ 153us) write_op.cc:270] Start()
0619 06:29:51.704036 (+ 16us) write_op.cc:276] Timestamp: P: 1781850586607069 usec, L: 0
0619 06:29:51.704193 (+ 157us) write_op.cc:270] Start()
0619 06:29:51.704215 (+ 22us) write_op.cc:276] Timestamp: P: 1781850586607647 usec, L: 0
0619 06:29:51.704389 (+ 174us) write_op.cc:270] Start()
0619 06:29:51.704409 (+ 20us) write_op.cc:276] Timestamp: P: 1781850586669361 usec, L: 0
0619 06:29:51.704583 (+ 174us) write_op.cc:270] Start()
0619 06:29:51.704601 (+ 18us) write_op.cc:276] Timestamp: P: 1781850586670106 usec, L: 0
0619 06:29:51.704752 (+ 151us) write_op.cc:270] Start()
0619 06:29:51.704768 (+ 16us) write_op.cc:276] Timestamp: P: 1781850586670736 usec, L: 0
0619 06:29:51.704915 (+ 147us) write_op.cc:270] Start()
0619 06:29:51.704933 (+ 18us) write_op.cc:276] Timestamp: P: 1781850586689507 usec, L: 0
0619 06:29:51.705114 (+ 181us) write_op.cc:270] Start()
0619 06:29:51.705135 (+ 21us) write_op.cc:276] Timestamp: P: 1781850586752331 usec, L: 0
0619 06:29:51.705295 (+ 160us) write_op.cc:270] Start()
0619 06:29:51.705313 (+ 18us) write_op.cc:276] Timestamp: P: 1781850586752940 usec, L: 0
0619 06:29:51.705453 (+ 140us) write_op.cc:270] Start()
0619 06:29:51.705469 (+ 16us) write_op.cc:276] Timestamp: P: 1781850586758678 usec, L: 0
0619 06:29:51.705610 (+ 141us) write_op.cc:270] Start()
0619 06:29:51.705627 (+ 17us) write_op.cc:276] Timestamp: P: 1781850586764493 usec, L: 0
0619 06:29:51.705767 (+ 140us) write_op.cc:270] Start()
0619 06:29:51.705783 (+ 16us) write_op.cc:276] Timestamp: P: 1781850586799702 usec, L: 0
0619 06:29:51.705924 (+ 141us) write_op.cc:270] Start()
0619 06:29:51.705942 (+ 18us) write_op.cc:276] Timestamp: P: 1781850586813404 usec, L: 0
0619 06:29:51.706557 (+ 615us) write_op.cc:270] Start()
0619 06:29:51.706577 (+ 20us) write_op.cc:276] Timestamp: P: 1781850586837909 usec, L: 0
0619 06:29:51.706723 (+ 146us) write_op.cc:270] Start()
0619 06:29:51.706739 (+ 16us) write_op.cc:276] Timestamp: P: 1781850586839977 usec, L: 0
0619 06:29:51.733661 (+ 26922us) write_op.cc:270] Start()
0619 06:29:51.733684 (+ 23us) write_op.cc:276] Timestamp: P: 1781850586843049 usec, L: 0
0619 06:29:51.766506 (+ 32822us) write_op.cc:270] Start()
0619 06:29:51.766561 (+ 55us) write_op.cc:276] Timestamp: P: 1781850586859798 usec, L: 0
0619 06:29:51.783848 (+ 17287us) write_op.cc:270] Start()
0619 06:29:51.783875 (+ 27us) write_op.cc:276] Timestamp: P: 1781850586900720 usec, L: 0
0619 06:29:51.789652 (+ 5777us) write_op.cc:270] Start()
0619 06:29:51.800694 (+ 11042us) write_op.cc:276] Timestamp: P: 1781850586907376 usec, L: 0
0619 06:29:51.806569 (+ 5875us) write_op.cc:270] Start()
0619 06:29:51.806593 (+ 24us) write_op.cc:276] Timestamp: P: 1781850586937096 usec, L: 0
0619 06:29:51.806750 (+ 157us) write_op.cc:270] Start()
0619 06:29:51.806769 (+ 19us) write_op.cc:276] Timestamp: P: 1781850586943330 usec, L: 0
0619 06:29:51.809158 (+ 2389us) write_op.cc:270] Start()
0619 06:29:51.809174 (+ 16us) write_op.cc:276] Timestamp: P: 1781850586967209 usec, L: 0
0619 06:29:51.809349 (+ 175us) write_op.cc:270] Start()
0619 06:29:51.809370 (+ 21us) write_op.cc:276] Timestamp: P: 1781850586967806 usec, L: 0
0619 06:29:51.809510 (+ 140us) write_op.cc:270] Start()
0619 06:29:51.809529 (+ 19us) write_op.cc:276] Timestamp: P: 1781850586985841 usec, L: 0
0619 06:29:51.809653 (+ 124us) write_op.cc:270] Start()
0619 06:29:51.809672 (+ 19us) write_op.cc:276] Timestamp: P: 1781850587007092 usec, L: 0
0619 06:29:51.809796 (+ 124us) write_op.cc:270] Start()
0619 06:29:51.809816 (+ 20us) write_op.cc:276] Timestamp: P: 1781850587030871 usec, L: 0
0619 06:29:51.813780 (+ 3964us) write_op.cc:270] Start()
0619 06:29:51.813801 (+ 21us) write_op.cc:276] Timestamp: P: 1781850587048803 usec, L: 0
0619 06:29:51.813937 (+ 136us) write_op.cc:270] Start()
0619 06:29:51.813955 (+ 18us) write_op.cc:276] Timestamp: P: 1781850587050301 usec, L: 0
0619 06:29:51.821808 (+ 7853us) write_op.cc:270] Start()
0619 06:29:51.821833 (+ 25us) write_op.cc:276] Timestamp: P: 1781850587079895 usec, L: 0
0619 06:29:51.822652 (+ 819us) write_op.cc:270] Start()
0619 06:29:51.822679 (+ 27us) write_op.cc:276] Timestamp: P: 1781850587083153 usec, L: 0
0619 06:29:51.825380 (+ 2701us) write_op.cc:270] Start()
0619 06:29:51.825435 (+ 55us) write_op.cc:276] Timestamp: P: 1781850587128601 usec, L: 0
0619 06:29:51.827685 (+ 2250us) write_op.cc:270] Start()
0619 06:29:51.827708 (+ 23us) write_op.cc:276] Timestamp: P: 1781850587149478 usec, L: 0
0619 06:29:51.827901 (+ 193us) write_op.cc:270] Start()
0619 06:29:51.827923 (+ 22us) write_op.cc:276] Timestamp: P: 1781850587187423 usec, L: 0
0619 06:29:51.866900 (+ 38977us) write_op.cc:270] Start()
0619 06:29:51.866941 (+ 41us) write_op.cc:276] Timestamp: P: 1781850587200443 usec, L: 0
0619 06:29:51.883189 (+ 16248us) write_op.cc:270] Start()
0619 06:29:51.883218 (+ 29us) write_op.cc:276] Timestamp: P: 1781850587231707 usec, L: 0
0619 06:29:51.883477 (+ 259us) write_op.cc:270] Start()
0619 06:29:51.883505 (+ 28us) write_op.cc:276] Timestamp: P: 1781850587246138 usec, L: 0
0619 06:29:51.883704 (+ 199us) write_op.cc:270] Start()
0619 06:29:51.883727 (+ 23us) write_op.cc:276] Timestamp: P: 1781850587272892 usec, L: 0
0619 06:29:51.883926 (+ 199us) write_op.cc:270] Start()
0619 06:29:51.883949 (+ 23us) write_op.cc:276] Timestamp: P: 1781850587273478 usec, L: 0
0619 06:29:51.884439 (+ 490us) write_op.cc:270] Start()
0619 06:29:51.884464 (+ 25us) write_op.cc:276] Timestamp: P: 1781850587274156 usec, L: 0
0619 06:29:51.884861 (+ 397us) write_op.cc:270] Start()
0619 06:29:51.884891 (+ 30us) write_op.cc:276] Timestamp: P: 1781850587287935 usec, L: 0
0619 06:29:51.902203 (+ 17312us) write_op.cc:270] Start()
0619 06:29:51.902228 (+ 25us) write_op.cc:276] Timestamp: P: 1781850587342339 usec, L: 0
0619 06:29:51.902423 (+ 195us) write_op.cc:270] Start()
0619 06:29:51.902446 (+ 23us) write_op.cc:276] Timestamp: P: 1781850587345486 usec, L: 0
0619 06:29:51.905485 (+ 3039us) write_op.cc:270] Start()
0619 06:29:51.905509 (+ 24us) write_op.cc:276] Timestamp: P: 1781850587346815 usec, L: 0
0619 06:29:51.907571 (+ 2062us) write_op.cc:270] Start()
0619 06:29:51.907594 (+ 23us) write_op.cc:276] Timestamp: P: 1781850587361339 usec, L: 0
0619 06:29:51.911614 (+ 4020us) write_op.cc:270] Start()
0619 06:29:51.911632 (+ 18us) write_op.cc:276] Timestamp: P: 1781850587388984 usec, L: 0
0619 06:29:51.913351 (+ 1719us) write_op.cc:270] Start()
0619 06:29:51.913369 (+ 18us) write_op.cc:276] Timestamp: P: 1781850587402306 usec, L: 0
0619 06:29:51.918564 (+ 5195us) write_op.cc:270] Start()
0619 06:29:51.918587 (+ 23us) write_op.cc:276] Timestamp: P: 1781850587409983 usec, L: 0
0619 06:29:51.927224 (+ 8637us) write_op.cc:270] Start()
0619 06:29:51.927250 (+ 26us) write_op.cc:276] Timestamp: P: 1781850587453937 usec, L: 0
0619 06:29:51.927450 (+ 200us) write_op.cc:270] Start()
0619 06:29:51.927473 (+ 23us) write_op.cc:276] Timestamp: P: 1781850587466810 usec, L: 0
0619 06:29:51.927693 (+ 220us) write_op.cc:270] Start()
0619 06:29:51.927715 (+ 22us) write_op.cc:276] Timestamp: P: 1781850587482589 usec, L: 0
0619 06:29:51.927895 (+ 180us) write_op.cc:270] Start()
0619 06:29:51.927927 (+ 32us) write_op.cc:276] Timestamp: P: 1781850587512446 usec, L: 0
0619 06:29:51.934032 (+ 6105us) write_op.cc:270] Start()
0619 06:29:51.934056 (+ 24us) write_op.cc:276] Timestamp: P: 1781850587513114 usec, L: 0
0619 06:29:51.934255 (+ 199us) write_op.cc:270] Start()
0619 06:29:51.934278 (+ 23us) write_op.cc:276] Timestamp: P: 1781850587545233 usec, L: 0
0619 06:29:51.934418 (+ 140us) write_op.cc:270] Start()
0619 06:29:51.934439 (+ 21us) write_op.cc:276] Timestamp: P: 1781850587572175 usec, L: 0
0619 06:29:51.934617 (+ 178us) write_op.cc:270] Start()
0619 06:29:51.934638 (+ 21us) write_op.cc:276] Timestamp: P: 1781850587633153 usec, L: 0
0619 06:29:51.934773 (+ 135us) write_op.cc:270] Start()
0619 06:29:51.934791 (+ 18us) write_op.cc:276] Timestamp: P: 1781850587637065 usec, L: 0
0619 06:29:51.934973 (+ 182us) write_op.cc:270] Start()
0619 06:29:51.934995 (+ 22us) write_op.cc:276] Timestamp: P: 1781850587642171 usec, L: 0
0619 06:29:51.935167 (+ 172us) write_op.cc:270] Start()
0619 06:29:51.935188 (+ 21us) write_op.cc:276] Timestamp: P: 1781850587643999 usec, L: 0
0619 06:29:51.935336 (+ 148us) write_op.cc:270] Start()
0619 06:29:51.935356 (+ 20us) write_op.cc:276] Timestamp: P: 1781850587687160 usec, L: 0
0619 06:29:51.941469 (+ 6113us) write_op.cc:270] Start()
0619 06:29:51.941495 (+ 26us) write_op.cc:276] Timestamp: P: 1781850587721319 usec, L: 0
0619 06:29:51.941658 (+ 163us) write_op.cc:270] Start()
0619 06:29:51.941682 (+ 24us) write_op.cc:276] Timestamp: P: 1781850587732164 usec, L: 0
0619 06:29:51.951901 (+ 10219us) write_op.cc:270] Start()
0619 06:29:51.951936 (+ 35us) write_op.cc:276] Timestamp: P: 1781850587735253 usec, L: 0
0619 06:29:51.964787 (+ 12851us) write_op.cc:270] Start()
0619 06:29:51.964814 (+ 27us) write_op.cc:276] Timestamp: P: 1781850587777092 usec, L: 0
0619 06:29:51.968324 (+ 3510us) write_op.cc:270] Start()
0619 06:29:51.968350 (+ 26us) write_op.cc:276] Timestamp: P: 1781850587785335 usec, L: 0
0619 06:29:51.977197 (+ 8847us) write_op.cc:270] Start()
0619 06:29:51.981563 (+ 4366us) write_op.cc:276] Timestamp: P: 1781850587790117 usec, L: 0
0619 06:29:51.982800 (+ 1237us) write_op.cc:270] Start()
0619 06:29:51.982822 (+ 22us) write_op.cc:276] Timestamp: P: 1781850587820322 usec, L: 0
0619 06:29:51.982960 (+ 138us) write_op.cc:270] Start()
0619 06:29:51.982981 (+ 21us) write_op.cc:276] Timestamp: P: 1781850587853037 usec, L: 0
0619 06:29:51.998618 (+ 15637us) write_op.cc:270] Start()
0619 06:29:51.998636 (+ 18us) write_op.cc:276] Timestamp: P: 1781850587867979 usec, L: 0
0619 06:29:51.999724 (+ 1088us) write_op.cc:270] Start()
0619 06:29:51.999749 (+ 25us) write_op.cc:276] Timestamp: P: 1781850587874671 usec, L: 0
0619 06:29:52.007837 (+ 8088us) write_op.cc:270] Start()
0619 06:29:52.007862 (+ 25us) write_op.cc:276] Timestamp: P: 1781850587877631 usec, L: 0
0619 06:29:52.009105 (+ 1243us) write_op.cc:270] Start()
0619 06:29:52.009131 (+ 26us) write_op.cc:276] Timestamp: P: 1781850587907111 usec, L: 0
0619 06:29:52.009276 (+ 145us) write_op.cc:270] Start()
0619 06:29:52.009295 (+ 19us) write_op.cc:276] Timestamp: P: 1781850587942533 usec, L: 0
0619 06:29:52.016447 (+ 7152us) write_op.cc:270] Start()
0619 06:29:52.016475 (+ 28us) write_op.cc:276] Timestamp: P: 1781850587959496 usec, L: 0
0619 06:29:52.018968 (+ 2493us) write_op.cc:270] Start()
0619 06:29:52.018994 (+ 26us) write_op.cc:276] Timestamp: P: 1781850587962245 usec, L: 0
0619 06:29:52.022282 (+ 3288us) write_op.cc:270] Start()
0619 06:29:52.022308 (+ 26us) write_op.cc:276] Timestamp: P: 1781850587971936 usec, L: 0
0619 06:29:52.032850 (+ 10542us) write_op.cc:270] Start()
0619 06:29:52.032874 (+ 24us) write_op.cc:276] Timestamp: P: 1781850587995551 usec, L: 0
0619 06:29:52.037640 (+ 4766us) write_op.cc:270] Start()
0619 06:29:52.037667 (+ 27us) write_op.cc:276] Timestamp: P: 1781850588005374 usec, L: 0
0619 06:29:52.041942 (+ 4275us) write_op.cc:270] Start()
0619 06:29:52.041968 (+ 26us) write_op.cc:276] Timestamp: P: 1781850588047112 usec, L: 0
0619 06:29:52.042121 (+ 153us) write_op.cc:270] Start()
0619 06:29:52.042142 (+ 21us) write_op.cc:276] Timestamp: P: 1781850588047796 usec, L: 0
0619 06:29:52.043089 (+ 947us) write_op.cc:270] Start()
0619 06:29:52.043113 (+ 24us) write_op.cc:276] Timestamp: P: 1781850588068967 usec, L: 0
0619 06:29:52.043276 (+ 163us) write_op.cc:270] Start()
0619 06:29:52.043296 (+ 20us) write_op.cc:276] Timestamp: P: 1781850588072153 usec, L: 0
0619 06:29:52.043460 (+ 164us) write_op.cc:270] Start()
0619 06:29:52.043479 (+ 19us) write_op.cc:276] Timestamp: P: 1781850588122101 usec, L: 0
0619 06:29:52.045300 (+ 1821us) write_op.cc:270] Start()
0619 06:29:52.045320 (+ 20us) write_op.cc:276] Timestamp: P: 1781850588142822 usec, L: 0
0619 06:29:52.045663 (+ 343us) write_op.cc:270] Start()
0619 06:29:52.045686 (+ 23us) write_op.cc:276] Timestamp: P: 1781850588150120 usec, L: 0
0619 06:29:52.045844 (+ 158us) write_op.cc:270] Start()
0619 06:29:52.045876 (+ 32us) write_op.cc:276] Timestamp: P: 1781850588157027 usec, L: 0
0619 06:29:52.046033 (+ 157us) write_op.cc:270] Start()
0619 06:29:52.046052 (+ 19us) write_op.cc:276] Timestamp: P: 1781850588177955 usec, L: 0
0619 06:29:52.046195 (+ 143us) write_op.cc:270] Start()
0619 06:29:52.046214 (+ 19us) write_op.cc:276] Timestamp: P: 1781850588188388 usec, L: 0
0619 06:29:52.046340 (+ 126us) write_op.cc:270] Start()
0619 06:29:52.046359 (+ 19us) write_op.cc:276] Timestamp: P: 1781850588225142 usec, L: 0
0619 06:29:52.047035 (+ 676us) write_op.cc:270] Start()
0619 06:29:52.047060 (+ 25us) write_op.cc:276] Timestamp: P: 1781850588225763 usec, L: 0
0619 06:29:52.047374 (+ 314us) write_op.cc:270] Start()
0619 06:29:52.047397 (+ 23us) write_op.cc:276] Timestamp: P: 1781850588268418 usec, L: 0
0619 06:29:52.047556 (+ 159us) write_op.cc:270] Start()
0619 06:29:52.047577 (+ 21us) write_op.cc:276] Timestamp: P: 1781850588269144 usec, L: 0
0619 06:29:52.047709 (+ 132us) write_op.cc:270] Start()
0619 06:29:52.047745 (+ 36us) write_op.cc:276] Timestamp: P: 1781850588274759 usec, L: 0
0619 06:29:52.047863 (+ 118us) write_op.cc:270] Start()
0619 06:29:52.047881 (+ 18us) write_op.cc:276] Timestamp: P: 1781850588318956 usec, L: 0
0619 06:29:52.048028 (+ 147us) write_op.cc:270] Start()
0619 06:29:52.048054 (+ 26us) write_op.cc:276] Timestamp: P: 1781850588340606 usec, L: 0
0619 06:29:52.048186 (+ 132us) write_op.cc:270] Start()
0619 06:29:52.048204 (+ 18us) write_op.cc:276] Timestamp: P: 1781850588341201 usec, L: 0
0619 06:29:52.077931 (+ 29727us) write_op.cc:270] Start()
0619 06:29:52.077959 (+ 28us) write_op.cc:276] Timestamp: P: 1781850588359780 usec, L: 0
0619 06:29:52.078658 (+ 699us) write_op.cc:270] Start()
0619 06:29:52.078682 (+ 24us) write_op.cc:276] Timestamp: P: 1781850588401345 usec, L: 0
0619 06:29:52.080668 (+ 1986us) write_op.cc:270] Start()
0619 06:29:52.080692 (+ 24us) write_op.cc:276] Timestamp: P: 1781850588432691 usec, L: 0
0619 06:29:52.085237 (+ 4545us) write_op.cc:270] Start()
0619 06:29:52.085261 (+ 24us) write_op.cc:276] Timestamp: P: 1781850588433874 usec, L: 0
0619 06:29:52.091944 (+ 6683us) write_op.cc:270] Start()
0619 06:29:52.091986 (+ 42us) write_op.cc:276] Timestamp: P: 1781850588446822 usec, L: 0
0619 06:29:52.094129 (+ 2143us) write_op.cc:270] Start()
0619 06:29:52.094149 (+ 20us) write_op.cc:276] Timestamp: P: 1781850588477009 usec, L: 0
0619 06:29:52.094284 (+ 135us) write_op.cc:270] Start()
0619 06:29:52.094301 (+ 17us) write_op.cc:276] Timestamp: P: 1781850588495892 usec, L: 0
0619 06:29:52.097747 (+ 3446us) write_op.cc:270] Start()
0619 06:29:52.097771 (+ 24us) write_op.cc:276] Timestamp: P: 1781850588498192 usec, L: 0
0619 06:29:52.097969 (+ 198us) write_op.cc:270] Start()
0619 06:29:52.098003 (+ 34us) write_op.cc:276] Timestamp: P: 1781850588533448 usec, L: 0
0619 06:29:52.098146 (+ 143us) write_op.cc:270] Start()
0619 06:29:52.098165 (+ 19us) write_op.cc:276] Timestamp: P: 1781850588544703 usec, L: 0
0619 06:29:52.098293 (+ 128us) write_op.cc:270] Start()
0619 06:29:52.098312 (+ 19us) write_op.cc:276] Timestamp: P: 1781850588560201 usec, L: 0
0619 06:29:52.098438 (+ 126us) write_op.cc:270] Start()
0619 06:29:52.098461 (+ 23us) write_op.cc:276] Timestamp: P: 1781850588573147 usec, L: 0
0619 06:29:52.117307 (+ 18846us) write_op.cc:270] Start()
0619 06:29:52.117330 (+ 23us) write_op.cc:276] Timestamp: P: 1781850588601456 usec, L: 0
0619 06:29:52.126488 (+ 9158us) write_op.cc:270] Start()
0619 06:29:52.126527 (+ 39us) write_op.cc:276] Timestamp: P: 1781850588603044 usec, L: 0
0619 06:29:52.127521 (+ 994us) write_op.cc:270] Start()
0619 06:29:52.127588 (+ 67us) write_op.cc:276] Timestamp: P: 1781850588607359 usec, L: 0
0619 06:29:52.140031 (+ 12443us) write_op.cc:270] Start()
0619 06:29:52.140068 (+ 37us) write_op.cc:276] Timestamp: P: 1781850588624547 usec, L: 0
0619 06:29:52.142385 (+ 2317us) write_op.cc:270] Start()
0619 06:29:52.142411 (+ 26us) write_op.cc:276] Timestamp: P: 1781850588653106 usec, L: 0
0619 06:29:52.142642 (+ 231us) write_op.cc:270] Start()
0619 06:29:52.142665 (+ 23us) write_op.cc:276] Timestamp: P: 1781850588679061 usec, L: 0
0619 06:29:52.142848 (+ 183us) write_op.cc:270] Start()
0619 06:29:52.142870 (+ 22us) write_op.cc:276] Timestamp: P: 1781850588681097 usec, L: 0
0619 06:29:52.143000 (+ 130us) write_op.cc:270] Start()
0619 06:29:52.143020 (+ 20us) write_op.cc:276] Timestamp: P: 1781850588723020 usec, L: 0
0619 06:29:52.143157 (+ 137us) write_op.cc:270] Start()
0619 06:29:52.143179 (+ 22us) write_op.cc:276] Timestamp: P: 1781850588729581 usec, L: 0
0619 06:29:52.143318 (+ 139us) write_op.cc:270] Start()
0619 06:29:52.143336 (+ 18us) write_op.cc:276] Timestamp: P: 1781850588757268 usec, L: 0
0619 06:29:52.143469 (+ 133us) write_op.cc:270] Start()
0619 06:29:52.143490 (+ 21us) write_op.cc:276] Timestamp: P: 1781850588779622 usec, L: 0
0619 06:29:52.143640 (+ 150us) write_op.cc:270] Start()
0619 06:29:52.143657 (+ 17us) write_op.cc:276] Timestamp: P: 1781850588786132 usec, L: 0
0619 06:29:52.143787 (+ 130us) write_op.cc:270] Start()
0619 06:29:52.143810 (+ 23us) write_op.cc:276] Timestamp: P: 1781850588802365 usec, L: 0
0619 06:29:52.143947 (+ 137us) write_op.cc:270] Start()
0619 06:29:52.143992 (+ 45us) write_op.cc:276] Timestamp: P: 1781850588806723 usec, L: 0
0619 06:29:52.157062 (+ 13070us) write_op.cc:270] Start()
0619 06:29:52.157085 (+ 23us) write_op.cc:276] Timestamp: P: 1781850588837749 usec, L: 0
0619 06:29:52.164784 (+ 7699us) write_op.cc:270] Start()
0619 06:29:52.164804 (+ 20us) write_op.cc:276] Timestamp: P: 1781850588851925 usec, L: 0
0619 06:29:52.169820 (+ 5016us) write_op.cc:270] Start()
0619 06:29:52.169840 (+ 20us) write_op.cc:276] Timestamp: P: 1781850588857309 usec, L: 0
0619 06:29:52.172442 (+ 2602us) write_op.cc:270] Start()
0619 06:29:52.172462 (+ 20us) write_op.cc:276] Timestamp: P: 1781850588895442 usec, L: 0
0619 06:29:52.175026 (+ 2564us) write_op.cc:270] Start()
0619 06:29:52.175045 (+ 19us) write_op.cc:276] Timestamp: P: 1781850588903039 usec, L: 0
0619 06:29:52.183595 (+ 8550us) write_op.cc:270] Start()
0619 06:29:52.183620 (+ 25us) write_op.cc:276] Timestamp: P: 1781850588929784 usec, L: 0
0619 06:29:52.183773 (+ 153us) write_op.cc:270] Start()
0619 06:29:52.183802 (+ 29us) write_op.cc:276] Timestamp: P: 1781850588946110 usec, L: 0
0619 06:29:52.223634 (+ 39832us) write_op.cc:270] Start()
0619 06:29:52.223657 (+ 23us) write_op.cc:276] Timestamp: P: 1781850588965703 usec, L: 0
0619 06:29:52.223795 (+ 138us) write_op.cc:270] Start()
0619 06:29:52.223815 (+ 20us) write_op.cc:276] Timestamp: P: 1781850588986585 usec, L: 0
0619 06:29:52.223959 (+ 144us) write_op.cc:270] Start()
0619 06:29:52.223980 (+ 21us) write_op.cc:276] Timestamp: P: 178185
I20260619 06:29:53.335322 8660 raft_consensus.cc:482] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 996381a7495d4720a6f6be44a1d4781b)
I20260619 06:29:53.338956 8660 raft_consensus.cc:504] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } } peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } }
I20260619 06:29:53.339977 7860 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08686b31ffd64266bcdbd6f5eb29a87d" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 1252 } } ignore_live_leader: false dest_uuid: "996381a7495d4720a6f6be44a1d4781b" is_pre_election: true
I20260619 06:29:53.340883 8660 leader_election.cc:288] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499), 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063)
I20260619 06:29:53.346014 7993 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08686b31ffd64266bcdbd6f5eb29a87d" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 1252 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1" is_pre_election: true
I20260619 06:29:53.367648 8458 leader_election.cc:302] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b46f2dae92104884b86705d6bbc20003; no voters: 3fc4e58423894a27a7b94de5c6013cf1, 996381a7495d4720a6f6be44a1d4781b
I20260619 06:29:53.376935 8660 raft_consensus.cc:2726] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 06:29:53.402267 8664 raft_consensus.cc:482] T f5c2224f852746c8893931fd3ff27126 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 996381a7495d4720a6f6be44a1d4781b)
I20260619 06:29:53.402446 8664 raft_consensus.cc:504] T f5c2224f852746c8893931fd3ff27126 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:53.405089 8664 leader_election.cc:288] T f5c2224f852746c8893931fd3ff27126 P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063), 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499)
I20260619 06:29:53.405613 7862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5c2224f852746c8893931fd3ff27126" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 1344 } } ignore_live_leader: false dest_uuid: "996381a7495d4720a6f6be44a1d4781b" is_pre_election: true
I20260619 06:29:53.409722 7993 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5c2224f852746c8893931fd3ff27126" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 1344 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1" is_pre_election: true
I20260619 06:29:53.427522 8458 leader_election.cc:302] T f5c2224f852746c8893931fd3ff27126 P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b46f2dae92104884b86705d6bbc20003; no voters: 3fc4e58423894a27a7b94de5c6013cf1, 996381a7495d4720a6f6be44a1d4781b
I20260619 06:29:53.430660 8664 raft_consensus.cc:2726] T f5c2224f852746c8893931fd3ff27126 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 06:29:53.578146 8664 raft_consensus.cc:482] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3fc4e58423894a27a7b94de5c6013cf1)
I20260619 06:29:53.578361 8664 raft_consensus.cc:504] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:53.579381 7860 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3e5e97eabdf42cf8e46ccb4b61c5fb7" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 1274 } } ignore_live_leader: false dest_uuid: "996381a7495d4720a6f6be44a1d4781b" is_pre_election: true
I20260619 06:29:53.581808 8664 leader_election.cc:288] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063), 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499)
I20260619 06:29:53.583719 7993 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3e5e97eabdf42cf8e46ccb4b61c5fb7" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 1274 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1" is_pre_election: true
I20260619 06:29:53.585899 8458 leader_election.cc:302] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b46f2dae92104884b86705d6bbc20003; no voters: 3fc4e58423894a27a7b94de5c6013cf1, 996381a7495d4720a6f6be44a1d4781b
I20260619 06:29:53.593127 8664 raft_consensus.cc:2726] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 06:29:53.660939 8664 raft_consensus.cc:482] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3fc4e58423894a27a7b94de5c6013cf1)
I20260619 06:29:53.662873 8664 raft_consensus.cc:504] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:53.663578 8664 leader_election.cc:288] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063), 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499)
I20260619 06:29:53.664635 7860 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cffdcc0e99c47aead56bbaea58d3e4d" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 1252 } } ignore_live_leader: false dest_uuid: "996381a7495d4720a6f6be44a1d4781b" is_pre_election: true
I20260619 06:29:53.702272 7990 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cffdcc0e99c47aead56bbaea58d3e4d" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 1252 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1" is_pre_election: true
I20260619 06:29:53.725410 8458 leader_election.cc:302] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b46f2dae92104884b86705d6bbc20003; no voters: 3fc4e58423894a27a7b94de5c6013cf1, 996381a7495d4720a6f6be44a1d4781b
I20260619 06:29:53.725739 8653 raft_consensus.cc:2726] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 06:29:53.778112 8660 raft_consensus.cc:482] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3fc4e58423894a27a7b94de5c6013cf1)
I20260619 06:29:53.778338 8660 raft_consensus.cc:504] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:53.779481 7860 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98eb40b379a24876b6334fff708de671" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 1275 } } ignore_live_leader: false dest_uuid: "996381a7495d4720a6f6be44a1d4781b" is_pre_election: true
I20260619 06:29:53.779623 7992 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98eb40b379a24876b6334fff708de671" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 1275 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1" is_pre_election: true
I20260619 06:29:53.780392 8660 leader_election.cc:288] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063), 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499)
I20260619 06:29:53.780716 8458 leader_election.cc:302] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b46f2dae92104884b86705d6bbc20003; no voters: 3fc4e58423894a27a7b94de5c6013cf1, 996381a7495d4720a6f6be44a1d4781b
I20260619 06:29:53.781143 8660 raft_consensus.cc:2726] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 06:29:52.890695 8557 rpcz_store.cc:276] 0619 06:29:51.203742 (+ 0us) service_pool.cc:170] Inserting onto call queue
0619 06:29:51.204644 (+ 902us) service_pool.cc:227] Handling call
0619 06:29:51.254911 (+ 50267us) raft_consensus.cc:1457] Updating replica for 311 ops
0619 06:29:51.554793 (+299882us) raft_consensus.cc:1520] Early marking committed up to index 0
0619 06:29:51.554799 (+ 6us) raft_consensus.cc:1525] Triggering prepare for 311 ops
0619 06:29:51.554913 (+ 114us) write_op.cc:270] Start()
0619 06:29:51.554941 (+ 28us) write_op.cc:276] Timestamp: P: 1781850585403300 usec, L: 0
0619 06:29:51.583509 (+ 28568us) write_op.cc:270] Start()
0619 06:29:51.583538 (+ 29us) write_op.cc:276] Timestamp: P: 1781850585445332 usec, L: 0
0619 06:29:51.584751 (+ 1213us) write_op.cc:270] Start()
0619 06:29:51.584781 (+ 30us) write_op.cc:276] Timestamp: P: 1781850585446006 usec, L: 0
0619 06:29:51.593432 (+ 8651us) write_op.cc:270] Start()
0619 06:29:51.593457 (+ 25us) write_op.cc:276] Timestamp: P: 1781850585447379 usec, L: 0
0619 06:29:51.610658 (+ 17201us) write_op.cc:270] Start()
0619 06:29:51.610685 (+ 27us) write_op.cc:276] Timestamp: P: 1781850585504527 usec, L: 0
0619 06:29:51.610912 (+ 227us) write_op.cc:270] Start()
0619 06:29:51.610939 (+ 27us) write_op.cc:276] Timestamp: P: 1781850585505982 usec, L: 0
0619 06:29:51.611126 (+ 187us) write_op.cc:270] Start()
0619 06:29:51.611180 (+ 54us) write_op.cc:276] Timestamp: P: 1781850585543710 usec, L: 0
0619 06:29:51.611397 (+ 217us) write_op.cc:270] Start()
0619 06:29:51.611421 (+ 24us) write_op.cc:276] Timestamp: P: 1781850585545677 usec, L: 0
0619 06:29:51.611618 (+ 197us) write_op.cc:270] Start()
0619 06:29:51.611642 (+ 24us) write_op.cc:276] Timestamp: P: 1781850585573788 usec, L: 0
0619 06:29:51.612981 (+ 1339us) write_op.cc:270] Start()
0619 06:29:51.613005 (+ 24us) write_op.cc:276] Timestamp: P: 1781850585609964 usec, L: 0
0619 06:29:51.613200 (+ 195us) write_op.cc:270] Start()
0619 06:29:51.613220 (+ 20us) write_op.cc:276] Timestamp: P: 1781850585629456 usec, L: 0
0619 06:29:51.613403 (+ 183us) write_op.cc:270] Start()
0619 06:29:51.613425 (+ 22us) write_op.cc:276] Timestamp: P: 1781850585645041 usec, L: 0
0619 06:29:51.613592 (+ 167us) write_op.cc:270] Start()
0619 06:29:51.613611 (+ 19us) write_op.cc:276] Timestamp: P: 1781850585650834 usec, L: 0
0619 06:29:51.613772 (+ 161us) write_op.cc:270] Start()
0619 06:29:51.613791 (+ 19us) write_op.cc:276] Timestamp: P: 1781850585674505 usec, L: 0
0619 06:29:51.613962 (+ 171us) write_op.cc:270] Start()
0619 06:29:51.613982 (+ 20us) write_op.cc:276] Timestamp: P: 1781850585710204 usec, L: 0
0619 06:29:51.614150 (+ 168us) write_op.cc:270] Start()
0619 06:29:51.614168 (+ 18us) write_op.cc:276] Timestamp: P: 1781850585723964 usec, L: 0
0619 06:29:51.614347 (+ 179us) write_op.cc:270] Start()
0619 06:29:51.614366 (+ 19us) write_op.cc:276] Timestamp: P: 1781850585725880 usec, L: 0
0619 06:29:51.615233 (+ 867us) write_op.cc:270] Start()
0619 06:29:51.615258 (+ 25us) write_op.cc:276] Timestamp: P: 1781850585726416 usec, L: 0
0619 06:29:51.628895 (+ 13637us) write_op.cc:270] Start()
0619 06:29:51.628925 (+ 30us) write_op.cc:276] Timestamp: P: 1781850585741787 usec, L: 0
0619 06:29:51.629121 (+ 196us) write_op.cc:270] Start()
0619 06:29:51.629144 (+ 23us) write_op.cc:276] Timestamp: P: 1781850585795052 usec, L: 0
0619 06:29:51.631086 (+ 1942us) write_op.cc:270] Start()
0619 06:29:51.631111 (+ 25us) write_op.cc:276] Timestamp: P: 1781850585803124 usec, L: 0
0619 06:29:51.634463 (+ 3352us) write_op.cc:270] Start()
0619 06:29:51.635176 (+ 713us) write_op.cc:276] Timestamp: P: 1781850585806084 usec, L: 0
0619 06:29:51.652838 (+ 17662us) write_op.cc:270] Start()
0619 06:29:51.652863 (+ 25us) write_op.cc:276] Timestamp: P: 1781850585837703 usec, L: 0
0619 06:29:51.680464 (+ 27601us) write_op.cc:270] Start()
0619 06:29:51.680488 (+ 24us) write_op.cc:276] Timestamp: P: 1781850585883842 usec, L: 0
0619 06:29:51.687511 (+ 7023us) write_op.cc:270] Start()
0619 06:29:51.687547 (+ 36us) write_op.cc:276] Timestamp: P: 1781850585901707 usec, L: 0
0619 06:29:51.695188 (+ 7641us) write_op.cc:270] Start()
0619 06:29:51.695212 (+ 24us) write_op.cc:276] Timestamp: P: 1781850585908374 usec, L: 0
0619 06:29:51.708438 (+ 13226us) write_op.cc:270] Start()
0619 06:29:51.708462 (+ 24us) write_op.cc:276] Timestamp: P: 1781850585926375 usec, L: 0
0619 06:29:51.728575 (+ 20113us) write_op.cc:270] Start()
0619 06:29:51.728602 (+ 27us) write_op.cc:276] Timestamp: P: 1781850585957299 usec, L: 0
0619 06:29:51.728820 (+ 218us) write_op.cc:270] Start()
0619 06:29:51.728842 (+ 22us) write_op.cc:276] Timestamp: P: 1781850585969066 usec, L: 0
0619 06:29:51.728973 (+ 131us) write_op.cc:270] Start()
0619 06:29:51.728993 (+ 20us) write_op.cc:276] Timestamp: P: 1781850585973488 usec, L: 0
0619 06:29:51.729115 (+ 122us) write_op.cc:270] Start()
0619 06:29:51.729135 (+ 20us) write_op.cc:276] Timestamp: P: 1781850585986781 usec, L: 0
0619 06:29:51.730955 (+ 1820us) write_op.cc:270] Start()
0619 06:29:51.730976 (+ 21us) write_op.cc:276] Timestamp: P: 1781850586014400 usec, L: 0
0619 06:29:51.731172 (+ 196us) write_op.cc:270] Start()
0619 06:29:51.731193 (+ 21us) write_op.cc:276] Timestamp: P: 1781850586031507 usec, L: 0
0619 06:29:51.731309 (+ 116us) write_op.cc:270] Start()
0619 06:29:51.731325 (+ 16us) write_op.cc:276] Timestamp: P: 1781850586065832 usec, L: 0
0619 06:29:51.731432 (+ 107us) write_op.cc:270] Start()
0619 06:29:51.731447 (+ 15us) write_op.cc:276] Timestamp: P: 1781850586085987 usec, L: 0
0619 06:29:51.731548 (+ 101us) write_op.cc:270] Start()
0619 06:29:51.731585 (+ 37us) write_op.cc:276] Timestamp: P: 1781850586092588 usec, L: 0
0619 06:29:51.752614 (+ 21029us) write_op.cc:270] Start()
0619 06:29:51.752640 (+ 26us) write_op.cc:276] Timestamp: P: 1781850586097664 usec, L: 0
0619 06:29:51.752836 (+ 196us) write_op.cc:270] Start()
0619 06:29:51.752857 (+ 21us) write_op.cc:276] Timestamp: P: 1781850586118884 usec, L: 0
0619 06:29:51.752995 (+ 138us) write_op.cc:270] Start()
0619 06:29:51.753014 (+ 19us) write_op.cc:276] Timestamp: P: 1781850586156872 usec, L: 0
0619 06:29:51.753151 (+ 137us) write_op.cc:270] Start()
0619 06:29:51.753170 (+ 19us) write_op.cc:276] Timestamp: P: 1781850586183332 usec, L: 0
0619 06:29:51.753329 (+ 159us) write_op.cc:270] Start()
0619 06:29:51.753348 (+ 19us) write_op.cc:276] Timestamp: P: 1781850586188995 usec, L: 0
0619 06:29:51.764481 (+ 11133us) write_op.cc:270] Start()
0619 06:29:51.764507 (+ 26us) write_op.cc:276] Timestamp: P: 1781850586191242 usec, L: 0
0619 06:29:51.764714 (+ 207us) write_op.cc:270] Start()
0619 06:29:51.764737 (+ 23us) write_op.cc:276] Timestamp: P: 1781850586220037 usec, L: 0
0619 06:29:51.764878 (+ 141us) write_op.cc:270] Start()
0619 06:29:51.764898 (+ 20us) write_op.cc:276] Timestamp: P: 1781850586235543 usec, L: 0
0619 06:29:51.765027 (+ 129us) write_op.cc:270] Start()
0619 06:29:51.765046 (+ 19us) write_op.cc:276] Timestamp: P: 1781850586254446 usec, L: 0
0619 06:29:51.765190 (+ 144us) write_op.cc:270] Start()
0619 06:29:51.765210 (+ 20us) write_op.cc:276] Timestamp: P: 1781850586256215 usec, L: 0
0619 06:29:51.765344 (+ 134us) write_op.cc:270] Start()
0619 06:29:51.765364 (+ 20us) write_op.cc:276] Timestamp: P: 1781850586263616 usec, L: 0
0619 06:29:51.765520 (+ 156us) write_op.cc:270] Start()
0619 06:29:51.765540 (+ 20us) write_op.cc:276] Timestamp: P: 1781850586310114 usec, L: 0
0619 06:29:51.765676 (+ 136us) write_op.cc:270] Start()
0619 06:29:51.765696 (+ 20us) write_op.cc:276] Timestamp: P: 1781850586325609 usec, L: 0
0619 06:29:51.765814 (+ 118us) write_op.cc:270] Start()
0619 06:29:51.765832 (+ 18us) write_op.cc:276] Timestamp: P: 1781850586326780 usec, L: 0
0619 06:29:51.767316 (+ 1484us) write_op.cc:270] Start()
0619 06:29:51.767338 (+ 22us) write_op.cc:276] Timestamp: P: 1781850586327370 usec, L: 0
0619 06:29:51.770564 (+ 3226us) write_op.cc:270] Start()
0619 06:29:51.770588 (+ 24us) write_op.cc:276] Timestamp: P: 1781850586353237 usec, L: 0
0619 06:29:51.770768 (+ 180us) write_op.cc:270] Start()
0619 06:29:51.770797 (+ 29us) write_op.cc:276] Timestamp: P: 1781850586378843 usec, L: 0
0619 06:29:51.778592 (+ 7795us) write_op.cc:270] Start()
0619 06:29:51.778620 (+ 28us) write_op.cc:276] Timestamp: P: 1781850586383069 usec, L: 0
0619 06:29:51.783851 (+ 5231us) write_op.cc:270] Start()
0619 06:29:51.783875 (+ 24us) write_op.cc:276] Timestamp: P: 1781850586399637 usec, L: 0
0619 06:29:51.787912 (+ 4037us) write_op.cc:270] Start()
0619 06:29:51.787935 (+ 23us) write_op.cc:276] Timestamp: P: 1781850586446205 usec, L: 0
0619 06:29:51.788139 (+ 204us) write_op.cc:270] Start()
0619 06:29:51.788166 (+ 27us) write_op.cc:276] Timestamp: P: 1781850586459423 usec, L: 0
0619 06:29:51.788324 (+ 158us) write_op.cc:270] Start()
0619 06:29:51.788339 (+ 15us) write_op.cc:276] Timestamp: P: 1781850586475416 usec, L: 0
0619 06:29:51.803705 (+ 15366us) write_op.cc:270] Start()
0619 06:29:51.803732 (+ 27us) write_op.cc:276] Timestamp: P: 1781850586513457 usec, L: 0
0619 06:29:51.803924 (+ 192us) write_op.cc:270] Start()
0619 06:29:51.803976 (+ 52us) write_op.cc:276] Timestamp: P: 1781850586533484 usec, L: 0
0619 06:29:51.804119 (+ 143us) write_op.cc:270] Start()
0619 06:29:51.804136 (+ 17us) write_op.cc:276] Timestamp: P: 1781850586542550 usec, L: 0
0619 06:29:51.804290 (+ 154us) write_op.cc:270] Start()
0619 06:29:51.804308 (+ 18us) write_op.cc:276] Timestamp: P: 1781850586543187 usec, L: 0
0619 06:29:51.804445 (+ 137us) write_op.cc:270] Start()
0619 06:29:51.804463 (+ 18us) write_op.cc:276] Timestamp: P: 1781850586571305 usec, L: 0
0619 06:29:51.804594 (+ 131us) write_op.cc:270] Start()
0619 06:29:51.804611 (+ 17us) write_op.cc:276] Timestamp: P: 1781850586591093 usec, L: 0
0619 06:29:51.804763 (+ 152us) write_op.cc:270] Start()
0619 06:29:51.804781 (+ 18us) write_op.cc:276] Timestamp: P: 1781850586594524 usec, L: 0
0619 06:29:51.804911 (+ 130us) write_op.cc:270] Start()
0619 06:29:51.804927 (+ 16us) write_op.cc:276] Timestamp: P: 1781850586606855 usec, L: 0
0619 06:29:51.805036 (+ 109us) write_op.cc:270] Start()
0619 06:29:51.805053 (+ 17us) write_op.cc:276] Timestamp: P: 1781850586608047 usec, L: 0
0619 06:29:51.805208 (+ 155us) write_op.cc:270] Start()
0619 06:29:51.805223 (+ 15us) write_op.cc:276] Timestamp: P: 1781850586669338 usec, L: 0
0619 06:29:51.806476 (+ 1253us) write_op.cc:270] Start()
0619 06:29:51.806519 (+ 43us) write_op.cc:276] Timestamp: P: 1781850586671446 usec, L: 0
0619 06:29:51.807126 (+ 607us) write_op.cc:270] Start()
0619 06:29:51.807148 (+ 22us) write_op.cc:276] Timestamp: P: 1781850586671975 usec, L: 0
0619 06:29:51.810093 (+ 2945us) write_op.cc:270] Start()
0619 06:29:51.810115 (+ 22us) write_op.cc:276] Timestamp: P: 1781850586683403 usec, L: 0
0619 06:29:51.810293 (+ 178us) write_op.cc:270] Start()
0619 06:29:51.810314 (+ 21us) write_op.cc:276] Timestamp: P: 1781850586752322 usec, L: 0
0619 06:29:51.812900 (+ 2586us) write_op.cc:270] Start()
0619 06:29:51.812923 (+ 23us) write_op.cc:276] Timestamp: P: 1781850586757341 usec, L: 0
0619 06:29:51.813603 (+ 680us) write_op.cc:270] Start()
0619 06:29:51.813625 (+ 22us) write_op.cc:276] Timestamp: P: 1781850586758404 usec, L: 0
0619 06:29:51.814452 (+ 827us) write_op.cc:270] Start()
0619 06:29:51.814576 (+ 124us) write_op.cc:276] Timestamp: P: 1781850586766055 usec, L: 0
0619 06:29:51.849519 (+ 34943us) write_op.cc:270] Start()
0619 06:29:51.849543 (+ 24us) write_op.cc:276] Timestamp: P: 1781850586801140 usec, L: 0
0619 06:29:51.866250 (+ 16707us) write_op.cc:270] Start()
0619 06:29:51.867364 (+ 1114us) write_op.cc:276] Timestamp: P: 1781850586813979 usec, L: 0
0619 06:29:51.867599 (+ 235us) write_op.cc:270] Start()
0619 06:29:51.867623 (+ 24us) write_op.cc:276] Timestamp: P: 1781850586843253 usec, L: 0
0619 06:29:51.867815 (+ 192us) write_op.cc:270] Start()
0619 06:29:51.867840 (+ 25us) write_op.cc:276] Timestamp: P: 1781850586843843 usec, L: 0
0619 06:29:51.868049 (+ 209us) write_op.cc:270] Start()
0619 06:29:51.868071 (+ 22us) write_op.cc:276] Timestamp: P: 1781850586844945 usec, L: 0
0619 06:29:51.868355 (+ 284us) write_op.cc:270] Start()
0619 06:29:51.868377 (+ 22us) write_op.cc:276] Timestamp: P: 1781850586860116 usec, L: 0
0619 06:29:51.868566 (+ 189us) write_op.cc:270] Start()
0619 06:29:51.868591 (+ 25us) write_op.cc:276] Timestamp: P: 1781850586907352 usec, L: 0
0619 06:29:51.868800 (+ 209us) write_op.cc:270] Start()
0619 06:29:51.868821 (+ 21us) write_op.cc:276] Timestamp: P: 1781850586907924 usec, L: 0
0619 06:29:51.869007 (+ 186us) write_op.cc:270] Start()
0619 06:29:51.869028 (+ 21us) write_op.cc:276] Timestamp: P: 1781850586930634 usec, L: 0
0619 06:29:51.876085 (+ 7057us) write_op.cc:270] Start()
0619 06:29:51.876120 (+ 35us) write_op.cc:276] Timestamp: P: 1781850586931998 usec, L: 0
0619 06:29:51.900415 (+ 24295us) write_op.cc:270] Start()
0619 06:29:51.900441 (+ 26us) write_op.cc:276] Timestamp: P: 1781850586966755 usec, L: 0
0619 06:29:51.905243 (+ 4802us) write_op.cc:270] Start()
0619 06:29:51.905272 (+ 29us) write_op.cc:276] Timestamp: P: 1781850586969911 usec, L: 0
0619 06:29:51.911362 (+ 6090us) write_op.cc:270] Start()
0619 06:29:51.911383 (+ 21us) write_op.cc:276] Timestamp: P: 1781850586987475 usec, L: 0
0619 06:29:51.913090 (+ 1707us) write_op.cc:270] Start()
0619 06:29:51.913110 (+ 20us) write_op.cc:276] Timestamp: P: 1781850587007751 usec, L: 0
0619 06:29:51.913256 (+ 146us) write_op.cc:270] Start()
0619 06:29:51.913271 (+ 15us) write_op.cc:276] Timestamp: P: 1781850587032388 usec, L: 0
0619 06:29:51.918298 (+ 5027us) write_op.cc:270] Start()
0619 06:29:51.918319 (+ 21us) write_op.cc:276] Timestamp: P: 1781850587048444 usec, L: 0
0619 06:29:51.919624 (+ 1305us) write_op.cc:270] Start()
0619 06:29:51.919647 (+ 23us) write_op.cc:276] Timestamp: P: 1781850587049095 usec, L: 0
0619 06:29:51.919954 (+ 307us) write_op.cc:270] Start()
0619 06:29:51.919976 (+ 22us) write_op.cc:276] Timestamp: P: 1781850587081454 usec, L: 0
0619 06:29:51.921176 (+ 1200us) write_op.cc:270] Start()
0619 06:29:51.921200 (+ 24us) write_op.cc:276] Timestamp: P: 1781850587083734 usec, L: 0
0619 06:29:51.921422 (+ 222us) write_op.cc:270] Start()
0619 06:29:51.921444 (+ 22us) write_op.cc:276] Timestamp: P: 1781850587129259 usec, L: 0
0619 06:29:51.940354 (+ 18910us) write_op.cc:270] Start()
0619 06:29:51.940380 (+ 26us) write_op.cc:276] Timestamp: P: 1781850587143750 usec, L: 0
0619 06:29:51.978829 (+ 38449us) write_op.cc:270] Start()
0619 06:29:51.978856 (+ 27us) write_op.cc:276] Timestamp: P: 1781850587200337 usec, L: 0
0619 06:29:51.979139 (+ 283us) write_op.cc:270] Start()
0619 06:29:51.979167 (+ 28us) write_op.cc:276] Timestamp: P: 1781850587207876 usec, L: 0
0619 06:29:51.983165 (+ 3998us) write_op.cc:270] Start()
0619 06:29:51.986137 (+ 2972us) write_op.cc:276] Timestamp: P: 1781850587242696 usec, L: 0
0619 06:29:51.987894 (+ 1757us) write_op.cc:270] Start()
0619 06:29:51.987918 (+ 24us) write_op.cc:276] Timestamp: P: 1781850587255882 usec, L: 0
0619 06:29:51.988073 (+ 155us) write_op.cc:270] Start()
0619 06:29:51.988098 (+ 25us) write_op.cc:276] Timestamp: P: 1781850587271590 usec, L: 0
0619 06:29:51.992909 (+ 4811us) write_op.cc:270] Start()
0619 06:29:51.992934 (+ 25us) write_op.cc:276] Timestamp: P: 1781850587273169 usec, L: 0
0619 06:29:51.993079 (+ 145us) write_op.cc:270] Start()
0619 06:29:51.993097 (+ 18us) write_op.cc:276] Timestamp: P: 1781850587276846 usec, L: 0
0619 06:29:51.993216 (+ 119us) write_op.cc:270] Start()
0619 06:29:51.993236 (+ 20us) write_op.cc:276] Timestamp: P: 1781850587287747 usec, L: 0
0619 06:29:51.993363 (+ 127us) write_op.cc:270] Start()
0619 06:29:51.993383 (+ 20us) write_op.cc:276] Timestamp: P: 1781850587338770 usec, L: 0
0619 06:29:51.993534 (+ 151us) write_op.cc:270] Start()
0619 06:29:51.993556 (+ 22us) write_op.cc:276] Timestamp: P: 1781850587342650 usec, L: 0
0619 06:29:51.993718 (+ 162us) write_op.cc:270] Start()
0619 06:29:51.993741 (+ 23us) write_op.cc:276] Timestamp: P: 1781850587349704 usec, L: 0
0619 06:29:51.993981 (+ 240us) write_op.cc:270] Start()
0619 06:29:51.994005 (+ 24us) write_op.cc:276] Timestamp: P: 1781850587351438 usec, L: 0
0619 06:29:51.994166 (+ 161us) write_op.cc:270] Start()
0619 06:29:51.994187 (+ 21us) write_op.cc:276] Timestamp: P: 1781850587390374 usec, L: 0
0619 06:29:51.994648 (+ 461us) write_op.cc:270] Start()
0619 06:29:51.994673 (+ 25us) write_op.cc:276] Timestamp: P: 1781850587400792 usec, L: 0
0619 06:29:51.994829 (+ 156us) write_op.cc:270] Start()
0619 06:29:51.994849 (+ 20us) write_op.cc:276] Timestamp: P: 1781850587414190 usec, L: 0
0619 06:29:51.995731 (+ 882us) write_op.cc:270] Start()
0619 06:29:51.995897 (+ 166us) write_op.cc:276] Timestamp: P: 1781850587456282 usec, L: 0
0619 06:29:51.996060 (+ 163us) write_op.cc:270] Start()
0619 06:29:51.996081 (+ 21us) write_op.cc:276] Timestamp: P: 1781850587469934 usec, L: 0
0619 06:29:51.996237 (+ 156us) write_op.cc:270] Start()
0619 06:29:51.996256 (+ 19us) write_op.cc:276] Timestamp: P: 1781850587512618 usec, L: 0
0619 06:29:51.996397 (+ 141us) write_op.cc:270] Start()
0619 06:29:51.996658 (+ 261us) write_op.cc:276] Timestamp: P: 1781850587513359 usec, L: 0
0619 06:29:51.997026 (+ 368us) write_op.cc:270] Start()
0619 06:29:51.997050 (+ 24us) write_op.cc:276] Timestamp: P: 1781850587514040 usec, L: 0
0619 06:29:51.997231 (+ 181us) write_op.cc:270] Start()
0619 06:29:51.997251 (+ 20us) write_op.cc:276] Timestamp: P: 1781850587545436 usec, L: 0
0619 06:29:51.997432 (+ 181us) write_op.cc:270] Start()
0619 06:29:51.997453 (+ 21us) write_op.cc:276] Timestamp: P: 1781850587572761 usec, L: 0
0619 06:29:51.997757 (+ 304us) write_op.cc:270] Start()
0619 06:29:51.997779 (+ 22us) write_op.cc:276] Timestamp: P: 1781850587630385 usec, L: 0
0619 06:29:51.997948 (+ 169us) write_op.cc:270] Start()
0619 06:29:51.997968 (+ 20us) write_op.cc:276] Timestamp: P: 1781850587638444 usec, L: 0
0619 06:29:51.998142 (+ 174us) write_op.cc:270] Start()
0619 06:29:51.998163 (+ 21us) write_op.cc:276] Timestamp: P: 1781850587642214 usec, L: 0
0619 06:29:51.998317 (+ 154us) write_op.cc:270] Start()
0619 06:29:51.998338 (+ 21us) write_op.cc:276] Timestamp: P: 1781850587644926 usec, L: 0
0619 06:29:51.998532 (+ 194us) write_op.cc:270] Start()
0619 06:29:51.998554 (+ 22us) write_op.cc:276] Timestamp: P: 1781850587695444 usec, L: 0
0619 06:29:52.020294 (+ 21740us) write_op.cc:270] Start()
0619 06:29:52.020321 (+ 27us) write_op.cc:276] Timestamp: P: 1781850587713483 usec, L: 0
0619 06:29:52.022856 (+ 2535us) write_op.cc:270] Start()
0619 06:29:52.022882 (+ 26us) write_op.cc:276] Timestamp: P: 1781850587729288 usec, L: 0
0619 06:29:52.033031 (+ 10149us) write_op.cc:270] Start()
0619 06:29:52.033072 (+ 41us) write_op.cc:276] Timestamp: P: 1781850587738624 usec, L: 0
0619 06:29:52.041616 (+ 8544us) write_op.cc:270] Start()
0619 06:29:52.041649 (+ 33us) write_op.cc:276] Timestamp: P: 1781850587784603 usec, L: 0
0619 06:29:52.041885 (+ 236us) write_op.cc:270] Start()
0619 06:29:52.041914 (+ 29us) write_op.cc:276] Timestamp: P: 1781850587786019 usec, L: 0
0619 06:29:52.042155 (+ 241us) write_op.cc:270] Start()
0619 06:29:52.042183 (+ 28us) write_op.cc:276] Timestamp: P: 1781850587819733 usec, L: 0
0619 06:29:52.042377 (+ 194us) write_op.cc:270] Start()
0619 06:29:52.042421 (+ 44us) write_op.cc:276] Timestamp: P: 1781850587832399 usec, L: 0
0619 06:29:52.042634 (+ 213us) write_op.cc:270] Start()
0619 06:29:52.042689 (+ 55us) write_op.cc:276] Timestamp: P: 1781850587851813 usec, L: 0
0619 06:29:52.042900 (+ 211us) write_op.cc:270] Start()
0619 06:29:52.042931 (+ 31us) write_op.cc:276] Timestamp: P: 1781850587867490 usec, L: 0
0619 06:29:52.043100 (+ 169us) write_op.cc:270] Start()
0619 06:29:52.043124 (+ 24us) write_op.cc:276] Timestamp: P: 1781850587877518 usec, L: 0
0619 06:29:52.043271 (+ 147us) write_op.cc:270] Start()
0619 06:29:52.043293 (+ 22us) write_op.cc:276] Timestamp: P: 1781850587879160 usec, L: 0
0619 06:29:52.079420 (+ 36127us) write_op.cc:270] Start()
0619 06:29:52.079446 (+ 26us) write_op.cc:276] Timestamp: P: 1781850587908568 usec, L: 0
0619 06:29:52.079598 (+ 152us) write_op.cc:270] Start()
0619 06:29:52.079622 (+ 24us) write_op.cc:276] Timestamp: P: 1781850587947944 usec, L: 0
0619 06:29:52.081363 (+ 1741us) write_op.cc:270] Start()
0619 06:29:52.081388 (+ 25us) write_op.cc:276] Timestamp: P: 1781850587958346 usec, L: 0
0619 06:29:52.102831 (+ 21443us) write_op.cc:270] Start()
0619 06:29:52.102858 (+ 27us) write_op.cc:276] Timestamp: P: 1781850587971351 usec, L: 0
0619 06:29:52.103173 (+ 315us) write_op.cc:270] Start()
0619 06:29:52.103200 (+ 27us) write_op.cc:276] Timestamp: P: 1781850587972458 usec, L: 0
0619 06:29:52.107734 (+ 4534us) write_op.cc:270] Start()
0619 06:29:52.107757 (+ 23us) write_op.cc:276] Timestamp: P: 1781850587995626 usec, L: 0
0619 06:29:52.122635 (+ 14878us) write_op.cc:270] Start()
0619 06:29:52.122668 (+ 33us) write_op.cc:276] Timestamp: P: 1781850588005931 usec, L: 0
0619 06:29:52.126438 (+ 3770us) write_op.cc:270] Start()
0619 06:29:52.130393 (+ 3955us) write_op.cc:276] Timestamp: P: 1781850588047733 usec, L: 0
0619 06:29:52.141123 (+ 10730us) write_op.cc:270] Start()
0619 06:29:52.141148 (+ 25us) write_op.cc:276] Timestamp: P: 1781850588052429 usec, L: 0
0619 06:29:52.141282 (+ 134us) write_op.cc:270] Start()
0619 06:29:52.141307 (+ 25us) write_op.cc:276] Timestamp: P: 1781850588068854 usec, L: 0
0619 06:29:52.145730 (+ 4423us) write_op.cc:270] Start()
0619 06:29:52.145752 (+ 22us) write_op.cc:276] Timestamp: P: 1781850588071584 usec, L: 0
0619 06:29:52.155593 (+ 9841us) write_op.cc:270] Start()
0619 06:29:52.155619 (+ 26us) write_op.cc:276] Timestamp: P: 1781850588119850 usec, L: 0
0619 06:29:52.162596 (+ 6977us) write_op.cc:270] Start()
0619 06:29:52.162613 (+ 17us) write_op.cc:276] Timestamp: P: 1781850588145764 usec, L: 0
0619 06:29:52.162733 (+ 120us) write_op.cc:270] Start()
0619 06:29:52.162751 (+ 18us) write_op.cc:276] Timestamp: P: 1781850588149063 usec, L: 0
0619 06:29:52.164058 (+ 1307us) write_op.cc:270] Start()
0619 06:29:52.164078 (+ 20us) write_op.cc:276] Timestamp: P: 1781850588156367 usec, L: 0
0619 06:29:52.166713 (+ 2635us) write_op.cc:270] Start()
0619 06:29:52.166736 (+ 23us) write_op.cc:276] Timestamp: P: 1781850588178630 usec, L: 0
0619 06:29:52.169494 (+ 2758us) write_op.cc:270] Start()
0619 06:29:52.169514 (+ 20us) write_op.cc:276] Timestamp: P: 1781850588179157 usec, L: 0
0619 06:29:52.173926 (+ 4412us) write_op.cc:270] Start()
0619 06:29:52.173947 (+ 21us) write_op.cc:276] Timestamp: P: 1781850588225689 usec, L: 0
0619 06:29:52.210360 (+ 36413us) write_op.cc:270] Start()
0619 06:29:52.210393 (+ 33us) write_op.cc:276] Timestamp: P: 1781850588226353 usec, L: 0
0619 06:29:52.214736 (+ 4343us) write_op.cc:270] Start()
0619 06:29:52.214763 (+ 27us) write_op.cc:276] Timestamp: P: 1781850588270285 usec, L: 0
0619 06:29:52.215380 (+ 617us) write_op.cc:270] Start()
0619 06:29:52.215404 (+ 24us) write_op.cc:276] Timestamp: P: 1781850588271157 usec, L: 0
0619 06:29:52.217147 (+ 1743us) write_op.cc:270] Start()
0619 06:29:52.217170 (+ 23us) write_op.cc:276] Timestamp: P: 1781850588273206 usec, L: 0
0619 06:29:52.217331 (+ 161us) write_op.cc:270] Start()
0619 06:29:52.217350 (+ 19us) write_op.cc:276] Timestamp: P: 1781850588320785 usec, L: 0
0619 06:29:52.217490 (+ 140us) write_op.cc:270] Start()
0619 06:29:52.217509 (+ 19us) write_op.cc:276] Timestamp: P: 1781850588340742 usec, L: 0
0619 06:29:52.217649 (+ 140us) write_op.cc:270] Start()
0619 06:29:52.217670 (+ 21us) write_op.cc:276] Timestamp: P: 1781850588342759 usec, L: 0
0619 06:29:52.217821 (+ 151us) write_op.cc:270] Start()
0619 06:29:52.217843 (+ 22us) write_op.cc:276] Timestamp: P: 1781850588359113 usec, L: 0
0619 06:29:52.218002 (+ 159us) write_op.cc:270] Start()
0619 06:29:52.218022 (+ 20us) write_op.cc:276] Timestamp: P: 1781850588401228 usec, L: 0
0619 06:29:52.218156 (+ 134us) write_op.cc:270] Start()
0619 06:29:52.218172 (+ 16us) write_op.cc:276] Timestamp: P: 1781850588431352 usec, L: 0
0619 06:29:52.218315 (+ 143us) write_op.cc:270] Start()
0619 06:29:52.218336 (+ 21us) write_op.cc:276] Timestamp: P: 1781850588436046 usec, L: 0
0619 06:29:52.218595 (+ 259us) write_op.cc:270] Start()
0619 06:29:52.218615 (+ 20us) write_op.cc:276] Timestamp: P: 1781850588446975 usec, L: 0
0619 06:29:52.219320 (+ 705us) write_op.cc:270] Start()
0619 06:29:52.219342 (+ 22us) write_op.cc:276] Timestamp: P: 1781850588477509 usec, L: 0
0619 06:29:52.219495 (+ 153us) write_op.cc:270] Start()
0619 06:29:52.219514 (+ 19us) write_op.cc:276] Timestamp: P: 1781850588494923 usec, L: 0
0619 06:29:52.219688 (+ 174us) write_op.cc:270] Start()
0619 06:29:52.219708 (+ 20us) write_op.cc:276] Timestamp: P: 1781850588497624 usec, L: 0
0619 06:29:52.219828 (+ 120us) write_op.cc:270] Start()
0619 06:29:52.219859 (+ 31us) write_op.cc:276] Timestamp: P: 1781850588533327 usec, L: 0
0619 06:29:52.220159 (+ 300us) write_op.cc:270] Start()
0619 06:29:52.220225 (+ 66us) write_op.cc:276] Timestamp: P: 1781850588545363 usec, L: 0
0619 06:29:52.223634 (+ 3409us) write_op.cc:270] Start()
0619 06:29:52.223657 (+ 23us) write_op.cc:276] Timestamp: P: 1781850588561667 usec, L: 0
0619 06:29:52.248220 (+ 24563us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x60f00000add8. stack: 00007ff742e9066e 00007ff742e90430 00007ff741f175ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007ff74b98dc35 00007ff74e404e49 00007ff74e3ac5c9 00007ff74e3a9ee9 00007ff751f50a6c 00007ff74c83bfa6 00007ff74c83bcd5 00007ff7499cc9be 00007ff7499cb79e 00007ff7499d1b25
0619 06:29:52.252121 (+ 3901us) write_op.cc:270] Start()
0619 06:29:52.252150 (+ 29us) write_op.cc:276] Timestamp: P: 1781850588574309 usec, L: 0
0619 06:29:52.252324 (+ 174us) write_op.cc:270] Start()
0619 06:29:52.252342 (+ 18us) write_op.cc:276] Timestamp: P: 1781850588600779 usec, L: 0
0619 06:29:52.252496 (+ 154us) write_op.cc:270] Start()
0619 06:29:52.252515 (+ 19us) write_op.cc:276] Timestamp: P: 1781850588601354 usec, L: 0
0619 06:29:52.252677 (+ 162us) write_op.cc:270] Start()
0619 06:29:52.252697 (+ 20us) write_op.cc:276] Timestamp: P: 1781850588607935 usec, L: 0
0619 06:29:52.252835 (+ 138us) write_op.cc:270] Start()
0619 06:29:52.252853 (+ 18us) write_op.cc:276] Timestamp: P: 1781850588624415 usec, L: 0
0619 06:29:52.252974 (+ 121us) write_op.cc:270] Start()
0619 06:29:52.252991 (+ 17us) write_op.cc:276] Timestamp: P: 1781850588655159 usec, L: 0
0619 06:29:52.253096 (+ 105us) write_op.cc:270] Start()
0619 06:29:52.253113 (+ 17us) write_op.cc:276] Timestamp: P: 1781850588660169 usec, L: 0
0619 06:29:52.278211 (+ 25098us) write_op.cc:270] Start()
0619 06:29:52.278235 (+ 24us) write_op.cc:276] Timestamp: P: 1781850588676765 usec, L: 0
0619 06:29:52.292030 (+ 13795us) write_op.cc:270] Start()
0619 06:29:52.292055 (+ 25us) write_op.cc:276] Timestamp: P: 1781850588722146 usec, L: 0
0619 06:29:52.306020 (+ 13965us) write_op.cc:270] Start()
0619 06:29:52.306044 (+ 24us) write_op.cc:276] Timestamp: P: 1781850588730114 usec, L: 0
0619 06:29:52.309241 (+ 3197us) write_op.cc:270] Start()
0619 06:29:52.309267 (+ 26us) write_op.cc:276] Timestamp: P: 1781850588758214 usec, L: 0
0619 06:29:52.309412 (+ 145us) write_op.cc:270] Start()
0619 06:29:52.309446 (+ 34us) write_op.cc:276] Timestamp: P: 1781850588795791 usec, L: 0
0619 06:29:52.324828 (+ 15382us) write_op.cc:270] Start()
0619 06:29:52.324855 (+ 27us) write_op.cc:276] Timestamp: P: 1781850588807626 usec, L: 0
0619 06:29:52.328292 (+ 3437us) write_op.cc:270] Start()
0619 06:29:52.328317 (+ 25us) write_op.cc:276] Timestamp: P: 1781850588808275 usec, L: 0
0619 06:29:52.328503 (+ 186us) write_op.cc:270] Start()
0619 06:29:52.328525 (+ 22us) write_op.cc:276] Timestamp: P: 1781850588808921 usec, L: 0
0619 06:29:52.328700 (+ 175us) write_op.cc:270] Start()
0619 06:29:52.328732 (+ 32us) write_op.cc:276] Timestamp: P: 1781850588832559 usec, L: 0
0619 06:29:52.328882 (+ 150us) write_op.cc:270] Start()
0619 06:29:52.328905 (+ 23us) write_op.cc:276] Timestamp: P: 1781850588848539 usec, L: 0
0619 06:29:52.329051 (+ 146us) write_op.cc:270] Start()
0619 06:29:52.329071 (+ 20us) write_op.cc:276] Timestamp: P: 1781850588852312 usec, L: 0
0619 06:29:52.329214 (+ 143us) write_op.cc:270] Start()
0619 06:29:52.329240 (+ 26us) write_op.cc:276] Timestamp: P: 1781850588901422 usec, L: 0
0619 06:29:52.329383 (+ 143us) write_op.cc:270] Start()
0619 06:29:52.329403 (+ 20us) write_op.cc:276] Timestamp: P: 1781850588904426 usec, L: 0
0619 06:29:52.329556 (+ 153us) write_op.cc:270] Start()
0619 06:29:52.329580 (+ 24us) write_op.cc:276] Timestamp: P: 1781850588941647 usec, L: 0
0619 06:29:52.329731 (+ 151us) write_op.cc:270] Start()
0619 06:29:52.329755 (+ 24us) write_op.cc:276] Timestamp: P: 1781850588942528 usec, L: 0
0619 06:29:52.329910 (+ 155us) write_op.cc:270] Start()
0619 06:29:52.329931 (+ 21us) write_op.cc:276] Timestamp: P: 1781850588957416 usec, L: 0
0619 06:29:52.330058 (+ 127us) write_op.cc:270] Start()
0619 06:29:52.330077 (+ 19us) write_op.cc:276] Timestamp: P: 1781850588987567 usec, L: 0
0619 06:29:52.339716 (+ 9639us) write_op.cc:270] St
I20260619 06:29:53.906407 8664 raft_consensus.cc:482] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 996381a7495d4720a6f6be44a1d4781b)
I20260619 06:29:53.906617 8664 raft_consensus.cc:504] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:53.909380 8664 leader_election.cc:288] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063), 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499)
I20260619 06:29:53.908826 7861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e2da70288694680bec48ac95c14656f" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 1371 } } ignore_live_leader: false dest_uuid: "996381a7495d4720a6f6be44a1d4781b" is_pre_election: true
I20260619 06:29:53.266579 8553 rpcz_store.cc:276] 0619 06:29:51.649677 (+ 0us) service_pool.cc:170] Inserting onto call queue
0619 06:29:51.649731 (+ 54us) service_pool.cc:227] Handling call
0619 06:29:51.730110 (+ 80379us) raft_consensus.cc:1457] Updating replica for 329 ops
0619 06:29:51.969599 (+239489us) raft_consensus.cc:1520] Early marking committed up to index 945
0619 06:29:51.969699 (+ 100us) raft_consensus.cc:1525] Triggering prepare for 329 ops
0619 06:29:51.976948 (+ 7249us) write_op.cc:270] Start()
0619 06:29:51.976971 (+ 23us) write_op.cc:276] Timestamp: P: 1781850585517412 usec, L: 0
0619 06:29:51.986211 (+ 9240us) write_op.cc:270] Start()
0619 06:29:51.986235 (+ 24us) write_op.cc:276] Timestamp: P: 1781850585531487 usec, L: 0
0619 06:29:51.986370 (+ 135us) write_op.cc:270] Start()
0619 06:29:51.986390 (+ 20us) write_op.cc:276] Timestamp: P: 1781850585546913 usec, L: 0
0619 06:29:51.986534 (+ 144us) write_op.cc:270] Start()
0619 06:29:51.990174 (+ 3640us) write_op.cc:276] Timestamp: P: 1781850585549528 usec, L: 0
0619 06:29:52.001188 (+ 11014us) write_op.cc:270] Start()
0619 06:29:52.001215 (+ 27us) write_op.cc:276] Timestamp: P: 1781850585596113 usec, L: 0
0619 06:29:52.001432 (+ 217us) write_op.cc:270] Start()
0619 06:29:52.001455 (+ 23us) write_op.cc:276] Timestamp: P: 1781850585622788 usec, L: 0
0619 06:29:52.001612 (+ 157us) write_op.cc:270] Start()
0619 06:29:52.001654 (+ 42us) write_op.cc:276] Timestamp: P: 1781850585649672 usec, L: 0
0619 06:29:52.001797 (+ 143us) write_op.cc:270] Start()
0619 06:29:52.001819 (+ 22us) write_op.cc:276] Timestamp: P: 1781850585651190 usec, L: 0
0619 06:29:52.001982 (+ 163us) write_op.cc:270] Start()
0619 06:29:52.002004 (+ 22us) write_op.cc:276] Timestamp: P: 1781850585681360 usec, L: 0
0619 06:29:52.002163 (+ 159us) write_op.cc:270] Start()
0619 06:29:52.002185 (+ 22us) write_op.cc:276] Timestamp: P: 1781850585683838 usec, L: 0
0619 06:29:52.002325 (+ 140us) write_op.cc:270] Start()
0619 06:29:52.002346 (+ 21us) write_op.cc:276] Timestamp: P: 1781850585715670 usec, L: 0
0619 06:29:52.004926 (+ 2580us) write_op.cc:270] Start()
0619 06:29:52.005025 (+ 99us) write_op.cc:276] Timestamp: P: 1781850585733051 usec, L: 0
0619 06:29:52.009581 (+ 4556us) write_op.cc:270] Start()
0619 06:29:52.009606 (+ 25us) write_op.cc:276] Timestamp: P: 1781850585741407 usec, L: 0
0619 06:29:52.009747 (+ 141us) write_op.cc:270] Start()
0619 06:29:52.009768 (+ 21us) write_op.cc:276] Timestamp: P: 1781850585747605 usec, L: 0
0619 06:29:52.012200 (+ 2432us) write_op.cc:270] Start()
0619 06:29:52.012226 (+ 26us) write_op.cc:276] Timestamp: P: 1781850585755179 usec, L: 0
0619 06:29:52.019142 (+ 6916us) write_op.cc:270] Start()
0619 06:29:52.019167 (+ 25us) write_op.cc:276] Timestamp: P: 1781850585815647 usec, L: 0
0619 06:29:52.020876 (+ 1709us) write_op.cc:270] Start()
0619 06:29:52.020905 (+ 29us) write_op.cc:276] Timestamp: P: 1781850585819344 usec, L: 0
0619 06:29:52.033189 (+ 12284us) write_op.cc:270] Start()
0619 06:29:52.033212 (+ 23us) write_op.cc:276] Timestamp: P: 1781850585825005 usec, L: 0
0619 06:29:52.042651 (+ 9439us) write_op.cc:270] Start()
0619 06:29:52.042676 (+ 25us) write_op.cc:276] Timestamp: P: 1781850585859238 usec, L: 0
0619 06:29:52.042816 (+ 140us) write_op.cc:270] Start()
0619 06:29:52.042839 (+ 23us) write_op.cc:276] Timestamp: P: 1781850585884475 usec, L: 0
0619 06:29:52.043798 (+ 959us) write_op.cc:270] Start()
0619 06:29:52.043823 (+ 25us) write_op.cc:276] Timestamp: P: 1781850585905613 usec, L: 0
0619 06:29:52.043983 (+ 160us) write_op.cc:270] Start()
0619 06:29:52.044068 (+ 85us) write_op.cc:276] Timestamp: P: 1781850585911413 usec, L: 0
0619 06:29:52.044242 (+ 174us) write_op.cc:270] Start()
0619 06:29:52.044263 (+ 21us) write_op.cc:276] Timestamp: P: 1781850585931437 usec, L: 0
0619 06:29:52.044401 (+ 138us) write_op.cc:270] Start()
0619 06:29:52.044437 (+ 36us) write_op.cc:276] Timestamp: P: 1781850585963242 usec, L: 0
0619 06:29:52.044646 (+ 209us) write_op.cc:270] Start()
0619 06:29:52.044668 (+ 22us) write_op.cc:276] Timestamp: P: 1781850585981197 usec, L: 0
0619 06:29:52.044863 (+ 195us) write_op.cc:270] Start()
0619 06:29:52.044892 (+ 29us) write_op.cc:276] Timestamp: P: 1781850585982351 usec, L: 0
0619 06:29:52.045026 (+ 134us) write_op.cc:270] Start()
0619 06:29:52.045046 (+ 20us) write_op.cc:276] Timestamp: P: 1781850585988240 usec, L: 0
0619 06:29:52.045178 (+ 132us) write_op.cc:270] Start()
0619 06:29:52.045197 (+ 19us) write_op.cc:276] Timestamp: P: 1781850586023231 usec, L: 0
0619 06:29:52.075575 (+ 30378us) write_op.cc:270] Start()
0619 06:29:52.075619 (+ 44us) write_op.cc:276] Timestamp: P: 1781850586035871 usec, L: 0
0619 06:29:52.077060 (+ 1441us) write_op.cc:270] Start()
0619 06:29:52.077084 (+ 24us) write_op.cc:276] Timestamp: P: 1781850586064181 usec, L: 0
0619 06:29:52.087813 (+ 10729us) write_op.cc:270] Start()
0619 06:29:52.087839 (+ 26us) write_op.cc:276] Timestamp: P: 1781850586102546 usec, L: 0
0619 06:29:52.087984 (+ 145us) write_op.cc:270] Start()
0619 06:29:52.088004 (+ 20us) write_op.cc:276] Timestamp: P: 1781850586103475 usec, L: 0
0619 06:29:52.088175 (+ 171us) write_op.cc:270] Start()
0619 06:29:52.088198 (+ 23us) write_op.cc:276] Timestamp: P: 1781850586112378 usec, L: 0
0619 06:29:52.088368 (+ 170us) write_op.cc:270] Start()
0619 06:29:52.088397 (+ 29us) write_op.cc:276] Timestamp: P: 1781850586144586 usec, L: 0
0619 06:29:52.088573 (+ 176us) write_op.cc:270] Start()
0619 06:29:52.088598 (+ 25us) write_op.cc:276] Timestamp: P: 1781850586160799 usec, L: 0
0619 06:29:52.088804 (+ 206us) write_op.cc:270] Start()
0619 06:29:52.088828 (+ 24us) write_op.cc:276] Timestamp: P: 1781850586183867 usec, L: 0
0619 06:29:52.089037 (+ 209us) write_op.cc:270] Start()
0619 06:29:52.089062 (+ 25us) write_op.cc:276] Timestamp: P: 1781850586192074 usec, L: 0
0619 06:29:52.097338 (+ 8276us) write_op.cc:270] Start()
0619 06:29:52.097363 (+ 25us) write_op.cc:276] Timestamp: P: 1781850586194882 usec, L: 0
0619 06:29:52.098638 (+ 1275us) write_op.cc:270] Start()
0619 06:29:52.098659 (+ 21us) write_op.cc:276] Timestamp: P: 1781850586223188 usec, L: 0
0619 06:29:52.098836 (+ 177us) write_op.cc:270] Start()
0619 06:29:52.098874 (+ 38us) write_op.cc:276] Timestamp: P: 1781850586239767 usec, L: 0
0619 06:29:52.099015 (+ 141us) write_op.cc:270] Start()
0619 06:29:52.099035 (+ 20us) write_op.cc:276] Timestamp: P: 1781850586265770 usec, L: 0
0619 06:29:52.099165 (+ 130us) write_op.cc:270] Start()
0619 06:29:52.099186 (+ 21us) write_op.cc:276] Timestamp: P: 1781850586274031 usec, L: 0
0619 06:29:52.099336 (+ 150us) write_op.cc:270] Start()
0619 06:29:52.099356 (+ 20us) write_op.cc:276] Timestamp: P: 1781850586282773 usec, L: 0
0619 06:29:52.099502 (+ 146us) write_op.cc:270] Start()
0619 06:29:52.099521 (+ 19us) write_op.cc:276] Timestamp: P: 1781850586307237 usec, L: 0
0619 06:29:52.099645 (+ 124us) write_op.cc:270] Start()
0619 06:29:52.099664 (+ 19us) write_op.cc:276] Timestamp: P: 1781850586331481 usec, L: 0
0619 06:29:52.099777 (+ 113us) write_op.cc:270] Start()
0619 06:29:52.099794 (+ 17us) write_op.cc:276] Timestamp: P: 1781850586333442 usec, L: 0
0619 06:29:52.099959 (+ 165us) write_op.cc:270] Start()
0619 06:29:52.099980 (+ 21us) write_op.cc:276] Timestamp: P: 1781850586340640 usec, L: 0
0619 06:29:52.100139 (+ 159us) write_op.cc:270] Start()
0619 06:29:52.100650 (+ 511us) write_op.cc:276] Timestamp: P: 1781850586356335 usec, L: 0
0619 06:29:52.100826 (+ 176us) write_op.cc:270] Start()
0619 06:29:52.100849 (+ 23us) write_op.cc:276] Timestamp: P: 1781850586381173 usec, L: 0
0619 06:29:52.100993 (+ 144us) write_op.cc:270] Start()
0619 06:29:52.101015 (+ 22us) write_op.cc:276] Timestamp: P: 1781850586384133 usec, L: 0
0619 06:29:52.101151 (+ 136us) write_op.cc:270] Start()
0619 06:29:52.101172 (+ 21us) write_op.cc:276] Timestamp: P: 1781850586401494 usec, L: 0
0619 06:29:52.101330 (+ 158us) write_op.cc:270] Start()
0619 06:29:52.101382 (+ 52us) write_op.cc:276] Timestamp: P: 1781850586448084 usec, L: 0
0619 06:29:52.101608 (+ 226us) write_op.cc:270] Start()
0619 06:29:52.101632 (+ 24us) write_op.cc:276] Timestamp: P: 1781850586459014 usec, L: 0
0619 06:29:52.101782 (+ 150us) write_op.cc:270] Start()
0619 06:29:52.101803 (+ 21us) write_op.cc:276] Timestamp: P: 1781850586483862 usec, L: 0
0619 06:29:52.101946 (+ 143us) write_op.cc:270] Start()
0619 06:29:52.101967 (+ 21us) write_op.cc:276] Timestamp: P: 1781850586495443 usec, L: 0
0619 06:29:52.105575 (+ 3608us) write_op.cc:270] Start()
0619 06:29:52.105600 (+ 25us) write_op.cc:276] Timestamp: P: 1781850586539536 usec, L: 0
0619 06:29:52.105761 (+ 161us) write_op.cc:270] Start()
0619 06:29:52.105783 (+ 22us) write_op.cc:276] Timestamp: P: 1781850586545484 usec, L: 0
0619 06:29:52.105917 (+ 134us) write_op.cc:270] Start()
0619 06:29:52.105937 (+ 20us) write_op.cc:276] Timestamp: P: 1781850586549869 usec, L: 0
0619 06:29:52.106115 (+ 178us) write_op.cc:270] Start()
0619 06:29:52.106137 (+ 22us) write_op.cc:276] Timestamp: P: 1781850586575852 usec, L: 0
0619 06:29:52.106269 (+ 132us) write_op.cc:270] Start()
0619 06:29:52.106308 (+ 39us) write_op.cc:276] Timestamp: P: 1781850586598571 usec, L: 0
0619 06:29:52.106439 (+ 131us) write_op.cc:270] Start()
0619 06:29:52.106458 (+ 19us) write_op.cc:276] Timestamp: P: 1781850586607918 usec, L: 0
0619 06:29:52.106632 (+ 174us) write_op.cc:270] Start()
0619 06:29:52.107970 (+ 1338us) write_op.cc:276] Timestamp: P: 1781850586611523 usec, L: 0
0619 06:29:52.122856 (+ 14886us) write_op.cc:270] Start()
0619 06:29:52.122880 (+ 24us) write_op.cc:276] Timestamp: P: 1781850586640879 usec, L: 0
0619 06:29:52.126667 (+ 3787us) write_op.cc:270] Start()
0619 06:29:52.126687 (+ 20us) write_op.cc:276] Timestamp: P: 1781850586679064 usec, L: 0
0619 06:29:52.140382 (+ 13695us) write_op.cc:270] Start()
0619 06:29:52.140409 (+ 27us) write_op.cc:276] Timestamp: P: 1781850586680111 usec, L: 0
0619 06:29:52.145081 (+ 4672us) write_op.cc:270] Start()
0619 06:29:52.145097 (+ 16us) write_op.cc:276] Timestamp: P: 1781850586717417 usec, L: 0
0619 06:29:52.146635 (+ 1538us) write_op.cc:270] Start()
0619 06:29:52.146660 (+ 25us) write_op.cc:276] Timestamp: P: 1781850586718296 usec, L: 0
0619 06:29:52.158540 (+ 11880us) write_op.cc:270] Start()
0619 06:29:52.158564 (+ 24us) write_op.cc:276] Timestamp: P: 1781850586761732 usec, L: 0
0619 06:29:52.166711 (+ 8147us) write_op.cc:270] Start()
0619 06:29:52.166736 (+ 25us) write_op.cc:276] Timestamp: P: 1781850586766200 usec, L: 0
0619 06:29:52.166890 (+ 154us) write_op.cc:270] Start()
0619 06:29:52.166910 (+ 20us) write_op.cc:276] Timestamp: P: 1781850586766783 usec, L: 0
0619 06:29:52.167058 (+ 148us) write_op.cc:270] Start()
0619 06:29:52.167079 (+ 21us) write_op.cc:276] Timestamp: P: 1781850586770026 usec, L: 0
0619 06:29:52.167204 (+ 125us) write_op.cc:270] Start()
0619 06:29:52.167222 (+ 18us) write_op.cc:276] Timestamp: P: 1781850586805203 usec, L: 0
0619 06:29:52.167342 (+ 120us) write_op.cc:270] Start()
0619 06:29:52.167361 (+ 19us) write_op.cc:276] Timestamp: P: 1781850586818211 usec, L: 0
0619 06:29:52.167494 (+ 133us) write_op.cc:270] Start()
0619 06:29:52.167511 (+ 17us) write_op.cc:276] Timestamp: P: 1781850586862432 usec, L: 0
0619 06:29:52.167625 (+ 114us) write_op.cc:270] Start()
0619 06:29:52.167642 (+ 17us) write_op.cc:276] Timestamp: P: 1781850586870581 usec, L: 0
0619 06:29:52.167746 (+ 104us) write_op.cc:270] Start()
0619 06:29:52.167762 (+ 16us) write_op.cc:276] Timestamp: P: 1781850586875865 usec, L: 0
0619 06:29:52.167917 (+ 155us) write_op.cc:270] Start()
0619 06:29:52.167935 (+ 18us) write_op.cc:276] Timestamp: P: 1781850586876479 usec, L: 0
0619 06:29:52.168101 (+ 166us) write_op.cc:270] Start()
0619 06:29:52.168122 (+ 21us) write_op.cc:276] Timestamp: P: 1781850586907321 usec, L: 0
0619 06:29:52.168281 (+ 159us) write_op.cc:270] Start()
0619 06:29:52.168300 (+ 19us) write_op.cc:276] Timestamp: P: 1781850586912359 usec, L: 0
0619 06:29:52.168416 (+ 116us) write_op.cc:270] Start()
0619 06:29:52.168433 (+ 17us) write_op.cc:276] Timestamp: P: 1781850586933526 usec, L: 0
0619 06:29:52.168592 (+ 159us) write_op.cc:270] Start()
0619 06:29:52.169425 (+ 833us) write_op.cc:276] Timestamp: P: 1781850586934082 usec, L: 0
0619 06:29:52.170849 (+ 1424us) write_op.cc:270] Start()
0619 06:29:52.170876 (+ 27us) write_op.cc:276] Timestamp: P: 1781850586967142 usec, L: 0
0619 06:29:52.171072 (+ 196us) write_op.cc:270] Start()
0619 06:29:52.171094 (+ 22us) write_op.cc:276] Timestamp: P: 1781850586975904 usec, L: 0
0619 06:29:52.171248 (+ 154us) write_op.cc:270] Start()
0619 06:29:52.171267 (+ 19us) write_op.cc:276] Timestamp: P: 1781850586992910 usec, L: 0
0619 06:29:52.171419 (+ 152us) write_op.cc:270] Start()
0619 06:29:52.171439 (+ 20us) write_op.cc:276] Timestamp: P: 1781850587005158 usec, L: 0
0619 06:29:52.171565 (+ 126us) write_op.cc:270] Start()
0619 06:29:52.171583 (+ 18us) write_op.cc:276] Timestamp: P: 1781850587037325 usec, L: 0
0619 06:29:52.171807 (+ 224us) write_op.cc:270] Start()
0619 06:29:52.171832 (+ 25us) write_op.cc:276] Timestamp: P: 1781850587053833 usec, L: 0
0619 06:29:52.173771 (+ 1939us) write_op.cc:270] Start()
0619 06:29:52.173797 (+ 26us) write_op.cc:276] Timestamp: P: 1781850587079623 usec, L: 0
0619 06:29:52.182912 (+ 9115us) write_op.cc:270] Start()
0619 06:29:52.182943 (+ 31us) write_op.cc:276] Timestamp: P: 1781850587083117 usec, L: 0
0619 06:29:52.191603 (+ 8660us) write_op.cc:270] Start()
0619 06:29:52.191621 (+ 18us) write_op.cc:276] Timestamp: P: 1781850587083799 usec, L: 0
0619 06:29:52.199159 (+ 7538us) write_op.cc:270] Start()
0619 06:29:52.199186 (+ 27us) write_op.cc:276] Timestamp: P: 1781850587128494 usec, L: 0
0619 06:29:52.220447 (+ 21261us) write_op.cc:270] Start()
0619 06:29:52.220469 (+ 22us) write_op.cc:276] Timestamp: P: 1781850587148475 usec, L: 0
0619 06:29:52.222686 (+ 2217us) write_op.cc:270] Start()
0619 06:29:52.222713 (+ 27us) write_op.cc:276] Timestamp: P: 1781850587197091 usec, L: 0
0619 06:29:52.226133 (+ 3420us) write_op.cc:270] Start()
0619 06:29:52.226154 (+ 21us) write_op.cc:276] Timestamp: P: 1781850587202624 usec, L: 0
0619 06:29:52.252207 (+ 26053us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x60f00000add8. stack: 00007ff742e9066e 00007ff742e90430 00007ff741f175ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007ff74b98dc35 00007ff74e404e49 00007ff74e3ac5c9 00007ff74e3a9ee9 00007ff751f50a6c 00007ff74c83bfa6 00007ff74c83bcd5 00007ff7499cc9be 00007ff7499cb79e 00007ff7499d1b25
0619 06:29:52.252321 (+ 114us) write_op.cc:270] Start()
0619 06:29:52.252342 (+ 21us) write_op.cc:276] Timestamp: P: 1781850587242434 usec, L: 0
0619 06:29:52.252496 (+ 154us) write_op.cc:270] Start()
0619 06:29:52.252515 (+ 19us) write_op.cc:276] Timestamp: P: 1781850587243164 usec, L: 0
0619 06:29:52.252677 (+ 162us) write_op.cc:270] Start()
0619 06:29:52.252697 (+ 20us) write_op.cc:276] Timestamp: P: 1781850587271559 usec, L: 0
0619 06:29:52.252852 (+ 155us) write_op.cc:270] Start()
0619 06:29:52.252868 (+ 16us) write_op.cc:276] Timestamp: P: 1781850587285220 usec, L: 0
0619 06:29:52.257302 (+ 4434us) write_op.cc:270] Start()
0619 06:29:52.257325 (+ 23us) write_op.cc:276] Timestamp: P: 1781850587291293 usec, L: 0
0619 06:29:52.272157 (+ 14832us) write_op.cc:270] Start()
0619 06:29:52.272178 (+ 21us) write_op.cc:276] Timestamp: P: 1781850587295681 usec, L: 0
0619 06:29:52.277935 (+ 5757us) write_op.cc:270] Start()
0619 06:29:52.277960 (+ 25us) write_op.cc:276] Timestamp: P: 1781850587343756 usec, L: 0
0619 06:29:52.291678 (+ 13718us) write_op.cc:270] Start()
0619 06:29:52.291699 (+ 21us) write_op.cc:276] Timestamp: P: 1781850587344393 usec, L: 0
0619 06:29:52.291838 (+ 139us) write_op.cc:270] Start()
0619 06:29:52.291857 (+ 19us) write_op.cc:276] Timestamp: P: 1781850587354251 usec, L: 0
0619 06:29:52.295251 (+ 3394us) write_op.cc:270] Start()
0619 06:29:52.295275 (+ 24us) write_op.cc:276] Timestamp: P: 1781850587366553 usec, L: 0
0619 06:29:52.295411 (+ 136us) write_op.cc:270] Start()
0619 06:29:52.295444 (+ 33us) write_op.cc:276] Timestamp: P: 1781850587402872 usec, L: 0
0619 06:29:52.304169 (+ 8725us) write_op.cc:270] Start()
0619 06:29:52.304195 (+ 26us) write_op.cc:276] Timestamp: P: 1781850587431589 usec, L: 0
0619 06:29:52.310013 (+ 5818us) write_op.cc:270] Start()
0619 06:29:52.310037 (+ 24us) write_op.cc:276] Timestamp: P: 1781850587434315 usec, L: 0
0619 06:29:52.310189 (+ 152us) write_op.cc:270] Start()
0619 06:29:52.310211 (+ 22us) write_op.cc:276] Timestamp: P: 1781850587461198 usec, L: 0
0619 06:29:52.310353 (+ 142us) write_op.cc:270] Start()
0619 06:29:52.310373 (+ 20us) write_op.cc:276] Timestamp: P: 1781850587474432 usec, L: 0
0619 06:29:52.310537 (+ 164us) write_op.cc:270] Start()
0619 06:29:52.310558 (+ 21us) write_op.cc:276] Timestamp: P: 1781850587501781 usec, L: 0
0619 06:29:52.310715 (+ 157us) write_op.cc:270] Start()
0619 06:29:52.310739 (+ 24us) write_op.cc:276] Timestamp: P: 1781850587506935 usec, L: 0
0619 06:29:52.310895 (+ 156us) write_op.cc:270] Start()
0619 06:29:52.310916 (+ 21us) write_op.cc:276] Timestamp: P: 1781850587566407 usec, L: 0
0619 06:29:52.311077 (+ 161us) write_op.cc:270] Start()
0619 06:29:52.311098 (+ 21us) write_op.cc:276] Timestamp: P: 1781850587567097 usec, L: 0
0619 06:29:52.311232 (+ 134us) write_op.cc:270] Start()
0619 06:29:52.311251 (+ 19us) write_op.cc:276] Timestamp: P: 1781850587600643 usec, L: 0
0619 06:29:52.311427 (+ 176us) write_op.cc:270] Start()
0619 06:29:52.311451 (+ 24us) write_op.cc:276] Timestamp: P: 1781850587601346 usec, L: 0
0619 06:29:52.311587 (+ 136us) write_op.cc:270] Start()
0619 06:29:52.311617 (+ 30us) write_op.cc:276] Timestamp: P: 1781850587650581 usec, L: 0
0619 06:29:52.311756 (+ 139us) write_op.cc:270] Start()
0619 06:29:52.311776 (+ 20us) write_op.cc:276] Timestamp: P: 1781850587671401 usec, L: 0
0619 06:29:52.311908 (+ 132us) write_op.cc:270] Start()
0619 06:29:52.311929 (+ 21us) write_op.cc:276] Timestamp: P: 1781850587678128 usec, L: 0
0619 06:29:52.312079 (+ 150us) write_op.cc:270] Start()
0619 06:29:52.312108 (+ 29us) write_op.cc:276] Timestamp: P: 1781850587714914 usec, L: 0
0619 06:29:52.312258 (+ 150us) write_op.cc:270] Start()
0619 06:29:52.312280 (+ 22us) write_op.cc:276] Timestamp: P: 1781850587716223 usec, L: 0
0619 06:29:52.312410 (+ 130us) write_op.cc:270] Start()
0619 06:29:52.312444 (+ 34us) write_op.cc:276] Timestamp: P: 1781850587734257 usec, L: 0
0619 06:29:52.312612 (+ 168us) write_op.cc:270] Start()
0619 06:29:52.312637 (+ 25us) write_op.cc:276] Timestamp: P: 1781850587738042 usec, L: 0
0619 06:29:52.315025 (+ 2388us) write_op.cc:270] Start()
0619 06:29:52.315045 (+ 20us) write_op.cc:276] Timestamp: P: 1781850587786646 usec, L: 0
0619 06:29:52.315165 (+ 120us) write_op.cc:270] Start()
0619 06:29:52.315182 (+ 17us) write_op.cc:276] Timestamp: P: 1781850587789650 usec, L: 0
0619 06:29:52.321203 (+ 6021us) write_op.cc:270] Start()
0619 06:29:52.321227 (+ 24us) write_op.cc:276] Timestamp: P: 1781850587819830 usec, L: 0
0619 06:29:52.321379 (+ 152us) write_op.cc:270] Start()
0619 06:29:52.321402 (+ 23us) write_op.cc:276] Timestamp: P: 1781850587838576 usec, L: 0
0619 06:29:52.325566 (+ 4164us) write_op.cc:270] Start()
0619 06:29:52.326841 (+ 1275us) write_op.cc:276] Timestamp: P: 1781850587853182 usec, L: 0
0619 06:29:52.328039 (+ 1198us) write_op.cc:270] Start()
0619 06:29:52.328063 (+ 24us) write_op.cc:276] Timestamp: P: 1781850587872495 usec, L: 0
0619 06:29:52.341090 (+ 13027us) write_op.cc:270] Start()
0619 06:29:52.341114 (+ 24us) write_op.cc:276] Timestamp: P: 1781850587884413 usec, L: 0
0619 06:29:52.383355 (+ 42241us) write_op.cc:270] Start()
0619 06:29:52.383382 (+ 27us) write_op.cc:276] Timestamp: P: 1781850587893295 usec, L: 0
0619 06:29:52.383552 (+ 170us) write_op.cc:270] Start()
0619 06:29:52.389198 (+ 5646us) write_op.cc:276] Timestamp: P: 1781850587926142 usec, L: 0
0619 06:29:52.389347 (+ 149us) write_op.cc:270] Start()
0619 06:29:52.389372 (+ 25us) write_op.cc:276] Timestamp: P: 1781850587950273 usec, L: 0
0619 06:29:52.393376 (+ 4004us) write_op.cc:270] Start()
0619 06:29:52.393401 (+ 25us) write_op.cc:276] Timestamp: P: 1781850587959464 usec, L: 0
0619 06:29:52.393586 (+ 185us) write_op.cc:270] Start()
0619 06:29:52.393607 (+ 21us) write_op.cc:276] Timestamp: P: 1781850587988694 usec, L: 0
0619 06:29:52.393749 (+ 142us) write_op.cc:270] Start()
0619 06:29:52.393769 (+ 20us) write_op.cc:276] Timestamp: P: 1781850587994836 usec, L: 0
0619 06:29:52.393928 (+ 159us) write_op.cc:270] Start()
0619 06:29:52.393950 (+ 22us) write_op.cc:276] Timestamp: P: 1781850588011092 usec, L: 0
0619 06:29:52.394089 (+ 139us) write_op.cc:270] Start()
0619 06:29:52.394119 (+ 30us) write_op.cc:276] Timestamp: P: 1781850588012412 usec, L: 0
0619 06:29:52.394258 (+ 139us) write_op.cc:270] Start()
0619 06:29:52.394279 (+ 21us) write_op.cc:276] Timestamp: P: 1781850588072522 usec, L: 0
0619 06:29:52.394417 (+ 138us) write_op.cc:270] Start()
0619 06:29:52.394449 (+ 32us) write_op.cc:276] Timestamp: P: 1781850588073477 usec, L: 0
0619 06:29:52.394616 (+ 167us) write_op.cc:270] Start()
0619 06:29:52.394642 (+ 26us) write_op.cc:276] Timestamp: P: 1781850588077309 usec, L: 0
0619 06:29:52.394790 (+ 148us) write_op.cc:270] Start()
0619 06:29:52.394813 (+ 23us) write_op.cc:276] Timestamp: P: 1781850588078602 usec, L: 0
0619 06:29:52.394952 (+ 139us) write_op.cc:270] Start()
0619 06:29:52.394972 (+ 20us) write_op.cc:276] Timestamp: P: 1781850588130330 usec, L: 0
0619 06:29:52.395102 (+ 130us) write_op.cc:270] Start()
0619 06:29:52.395123 (+ 21us) write_op.cc:276] Timestamp: P: 1781850588145276 usec, L: 0
0619 06:29:52.395273 (+ 150us) write_op.cc:270] Start()
0619 06:29:52.395295 (+ 22us) write_op.cc:276] Timestamp: P: 1781850588166359 usec, L: 0
0619 06:29:52.395445 (+ 150us) write_op.cc:270] Start()
0619 06:29:52.395467 (+ 22us) write_op.cc:276] Timestamp: P: 1781850588166899 usec, L: 0
0619 06:29:52.395617 (+ 150us) write_op.cc:270] Start()
0619 06:29:52.395640 (+ 23us) write_op.cc:276] Timestamp: P: 1781850588192543 usec, L: 0
0619 06:29:52.395780 (+ 140us) write_op.cc:270] Start()
0619 06:29:52.395797 (+ 17us) write_op.cc:276] Timestamp: P: 1781850588194790 usec, L: 0
0619 06:29:52.395893 (+ 96us) write_op.cc:270] Start()
0619 06:29:52.395909 (+ 16us) write_op.cc:276] Timestamp: P: 1781850588226247 usec, L: 0
0619 06:29:52.396016 (+ 107us) write_op.cc:270] Start()
0619 06:29:52.396032 (+ 16us) write_op.cc:276] Timestamp: P: 1781850588233412 usec, L: 0
0619 06:29:52.416281 (+ 20249us) write_op.cc:270] Start()
0619 06:29:52.416308 (+ 27us) write_op.cc:276] Timestamp: P: 1781850588279154 usec, L: 0
0619 06:29:52.424098 (+ 7790us) write_op.cc:270] Start()
0619 06:29:52.424123 (+ 25us) write_op.cc:276] Timestamp: P: 1781850588285629 usec, L: 0
0619 06:29:52.445186 (+ 21063us) write_op.cc:270] Start()
0619 06:29:52.445213 (+ 27us) write_op.cc:276] Timestamp: P: 1781850588288200 usec, L: 0
0619 06:29:52.446626 (+ 1413us) write_op.cc:270] Start()
0619 06:29:52.446651 (+ 25us) write_op.cc:276] Timestamp: P: 1781850588323530 usec, L: 0
0619 06:29:52.449503 (+ 2852us) write_op.cc:270] Start()
0619 06:29:52.449532 (+ 29us) write_op.cc:276] Timestamp: P: 1781850588340424 usec, L: 0
0619 06:29:52.451050 (+ 1518us) write_op.cc:270] Start()
0619 06:29:52.451075 (+ 25us) write_op.cc:276] Timestamp: P: 1781850588355817 usec, L: 0
0619 06:29:52.452256 (+ 1181us) write_op.cc:270] Start()
0619 06:29:52.452278 (+ 22us) write_op.cc:276] Timestamp: P: 1781850588364302 usec, L: 0
0619 06:29:52.478400 (+ 26122us) write_op.cc:270] Start()
0619 06:29:52.478438 (+ 38us) write_op.cc:276] Timestamp: P: 1781850588395765 usec, L: 0
0619 06:29:52.495080 (+ 16642us) write_op.cc:270] Start()
0619 06:29:52.495106 (+ 26us) write_op.cc:276] Timestamp: P: 1781850588433717 usec, L: 0
0619 06:29:52.495259 (+ 153us) write_op.cc:270] Start()
0619 06:29:52.495278 (+ 19us) write_op.cc:276] Timestamp: P: 1781850588435743 usec, L: 0
0619 06:29:52.495436 (+ 158us) write_op.cc:270] Start()
0619 06:29:52.495459 (+ 23us) write_op.cc:276] Timestamp: P: 1781850588458346 usec, L: 0
0619 06:29:52.497865 (+ 2406us) write_op.cc:270] Start()
0619 06:29:52.497891 (+ 26us) write_op.cc:276] Timestamp: P: 1781850588464751 usec, L: 0
0619 06:29:52.505027 (+ 7136us) write_op.cc:270] Start()
0619 06:29:52.505049 (+ 22us) write_op.cc:276] Timestamp: P: 1781850588493473 usec, L: 0
0619 06:29:52.513170 (+ 8121us) write_op.cc:270] Start()
0619 06:29:52.513199 (+ 29us) write_op.cc:276] Timestamp: P: 1781850588495244 usec, L: 0
0619 06:29:52.520469 (+ 7270us) write_op.cc:270] Start()
0619 06:29:52.520493 (+ 24us) write_op.cc:276] Timestamp: P: 1781850588552915 usec, L: 0
0619 06:29:52.543182 (+ 22689us) write_op.cc:270] Start()
0619 06:29:52.543209 (+ 27us) write_op.cc:276] Timestamp: P: 1781850588554099 usec, L: 0
0619 06:29:52.544079 (+ 870us) write_op.cc:270] Start()
0619 06:29:52.544102 (+ 23us) write_op.cc:276] Timestamp: P: 1781850588563505 usec, L: 0
0619 06:29:52.544693 (+ 591us) write_op.cc:270] Start()
0619 06:29:52.544717 (+ 24us) write_op.cc:276] Timestamp: P: 1781850588582738 usec, L: 0
0619 06:29:52.561012 (+ 16295us) write_op.cc:270] Start()
0619 06:29:52.561035 (+ 23us) write_op.cc:276] Timestamp: P: 1781850588610879 usec, L: 0
0619 06:29:52.564001 (+ 2966us) write_op.cc:270] Start()
0619 06:29:52.564022 (+ 21us) write_op.cc:276] Timestamp: P: 1781850588611444 usec, L: 0
0619 06:29:52.569902 (+ 5880us) write_op.cc:270] Start()
0619 06:29:52.569926 (+ 24us) write_op.cc:276] Timestamp: P: 1781850588614256 usec, L: 0
0619 06:29:52.571970 (+ 2044us) write_op.cc:270] Start()
0619 06:29:52.571989 (+ 19us) write_op.cc:276] Timestamp: P: 1781850588628137 usec, L: 0
0619 06:29:52.572111 (+ 122us) write_op.cc:270] Start()
0619 06:29:52.572129 (+ 18us) write_op.cc:276] Timestamp: P: 1781850588659388 usec, L: 0
0619 06:29:52.572244 (+ 115us) write_op.cc:270] Start()
0619 06:29:52.572261 (+ 17us) write_op.cc:276] Timestamp: P: 1781850588675923 usec, L: 0
0619 06:29:52.572394 (+ 133us) write_op.cc:270] Start()
0619 06:29:52.572411 (+ 17us) write_op.cc:276] Timestamp: P: 1781850588680299 usec, L: 0
0619 06:29:52.572528 (+ 117us) write_op.cc:270] Start()
0619 06:29:52.572544 (+ 16us) write_op.cc:276] Timestamp: P: 1781850588721297 usec, L: 0
0619 06:29:52.572672 (+ 128us) write_op.cc:270] Start()
0619 06:29:52.572690 (+ 18us) write_op.cc:276] Timestamp: P: 1781850588738612 usec, L: 0
0619 06:29:52.593209 (+ 20519us) write_op.cc:270] Start()
0619 06:29:52.593224 (+ 15us) write_op.cc:276] Timestamp: P: 1781850588762907 usec, L: 0
0619 06:29:52.593353 (+ 129us) write_op.cc:270] Start()
0619 06:29:52.593385 (+ 32us) write_op.cc:276] Timestamp: P: 1781850588790033 usec, L: 0
0619 06:29:52.597451 (+ 4066us) write_op.cc:270] Start()
0619 06:29:52.597473 (+ 22us) write_op.cc:276] Timestamp: P: 1781850588791507 usec, L: 0
0619 06:29:52.600746 (+ 3273us) write_op.cc:270] Start()
0619 06:29:52.600770 (+ 24us) write_op.cc:276] Timestamp: P: 1781850588814257 usec, L: 0
0619 06:29:52.634418 (+ 33648us) write_op.cc:270] Start()
0619 06:29:52.634470 (+ 52us) write_op.cc:276] Timestamp: P: 1781850588814998 usec, L: 0
0619 06:29:52.634715 (+ 245us) write_op.cc:270] Start()
0619 06:29:52.634743 (+ 28us) write_op.cc:276] Timestamp: P: 1781850588832395 usec, L: 0
0619 06:29:52.641883 (+ 7140us) write_op.cc:270] Start()
0619 06:29:52.641917 (+ 34us) write_op.cc:276] Timestamp: P: 1781850588854320 usec, L: 0
0619 06:29:52.675446 (+ 33529us) write_op.cc:270] Start()
0619 06:29:52.675583 (+ 137us) write_op.cc:276] Timestamp: P: 1781850588865742 usec, L: 0
0619 06:29:52.675833 (+ 250us) write_op.cc:270] Start()
0619 06:29:52.675864 (+ 31us) write_op.cc:276] Timestamp: P: 1781850588897343 usec, L: 0
0619 06:29:52.679769 (+ 3905us) write_op.cc:270] Start()
0619 06:29:52.679794 (+ 25us) write_op.cc:276] Timestamp: P: 1781850588899865 usec, L: 0
0619 06:29:52.701069 (+ 21275us) write_op.cc:270] Start()
0619 06:29:52.701095 (+ 26us) write_op.cc:276] Timestamp: P: 1781850588939868 usec, L: 0
0619 06:29:52.703904 (+ 2809us) write_op.cc:270] Start()
0619 06:29:52.703926 (+ 22us) write_op.cc:276] Timestamp: P: 1781850588948274 usec, L: 0
0619 06:29:52.704941 (+ 1015us) write_op.cc:270] Start()
0619 06:29:52.704965 (+ 24us) write_op.cc:276] Timestamp: P: 1781850588964935 usec, L: 0
0619 06:29:52.706372 (+ 1407us) write_op.cc:270] Start()
0619 06:29:52.706397 (+ 25us) write_op.cc:276] Timestamp: P: 1781850588983621 usec, L: 0
0619 06:29:52.706587 (+ 190us) write_op.cc:270] Start()
0619 06:29:52.706612 (+ 25us) write_op.cc:276] Timestamp: P: 1781850589003172 usec, L: 0
0619 06:29:52.708019 (+ 1407us) write_op.cc:270] Start()
0619 06:29:52.708041 (+ 22us) write_op.cc:276] Timestamp: P: 1781850589025944 usec, L: 0
0619 06:29:52.741024 (+ 32983us) write_op.cc:270] Start()
0619 06:29:52.741048 (+ 24us) write_op.cc:276] Timestamp: P: 1781850589033966 usec, L: 0
0619 06:29:52.751816 (+ 10768us) write_op.cc:270] Start()
0619 06:29:52.751837 (+ 21us) write_op.cc:276] Timestamp: P: 1781850589038225 usec, L: 0
0619 06:29:52.755501 (+ 3664us) write_op.cc:270]
I20260619 06:29:53.914419 7993 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e2da70288694680bec48ac95c14656f" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 1371 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1" is_pre_election: true
I20260619 06:29:53.942130 8458 leader_election.cc:302] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b46f2dae92104884b86705d6bbc20003; no voters: 3fc4e58423894a27a7b94de5c6013cf1, 996381a7495d4720a6f6be44a1d4781b
I20260619 06:29:53.942445 8664 raft_consensus.cc:2726] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 06:29:54.021947 8664 raft_consensus.cc:482] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 996381a7495d4720a6f6be44a1d4781b)
I20260619 06:29:54.022151 8664 raft_consensus.cc:504] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } } peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } }
I20260619 06:29:54.023340 7862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08686b31ffd64266bcdbd6f5eb29a87d" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 1252 } } ignore_live_leader: false dest_uuid: "996381a7495d4720a6f6be44a1d4781b" is_pre_election: true
I20260619 06:29:54.025321 8664 leader_election.cc:288] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499), 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063)
I20260619 06:29:54.037031 7993 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08686b31ffd64266bcdbd6f5eb29a87d" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 1252 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1" is_pre_election: true
I20260619 06:29:54.037595 8458 leader_election.cc:302] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b46f2dae92104884b86705d6bbc20003; no voters: 3fc4e58423894a27a7b94de5c6013cf1, 996381a7495d4720a6f6be44a1d4781b
I20260619 06:29:54.042625 8664 raft_consensus.cc:2726] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 06:29:53.289608 8556 rpcz_store.cc:276] 0619 06:29:51.632411 (+ 0us) service_pool.cc:170] Inserting onto call queue
0619 06:29:51.632569 (+ 158us) service_pool.cc:227] Handling call
0619 06:29:51.914715 (+282146us) raft_consensus.cc:1457] Updating replica for 339 ops
0619 06:29:52.094802 (+180087us) raft_consensus.cc:1520] Early marking committed up to index 0
0619 06:29:52.094807 (+ 5us) raft_consensus.cc:1525] Triggering prepare for 339 ops
0619 06:29:52.094902 (+ 95us) write_op.cc:270] Start()
0619 06:29:52.094924 (+ 22us) write_op.cc:276] Timestamp: P: 1781850585207322 usec, L: 0
0619 06:29:52.095379 (+ 455us) write_op.cc:270] Start()
0619 06:29:52.095403 (+ 24us) write_op.cc:276] Timestamp: P: 1781850585247714 usec, L: 0
0619 06:29:52.095564 (+ 161us) write_op.cc:270] Start()
0619 06:29:52.095582 (+ 18us) write_op.cc:276] Timestamp: P: 1781850585250522 usec, L: 0
0619 06:29:52.096126 (+ 544us) write_op.cc:270] Start()
0619 06:29:52.096152 (+ 26us) write_op.cc:276] Timestamp: P: 1781850585314956 usec, L: 0
0619 06:29:52.096631 (+ 479us) write_op.cc:270] Start()
0619 06:29:52.096662 (+ 31us) write_op.cc:276] Timestamp: P: 1781850585341382 usec, L: 0
0619 06:29:52.096839 (+ 177us) write_op.cc:270] Start()
0619 06:29:52.096860 (+ 21us) write_op.cc:276] Timestamp: P: 1781850585412536 usec, L: 0
0619 06:29:52.096987 (+ 127us) write_op.cc:270] Start()
0619 06:29:52.097027 (+ 40us) write_op.cc:276] Timestamp: P: 1781850585439559 usec, L: 0
0619 06:29:52.097139 (+ 112us) write_op.cc:270] Start()
0619 06:29:52.097156 (+ 17us) write_op.cc:276] Timestamp: P: 1781850585453009 usec, L: 0
0619 06:29:52.125515 (+ 28359us) write_op.cc:270] Start()
0619 06:29:52.125541 (+ 26us) write_op.cc:276] Timestamp: P: 1781850585463059 usec, L: 0
0619 06:29:52.125703 (+ 162us) write_op.cc:270] Start()
0619 06:29:52.125719 (+ 16us) write_op.cc:276] Timestamp: P: 1781850585517384 usec, L: 0
0619 06:29:52.125846 (+ 127us) write_op.cc:270] Start()
0619 06:29:52.125860 (+ 14us) write_op.cc:276] Timestamp: P: 1781850585529983 usec, L: 0
0619 06:29:52.125941 (+ 81us) write_op.cc:270] Start()
0619 06:29:52.125953 (+ 12us) write_op.cc:276] Timestamp: P: 1781850585547607 usec, L: 0
0619 06:29:52.126077 (+ 124us) write_op.cc:270] Start()
0619 06:29:52.126095 (+ 18us) write_op.cc:276] Timestamp: P: 1781850585555912 usec, L: 0
0619 06:29:52.126220 (+ 125us) write_op.cc:270] Start()
0619 06:29:52.126239 (+ 19us) write_op.cc:276] Timestamp: P: 1781850585598422 usec, L: 0
0619 06:29:52.138353 (+ 12114us) write_op.cc:270] Start()
0619 06:29:52.138385 (+ 32us) write_op.cc:276] Timestamp: P: 1781850585621989 usec, L: 0
0619 06:29:52.140222 (+ 1837us) write_op.cc:270] Start()
0619 06:29:52.140246 (+ 24us) write_op.cc:276] Timestamp: P: 1781850585649626 usec, L: 0
0619 06:29:52.144279 (+ 4033us) write_op.cc:270] Start()
0619 06:29:52.144301 (+ 22us) write_op.cc:276] Timestamp: P: 1781850585651862 usec, L: 0
0619 06:29:52.144494 (+ 193us) write_op.cc:270] Start()
0619 06:29:52.144518 (+ 24us) write_op.cc:276] Timestamp: P: 1781850585653264 usec, L: 0
0619 06:29:52.144689 (+ 171us) write_op.cc:270] Start()
0619 06:29:52.144715 (+ 26us) write_op.cc:276] Timestamp: P: 1781850585681828 usec, L: 0
0619 06:29:52.144893 (+ 178us) write_op.cc:270] Start()
0619 06:29:52.144913 (+ 20us) write_op.cc:276] Timestamp: P: 1781850585715188 usec, L: 0
0619 06:29:52.145068 (+ 155us) write_op.cc:270] Start()
0619 06:29:52.145088 (+ 20us) write_op.cc:276] Timestamp: P: 1781850585734951 usec, L: 0
0619 06:29:52.145232 (+ 144us) write_op.cc:270] Start()
0619 06:29:52.145251 (+ 19us) write_op.cc:276] Timestamp: P: 1781850585743331 usec, L: 0
0619 06:29:52.145380 (+ 129us) write_op.cc:270] Start()
0619 06:29:52.145397 (+ 17us) write_op.cc:276] Timestamp: P: 1781850585749732 usec, L: 0
0619 06:29:52.145552 (+ 155us) write_op.cc:270] Start()
0619 06:29:52.145575 (+ 23us) write_op.cc:276] Timestamp: P: 1781850585750925 usec, L: 0
0619 06:29:52.149091 (+ 3516us) write_op.cc:270] Start()
0619 06:29:52.149124 (+ 33us) write_op.cc:276] Timestamp: P: 1781850585814584 usec, L: 0
0619 06:29:52.162550 (+ 13426us) write_op.cc:270] Start()
0619 06:29:52.162587 (+ 37us) write_op.cc:276] Timestamp: P: 1781850585822247 usec, L: 0
0619 06:29:52.163287 (+ 700us) write_op.cc:270] Start()
0619 06:29:52.163325 (+ 38us) write_op.cc:276] Timestamp: P: 1781850585840060 usec, L: 0
0619 06:29:52.163521 (+ 196us) write_op.cc:270] Start()
0619 06:29:52.163557 (+ 36us) write_op.cc:276] Timestamp: P: 1781850585851800 usec, L: 0
0619 06:29:52.163698 (+ 141us) write_op.cc:270] Start()
0619 06:29:52.163737 (+ 39us) write_op.cc:276] Timestamp: P: 1781850585884669 usec, L: 0
0619 06:29:52.163889 (+ 152us) write_op.cc:270] Start()
0619 06:29:52.163908 (+ 19us) write_op.cc:276] Timestamp: P: 1781850585904893 usec, L: 0
0619 06:29:52.169581 (+ 5673us) write_op.cc:270] Start()
0619 06:29:52.169600 (+ 19us) write_op.cc:276] Timestamp: P: 1781850585918864 usec, L: 0
0619 06:29:52.172299 (+ 2699us) write_op.cc:270] Start()
0619 06:29:52.172322 (+ 23us) write_op.cc:276] Timestamp: P: 1781850585931315 usec, L: 0
0619 06:29:52.174821 (+ 2499us) write_op.cc:270] Start()
0619 06:29:52.174845 (+ 24us) write_op.cc:276] Timestamp: P: 1781850585955051 usec, L: 0
0619 06:29:52.185682 (+ 10837us) write_op.cc:270] Start()
0619 06:29:52.185711 (+ 29us) write_op.cc:276] Timestamp: P: 1781850585981043 usec, L: 0
0619 06:29:52.189825 (+ 4114us) write_op.cc:270] Start()
0619 06:29:52.189851 (+ 26us) write_op.cc:276] Timestamp: P: 1781850585981727 usec, L: 0
0619 06:29:52.190049 (+ 198us) write_op.cc:270] Start()
0619 06:29:52.190070 (+ 21us) write_op.cc:276] Timestamp: P: 1781850585988687 usec, L: 0
0619 06:29:52.190213 (+ 143us) write_op.cc:270] Start()
0619 06:29:52.190235 (+ 22us) write_op.cc:276] Timestamp: P: 1781850586021754 usec, L: 0
0619 06:29:52.190376 (+ 141us) write_op.cc:270] Start()
0619 06:29:52.190396 (+ 20us) write_op.cc:276] Timestamp: P: 1781850586045064 usec, L: 0
0619 06:29:52.190555 (+ 159us) write_op.cc:270] Start()
0619 06:29:52.190575 (+ 20us) write_op.cc:276] Timestamp: P: 1781850586069758 usec, L: 0
0619 06:29:52.190699 (+ 124us) write_op.cc:270] Start()
0619 06:29:52.190719 (+ 20us) write_op.cc:276] Timestamp: P: 1781850586102765 usec, L: 0
0619 06:29:52.225900 (+ 35181us) write_op.cc:270] Start()
0619 06:29:52.225925 (+ 25us) write_op.cc:276] Timestamp: P: 1781850586107062 usec, L: 0
0619 06:29:52.249730 (+ 23805us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x60f00000add8. stack: 00007ff742e9066e 00007ff742e90430 00007ff741f175ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007ff74b98dc35 00007ff74e404e49 00007ff74e3ac5c9 00007ff74e3a9ee9 00007ff751f50a6c 00007ff74c83bfa6 00007ff74c83bcd5 00007ff7499cc9be 00007ff7499cb79e 00007ff7499d1b25
0619 06:29:52.252906 (+ 3176us) write_op.cc:270] Start()
0619 06:29:52.252933 (+ 27us) write_op.cc:276] Timestamp: P: 1781850586112973 usec, L: 0
0619 06:29:52.253053 (+ 120us) write_op.cc:270] Start()
0619 06:29:52.253070 (+ 17us) write_op.cc:276] Timestamp: P: 1781850586142595 usec, L: 0
0619 06:29:52.253188 (+ 118us) write_op.cc:270] Start()
0619 06:29:52.253208 (+ 20us) write_op.cc:276] Timestamp: P: 1781850586160626 usec, L: 0
0619 06:29:52.253846 (+ 638us) write_op.cc:270] Start()
0619 06:29:52.253879 (+ 33us) write_op.cc:276] Timestamp: P: 1781850586189962 usec, L: 0
0619 06:29:52.271712 (+ 17833us) write_op.cc:270] Start()
0619 06:29:52.271737 (+ 25us) write_op.cc:276] Timestamp: P: 1781850586192603 usec, L: 0
0619 06:29:52.276981 (+ 5244us) write_op.cc:270] Start()
0619 06:29:52.277006 (+ 25us) write_op.cc:276] Timestamp: P: 1781850586195707 usec, L: 0
0619 06:29:52.277155 (+ 149us) write_op.cc:270] Start()
0619 06:29:52.277175 (+ 20us) write_op.cc:276] Timestamp: P: 1781850586222073 usec, L: 0
0619 06:29:52.280011 (+ 2836us) write_op.cc:270] Start()
0619 06:29:52.280035 (+ 24us) write_op.cc:276] Timestamp: P: 1781850586239183 usec, L: 0
0619 06:29:52.280185 (+ 150us) write_op.cc:270] Start()
0619 06:29:52.280206 (+ 21us) write_op.cc:276] Timestamp: P: 1781850586267451 usec, L: 0
0619 06:29:52.280353 (+ 147us) write_op.cc:270] Start()
0619 06:29:52.280379 (+ 26us) write_op.cc:276] Timestamp: P: 1781850586276182 usec, L: 0
0619 06:29:52.280548 (+ 169us) write_op.cc:270] Start()
0619 06:29:52.280570 (+ 22us) write_op.cc:276] Timestamp: P: 1781850586281218 usec, L: 0
0619 06:29:52.280707 (+ 137us) write_op.cc:270] Start()
0619 06:29:52.280728 (+ 21us) write_op.cc:276] Timestamp: P: 1781850586306835 usec, L: 0
0619 06:29:52.280856 (+ 128us) write_op.cc:270] Start()
0619 06:29:52.281062 (+ 206us) write_op.cc:276] Timestamp: P: 1781850586333084 usec, L: 0
0619 06:29:52.281238 (+ 176us) write_op.cc:270] Start()
0619 06:29:52.281259 (+ 21us) write_op.cc:276] Timestamp: P: 1781850586334012 usec, L: 0
0619 06:29:52.281444 (+ 185us) write_op.cc:270] Start()
0619 06:29:52.281464 (+ 20us) write_op.cc:276] Timestamp: P: 1781850586334668 usec, L: 0
0619 06:29:52.281778 (+ 314us) write_op.cc:270] Start()
0619 06:29:52.281831 (+ 53us) write_op.cc:276] Timestamp: P: 1781850586356165 usec, L: 0
0619 06:29:52.282009 (+ 178us) write_op.cc:270] Start()
0619 06:29:52.282031 (+ 22us) write_op.cc:276] Timestamp: P: 1781850586383366 usec, L: 0
0619 06:29:52.282184 (+ 153us) write_op.cc:270] Start()
0619 06:29:52.282208 (+ 24us) write_op.cc:276] Timestamp: P: 1781850586383925 usec, L: 0
0619 06:29:52.282356 (+ 148us) write_op.cc:270] Start()
0619 06:29:52.282376 (+ 20us) write_op.cc:276] Timestamp: P: 1781850586400881 usec, L: 0
0619 06:29:52.282553 (+ 177us) write_op.cc:270] Start()
0619 06:29:52.282576 (+ 23us) write_op.cc:276] Timestamp: P: 1781850586448069 usec, L: 0
0619 06:29:52.282725 (+ 149us) write_op.cc:270] Start()
0619 06:29:52.282749 (+ 24us) write_op.cc:276] Timestamp: P: 1781850586460705 usec, L: 0
0619 06:29:52.282886 (+ 137us) write_op.cc:270] Start()
0619 06:29:52.282908 (+ 22us) write_op.cc:276] Timestamp: P: 1781850586477485 usec, L: 0
0619 06:29:52.283045 (+ 137us) write_op.cc:270] Start()
0619 06:29:52.283065 (+ 20us) write_op.cc:276] Timestamp: P: 1781850586496741 usec, L: 0
0619 06:29:52.283209 (+ 144us) write_op.cc:270] Start()
0619 06:29:52.283228 (+ 19us) write_op.cc:276] Timestamp: P: 1781850586534978 usec, L: 0
0619 06:29:52.309742 (+ 26514us) write_op.cc:270] Start()
0619 06:29:52.309767 (+ 25us) write_op.cc:276] Timestamp: P: 1781850586542853 usec, L: 0
0619 06:29:52.320860 (+ 11093us) write_op.cc:270] Start()
0619 06:29:52.320884 (+ 24us) write_op.cc:276] Timestamp: P: 1781850586544254 usec, L: 0
0619 06:29:52.326554 (+ 5670us) write_op.cc:270] Start()
0619 06:29:52.326579 (+ 25us) write_op.cc:276] Timestamp: P: 1781850586572755 usec, L: 0
0619 06:29:52.330807 (+ 4228us) write_op.cc:270] Start()
0619 06:29:52.330834 (+ 27us) write_op.cc:276] Timestamp: P: 1781850586598297 usec, L: 0
0619 06:29:52.330981 (+ 147us) write_op.cc:270] Start()
0619 06:29:52.331002 (+ 21us) write_op.cc:276] Timestamp: P: 1781850586606775 usec, L: 0
0619 06:29:52.336902 (+ 5900us) write_op.cc:270] Start()
0619 06:29:52.336926 (+ 24us) write_op.cc:276] Timestamp: P: 1781850586612625 usec, L: 0
0619 06:29:52.340593 (+ 3667us) write_op.cc:270] Start()
0619 06:29:52.343392 (+ 2799us) write_op.cc:276] Timestamp: P: 1781850586641460 usec, L: 0
0619 06:29:52.343564 (+ 172us) write_op.cc:270] Start()
0619 06:29:52.343588 (+ 24us) write_op.cc:276] Timestamp: P: 1781850586678739 usec, L: 0
0619 06:29:52.374560 (+ 30972us) write_op.cc:270] Start()
0619 06:29:52.374588 (+ 28us) write_op.cc:276] Timestamp: P: 1781850586679701 usec, L: 0
0619 06:29:52.374741 (+ 153us) write_op.cc:270] Start()
0619 06:29:52.374762 (+ 21us) write_op.cc:276] Timestamp: P: 1781850586685731 usec, L: 0
0619 06:29:52.387805 (+ 13043us) write_op.cc:270] Start()
0619 06:29:52.387830 (+ 25us) write_op.cc:276] Timestamp: P: 1781850586688281 usec, L: 0
0619 06:29:52.389026 (+ 1196us) write_op.cc:270] Start()
0619 06:29:52.389053 (+ 27us) write_op.cc:276] Timestamp: P: 1781850586761094 usec, L: 0
0619 06:29:52.392749 (+ 3696us) write_op.cc:270] Start()
0619 06:29:52.392776 (+ 27us) write_op.cc:276] Timestamp: P: 1781850586765135 usec, L: 0
0619 06:29:52.399208 (+ 6432us) write_op.cc:270] Start()
0619 06:29:52.399231 (+ 23us) write_op.cc:276] Timestamp: P: 1781850586767932 usec, L: 0
0619 06:29:52.399362 (+ 131us) write_op.cc:270] Start()
0619 06:29:52.399379 (+ 17us) write_op.cc:276] Timestamp: P: 1781850586769118 usec, L: 0
0619 06:29:52.403042 (+ 3663us) write_op.cc:270] Start()
0619 06:29:52.403065 (+ 23us) write_op.cc:276] Timestamp: P: 1781850586804585 usec, L: 0
0619 06:29:52.410920 (+ 7855us) write_op.cc:270] Start()
0619 06:29:52.410947 (+ 27us) write_op.cc:276] Timestamp: P: 1781850586817848 usec, L: 0
0619 06:29:52.416818 (+ 5871us) write_op.cc:270] Start()
0619 06:29:52.416843 (+ 25us) write_op.cc:276] Timestamp: P: 1781850586861281 usec, L: 0
0619 06:29:52.422684 (+ 5841us) write_op.cc:270] Start()
0619 06:29:52.422709 (+ 25us) write_op.cc:276] Timestamp: P: 1781850586869370 usec, L: 0
0619 06:29:52.438111 (+ 15402us) write_op.cc:270] Start()
0619 06:29:52.438139 (+ 28us) write_op.cc:276] Timestamp: P: 1781850586875974 usec, L: 0
0619 06:29:52.438323 (+ 184us) write_op.cc:270] Start()
0619 06:29:52.438346 (+ 23us) write_op.cc:276] Timestamp: P: 1781850586877125 usec, L: 0
0619 06:29:52.447283 (+ 8937us) write_op.cc:270] Start()
0619 06:29:52.447310 (+ 27us) write_op.cc:276] Timestamp: P: 1781850586910953 usec, L: 0
0619 06:29:52.450339 (+ 3029us) write_op.cc:270] Start()
0619 06:29:52.450365 (+ 26us) write_op.cc:276] Timestamp: P: 1781850586911582 usec, L: 0
0619 06:29:52.453937 (+ 3572us) write_op.cc:270] Start()
0619 06:29:52.453960 (+ 23us) write_op.cc:276] Timestamp: P: 1781850586933871 usec, L: 0
0619 06:29:52.454075 (+ 115us) write_op.cc:270] Start()
0619 06:29:52.454091 (+ 16us) write_op.cc:276] Timestamp: P: 1781850586949782 usec, L: 0
0619 06:29:52.458260 (+ 4169us) write_op.cc:270] Start()
0619 06:29:52.458284 (+ 24us) write_op.cc:276] Timestamp: P: 1781850586973340 usec, L: 0
0619 06:29:52.476365 (+ 18081us) write_op.cc:270] Start()
0619 06:29:52.476387 (+ 22us) write_op.cc:276] Timestamp: P: 1781850586975502 usec, L: 0
0619 06:29:52.476578 (+ 191us) write_op.cc:270] Start()
0619 06:29:52.476600 (+ 22us) write_op.cc:276] Timestamp: P: 1781850586989853 usec, L: 0
0619 06:29:52.476733 (+ 133us) write_op.cc:270] Start()
0619 06:29:52.476753 (+ 20us) write_op.cc:276] Timestamp: P: 1781850587005860 usec, L: 0
0619 06:29:52.476925 (+ 172us) write_op.cc:270] Start()
0619 06:29:52.476949 (+ 24us) write_op.cc:276] Timestamp: P: 1781850587036973 usec, L: 0
0619 06:29:52.477091 (+ 142us) write_op.cc:270] Start()
0619 06:29:52.477111 (+ 20us) write_op.cc:276] Timestamp: P: 1781850587053385 usec, L: 0
0619 06:29:52.477269 (+ 158us) write_op.cc:270] Start()
0619 06:29:52.477291 (+ 22us) write_op.cc:276] Timestamp: P: 1781850587054032 usec, L: 0
0619 06:29:52.477468 (+ 177us) write_op.cc:270] Start()
0619 06:29:52.477491 (+ 23us) write_op.cc:276] Timestamp: P: 1781850587083709 usec, L: 0
0619 06:29:52.477634 (+ 143us) write_op.cc:270] Start()
0619 06:29:52.477654 (+ 20us) write_op.cc:276] Timestamp: P: 1781850587084331 usec, L: 0
0619 06:29:52.512741 (+ 35087us) write_op.cc:270] Start()
0619 06:29:52.512763 (+ 22us) write_op.cc:276] Timestamp: P: 1781850587131669 usec, L: 0
0619 06:29:52.515047 (+ 2284us) write_op.cc:270] Start()
0619 06:29:52.515076 (+ 29us) write_op.cc:276] Timestamp: P: 1781850587146673 usec, L: 0
0619 06:29:52.515228 (+ 152us) write_op.cc:270] Start()
0619 06:29:52.515249 (+ 21us) write_op.cc:276] Timestamp: P: 1781850587201985 usec, L: 0
0619 06:29:52.519679 (+ 4430us) write_op.cc:270] Start()
0619 06:29:52.519705 (+ 26us) write_op.cc:276] Timestamp: P: 1781850587203292 usec, L: 0
0619 06:29:52.519860 (+ 155us) write_op.cc:270] Start()
0619 06:29:52.519882 (+ 22us) write_op.cc:276] Timestamp: P: 1781850587242726 usec, L: 0
0619 06:29:52.530379 (+ 10497us) write_op.cc:270] Start()
0619 06:29:52.530404 (+ 25us) write_op.cc:276] Timestamp: P: 1781850587259581 usec, L: 0
0619 06:29:52.532678 (+ 2274us) write_op.cc:270] Start()
0619 06:29:52.532707 (+ 29us) write_op.cc:276] Timestamp: P: 1781850587270455 usec, L: 0
0619 06:29:52.532865 (+ 158us) write_op.cc:270] Start()
0619 06:29:52.532887 (+ 22us) write_op.cc:276] Timestamp: P: 1781850587277363 usec, L: 0
0619 06:29:52.538999 (+ 6112us) write_op.cc:270] Start()
0619 06:29:52.539024 (+ 25us) write_op.cc:276] Timestamp: P: 1781850587295148 usec, L: 0
0619 06:29:52.539213 (+ 189us) write_op.cc:270] Start()
0619 06:29:52.539236 (+ 23us) write_op.cc:276] Timestamp: P: 1781850587296036 usec, L: 0
0619 06:29:52.540006 (+ 770us) write_op.cc:270] Start()
0619 06:29:52.540032 (+ 26us) write_op.cc:276] Timestamp: P: 1781850587339475 usec, L: 0
0619 06:29:52.540198 (+ 166us) write_op.cc:270] Start()
0619 06:29:52.540224 (+ 26us) write_op.cc:276] Timestamp: P: 1781850587343969 usec, L: 0
0619 06:29:52.540372 (+ 148us) write_op.cc:270] Start()
0619 06:29:52.540394 (+ 22us) write_op.cc:276] Timestamp: P: 1781850587366159 usec, L: 0
0619 06:29:52.540547 (+ 153us) write_op.cc:270] Start()
0619 06:29:52.540570 (+ 23us) write_op.cc:276] Timestamp: P: 1781850587369714 usec, L: 0
0619 06:29:52.540743 (+ 173us) write_op.cc:270] Start()
0619 06:29:52.540763 (+ 20us) write_op.cc:276] Timestamp: P: 1781850587405064 usec, L: 0
0619 06:29:52.540928 (+ 165us) write_op.cc:270] Start()
0619 06:29:52.540957 (+ 29us) write_op.cc:276] Timestamp: P: 1781850587432806 usec, L: 0
0619 06:29:52.541116 (+ 159us) write_op.cc:270] Start()
0619 06:29:52.541138 (+ 22us) write_op.cc:276] Timestamp: P: 1781850587433657 usec, L: 0
0619 06:29:52.543878 (+ 2740us) write_op.cc:270] Start()
0619 06:29:52.543901 (+ 23us) write_op.cc:276] Timestamp: P: 1781850587462864 usec, L: 0
0619 06:29:52.545475 (+ 1574us) write_op.cc:270] Start()
0619 06:29:52.545499 (+ 24us) write_op.cc:276] Timestamp: P: 1781850587475855 usec, L: 0
0619 06:29:52.551878 (+ 6379us) write_op.cc:270] Start()
0619 06:29:52.551902 (+ 24us) write_op.cc:276] Timestamp: P: 1781850587493737 usec, L: 0
0619 06:29:52.552059 (+ 157us) write_op.cc:270] Start()
0619 06:29:52.552079 (+ 20us) write_op.cc:276] Timestamp: P: 1781850587504885 usec, L: 0
0619 06:29:52.566706 (+ 14627us) write_op.cc:270] Start()
0619 06:29:52.566727 (+ 21us) write_op.cc:276] Timestamp: P: 1781850587567383 usec, L: 0
0619 06:29:52.572346 (+ 5619us) write_op.cc:270] Start()
0619 06:29:52.572371 (+ 25us) write_op.cc:276] Timestamp: P: 1781850587567936 usec, L: 0
0619 06:29:52.572501 (+ 130us) write_op.cc:270] Start()
0619 06:29:52.572519 (+ 18us) write_op.cc:276] Timestamp: P: 1781850587600324 usec, L: 0
0619 06:29:52.572672 (+ 153us) write_op.cc:270] Start()
0619 06:29:52.572690 (+ 18us) write_op.cc:276] Timestamp: P: 1781850587621943 usec, L: 0
0619 06:29:52.572821 (+ 131us) write_op.cc:270] Start()
0619 06:29:52.572837 (+ 16us) write_op.cc:276] Timestamp: P: 1781850587661174 usec, L: 0
0619 06:29:52.572948 (+ 111us) write_op.cc:270] Start()
0619 06:29:52.572963 (+ 15us) write_op.cc:276] Timestamp: P: 1781850587667540 usec, L: 0
0619 06:29:52.592999 (+ 20036us) write_op.cc:270] Start()
0619 06:29:52.593022 (+ 23us) write_op.cc:276] Timestamp: P: 1781850587679475 usec, L: 0
0619 06:29:52.593162 (+ 140us) write_op.cc:270] Start()
0619 06:29:52.597264 (+ 4102us) write_op.cc:276] Timestamp: P: 1781850587695714 usec, L: 0
0619 06:29:52.601900 (+ 4636us) write_op.cc:270] Start()
0619 06:29:52.601939 (+ 39us) write_op.cc:276] Timestamp: P: 1781850587715544 usec, L: 0
0619 06:29:52.610666 (+ 8727us) write_op.cc:270] Start()
0619 06:29:52.610696 (+ 30us) write_op.cc:276] Timestamp: P: 1781850587732814 usec, L: 0
0619 06:29:52.610819 (+ 123us) write_op.cc:270] Start()
0619 06:29:52.610834 (+ 15us) write_op.cc:276] Timestamp: P: 1781850587739351 usec, L: 0
0619 06:29:52.613174 (+ 2340us) write_op.cc:270] Start()
0619 06:29:52.613210 (+ 36us) write_op.cc:276] Timestamp: P: 1781850587786725 usec, L: 0
0619 06:29:52.613408 (+ 198us) write_op.cc:270] Start()
0619 06:29:52.613447 (+ 39us) write_op.cc:276] Timestamp: P: 1781850587787261 usec, L: 0
0619 06:29:52.613608 (+ 161us) write_op.cc:270] Start()
0619 06:29:52.613632 (+ 24us) write_op.cc:276] Timestamp: P: 1781850587820489 usec, L: 0
0619 06:29:52.613786 (+ 154us) write_op.cc:270] Start()
0619 06:29:52.613812 (+ 26us) write_op.cc:276] Timestamp: P: 1781850587839349 usec, L: 0
0619 06:29:52.613959 (+ 147us) write_op.cc:270] Start()
0619 06:29:52.613979 (+ 20us) write_op.cc:276] Timestamp: P: 1781850587870753 usec, L: 0
0619 06:29:52.653167 (+ 39188us) write_op.cc:270] Start()
0619 06:29:52.653199 (+ 32us) write_op.cc:276] Timestamp: P: 1781850587873038 usec, L: 0
0619 06:29:52.653357 (+ 158us) write_op.cc:270] Start()
0619 06:29:52.653381 (+ 24us) write_op.cc:276] Timestamp: P: 1781850587885891 usec, L: 0
0619 06:29:52.658394 (+ 5013us) write_op.cc:270] Start()
0619 06:29:52.658418 (+ 24us) write_op.cc:276] Timestamp: P: 1781850587894158 usec, L: 0
0619 06:29:52.660296 (+ 1878us) write_op.cc:270] Start()
0619 06:29:52.660316 (+ 20us) write_op.cc:276] Timestamp: P: 1781850587923878 usec, L: 0
0619 06:29:52.669190 (+ 8874us) write_op.cc:270] Start()
0619 06:29:52.669209 (+ 19us) write_op.cc:276] Timestamp: P: 1781850587950651 usec, L: 0
0619 06:29:52.669334 (+ 125us) write_op.cc:270] Start()
0619 06:29:52.669350 (+ 16us) write_op.cc:276] Timestamp: P: 1781850587959528 usec, L: 0
0619 06:29:52.690650 (+ 21300us) write_op.cc:270] Start()
0619 06:29:52.690698 (+ 48us) write_op.cc:276] Timestamp: P: 1781850587990267 usec, L: 0
0619 06:29:52.690839 (+ 141us) write_op.cc:270] Start()
0619 06:29:52.690856 (+ 17us) write_op.cc:276] Timestamp: P: 1781850587991276 usec, L: 0
0619 06:29:52.690969 (+ 113us) write_op.cc:270] Start()
0619 06:29:52.691002 (+ 33us) write_op.cc:276] Timestamp: P: 1781850588010388 usec, L: 0
0619 06:29:52.691138 (+ 136us) write_op.cc:270] Start()
0619 06:29:52.691155 (+ 17us) write_op.cc:276] Timestamp: P: 1781850588013189 usec, L: 0
0619 06:29:52.691264 (+ 109us) write_op.cc:270] Start()
0619 06:29:52.691282 (+ 18us) write_op.cc:276] Timestamp: P: 1781850588071993 usec, L: 0
0619 06:29:52.691396 (+ 114us) write_op.cc:270] Start()
0619 06:29:52.691415 (+ 19us) write_op.cc:276] Timestamp: P: 1781850588073242 usec, L: 0
0619 06:29:52.691543 (+ 128us) write_op.cc:270] Start()
0619 06:29:52.691562 (+ 19us) write_op.cc:276] Timestamp: P: 1781850588073867 usec, L: 0
0619 06:29:52.691709 (+ 147us) write_op.cc:270] Start()
0619 06:29:52.691728 (+ 19us) write_op.cc:276] Timestamp: P: 1781850588104333 usec, L: 0
0619 06:29:52.691875 (+ 147us) write_op.cc:270] Start()
0619 06:29:52.691895 (+ 20us) write_op.cc:276] Timestamp: P: 1781850588128603 usec, L: 0
0619 06:29:52.692028 (+ 133us) write_op.cc:270] Start()
0619 06:29:52.692047 (+ 19us) write_op.cc:276] Timestamp: P: 1781850588145769 usec, L: 0
0619 06:29:52.692173 (+ 126us) write_op.cc:270] Start()
0619 06:29:52.692194 (+ 21us) write_op.cc:276] Timestamp: P: 1781850588166270 usec, L: 0
0619 06:29:52.692322 (+ 128us) write_op.cc:270] Start()
0619 06:29:52.692344 (+ 22us) write_op.cc:276] Timestamp: P: 1781850588166957 usec, L: 0
0619 06:29:52.692499 (+ 155us) write_op.cc:270] Start()
0619 06:29:52.692521 (+ 22us) write_op.cc:276] Timestamp: P: 1781850588181159 usec, L: 0
0619 06:29:52.692688 (+ 167us) write_op.cc:270] Start()
0619 06:29:52.692709 (+ 21us) write_op.cc:276] Timestamp: P: 1781850588199203 usec, L: 0
0619 06:29:52.692858 (+ 149us) write_op.cc:270] Start()
0619 06:29:52.692885 (+ 27us) write_op.cc:276] Timestamp: P: 1781850588228046 usec, L: 0
0619 06:29:52.693016 (+ 131us) write_op.cc:270] Start()
0619 06:29:52.693036 (+ 20us) write_op.cc:276] Timestamp: P: 1781850588231895 usec, L: 0
0619 06:29:52.693184 (+ 148us) write_op.cc:270] Start()
0619 06:29:52.693205 (+ 21us) write_op.cc:276] Timestamp: P: 1781850588275667 usec, L: 0
0619 06:29:52.693344 (+ 139us) write_op.cc:270] Start()
0619 06:29:52.693365 (+ 21us) write_op.cc:276] Timestamp: P: 1781850588280740 usec, L: 0
0619 06:29:52.693496 (+ 131us) write_op.cc:270] Start()
0619 06:29:52.693518 (+ 22us) write_op.cc:276] Timestamp: P: 1781850588288969 usec, L: 0
0619 06:29:52.693695 (+ 177us) write_op.cc:270] Start()
0619 06:29:52.693716 (+ 21us) write_op.cc:276] Timestamp: P: 1781850588324282 usec, L: 0
0619 06:29:52.693864 (+ 148us) write_op.cc:270] Start()
0619 06:29:52.693885 (+ 21us) write_op.cc:276] Timestamp: P: 1781850588342023 usec, L: 0
0619 06:29:52.694045 (+ 160us) write_op.cc:270] Start()
0619 06:29:52.694066 (+ 21us) write_op.cc:276] Timestamp: P: 1781850588356163 usec, L: 0
0619 06:29:52.694208 (+ 142us) write_op.cc:270] Start()
0619 06:29:52.694228 (+ 20us) write_op.cc:276] Timestamp: P: 1781850588364504 usec, L: 0
0619 06:29:52.694369 (+ 141us) write_op.cc:270] Start()
0619 06:29:52.694391 (+ 22us) write_op.cc:276] Timestamp: P: 1781850588396533 usec, L: 0
0619 06:29:52.742638 (+ 48247us) write_op.cc:270] Start()
0619 06:29:52.742663 (+ 25us) write_op.cc:276] Timestamp: P: 1781850588432996 usec, L: 0
0619 06:29:52.756839 (+ 14176us) write_op.cc:270] Start()
0619 06:29:52.756864 (+ 25us) write_op.cc:276] Timestamp: P: 1781850588436604 usec, L: 0
0619 06:29:52.757023 (+ 159us) write_op.cc:270] Start()
0619 06:29:52.757043 (+ 20us) write_op.cc:276] Timestamp: P: 1781850588456814 usec, L: 0
0619 06:29:52.757205 (+ 162us) write_op.cc:270] Start()
0619 06:29:52.757227 (+ 22us) write_op.cc:276] Timestamp: P: 1781850588465038 usec, L: 0
0619 06:29:52.757370 (+ 143us) write_op.cc:270] Start()
0619 06:29:52.757390 (+ 20us) write_op.cc:276] Timestamp: P: 1781850588493688 usec, L: 0
0619 06:29:52.757590 (+ 200us) write_op.cc:270] Start()
0619 06:29:52.757613 (+ 23us) write_op.cc:276] Timestamp: P: 1781850588494435 usec, L: 0
0619 06:29:52.758651 (+ 1038us) write_op.cc:270] Start()
0619 06:29:52.758675 (+ 24us) write_op.cc:276] Timestamp: P: 1781850588524901 usec, L: 0
0619 06:29:52.758818 (+ 143us) write_op.cc:270] Start()
0619 06:29:52.758839 (+ 21us) write_op.cc:276] Timestamp: P: 1781850588553548 usec, L: 0
0619 06:29:52.759001 (+ 162us) write_op.cc:270] Start()
0619 06:29:52.759021 (+ 20us) write_op.cc:276] Timestamp: P: 1781850588568555 usec, L: 0
0619 06:29:52.759157 (+ 136us) write_op.cc:270] Start()
0619 06:29:52.759177 (+ 20us) write_op.cc:276] Timestamp: P: 1781850588583257 usec, L: 0
0619 06:29:52.774137 (+ 14960us) write_op.cc:270] Start()
0619 06:29:52.774162 (+ 25us) write_op.cc:276] Timestamp: P: 1781850588611012 usec, L: 0
0619 06:29:52.784196 (+ 10034us) write_op.cc:270] Start()
0619 06:29:52.784222 (+ 26us) write_op.cc:276] Timestamp: P: 1781850588611596 usec, L: 0
0619 06:29:52.794658 (+ 10436us) write_op.cc:270] Start()
0619 06:29:52.794688 (+ 30us) write_op.cc:276] Timestamp: P: 1781850588615160 usec, L: 0
0619 06:29:52.794844 (+ 156us) write_op.cc:270] Start()
0619 06:29:52.794861 (+ 17us) write_op.cc:276] Timestamp: P: 1781850588627768 usec, L: 0
0619 06:29:52.794970 (+ 109us) write_op.cc:270] Start()
0619 06:29:52.794985 (+ 15us) write_op.cc:276] Timestamp: P: 1781850588658745 usec, L: 0
0619 06:29:52.795101 (+ 116us) write_op.cc:270] Start()
0619 06:29:52.795116 (+ 15us) write_op.cc:276] Timestamp: P: 1781850588674411 usec, L: 0
0619 06:29:52.795228 (+ 112us) write_op.cc:270] Start()
0619 06:29:52.795244 (+ 16us) write_op.cc:276] Timestamp: P: 1781850588678860 usec, L: 0
0619 06:29:52.795347 (+ 103us) write_op.cc:270] Start()
0619 06:29:52.795361 (+ 14us) write_op.cc:276] Timestamp: P: 1781850588720467 usec, L: 0
0619 06:29:52.795461 (+ 100us) write_op.cc:270] Start()
0619 06:29:52.795489 (+ 28us) write_op.cc:276] Timestamp: P: 1781850588738961 usec, L: 0
0619 06:29:52.795639 (+ 150us) write_op.cc:270] Start()
0619 06:29:52.795654 (+ 15us) write_op.cc:276] Timestamp: P: 1781850588762495 usec, L: 0
0619 06:29:52.795755 (+ 101us) write_op.cc:270] Start()
0619 06:29:52.795769 (+ 14us) write_op.cc:276] Timestamp: P: 1781850588764113 usec, L: 0
0619 06:29:52.795892 (+ 123us) write_op.cc:270] Start()
0619 06:29:52.795908 (+ 16us) write_op.cc:276] Timestamp: P: 1781850588792138 usec, L: 0
0619 06:29:52.796014 (+ 106us) write_op.cc:270] Start()
0619 06:29:52.796028 (+ 14us) write_op.cc:276] Timestamp: P: 1781850588812865 usec, L: 0
0619 06:29:52.796143 (+ 115us) write_op.cc:270] Start()
0619 06:29:52.796159 (+ 16us) write_op.cc:276] Timestamp: P: 1781850588816923 usec, L: 0
0619 06:29:52.796271 (+ 112us) write_op.cc:270] Start()
0619 06:29:52.796286 (+ 15us) write_op.cc:276] Timestamp: P: 1781850588839218 usec, L: 0
0619 06:29:52.796391 (+ 105us) write_op.cc:270] Start()
0619 06:29:52.796405 (+ 14us) write_op.cc:276] Timestamp: P: 1781850588853403 usec, L: 0
0619 06:29:52.796511 (+ 106us) write_op.cc:270] Start()
0619 06:29:52.796527 (+ 16us) write_op.cc:276] Timestamp: P: 1781850588861450 usec, L: 0
0619 06:29:52.831847 (+ 35320us) write_op.cc:270] Start()
0619 06:29:52.831877 (+ 30us) write_op.cc:276] Timestamp: P: 1781850588895787 usec, L: 0
0619 06:29:52.832047 (+ 170us) write_op.cc:270] St
I20260619 06:29:54.238899 8361 ts_manager.cc:281] Unset tserver state for b46f2dae92104884b86705d6bbc20003 from MAINTENANCE_MODE
I20260619 06:29:54.250118 7908 heartbeater.cc:511] Master 127.7.96.62:40917 requested a full tablet report, sending...
I20260619 06:29:54.305258 8609 heartbeater.cc:511] Master 127.7.96.62:40917 requested a full tablet report, sending...
I20260619 06:29:54.350622 8664 raft_consensus.cc:482] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3fc4e58423894a27a7b94de5c6013cf1)
I20260619 06:29:54.350816 8664 raft_consensus.cc:504] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:54.352663 7860 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cffdcc0e99c47aead56bbaea58d3e4d" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 1252 } } ignore_live_leader: false dest_uuid: "996381a7495d4720a6f6be44a1d4781b" is_pre_election: true
I20260619 06:29:54.355485 8664 leader_election.cc:288] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063), 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499)
I20260619 06:29:54.363593 7991 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cffdcc0e99c47aead56bbaea58d3e4d" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 1252 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1" is_pre_election: true
I20260619 06:29:54.376561 8458 leader_election.cc:302] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b46f2dae92104884b86705d6bbc20003; no voters: 3fc4e58423894a27a7b94de5c6013cf1, 996381a7495d4720a6f6be44a1d4781b
I20260619 06:29:54.376886 8664 raft_consensus.cc:2726] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 06:29:54.394117 8291 heartbeater.cc:511] Master 127.7.96.62:40917 requested a full tablet report, sending...
I20260619 06:29:53.231951 8554 rpcz_store.cc:276] 0619 06:29:51.154146 (+ 0us) service_pool.cc:170] Inserting onto call queue
0619 06:29:51.157200 (+ 3054us) service_pool.cc:227] Handling call
0619 06:29:51.529073 (+371873us) raft_consensus.cc:1457] Updating replica for 315 ops
0619 06:29:51.709502 (+180429us) raft_consensus.cc:1520] Early marking committed up to index 0
0619 06:29:51.709507 (+ 5us) raft_consensus.cc:1525] Triggering prepare for 315 ops
0619 06:29:51.709595 (+ 88us) write_op.cc:270] Start()
0619 06:29:51.709617 (+ 22us) write_op.cc:276] Timestamp: P: 1781850585247933 usec, L: 0
0619 06:29:51.737038 (+ 27421us) write_op.cc:270] Start()
0619 06:29:51.737072 (+ 34us) write_op.cc:276] Timestamp: P: 1781850585278299 usec, L: 0
0619 06:29:51.737226 (+ 154us) write_op.cc:270] Start()
0619 06:29:51.737246 (+ 20us) write_op.cc:276] Timestamp: P: 1781850585314071 usec, L: 0
0619 06:29:51.737396 (+ 150us) write_op.cc:270] Start()
0619 06:29:51.737416 (+ 20us) write_op.cc:276] Timestamp: P: 1781850585332724 usec, L: 0
0619 06:29:51.737552 (+ 136us) write_op.cc:270] Start()
0619 06:29:51.737570 (+ 18us) write_op.cc:276] Timestamp: P: 1781850585406449 usec, L: 0
0619 06:29:51.737675 (+ 105us) write_op.cc:270] Start()
0619 06:29:51.737690 (+ 15us) write_op.cc:276] Timestamp: P: 1781850585434108 usec, L: 0
0619 06:29:51.737802 (+ 112us) write_op.cc:270] Start()
0619 06:29:51.737842 (+ 40us) write_op.cc:276] Timestamp: P: 1781850585461944 usec, L: 0
0619 06:29:51.737967 (+ 125us) write_op.cc:270] Start()
0619 06:29:51.737985 (+ 18us) write_op.cc:276] Timestamp: P: 1781850585463674 usec, L: 0
0619 06:29:51.738137 (+ 152us) write_op.cc:270] Start()
0619 06:29:51.738163 (+ 26us) write_op.cc:276] Timestamp: P: 1781850585517843 usec, L: 0
0619 06:29:51.738281 (+ 118us) write_op.cc:270] Start()
0619 06:29:51.738298 (+ 17us) write_op.cc:276] Timestamp: P: 1781850585532439 usec, L: 0
0619 06:29:51.738397 (+ 99us) write_op.cc:270] Start()
0619 06:29:51.738412 (+ 15us) write_op.cc:276] Timestamp: P: 1781850585546323 usec, L: 0
0619 06:29:51.738526 (+ 114us) write_op.cc:270] Start()
0619 06:29:51.738541 (+ 15us) write_op.cc:276] Timestamp: P: 1781850585548734 usec, L: 0
0619 06:29:51.738672 (+ 131us) write_op.cc:270] Start()
0619 06:29:51.738695 (+ 23us) write_op.cc:276] Timestamp: P: 1781850585596245 usec, L: 0
0619 06:29:51.738797 (+ 102us) write_op.cc:270] Start()
0619 06:29:51.738812 (+ 15us) write_op.cc:276] Timestamp: P: 1781850585620758 usec, L: 0
0619 06:29:51.738924 (+ 112us) write_op.cc:270] Start()
0619 06:29:51.738939 (+ 15us) write_op.cc:276] Timestamp: P: 1781850585649803 usec, L: 0
0619 06:29:51.739042 (+ 103us) write_op.cc:270] Start()
0619 06:29:51.739069 (+ 27us) write_op.cc:276] Timestamp: P: 1781850585665064 usec, L: 0
0619 06:29:51.739187 (+ 118us) write_op.cc:270] Start()
0619 06:29:51.739206 (+ 19us) write_op.cc:276] Timestamp: P: 1781850585671190 usec, L: 0
0619 06:29:51.739325 (+ 119us) write_op.cc:270] Start()
0619 06:29:51.739342 (+ 17us) write_op.cc:276] Timestamp: P: 1781850585681478 usec, L: 0
0619 06:29:51.739463 (+ 121us) write_op.cc:270] Start()
0619 06:29:51.739479 (+ 16us) write_op.cc:276] Timestamp: P: 1781850585702643 usec, L: 0
0619 06:29:51.739590 (+ 111us) write_op.cc:270] Start()
0619 06:29:51.739608 (+ 18us) write_op.cc:276] Timestamp: P: 1781850585739493 usec, L: 0
0619 06:29:51.739740 (+ 132us) write_op.cc:270] Start()
0619 06:29:51.739759 (+ 19us) write_op.cc:276] Timestamp: P: 1781850585748473 usec, L: 0
0619 06:29:51.739876 (+ 117us) write_op.cc:270] Start()
0619 06:29:51.739891 (+ 15us) write_op.cc:276] Timestamp: P: 1781850585752065 usec, L: 0
0619 06:29:51.739994 (+ 103us) write_op.cc:270] Start()
0619 06:29:51.740009 (+ 15us) write_op.cc:276] Timestamp: P: 1781850585759956 usec, L: 0
0619 06:29:51.740118 (+ 109us) write_op.cc:270] Start()
0619 06:29:51.740133 (+ 15us) write_op.cc:276] Timestamp: P: 1781850585813173 usec, L: 0
0619 06:29:51.740255 (+ 122us) write_op.cc:270] Start()
0619 06:29:51.740276 (+ 21us) write_op.cc:276] Timestamp: P: 1781850585816998 usec, L: 0
0619 06:29:51.740420 (+ 144us) write_op.cc:270] Start()
0619 06:29:51.740436 (+ 16us) write_op.cc:276] Timestamp: P: 1781850585824492 usec, L: 0
0619 06:29:51.740563 (+ 127us) write_op.cc:270] Start()
0619 06:29:51.740579 (+ 16us) write_op.cc:276] Timestamp: P: 1781850585859067 usec, L: 0
0619 06:29:51.740682 (+ 103us) write_op.cc:270] Start()
0619 06:29:51.740698 (+ 16us) write_op.cc:276] Timestamp: P: 1781850585883526 usec, L: 0
0619 06:29:51.740803 (+ 105us) write_op.cc:270] Start()
0619 06:29:51.740823 (+ 20us) write_op.cc:276] Timestamp: P: 1781850585901792 usec, L: 0
0619 06:29:51.740933 (+ 110us) write_op.cc:270] Start()
0619 06:29:51.740949 (+ 16us) write_op.cc:276] Timestamp: P: 1781850585929006 usec, L: 0
0619 06:29:51.741084 (+ 135us) write_op.cc:270] Start()
0619 06:29:51.741102 (+ 18us) write_op.cc:276] Timestamp: P: 1781850585930583 usec, L: 0
0619 06:29:51.766149 (+ 25047us) write_op.cc:270] Start()
0619 06:29:51.766177 (+ 28us) write_op.cc:276] Timestamp: P: 1781850585959744 usec, L: 0
0619 06:29:51.766356 (+ 179us) write_op.cc:270] Start()
0619 06:29:51.766371 (+ 15us) write_op.cc:276] Timestamp: P: 1781850585980649 usec, L: 0
0619 06:29:51.767792 (+ 1421us) write_op.cc:270] Start()
0619 06:29:51.767815 (+ 23us) write_op.cc:276] Timestamp: P: 1781850585981678 usec, L: 0
0619 06:29:51.780490 (+ 12675us) write_op.cc:270] Start()
0619 06:29:51.780510 (+ 20us) write_op.cc:276] Timestamp: P: 1781850585985838 usec, L: 0
0619 06:29:51.784258 (+ 3748us) write_op.cc:270] Start()
0619 06:29:51.784282 (+ 24us) write_op.cc:276] Timestamp: P: 1781850586024408 usec, L: 0
0619 06:29:51.788890 (+ 4608us) write_op.cc:270] Start()
0619 06:29:51.788913 (+ 23us) write_op.cc:276] Timestamp: P: 1781850586047133 usec, L: 0
0619 06:29:51.789078 (+ 165us) write_op.cc:270] Start()
0619 06:29:51.789100 (+ 22us) write_op.cc:276] Timestamp: P: 1781850586077481 usec, L: 0
0619 06:29:51.803741 (+ 14641us) write_op.cc:270] Start()
0619 06:29:51.803760 (+ 19us) write_op.cc:276] Timestamp: P: 1781850586084011 usec, L: 0
0619 06:29:51.809148 (+ 5388us) write_op.cc:270] Start()
0619 06:29:51.809173 (+ 25us) write_op.cc:276] Timestamp: P: 1781850586102869 usec, L: 0
0619 06:29:51.810725 (+ 1552us) write_op.cc:270] Start()
0619 06:29:51.810751 (+ 26us) write_op.cc:276] Timestamp: P: 1781850586104703 usec, L: 0
0619 06:29:51.815410 (+ 4659us) write_op.cc:270] Start()
0619 06:29:51.815432 (+ 22us) write_op.cc:276] Timestamp: P: 1781850586105340 usec, L: 0
0619 06:29:51.820613 (+ 5181us) write_op.cc:270] Start()
0619 06:29:51.820638 (+ 25us) write_op.cc:276] Timestamp: P: 1781850586168746 usec, L: 0
0619 06:29:51.820834 (+ 196us) write_op.cc:270] Start()
0619 06:29:51.820855 (+ 21us) write_op.cc:276] Timestamp: P: 1781850586180894 usec, L: 0
0619 06:29:51.830284 (+ 9429us) write_op.cc:270] Start()
0619 06:29:51.830309 (+ 25us) write_op.cc:276] Timestamp: P: 1781850586192088 usec, L: 0
0619 06:29:51.830527 (+ 218us) write_op.cc:270] Start()
0619 06:29:51.830551 (+ 24us) write_op.cc:276] Timestamp: P: 1781850586197125 usec, L: 0
0619 06:29:51.848761 (+ 18210us) write_op.cc:270] Start()
0619 06:29:51.848790 (+ 29us) write_op.cc:276] Timestamp: P: 1781850586221024 usec, L: 0
0619 06:29:51.854026 (+ 5236us) write_op.cc:270] Start()
0619 06:29:51.854062 (+ 36us) write_op.cc:276] Timestamp: P: 1781850586254913 usec, L: 0
0619 06:29:51.854264 (+ 202us) write_op.cc:270] Start()
0619 06:29:51.854287 (+ 23us) write_op.cc:276] Timestamp: P: 1781850586265778 usec, L: 0
0619 06:29:51.854473 (+ 186us) write_op.cc:270] Start()
0619 06:29:51.854517 (+ 44us) write_op.cc:276] Timestamp: P: 1781850586273427 usec, L: 0
0619 06:29:51.854701 (+ 184us) write_op.cc:270] Start()
0619 06:29:51.854725 (+ 24us) write_op.cc:276] Timestamp: P: 1781850586285911 usec, L: 0
0619 06:29:51.854924 (+ 199us) write_op.cc:270] Start()
0619 06:29:51.854947 (+ 23us) write_op.cc:276] Timestamp: P: 1781850586315569 usec, L: 0
0619 06:29:51.858759 (+ 3812us) write_op.cc:270] Start()
0619 06:29:51.858785 (+ 26us) write_op.cc:276] Timestamp: P: 1781850586331424 usec, L: 0
0619 06:29:51.858984 (+ 199us) write_op.cc:270] Start()
0619 06:29:51.859004 (+ 20us) write_op.cc:276] Timestamp: P: 1781850586333665 usec, L: 0
0619 06:29:51.859193 (+ 189us) write_op.cc:270] Start()
0619 06:29:51.859214 (+ 21us) write_op.cc:276] Timestamp: P: 1781850586334249 usec, L: 0
0619 06:29:51.859400 (+ 186us) write_op.cc:270] Start()
0619 06:29:51.859425 (+ 25us) write_op.cc:276] Timestamp: P: 1781850586350648 usec, L: 0
0619 06:29:51.865274 (+ 5849us) write_op.cc:270] Start()
0619 06:29:51.865306 (+ 32us) write_op.cc:276] Timestamp: P: 1781850586380313 usec, L: 0
0619 06:29:51.871700 (+ 6394us) write_op.cc:270] Start()
0619 06:29:51.871726 (+ 26us) write_op.cc:276] Timestamp: P: 1781850586381334 usec, L: 0
0619 06:29:51.876713 (+ 4987us) write_op.cc:270] Start()
0619 06:29:51.876741 (+ 28us) write_op.cc:276] Timestamp: P: 1781850586402429 usec, L: 0
0619 06:29:51.893461 (+ 16720us) write_op.cc:270] Start()
0619 06:29:51.893512 (+ 51us) write_op.cc:276] Timestamp: P: 1781850586460067 usec, L: 0
0619 06:29:51.893742 (+ 230us) write_op.cc:270] Start()
0619 06:29:51.893768 (+ 26us) write_op.cc:276] Timestamp: P: 1781850586462011 usec, L: 0
0619 06:29:51.893965 (+ 197us) write_op.cc:270] Start()
0619 06:29:51.893986 (+ 21us) write_op.cc:276] Timestamp: P: 1781850586467618 usec, L: 0
0619 06:29:51.894170 (+ 184us) write_op.cc:270] Start()
0619 06:29:51.894191 (+ 21us) write_op.cc:276] Timestamp: P: 1781850586515709 usec, L: 0
0619 06:29:51.894373 (+ 182us) write_op.cc:270] Start()
0619 06:29:51.894397 (+ 24us) write_op.cc:276] Timestamp: P: 1781850586533984 usec, L: 0
0619 06:29:51.894630 (+ 233us) write_op.cc:270] Start()
0619 06:29:51.894653 (+ 23us) write_op.cc:276] Timestamp: P: 1781850586542355 usec, L: 0
0619 06:29:51.894836 (+ 183us) write_op.cc:270] Start()
0619 06:29:51.894858 (+ 22us) write_op.cc:276] Timestamp: P: 1781850586545465 usec, L: 0
0619 06:29:51.895084 (+ 226us) write_op.cc:270] Start()
0619 06:29:51.895108 (+ 24us) write_op.cc:276] Timestamp: P: 1781850586575182 usec, L: 0
0619 06:29:51.895296 (+ 188us) write_op.cc:270] Start()
0619 06:29:51.895319 (+ 23us) write_op.cc:276] Timestamp: P: 1781850586600412 usec, L: 0
0619 06:29:51.895500 (+ 181us) write_op.cc:270] Start()
0619 06:29:51.895522 (+ 22us) write_op.cc:276] Timestamp: P: 1781850586609256 usec, L: 0
0619 06:29:51.897603 (+ 2081us) write_op.cc:270] Start()
0619 06:29:51.897630 (+ 27us) write_op.cc:276] Timestamp: P: 1781850586610407 usec, L: 0
0619 06:29:51.897843 (+ 213us) write_op.cc:270] Start()
0619 06:29:51.897865 (+ 22us) write_op.cc:276] Timestamp: P: 1781850586642060 usec, L: 0
0619 06:29:51.898066 (+ 201us) write_op.cc:270] Start()
0619 06:29:51.898087 (+ 21us) write_op.cc:276] Timestamp: P: 1781850586679404 usec, L: 0
0619 06:29:51.898253 (+ 166us) write_op.cc:270] Start()
0619 06:29:51.898273 (+ 20us) write_op.cc:276] Timestamp: P: 1781850586680438 usec, L: 0
0619 06:29:51.898467 (+ 194us) write_op.cc:270] Start()
0619 06:29:51.898489 (+ 22us) write_op.cc:276] Timestamp: P: 1781850586703701 usec, L: 0
0619 06:29:51.902650 (+ 4161us) write_op.cc:270] Start()
0619 06:29:51.902672 (+ 22us) write_op.cc:276] Timestamp: P: 1781850586704340 usec, L: 0
0619 06:29:51.902849 (+ 177us) write_op.cc:270] Start()
0619 06:29:51.902866 (+ 17us) write_op.cc:276] Timestamp: P: 1781850586761803 usec, L: 0
0619 06:29:51.912384 (+ 9518us) write_op.cc:270] Start()
0619 06:29:51.912402 (+ 18us) write_op.cc:276] Timestamp: P: 1781850586763469 usec, L: 0
0619 06:29:51.935675 (+ 23273us) write_op.cc:270] Start()
0619 06:29:51.935699 (+ 24us) write_op.cc:276] Timestamp: P: 1781850586768243 usec, L: 0
0619 06:29:51.935877 (+ 178us) write_op.cc:270] Start()
0619 06:29:51.935898 (+ 21us) write_op.cc:276] Timestamp: P: 1781850586768744 usec, L: 0
0619 06:29:51.940033 (+ 4135us) write_op.cc:270] Start()
0619 06:29:51.940059 (+ 26us) write_op.cc:276] Timestamp: P: 1781850586803971 usec, L: 0
0619 06:29:51.948554 (+ 8495us) write_op.cc:270] Start()
0619 06:29:51.948582 (+ 28us) write_op.cc:276] Timestamp: P: 1781850586817065 usec, L: 0
0619 06:29:51.951703 (+ 3121us) write_op.cc:270] Start()
0619 06:29:51.951728 (+ 25us) write_op.cc:276] Timestamp: P: 1781850586839353 usec, L: 0
0619 06:29:51.965071 (+ 13343us) write_op.cc:270] Start()
0619 06:29:51.965098 (+ 27us) write_op.cc:276] Timestamp: P: 1781850586860773 usec, L: 0
0619 06:29:51.970348 (+ 5250us) write_op.cc:270] Start()
0619 06:29:51.970371 (+ 23us) write_op.cc:276] Timestamp: P: 1781850586861431 usec, L: 0
0619 06:29:51.976725 (+ 6354us) write_op.cc:270] Start()
0619 06:29:51.976751 (+ 26us) write_op.cc:276] Timestamp: P: 1781850586877114 usec, L: 0
0619 06:29:51.980888 (+ 4137us) write_op.cc:270] Start()
0619 06:29:51.980913 (+ 25us) write_op.cc:276] Timestamp: P: 1781850586900574 usec, L: 0
0619 06:29:51.981061 (+ 148us) write_op.cc:270] Start()
0619 06:29:51.981082 (+ 21us) write_op.cc:276] Timestamp: P: 1781850586910969 usec, L: 0
0619 06:29:52.004278 (+ 23196us) write_op.cc:270] Start()
0619 06:29:52.004302 (+ 24us) write_op.cc:276] Timestamp: P: 1781850586949457 usec, L: 0
0619 06:29:52.004460 (+ 158us) write_op.cc:270] Start()
0619 06:29:52.004481 (+ 21us) write_op.cc:276] Timestamp: P: 1781850586950158 usec, L: 0
0619 06:29:52.008750 (+ 4269us) write_op.cc:270] Start()
0619 06:29:52.008777 (+ 27us) write_op.cc:276] Timestamp: P: 1781850586968254 usec, L: 0
0619 06:29:52.011933 (+ 3156us) write_op.cc:270] Start()
0619 06:29:52.011965 (+ 32us) write_op.cc:276] Timestamp: P: 1781850586972550 usec, L: 0
0619 06:29:52.016199 (+ 4234us) write_op.cc:270] Start()
0619 06:29:52.016229 (+ 30us) write_op.cc:276] Timestamp: P: 1781850586985710 usec, L: 0
0619 06:29:52.018753 (+ 2524us) write_op.cc:270] Start()
0619 06:29:52.018782 (+ 29us) write_op.cc:276] Timestamp: P: 1781850587003711 usec, L: 0
0619 06:29:52.020729 (+ 1947us) write_op.cc:270] Start()
0619 06:29:52.020756 (+ 27us) write_op.cc:276] Timestamp: P: 1781850587035430 usec, L: 0
0619 06:29:52.032210 (+ 11454us) write_op.cc:270] Start()
0619 06:29:52.032239 (+ 29us) write_op.cc:276] Timestamp: P: 1781850587053502 usec, L: 0
0619 06:29:52.050011 (+ 17772us) write_op.cc:270] Start()
0619 06:29:52.050044 (+ 33us) write_op.cc:276] Timestamp: P: 1781850587056673 usec, L: 0
0619 06:29:52.050213 (+ 169us) write_op.cc:270] Start()
0619 06:29:52.050233 (+ 20us) write_op.cc:276] Timestamp: P: 1781850587089230 usec, L: 0
0619 06:29:52.053661 (+ 3428us) write_op.cc:270] Start()
0619 06:29:52.053691 (+ 30us) write_op.cc:276] Timestamp: P: 1781850587097763 usec, L: 0
0619 06:29:52.061343 (+ 7652us) write_op.cc:270] Start()
0619 06:29:52.061388 (+ 45us) write_op.cc:276] Timestamp: P: 1781850587128007 usec, L: 0
0619 06:29:52.061589 (+ 201us) write_op.cc:270] Start()
0619 06:29:52.061614 (+ 25us) write_op.cc:276] Timestamp: P: 1781850587154999 usec, L: 0
0619 06:29:52.061796 (+ 182us) write_op.cc:270] Start()
0619 06:29:52.061819 (+ 23us) write_op.cc:276] Timestamp: P: 1781850587196823 usec, L: 0
0619 06:29:52.061976 (+ 157us) write_op.cc:270] Start()
0619 06:29:52.062001 (+ 25us) write_op.cc:276] Timestamp: P: 1781850587209109 usec, L: 0
0619 06:29:52.071892 (+ 9891us) write_op.cc:270] Start()
0619 06:29:52.071920 (+ 28us) write_op.cc:276] Timestamp: P: 1781850587232800 usec, L: 0
0619 06:29:52.091737 (+ 19817us) write_op.cc:270] Start()
0619 06:29:52.102129 (+ 10392us) write_op.cc:276] Timestamp: P: 1781850587255638 usec, L: 0
0619 06:29:52.110892 (+ 8763us) write_op.cc:270] Start()
0619 06:29:52.110924 (+ 32us) write_op.cc:276] Timestamp: P: 1781850587276527 usec, L: 0
0619 06:29:52.111106 (+ 182us) write_op.cc:270] Start()
0619 06:29:52.111149 (+ 43us) write_op.cc:276] Timestamp: P: 1781850587293251 usec, L: 0
0619 06:29:52.111330 (+ 181us) write_op.cc:270] Start()
0619 06:29:52.111353 (+ 23us) write_op.cc:276] Timestamp: P: 1781850587295351 usec, L: 0
0619 06:29:52.111519 (+ 166us) write_op.cc:270] Start()
0619 06:29:52.111541 (+ 22us) write_op.cc:276] Timestamp: P: 1781850587299793 usec, L: 0
0619 06:29:52.111689 (+ 148us) write_op.cc:270] Start()
0619 06:29:52.111713 (+ 24us) write_op.cc:276] Timestamp: P: 1781850587341163 usec, L: 0
0619 06:29:52.111866 (+ 153us) write_op.cc:270] Start()
0619 06:29:52.111892 (+ 26us) write_op.cc:276] Timestamp: P: 1781850587341799 usec, L: 0
0619 06:29:52.112048 (+ 156us) write_op.cc:270] Start()
0619 06:29:52.112072 (+ 24us) write_op.cc:276] Timestamp: P: 1781850587364569 usec, L: 0
0619 06:29:52.112243 (+ 171us) write_op.cc:270] Start()
0619 06:29:52.112269 (+ 26us) write_op.cc:276] Timestamp: P: 1781850587367171 usec, L: 0
0619 06:29:52.112454 (+ 185us) write_op.cc:270] Start()
0619 06:29:52.112477 (+ 23us) write_op.cc:276] Timestamp: P: 1781850587390361 usec, L: 0
0619 06:29:52.112622 (+ 145us) write_op.cc:270] Start()
0619 06:29:52.112657 (+ 35us) write_op.cc:276] Timestamp: P: 1781850587407136 usec, L: 0
0619 06:29:52.112840 (+ 183us) write_op.cc:270] Start()
0619 06:29:52.112862 (+ 22us) write_op.cc:276] Timestamp: P: 1781850587415376 usec, L: 0
0619 06:29:52.113039 (+ 177us) write_op.cc:270] Start()
0619 06:29:52.113063 (+ 24us) write_op.cc:276] Timestamp: P: 1781850587460009 usec, L: 0
0619 06:29:52.113260 (+ 197us) write_op.cc:270] Start()
0619 06:29:52.113284 (+ 24us) write_op.cc:276] Timestamp: P: 1781850587473278 usec, L: 0
0619 06:29:52.113452 (+ 168us) write_op.cc:270] Start()
0619 06:29:52.113475 (+ 23us) write_op.cc:276] Timestamp: P: 1781850587493200 usec, L: 0
0619 06:29:52.113621 (+ 146us) write_op.cc:270] Start()
0619 06:29:52.113643 (+ 22us) write_op.cc:276] Timestamp: P: 1781850587502957 usec, L: 0
0619 06:29:52.113807 (+ 164us) write_op.cc:270] Start()
0619 06:29:52.113829 (+ 22us) write_op.cc:276] Timestamp: P: 1781850587505940 usec, L: 0
0619 06:29:52.113975 (+ 146us) write_op.cc:270] Start()
0619 06:29:52.113996 (+ 21us) write_op.cc:276] Timestamp: P: 1781850587566745 usec, L: 0
0619 06:29:52.114177 (+ 181us) write_op.cc:270] Start()
0619 06:29:52.114211 (+ 34us) write_op.cc:276] Timestamp: P: 1781850587599605 usec, L: 0
0619 06:29:52.115576 (+ 1365us) write_op.cc:270] Start()
0619 06:29:52.115606 (+ 30us) write_op.cc:276] Timestamp: P: 1781850587634677 usec, L: 0
0619 06:29:52.115775 (+ 169us) write_op.cc:270] Start()
0619 06:29:52.115809 (+ 34us) write_op.cc:276] Timestamp: P: 1781850587649963 usec, L: 0
0619 06:29:52.125187 (+ 9378us) write_op.cc:270] Start()
0619 06:29:52.125214 (+ 27us) write_op.cc:276] Timestamp: P: 1781850587676331 usec, L: 0
0619 06:29:52.128051 (+ 2837us) write_op.cc:270] Start()
0619 06:29:52.128075 (+ 24us) write_op.cc:276] Timestamp: P: 1781850587677047 usec, L: 0
0619 06:29:52.128400 (+ 325us) write_op.cc:270] Start()
0619 06:29:52.128424 (+ 24us) write_op.cc:276] Timestamp: P: 1781850587690605 usec, L: 0
0619 06:29:52.128587 (+ 163us) write_op.cc:270] Start()
0619 06:29:52.128605 (+ 18us) write_op.cc:276] Timestamp: P: 1781850587718929 usec, L: 0
0619 06:29:52.144726 (+ 16121us) write_op.cc:270] Start()
0619 06:29:52.144744 (+ 18us) write_op.cc:276] Timestamp: P: 1781850587735639 usec, L: 0
0619 06:29:52.144893 (+ 149us) write_op.cc:270] Start()
0619 06:29:52.144913 (+ 20us) write_op.cc:276] Timestamp: P: 1781850587736981 usec, L: 0
0619 06:29:52.157367 (+ 12454us) write_op.cc:270] Start()
0619 06:29:52.162723 (+ 5356us) write_op.cc:276] Timestamp: P: 1781850587786035 usec, L: 0
0619 06:29:52.162846 (+ 123us) write_op.cc:270] Start()
0619 06:29:52.162867 (+ 21us) write_op.cc:276] Timestamp: P: 1781850587787247 usec, L: 0
0619 06:29:52.164069 (+ 1202us) write_op.cc:270] Start()
0619 06:29:52.164084 (+ 15us) write_op.cc:276] Timestamp: P: 1781850587790907 usec, L: 0
0619 06:29:52.172576 (+ 8492us) write_op.cc:270] Start()
0619 06:29:52.172594 (+ 18us) write_op.cc:276] Timestamp: P: 1781850587821141 usec, L: 0
0619 06:29:52.175198 (+ 2604us) write_op.cc:270] Start()
0619 06:29:52.175218 (+ 20us) write_op.cc:276] Timestamp: P: 1781850587851842 usec, L: 0
0619 06:29:52.175361 (+ 143us) write_op.cc:270] Start()
0619 06:29:52.175380 (+ 19us) write_op.cc:276] Timestamp: P: 1781850587870714 usec, L: 0
0619 06:29:52.175828 (+ 448us) write_op.cc:270] Start()
0619 06:29:52.175865 (+ 37us) write_op.cc:276] Timestamp: P: 1781850587886557 usec, L: 0
0619 06:29:52.176014 (+ 149us) write_op.cc:270] Start()
0619 06:29:52.176043 (+ 29us) write_op.cc:276] Timestamp: P: 1781850587890708 usec, L: 0
0619 06:29:52.176207 (+ 164us) write_op.cc:270] Start()
0619 06:29:52.176226 (+ 19us) write_op.cc:276] Timestamp: P: 1781850587924803 usec, L: 0
0619 06:29:52.176353 (+ 127us) write_op.cc:270] Start()
0619 06:29:52.176371 (+ 18us) write_op.cc:276] Timestamp: P: 1781850587945919 usec, L: 0
0619 06:29:52.178575 (+ 2204us) write_op.cc:270] Start()
0619 06:29:52.178602 (+ 27us) write_op.cc:276] Timestamp: P: 1781850587962740 usec, L: 0
0619 06:29:52.178927 (+ 325us) write_op.cc:270] Start()
0619 06:29:52.178950 (+ 23us) write_op.cc:276] Timestamp: P: 1781850587986528 usec, L: 0
0619 06:29:52.179114 (+ 164us) write_op.cc:270] Start()
0619 06:29:52.179134 (+ 20us) write_op.cc:276] Timestamp: P: 1781850587991071 usec, L: 0
0619 06:29:52.179253 (+ 119us) write_op.cc:270] Start()
0619 06:29:52.179271 (+ 18us) write_op.cc:276] Timestamp: P: 1781850588006113 usec, L: 0
0619 06:29:52.179389 (+ 118us) write_op.cc:270] Start()
0619 06:29:52.179406 (+ 17us) write_op.cc:276] Timestamp: P: 1781850588011778 usec, L: 0
0619 06:29:52.179533 (+ 127us) write_op.cc:270] Start()
0619 06:29:52.179551 (+ 18us) write_op.cc:276] Timestamp: P: 1781850588049544 usec, L: 0
0619 06:29:52.179685 (+ 134us) write_op.cc:270] Start()
0619 06:29:52.179704 (+ 19us) write_op.cc:276] Timestamp: P: 1781850588050620 usec, L: 0
0619 06:29:52.180932 (+ 1228us) write_op.cc:270] Start()
0619 06:29:52.180959 (+ 27us) write_op.cc:276] Timestamp: P: 1781850588072634 usec, L: 0
0619 06:29:52.181136 (+ 177us) write_op.cc:270] Start()
0619 06:29:52.181156 (+ 20us) write_op.cc:276] Timestamp: P: 1781850588075140 usec, L: 0
0619 06:29:52.181286 (+ 130us) write_op.cc:270] Start()
0619 06:29:52.181304 (+ 18us) write_op.cc:276] Timestamp: P: 1781850588131037 usec, L: 0
0619 06:29:52.181427 (+ 123us) write_op.cc:270] Start()
0619 06:29:52.181446 (+ 19us) write_op.cc:276] Timestamp: P: 1781850588145068 usec, L: 0
0619 06:29:52.181746 (+ 300us) write_op.cc:270] Start()
0619 06:29:52.181767 (+ 21us) write_op.cc:276] Timestamp: P: 1781850588166538 usec, L: 0
0619 06:29:52.181911 (+ 144us) write_op.cc:270] Start()
0619 06:29:52.181930 (+ 19us) write_op.cc:276] Timestamp: P: 1781850588167194 usec, L: 0
0619 06:29:52.182065 (+ 135us) write_op.cc:270] Start()
0619 06:29:52.182084 (+ 19us) write_op.cc:276] Timestamp: P: 1781850588192000 usec, L: 0
0619 06:29:52.215054 (+ 32970us) write_op.cc:270] Start()
0619 06:29:52.215079 (+ 25us) write_op.cc:276] Timestamp: P: 1781850588201207 usec, L: 0
0619 06:29:52.221873 (+ 6794us) write_op.cc:270] Start()
0619 06:29:52.221896 (+ 23us) write_op.cc:276] Timestamp: P: 1781850588229281 usec, L: 0
0619 06:29:52.223294 (+ 1398us) write_op.cc:270] Start()
0619 06:29:52.223313 (+ 19us) write_op.cc:276] Timestamp: P: 1781850588230639 usec, L: 0
0619 06:29:52.241010 (+ 17697us) write_op.cc:270] Start()
0619 06:29:52.241036 (+ 26us) write_op.cc:276] Timestamp: P: 1781850588275924 usec, L: 0
0619 06:29:52.250487 (+ 9451us) write_op.cc:270] Start()
0619 06:29:52.250533 (+ 46us) write_op.cc:276] Timestamp: P: 1781850588276634 usec, L: 0
0619 06:29:52.288287 (+ 37754us) write_op.cc:270] Start()
0619 06:29:52.288316 (+ 29us) write_op.cc:276] Timestamp: P: 1781850588289689 usec, L: 0
0619 06:29:52.291258 (+ 2942us) write_op.cc:270] Start()
0619 06:29:52.291283 (+ 25us) write_op.cc:276] Timestamp: P: 1781850588324152 usec, L: 0
0619 06:29:52.303821 (+ 12538us) write_op.cc:270] Start()
0619 06:29:52.303853 (+ 32us) write_op.cc:276] Timestamp: P: 1781850588355371 usec, L: 0
0619 06:29:52.313816 (+ 9963us) write_op.cc:270] Start()
0619 06:29:52.313839 (+ 23us) write_op.cc:276] Timestamp: P: 1781850588356240 usec, L: 0
0619 06:29:52.313995 (+ 156us) write_op.cc:270] Start()
0619 06:29:52.314017 (+ 22us) write_op.cc:276] Timestamp: P: 1781850588365086 usec, L: 0
0619 06:29:52.314140 (+ 123us) write_op.cc:270] Start()
0619 06:29:52.314159 (+ 19us) write_op.cc:276] Timestamp: P: 1781850588401391 usec, L: 0
0619 06:29:52.314288 (+ 129us) write_op.cc:270] Start()
0619 06:29:52.314307 (+ 19us) write_op.cc:276] Timestamp: P: 1781850588438349 usec, L: 0
0619 06:29:52.314465 (+ 158us) write_op.cc:270] Start()
0619 06:29:52.314488 (+ 23us) write_op.cc:276] Timestamp: P: 1781850588456286 usec, L: 0
0619 06:29:52.314664 (+ 176us) write_op.cc:270] Start()
0619 06:29:52.314688 (+ 24us) write_op.cc:276] Timestamp: P: 1781850588457418 usec, L: 0
0619 06:29:52.314825 (+ 137us) write_op.cc:270] Start()
0619 06:29:52.314845 (+ 20us) write_op.cc:276] Timestamp: P: 1781850588464361 usec, L: 0
0619 06:29:52.314980 (+ 135us) write_op.cc:270] Start()
0619 06:29:52.315001 (+ 21us) write_op.cc:276] Timestamp: P: 1781850588493322 usec, L: 0
0619 06:29:52.315132 (+ 131us) write_op.cc:270] Start()
0619 06:29:52.315151 (+ 19us) write_op.cc:276] Timestamp: P: 1781850588494058 usec, L: 0
0619 06:29:52.317850 (+ 2699us) write_op.cc:270] Start()
0619 06:29:52.317876 (+ 26us) write_op.cc:276] Timestamp: P: 1781850588552770 usec, L: 0
0619 06:29:52.318029 (+ 153us) write_op.cc:270] Start()
0619 06:29:52.318050 (+ 21us) write_op.cc:276] Timestamp: P: 1781850588553456 usec, L: 0
0619 06:29:52.318196 (+ 146us) write_op.cc:270] Start()
0619 06:29:52.318218 (+ 22us) write_op.cc:276] Timestamp: P: 1781850588563904 usec, L: 0
0619 06:29:52.318350 (+ 132us) write_op.cc:270] Start()
0619 06:29:52.318370 (+ 20us) write_op.cc:276] Timestamp: P: 1781850588583838 usec, L: 0
0619 06:29:52.318580 (+ 210us) write_op.cc:270] Start()
0619 06:29:52.318604 (+ 24us) write_op.cc:276] Timestamp: P: 1781850588610257 usec, L: 0
0619 06:29:52.318760 (+ 156us) write_op.cc:270] Start()
0619 06:29:52.318782 (+ 22us) write_op.cc:276] Timestamp: P: 1781850588613781 usec, L: 0
0619 06:29:52.319063 (+ 281us) write_op.cc:270] Start()
0619 06:29:52.319088 (+ 25us) write_op.cc:276] Timestamp: P: 1781850588617190 usec, L: 0
0619 06:29:52.319239 (+ 151us) write_op.cc:270] Start()
0619 06:29:52.319260 (+ 21us) write_op.cc:276] Timestamp: P: 1781850588627245 usec, L: 0
0619 06:29:52.322219 (+ 2959us) write_op.cc:270] Start()
0619 06:29:52.322244 (+ 25us) write_op.cc:276] Timestamp: P: 1781850588658487 usec, L: 0
0619 06:29:52.335582 (+ 13338us) write_op.cc:270] Start()
0619 06:29:52.335606 (+ 24us) write_op.cc:276] Timestamp: P: 1781850588677291 usec, L: 0
0619 06:29:52.340508 (+ 4902us) write_op.cc:270] Start()
0619 06:29:52.340527 (+ 19us) write_op.cc:276] Timestamp: P: 1781850588681885 usec, L: 0
0619 06:29:52.340687 (+ 160us) write_op.cc:270] Start()
0619 06:29:52.340710 (+ 23us) write_op.cc:276] Timestamp: P: 1781850588721464 usec, L: 0
0619 06:29:52.342193 (+ 1483us) write_op.cc:270] Start()
0619 06:29:52.342215 (+ 22us) write_op.cc:276] Timestamp: P: 1781850588735676 usec, L: 0
0619 06:29:52.351235 (+ 9020us) write_op.cc:270] Start()
0619 06:29:52.363302 (+ 12067us) write_op.cc:276] Timestamp: P: 1781850588764568 usec, L: 0
0619 06:29:52.373075 (+ 9773us) write_op.cc:270] Start()
0619 06:29:52.373100 (+ 25us) write_op.cc:276] Timestamp: P: 1781850588789991 usec, L: 0
0619 06:29:52.375078 (+ 1978us) write_op.cc:270] Start()
0619 06:29:52.375103 (+ 25us) write_op.cc:276] Timestamp: P: 1781850588790585 usec, L: 0
0619 06:29:52.384999 (+ 9896us) write_op.cc:270] Start()
0619 06:29:52.385026 (+ 27us) write_op.cc:276] Timestamp: P: 1781850588812219 usec, L: 0
0619 06:29:52.385369 (+ 343us) write_op.cc:270] Start()
0619 06:29:52.385396 (+ 27us) write_op.cc:276] Timestamp: P: 1781850588817532 usec, L: 0
0619 06:29:52.385588 (+ 192us) write_op.cc:270] Start()
0619 06:29:52.385611 (+ 23us) write_op.cc:276] Timestamp: P: 1781850588840134 usec, L: 0
0619 06:29:52.385757 (+ 146us) write_op.cc:270] Start()
0619 06:29:52.385795 (+ 38us) write_op.cc:276] Timestamp: P: 1781850588854917 usec, L: 0
0619 06:29:52.385957 (+ 162us) write_op.cc:270] Start()
0619 06:29:52.385981 (+ 24us) write_op.cc:276] Timestamp: P: 1781850588865017 usec, L: 0
0619 06:29:52.386152 (+ 171us) write_op.cc:270] Start()
0619 06:29:52.386176 (+ 24us) write_op.cc:276] Timestamp: P: 1781850588895084 usec, L: 0
0619 06:29:52.386310 (+ 134us) write_op.cc:270] Start()
0619 06:29:52.386327 (+ 17us) write_op.cc:276] Timestamp: P: 1781850588896760 usec, L: 0
0619 06:29:52.406360 (+ 20033us) write_op.cc:270] Start()
0619 06:29:52.406414 (+ 54us) write_op.cc:276] Timestamp: P: 1781850588935796 usec, L: 0
0619 06:29:52.406617 (+ 203us) write_op.cc:270] Start()
0619 06:29:52.406641 (+ 24us) write_op.cc:276] Timestamp: P: 1781850588948947 usec, L: 0
0619 06:29:52.406809 (+ 168us) write_op.cc:270] Start()
0619 06:29:52.406834 (+ 25us) write_op.cc:276] Timestamp: P: 17818505
I20260619 06:29:54.634626 8038 heartbeater.cc:511] Master 127.7.96.62:40917 requested a full tablet report, sending...
I20260619 06:29:54.695539 8676 raft_consensus.cc:482] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 996381a7495d4720a6f6be44a1d4781b)
I20260619 06:29:54.695778 8676 raft_consensus.cc:504] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } } peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } }
I20260619 06:29:54.720355 8676 leader_election.cc:288] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499), 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063)
I20260619 06:29:54.739189 7991 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08686b31ffd64266bcdbd6f5eb29a87d" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 1397 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1" is_pre_election: true
I20260619 06:29:54.739492 7861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08686b31ffd64266bcdbd6f5eb29a87d" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 1397 } } ignore_live_leader: false dest_uuid: "996381a7495d4720a6f6be44a1d4781b" is_pre_election: true
I20260619 06:29:54.781601 8458 leader_election.cc:302] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b46f2dae92104884b86705d6bbc20003; no voters: 3fc4e58423894a27a7b94de5c6013cf1, 996381a7495d4720a6f6be44a1d4781b
I20260619 06:29:54.781908 8676 raft_consensus.cc:2726] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 06:29:54.808199 8664 raft_consensus.cc:482] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3fc4e58423894a27a7b94de5c6013cf1)
I20260619 06:29:54.808386 8664 raft_consensus.cc:504] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:54.809176 8664 leader_election.cc:288] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063), 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499)
I20260619 06:29:54.825673 7862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3e5e97eabdf42cf8e46ccb4b61c5fb7" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 1400 } } ignore_live_leader: false dest_uuid: "996381a7495d4720a6f6be44a1d4781b" is_pre_election: true
I20260619 06:29:54.837596 7992 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3e5e97eabdf42cf8e46ccb4b61c5fb7" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 1400 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1" is_pre_election: true
I20260619 06:29:54.852766 8458 leader_election.cc:302] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b46f2dae92104884b86705d6bbc20003; no voters: 3fc4e58423894a27a7b94de5c6013cf1, 996381a7495d4720a6f6be44a1d4781b
I20260619 06:29:54.853083 8664 raft_consensus.cc:2726] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 06:29:54.964783 8677 raft_consensus.cc:482] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3fc4e58423894a27a7b94de5c6013cf1)
I20260619 06:29:54.969112 8677 raft_consensus.cc:504] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:54.976755 8677 leader_election.cc:288] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063), 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499)
I20260619 06:29:54.979614 7861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98eb40b379a24876b6334fff708de671" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 1414 } } ignore_live_leader: false dest_uuid: "996381a7495d4720a6f6be44a1d4781b" is_pre_election: true
I20260619 06:29:54.990361 7992 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98eb40b379a24876b6334fff708de671" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 1414 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1" is_pre_election: true
I20260619 06:29:54.999289 8458 leader_election.cc:302] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b46f2dae92104884b86705d6bbc20003; no voters: 3fc4e58423894a27a7b94de5c6013cf1, 996381a7495d4720a6f6be44a1d4781b
I20260619 06:29:55.082810 8677 raft_consensus.cc:2726] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 06:29:55.494966 8664 raft_consensus.cc:482] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3fc4e58423894a27a7b94de5c6013cf1)
I20260619 06:29:55.495172 8664 raft_consensus.cc:504] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:55.495925 8664 leader_election.cc:288] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063), 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499)
I20260619 06:29:55.497236 8556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.7.96.3:46325 (request call id 8) took 1065 ms. Trace:
I20260619 06:29:55.505205 7862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cffdcc0e99c47aead56bbaea58d3e4d" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 1426 } } ignore_live_leader: false dest_uuid: "996381a7495d4720a6f6be44a1d4781b" is_pre_election: true
I20260619 06:29:55.512995 7992 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cffdcc0e99c47aead56bbaea58d3e4d" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 1426 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1" is_pre_election: true
I20260619 06:29:55.525056 8458 leader_election.cc:302] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b46f2dae92104884b86705d6bbc20003; no voters: 3fc4e58423894a27a7b94de5c6013cf1, 996381a7495d4720a6f6be44a1d4781b
I20260619 06:29:55.525620 8664 raft_consensus.cc:2726] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 06:29:55.497372 8556 rpcz_store.cc:276] 0619 06:29:54.431758 (+ 0us) service_pool.cc:170] Inserting onto call queue
0619 06:29:54.431800 (+ 42us) service_pool.cc:227] Handling call
0619 06:29:54.489866 (+ 58066us) raft_consensus.cc:1457] Updating replica for 174 ops
0619 06:29:54.560426 (+ 70560us) raft_consensus.cc:1520] Early marking committed up to index 1252
0619 06:29:54.560531 (+ 105us) raft_consensus.cc:1525] Triggering prepare for 174 ops
0619 06:29:54.560623 (+ 92us) write_op.cc:270] Start()
0619 06:29:54.560644 (+ 21us) write_op.cc:276] Timestamp: P: 1781850591160333 usec, L: 0
0619 06:29:54.560768 (+ 124us) write_op.cc:270] Start()
0619 06:29:54.560785 (+ 17us) write_op.cc:276] Timestamp: P: 1781850591176249 usec, L: 0
0619 06:29:54.560887 (+ 102us) write_op.cc:270] Start()
0619 06:29:54.560902 (+ 15us) write_op.cc:276] Timestamp: P: 1781850591232459 usec, L: 0
0619 06:29:54.561029 (+ 127us) write_op.cc:270] Start()
0619 06:29:54.561050 (+ 21us) write_op.cc:276] Timestamp: P: 1781850591255363 usec, L: 0
0619 06:29:54.561729 (+ 679us) write_op.cc:270] Start()
0619 06:29:54.561755 (+ 26us) write_op.cc:276] Timestamp: P: 1781850591256826 usec, L: 0
0619 06:29:54.562134 (+ 379us) write_op.cc:270] Start()
0619 06:29:54.562156 (+ 22us) write_op.cc:276] Timestamp: P: 1781850591291182 usec, L: 0
0619 06:29:54.562366 (+ 210us) write_op.cc:270] Start()
0619 06:29:54.562406 (+ 40us) write_op.cc:276] Timestamp: P: 1781850591332285 usec, L: 0
0619 06:29:54.565531 (+ 3125us) write_op.cc:270] Start()
0619 06:29:54.565555 (+ 24us) write_op.cc:276] Timestamp: P: 1781850591341740 usec, L: 0
0619 06:29:54.565701 (+ 146us) write_op.cc:270] Start()
0619 06:29:54.565722 (+ 21us) write_op.cc:276] Timestamp: P: 1781850591363287 usec, L: 0
0619 06:29:54.574672 (+ 8950us) write_op.cc:270] Start()
0619 06:29:54.574696 (+ 24us) write_op.cc:276] Timestamp: P: 1781850591368186 usec, L: 0
0619 06:29:54.574840 (+ 144us) write_op.cc:270] Start()
0619 06:29:54.574859 (+ 19us) write_op.cc:276] Timestamp: P: 1781850591394978 usec, L: 0
0619 06:29:54.575006 (+ 147us) write_op.cc:270] Start()
0619 06:29:54.575027 (+ 21us) write_op.cc:276] Timestamp: P: 1781850591401145 usec, L: 0
0619 06:29:54.575163 (+ 136us) write_op.cc:270] Start()
0619 06:29:54.575182 (+ 19us) write_op.cc:276] Timestamp: P: 1781850591430228 usec, L: 0
0619 06:29:54.575392 (+ 210us) write_op.cc:270] Start()
0619 06:29:54.575413 (+ 21us) write_op.cc:276] Timestamp: P: 1781850591455521 usec, L: 0
0619 06:29:54.575696 (+ 283us) write_op.cc:270] Start()
0619 06:29:54.575718 (+ 22us) write_op.cc:276] Timestamp: P: 1781850591463787 usec, L: 0
0619 06:29:54.575862 (+ 144us) write_op.cc:270] Start()
0619 06:29:54.575881 (+ 19us) write_op.cc:276] Timestamp: P: 1781850591478136 usec, L: 0
0619 06:29:54.639800 (+ 63919us) write_op.cc:270] Start()
0619 06:29:54.639821 (+ 21us) write_op.cc:276] Timestamp: P: 1781850591508976 usec, L: 0
0619 06:29:54.642812 (+ 2991us) write_op.cc:270] Start()
0619 06:29:54.642834 (+ 22us) write_op.cc:276] Timestamp: P: 1781850591527599 usec, L: 0
0619 06:29:54.642964 (+ 130us) write_op.cc:270] Start()
0619 06:29:54.642983 (+ 19us) write_op.cc:276] Timestamp: P: 1781850591533853 usec, L: 0
0619 06:29:54.653099 (+ 10116us) write_op.cc:270] Start()
0619 06:29:54.686983 (+ 33884us) spinlock_profiling.cc:243] Waited 3.07 ms on lock 0x61900028f258. stack: 00007ff742e9066e 00007ff742e90430 00007ff741f175ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007ff74f80143a 00007ff74f80840f 00007ff74f59072c 00007ff74f54976a 00007ff74f6fc827 00007ff74f6cbe19 00007ff74f67c608 00007ff74f67b875 00007ff74e38dd27 00007ff74e3ac4e7
0619 06:29:54.687009 (+ 26us) write_op.cc:276] Timestamp: P: 1781850591536051 usec, L: 0
0619 06:29:54.692466 (+ 5457us) write_op.cc:270] Start()
0619 06:29:54.692491 (+ 25us) write_op.cc:276] Timestamp: P: 1781850591553190 usec, L: 0
0619 06:29:54.700107 (+ 7616us) write_op.cc:270] Start()
0619 06:29:54.700127 (+ 20us) write_op.cc:276] Timestamp: P: 1781850591591697 usec, L: 0
0619 06:29:54.700331 (+ 204us) write_op.cc:270] Start()
0619 06:29:54.700355 (+ 24us) write_op.cc:276] Timestamp: P: 1781850591615294 usec, L: 0
0619 06:29:54.700551 (+ 196us) write_op.cc:270] Start()
0619 06:29:54.700575 (+ 24us) write_op.cc:276] Timestamp: P: 1781850591615881 usec, L: 0
0619 06:29:54.700713 (+ 138us) write_op.cc:270] Start()
0619 06:29:54.700733 (+ 20us) write_op.cc:276] Timestamp: P: 1781850591674774 usec, L: 0
0619 06:29:54.700885 (+ 152us) write_op.cc:270] Start()
0619 06:29:54.700907 (+ 22us) write_op.cc:276] Timestamp: P: 1781850591699758 usec, L: 0
0619 06:29:54.701049 (+ 142us) write_op.cc:270] Start()
0619 06:29:54.701070 (+ 21us) write_op.cc:276] Timestamp: P: 1781850591744796 usec, L: 0
0619 06:29:54.701220 (+ 150us) write_op.cc:270] Start()
0619 06:29:54.701240 (+ 20us) write_op.cc:276] Timestamp: P: 1781850591774910 usec, L: 0
0619 06:29:54.701387 (+ 147us) write_op.cc:270] Start()
0619 06:29:54.701411 (+ 24us) write_op.cc:276] Timestamp: P: 1781850591778618 usec, L: 0
0619 06:29:54.705678 (+ 4267us) write_op.cc:270] Start()
0619 06:29:54.705708 (+ 30us) write_op.cc:276] Timestamp: P: 1781850591779310 usec, L: 0
0619 06:29:54.705869 (+ 161us) write_op.cc:270] Start()
0619 06:29:54.705894 (+ 25us) write_op.cc:276] Timestamp: P: 1781850591798123 usec, L: 0
0619 06:29:54.706111 (+ 217us) write_op.cc:270] Start()
0619 06:29:54.706133 (+ 22us) write_op.cc:276] Timestamp: P: 1781850591826826 usec, L: 0
0619 06:29:54.706293 (+ 160us) write_op.cc:270] Start()
0619 06:29:54.706313 (+ 20us) write_op.cc:276] Timestamp: P: 1781850591839184 usec, L: 0
0619 06:29:54.706454 (+ 141us) write_op.cc:270] Start()
0619 06:29:54.706475 (+ 21us) write_op.cc:276] Timestamp: P: 1781850591851961 usec, L: 0
0619 06:29:54.729895 (+ 23420us) write_op.cc:270] Start()
0619 06:29:54.729917 (+ 22us) write_op.cc:276] Timestamp: P: 1781850591871065 usec, L: 0
0619 06:29:54.734007 (+ 4090us) write_op.cc:270] Start()
0619 06:29:54.734032 (+ 25us) write_op.cc:276] Timestamp: P: 1781850591885496 usec, L: 0
0619 06:29:54.735071 (+ 1039us) write_op.cc:270] Start()
0619 06:29:54.735092 (+ 21us) write_op.cc:276] Timestamp: P: 1781850591894064 usec, L: 0
0619 06:29:54.739861 (+ 4769us) write_op.cc:270] Start()
0619 06:29:54.739891 (+ 30us) write_op.cc:276] Timestamp: P: 1781850591895135 usec, L: 0
0619 06:29:54.755197 (+ 15306us) write_op.cc:270] Start()
0619 06:29:54.755227 (+ 30us) write_op.cc:276] Timestamp: P: 1781850591924516 usec, L: 0
0619 06:29:54.755408 (+ 181us) write_op.cc:270] Start()
0619 06:29:54.755431 (+ 23us) write_op.cc:276] Timestamp: P: 1781850591946957 usec, L: 0
0619 06:29:54.755571 (+ 140us) write_op.cc:270] Start()
0619 06:29:54.755595 (+ 24us) write_op.cc:276] Timestamp: P: 1781850591959030 usec, L: 0
0619 06:29:54.755735 (+ 140us) write_op.cc:270] Start()
0619 06:29:54.755755 (+ 20us) write_op.cc:276] Timestamp: P: 1781850591966196 usec, L: 0
0619 06:29:54.758781 (+ 3026us) write_op.cc:270] Start()
0619 06:29:54.758809 (+ 28us) write_op.cc:276] Timestamp: P: 1781850591994088 usec, L: 0
0619 06:29:54.758978 (+ 169us) write_op.cc:270] Start()
0619 06:29:54.759005 (+ 27us) write_op.cc:276] Timestamp: P: 1781850592016174 usec, L: 0
0619 06:29:54.759155 (+ 150us) write_op.cc:270] Start()
0619 06:29:54.759175 (+ 20us) write_op.cc:276] Timestamp: P: 1781850592028922 usec, L: 0
0619 06:29:54.759337 (+ 162us) write_op.cc:270] Start()
0619 06:29:54.759361 (+ 24us) write_op.cc:276] Timestamp: P: 1781850592029797 usec, L: 0
0619 06:29:54.767182 (+ 7821us) write_op.cc:270] Start()
0619 06:29:54.767201 (+ 19us) write_op.cc:276] Timestamp: P: 1781850592064945 usec, L: 0
0619 06:29:54.768610 (+ 1409us) write_op.cc:270] Start()
0619 06:29:54.768636 (+ 26us) write_op.cc:276] Timestamp: P: 1781850592065659 usec, L: 0
0619 06:29:54.771187 (+ 2551us) write_op.cc:270] Start()
0619 06:29:54.771212 (+ 25us) write_op.cc:276] Timestamp: P: 1781850592072855 usec, L: 0
0619 06:29:54.775041 (+ 3829us) write_op.cc:270] Start()
0619 06:29:54.775069 (+ 28us) write_op.cc:276] Timestamp: P: 1781850592124207 usec, L: 0
0619 06:29:54.778716 (+ 3647us) write_op.cc:270] Start()
0619 06:29:54.778740 (+ 24us) write_op.cc:276] Timestamp: P: 1781850592148566 usec, L: 0
0619 06:29:54.778895 (+ 155us) write_op.cc:270] Start()
0619 06:29:54.784731 (+ 5836us) write_op.cc:276] Timestamp: P: 1781850592186839 usec, L: 0
0619 06:29:54.789280 (+ 4549us) write_op.cc:270] Start()
0619 06:29:54.789307 (+ 27us) write_op.cc:276] Timestamp: P: 1781850592206944 usec, L: 0
0619 06:29:54.790837 (+ 1530us) write_op.cc:270] Start()
0619 06:29:54.790866 (+ 29us) write_op.cc:276] Timestamp: P: 1781850592225293 usec, L: 0
0619 06:29:54.791042 (+ 176us) write_op.cc:270] Start()
0619 06:29:54.791069 (+ 27us) write_op.cc:276] Timestamp: P: 1781850592225899 usec, L: 0
0619 06:29:54.793330 (+ 2261us) write_op.cc:270] Start()
0619 06:29:54.793357 (+ 27us) write_op.cc:276] Timestamp: P: 1781850592246107 usec, L: 0
0619 06:29:54.793538 (+ 181us) write_op.cc:270] Start()
0619 06:29:54.793599 (+ 61us) write_op.cc:276] Timestamp: P: 1781850592271448 usec, L: 0
0619 06:29:54.796533 (+ 2934us) write_op.cc:270] Start()
0619 06:29:54.796588 (+ 55us) write_op.cc:276] Timestamp: P: 1781850592272822 usec, L: 0
0619 06:29:54.796746 (+ 158us) write_op.cc:270] Start()
0619 06:29:54.796774 (+ 28us) write_op.cc:276] Timestamp: P: 1781850592284002 usec, L: 0
0619 06:29:54.799452 (+ 2678us) write_op.cc:270] Start()
0619 06:29:54.799476 (+ 24us) write_op.cc:276] Timestamp: P: 1781850592306127 usec, L: 0
0619 06:29:54.815170 (+ 15694us) write_op.cc:270] Start()
0619 06:29:54.815198 (+ 28us) write_op.cc:276] Timestamp: P: 1781850592330239 usec, L: 0
0619 06:29:54.827981 (+ 12783us) write_op.cc:270] Start()
0619 06:29:54.828004 (+ 23us) write_op.cc:276] Timestamp: P: 1781850592357639 usec, L: 0
0619 06:29:54.830923 (+ 2919us) write_op.cc:270] Start()
0619 06:29:54.830948 (+ 25us) write_op.cc:276] Timestamp: P: 1781850592358197 usec, L: 0
0619 06:29:54.831098 (+ 150us) write_op.cc:270] Start()
0619 06:29:54.831118 (+ 20us) write_op.cc:276] Timestamp: P: 1781850592360555 usec, L: 0
0619 06:29:54.831290 (+ 172us) write_op.cc:270] Start()
0619 06:29:54.831308 (+ 18us) write_op.cc:276] Timestamp: P: 1781850592390677 usec, L: 0
0619 06:29:54.831426 (+ 118us) write_op.cc:270] Start()
0619 06:29:54.831461 (+ 35us) write_op.cc:276] Timestamp: P: 1781850592429337 usec, L: 0
0619 06:29:54.831575 (+ 114us) write_op.cc:270] Start()
0619 06:29:54.831591 (+ 16us) write_op.cc:276] Timestamp: P: 1781850592431238 usec, L: 0
0619 06:29:54.831747 (+ 156us) write_op.cc:270] Start()
0619 06:29:54.831769 (+ 22us) write_op.cc:276] Timestamp: P: 1781850592445586 usec, L: 0
0619 06:29:54.831947 (+ 178us) write_op.cc:270] Start()
0619 06:29:54.831971 (+ 24us) write_op.cc:276] Timestamp: P: 1781850592462374 usec, L: 0
0619 06:29:54.832137 (+ 166us) write_op.cc:270] Start()
0619 06:29:54.832158 (+ 21us) write_op.cc:276] Timestamp: P: 1781850592486860 usec, L: 0
0619 06:29:54.832303 (+ 145us) write_op.cc:270] Start()
0619 06:29:54.832324 (+ 21us) write_op.cc:276] Timestamp: P: 1781850592507217 usec, L: 0
0619 06:29:54.832460 (+ 136us) write_op.cc:270] Start()
0619 06:29:54.832479 (+ 19us) write_op.cc:276] Timestamp: P: 1781850592507681 usec, L: 0
0619 06:29:54.832605 (+ 126us) write_op.cc:270] Start()
0619 06:29:54.832630 (+ 25us) write_op.cc:276] Timestamp: P: 1781850592526961 usec, L: 0
0619 06:29:54.832765 (+ 135us) write_op.cc:270] Start()
0619 06:29:54.832784 (+ 19us) write_op.cc:276] Timestamp: P: 1781850592553816 usec, L: 0
0619 06:29:54.832924 (+ 140us) write_op.cc:270] Start()
0619 06:29:54.832941 (+ 17us) write_op.cc:276] Timestamp: P: 1781850592555027 usec, L: 0
0619 06:29:54.833079 (+ 138us) write_op.cc:270] Start()
0619 06:29:54.833097 (+ 18us) write_op.cc:276] Timestamp: P: 1781850592584643 usec, L: 0
0619 06:29:54.833266 (+ 169us) write_op.cc:270] Start()
0619 06:29:54.833289 (+ 23us) write_op.cc:276] Timestamp: P: 1781850592648261 usec, L: 0
0619 06:29:54.833411 (+ 122us) write_op.cc:270] Start()
0619 06:29:54.833452 (+ 41us) write_op.cc:276] Timestamp: P: 1781850592653625 usec, L: 0
0619 06:29:54.833565 (+ 113us) write_op.cc:270] Start()
0619 06:29:54.833584 (+ 19us) write_op.cc:276] Timestamp: P: 1781850592655219 usec, L: 0
0619 06:29:54.838972 (+ 5388us) write_op.cc:270] Start()
0619 06:29:54.839017 (+ 45us) write_op.cc:276] Timestamp: P: 1781850592661961 usec, L: 0
0619 06:29:54.839185 (+ 168us) write_op.cc:270] Start()
0619 06:29:54.839208 (+ 23us) write_op.cc:276] Timestamp: P: 1781850592693369 usec, L: 0
0619 06:29:54.839357 (+ 149us) write_op.cc:270] Start()
0619 06:29:54.839379 (+ 22us) write_op.cc:276] Timestamp: P: 1781850592701301 usec, L: 0
0619 06:29:54.839516 (+ 137us) write_op.cc:270] Start()
0619 06:29:54.839541 (+ 25us) write_op.cc:276] Timestamp: P: 1781850592707425 usec, L: 0
0619 06:29:54.839679 (+ 138us) write_op.cc:270] Start()
0619 06:29:54.839699 (+ 20us) write_op.cc:276] Timestamp: P: 1781850592727612 usec, L: 0
0619 06:29:54.839866 (+ 167us) write_op.cc:270] Start()
0619 06:29:54.839882 (+ 16us) write_op.cc:276] Timestamp: P: 1781850592759218 usec, L: 0
0619 06:29:54.851942 (+ 12060us) write_op.cc:270] Start()
0619 06:29:54.851975 (+ 33us) write_op.cc:276] Timestamp: P: 1781850592775602 usec, L: 0
0619 06:29:54.852191 (+ 216us) write_op.cc:270] Start()
0619 06:29:54.852217 (+ 26us) write_op.cc:276] Timestamp: P: 1781850592779754 usec, L: 0
0619 06:29:54.852376 (+ 159us) write_op.cc:270] Start()
0619 06:29:54.852399 (+ 23us) write_op.cc:276] Timestamp: P: 1781850592818520 usec, L: 0
0619 06:29:54.852543 (+ 144us) write_op.cc:270] Start()
0619 06:29:54.852566 (+ 23us) write_op.cc:276] Timestamp: P: 1781850592830848 usec, L: 0
0619 06:29:54.852711 (+ 145us) write_op.cc:270] Start()
0619 06:29:54.852737 (+ 26us) write_op.cc:276] Timestamp: P: 1781850592841801 usec, L: 0
0619 06:29:54.853078 (+ 341us) write_op.cc:270] Start()
0619 06:29:54.853110 (+ 32us) write_op.cc:276] Timestamp: P: 1781850592844880 usec, L: 0
0619 06:29:54.853340 (+ 230us) write_op.cc:270] Start()
0619 06:29:54.853363 (+ 23us) write_op.cc:276] Timestamp: P: 1781850592871641 usec, L: 0
0619 06:29:54.853540 (+ 177us) write_op.cc:270] Start()
0619 06:29:54.853564 (+ 24us) write_op.cc:276] Timestamp: P: 1781850592895613 usec, L: 0
0619 06:29:54.853733 (+ 169us) write_op.cc:270] Start()
0619 06:29:54.853754 (+ 21us) write_op.cc:276] Timestamp: P: 1781850592896272 usec, L: 0
0619 06:29:54.853847 (+ 93us) write_op.cc:270] Start()
0619 06:29:54.853859 (+ 12us) write_op.cc:276] Timestamp: P: 1781850592902008 usec, L: 0
0619 06:29:54.853953 (+ 94us) write_op.cc:270] Start()
0619 06:29:54.853988 (+ 35us) write_op.cc:276] Timestamp: P: 1781850592915765 usec, L: 0
0619 06:29:54.854093 (+ 105us) write_op.cc:270] Start()
0619 06:29:54.854105 (+ 12us) write_op.cc:276] Timestamp: P: 1781850592952324 usec, L: 0
0619 06:29:54.856899 (+ 2794us) write_op.cc:270] Start()
0619 06:29:54.856922 (+ 23us) write_op.cc:276] Timestamp: P: 1781850592960307 usec, L: 0
0619 06:29:54.866977 (+ 10055us) write_op.cc:270] Start()
0619 06:29:54.867001 (+ 24us) write_op.cc:276] Timestamp: P: 1781850592960911 usec, L: 0
0619 06:29:54.870787 (+ 3786us) write_op.cc:270] Start()
0619 06:29:54.870811 (+ 24us) write_op.cc:276] Timestamp: P: 1781850592964108 usec, L: 0
0619 06:29:54.878201 (+ 7390us) write_op.cc:270] Start()
0619 06:29:54.878230 (+ 29us) write_op.cc:276] Timestamp: P: 1781850593010040 usec, L: 0
0619 06:29:54.878708 (+ 478us) write_op.cc:270] Start()
0619 06:29:54.878738 (+ 30us) write_op.cc:276] Timestamp: P: 1781850593011029 usec, L: 0
0619 06:29:54.902612 (+ 23874us) write_op.cc:270] Start()
0619 06:29:54.902635 (+ 23us) write_op.cc:276] Timestamp: P: 1781850593054063 usec, L: 0
0619 06:29:54.905731 (+ 3096us) write_op.cc:270] Start()
0619 06:29:54.905756 (+ 25us) write_op.cc:276] Timestamp: P: 1781850593054816 usec, L: 0
0619 06:29:54.905890 (+ 134us) write_op.cc:270] Start()
0619 06:29:54.905909 (+ 19us) write_op.cc:276] Timestamp: P: 1781850593069909 usec, L: 0
0619 06:29:54.906046 (+ 137us) write_op.cc:270] Start()
0619 06:29:54.906066 (+ 20us) write_op.cc:276] Timestamp: P: 1781850593071748 usec, L: 0
0619 06:29:54.908107 (+ 2041us) write_op.cc:270] Start()
0619 06:29:54.908132 (+ 25us) write_op.cc:276] Timestamp: P: 1781850593113448 usec, L: 0
0619 06:29:54.912588 (+ 4456us) write_op.cc:270] Start()
0619 06:29:54.912616 (+ 28us) write_op.cc:276] Timestamp: P: 1781850593125296 usec, L: 0
0619 06:29:54.939333 (+ 26717us) write_op.cc:270] Start()
0619 06:29:54.939359 (+ 26us) write_op.cc:276] Timestamp: P: 1781850593129819 usec, L: 0
0619 06:29:54.948285 (+ 8926us) write_op.cc:270] Start()
0619 06:29:54.948307 (+ 22us) write_op.cc:276] Timestamp: P: 1781850593130434 usec, L: 0
0619 06:29:54.948420 (+ 113us) write_op.cc:270] Start()
0619 06:29:54.948435 (+ 15us) write_op.cc:276] Timestamp: P: 1781850593189484 usec, L: 0
0619 06:29:54.957693 (+ 9258us) write_op.cc:270] Start()
0619 06:29:54.957718 (+ 25us) write_op.cc:276] Timestamp: P: 1781850593203301 usec, L: 0
0619 06:29:54.957900 (+ 182us) write_op.cc:270] Start()
0619 06:29:54.957923 (+ 23us) write_op.cc:276] Timestamp: P: 1781850593237144 usec, L: 0
0619 06:29:54.958821 (+ 898us) write_op.cc:270] Start()
0619 06:29:54.958844 (+ 23us) write_op.cc:276] Timestamp: P: 1781850593254788 usec, L: 0
0619 06:29:54.959000 (+ 156us) write_op.cc:270] Start()
0619 06:29:54.959023 (+ 23us) write_op.cc:276] Timestamp: P: 1781850593287316 usec, L: 0
0619 06:29:54.959142 (+ 119us) write_op.cc:270] Start()
0619 06:29:54.959162 (+ 20us) write_op.cc:276] Timestamp: P: 1781850593314733 usec, L: 0
0619 06:29:54.959340 (+ 178us) write_op.cc:270] Start()
0619 06:29:54.959364 (+ 24us) write_op.cc:276] Timestamp: P: 1781850593317898 usec, L: 0
0619 06:29:54.959517 (+ 153us) write_op.cc:270] Start()
0619 06:29:54.959538 (+ 21us) write_op.cc:276] Timestamp: P: 1781850593334124 usec, L: 0
0619 06:29:54.959661 (+ 123us) write_op.cc:270] Start()
0619 06:29:54.959679 (+ 18us) write_op.cc:276] Timestamp: P: 1781850593361629 usec, L: 0
0619 06:29:54.959797 (+ 118us) write_op.cc:270] Start()
0619 06:29:54.959815 (+ 18us) write_op.cc:276] Timestamp: P: 1781850593372519 usec, L: 0
0619 06:29:54.959944 (+ 129us) write_op.cc:270] Start()
0619 06:29:54.959961 (+ 17us) write_op.cc:276] Timestamp: P: 1781850593387323 usec, L: 0
0619 06:29:54.960101 (+ 140us) write_op.cc:270] Start()
0619 06:29:54.960120 (+ 19us) write_op.cc:276] Timestamp: P: 1781850593487175 usec, L: 0
0619 06:29:54.960453 (+ 333us) write_op.cc:270] Start()
0619 06:29:54.960481 (+ 28us) write_op.cc:276] Timestamp: P: 1781850593497832 usec, L: 0
0619 06:29:54.960638 (+ 157us) write_op.cc:270] Start()
0619 06:29:54.960659 (+ 21us) write_op.cc:276] Timestamp: P: 1781850593509208 usec, L: 0
0619 06:29:54.960829 (+ 170us) write_op.cc:270] Start()
0619 06:29:54.960848 (+ 19us) write_op.cc:276] Timestamp: P: 1781850593509759 usec, L: 0
0619 06:29:54.960972 (+ 124us) write_op.cc:270] Start()
0619 06:29:54.960988 (+ 16us) write_op.cc:276] Timestamp: P: 1781850593531958 usec, L: 0
0619 06:29:54.961094 (+ 106us) write_op.cc:270] Start()
0619 06:29:54.961110 (+ 16us) write_op.cc:276] Timestamp: P: 1781850593552374 usec, L: 0
0619 06:29:54.961209 (+ 99us) write_op.cc:270] Start()
0619 06:29:54.961240 (+ 31us) write_op.cc:276] Timestamp: P: 1781850593583150 usec, L: 0
0619 06:29:54.961377 (+ 137us) write_op.cc:270] Start()
0619 06:29:54.961396 (+ 19us) write_op.cc:276] Timestamp: P: 1781850593600931 usec, L: 0
0619 06:29:54.969911 (+ 8515us) write_op.cc:270] Start()
0619 06:29:54.969940 (+ 29us) write_op.cc:276] Timestamp: P: 1781850593603193 usec, L: 0
0619 06:29:54.989987 (+ 20047us) write_op.cc:270] Start()
0619 06:29:54.990012 (+ 25us) write_op.cc:276] Timestamp: P: 1781850593604707 usec, L: 0
0619 06:29:55.003677 (+ 13665us) write_op.cc:270] Start()
0619 06:29:55.003704 (+ 27us) write_op.cc:276] Timestamp: P: 1781850593633327 usec, L: 0
0619 06:29:55.027114 (+ 23410us) write_op.cc:270] Start()
0619 06:29:55.027140 (+ 26us) write_op.cc:276] Timestamp: P: 1781850593691598 usec, L: 0
0619 06:29:55.042602 (+ 15462us) write_op.cc:270] Start()
0619 06:29:55.042636 (+ 34us) write_op.cc:276] Timestamp: P: 1781850593702992 usec, L: 0
0619 06:29:55.049921 (+ 7285us) write_op.cc:270] Start()
0619 06:29:55.049954 (+ 33us) write_op.cc:276] Timestamp: P: 1781850593704769 usec, L: 0
0619 06:29:55.055810 (+ 5856us) write_op.cc:270] Start()
0619 06:29:55.055843 (+ 33us) write_op.cc:276] Timestamp: P: 1781850593705482 usec, L: 0
0619 06:29:55.086104 (+ 30261us) write_op.cc:270] Start()
0619 06:29:55.086130 (+ 26us) write_op.cc:276] Timestamp: P: 1781850593736471 usec, L: 0
0619 06:29:55.086300 (+ 170us) write_op.cc:270] Start()
0619 06:29:55.086323 (+ 23us) write_op.cc:276] Timestamp: P: 1781850593746213 usec, L: 0
0619 06:29:55.092685 (+ 6362us) write_op.cc:270] Start()
0619 06:29:55.092708 (+ 23us) write_op.cc:276] Timestamp: P: 1781850593754642 usec, L: 0
0619 06:29:55.094591 (+ 1883us) write_op.cc:270] Start()
0619 06:29:55.094611 (+ 20us) write_op.cc:276] Timestamp: P: 1781850593762222 usec, L: 0
0619 06:29:55.094767 (+ 156us) write_op.cc:270] Start()
0619 06:29:55.094783 (+ 16us) write_op.cc:276] Timestamp: P: 1781850593789912 usec, L: 0
0619 06:29:55.094898 (+ 115us) write_op.cc:270] Start()
0619 06:29:55.094918 (+ 20us) write_op.cc:276] Timestamp: P: 1781850593821125 usec, L: 0
0619 06:29:55.095043 (+ 125us) write_op.cc:270] Start()
0619 06:29:55.095062 (+ 19us) write_op.cc:276] Timestamp: P: 1781850593822371 usec, L: 0
0619 06:29:55.099627 (+ 4565us) write_op.cc:270] Start()
0619 06:29:55.099643 (+ 16us) write_op.cc:276] Timestamp: P: 1781850593829434 usec, L: 0
0619 06:29:55.107356 (+ 7713us) write_op.cc:270] Start()
0619 06:29:55.107385 (+ 29us) write_op.cc:276] Timestamp: P: 1781850593862924 usec, L: 0
0619 06:29:55.107540 (+ 155us) write_op.cc:270] Start()
0619 06:29:55.107564 (+ 24us) write_op.cc:276] Timestamp: P: 1781850593888035 usec, L: 0
0619 06:29:55.117899 (+ 10335us) write_op.cc:270] Start()
0619 06:29:55.117925 (+ 26us) write_op.cc:276] Timestamp: P: 1781850593888694 usec, L: 0
0619 06:29:55.118102 (+ 177us) write_op.cc:270] Start()
0619 06:29:55.118124 (+ 22us) write_op.cc:276] Timestamp: P: 1781850593909463 usec, L: 0
0619 06:29:55.135744 (+ 17620us) write_op.cc:270] Start()
0619 06:29:55.135770 (+ 26us) write_op.cc:276] Timestamp: P: 1781850593927532 usec, L: 0
0619 06:29:55.138924 (+ 3154us) write_op.cc:270] Start()
0619 06:29:55.138948 (+ 24us) write_op.cc:276] Timestamp: P: 1781850593933208 usec, L: 0
0619 06:29:55.139552 (+ 604us) write_op.cc:270] Start()
0619 06:29:55.145628 (+ 6076us) write_op.cc:276] Timestamp: P: 1781850593975200 usec, L: 0
0619 06:29:55.145795 (+ 167us) write_op.cc:270] Start()
0619 06:29:55.145818 (+ 23us) write_op.cc:276] Timestamp: P: 1781850593989632 usec, L: 0
0619 06:29:55.145946 (+ 128us) write_op.cc:270] Start()
0619 06:29:55.145964 (+ 18us) write_op.cc:276] Timestamp: P: 1781850593991705 usec, L: 0
0619 06:29:55.146095 (+ 131us) write_op.cc:270] Start()
0619 06:29:55.146113 (+ 18us) write_op.cc:276] Timestamp: P: 1781850594015146 usec, L: 0
0619 06:29:55.146245 (+ 132us) write_op.cc:270] Start()
0619 06:29:55.146264 (+ 19us) write_op.cc:276] Timestamp: P: 1781850594037846 usec, L: 0
0619 06:29:55.146388 (+ 124us) write_op.cc:270] Start()
0619 06:29:55.146405 (+ 17us) write_op.cc:276] Timestamp: P: 1781850594038533 usec, L: 0
0619 06:29:55.146586 (+ 181us) write_op.cc:270] Start()
0619 06:29:55.146607 (+ 21us) write_op.cc:276] Timestamp: P: 1781850594074326 usec, L: 0
0619 06:29:55.146759 (+ 152us) write_op.cc:270] Start()
0619 06:29:55.146780 (+ 21us) write_op.cc:276] Timestamp: P: 1781850594086652 usec, L: 0
0619 06:29:55.146908 (+ 128us) write_op.cc:270] Start()
0619 06:29:55.146926 (+ 18us) write_op.cc:276] Timestamp: P: 1781850594097004 usec, L: 0
0619 06:29:55.147077 (+ 151us) write_op.cc:270] Start()
0619 06:29:55.147098 (+ 21us) write_op.cc:276] Timestamp: P: 1781850594100775 usec, L: 0
0619 06:29:55.147226 (+ 128us) write_op.cc:270] Start()
0619 06:29:55.147246 (+ 20us) write_op.cc:276] Timestamp: P: 1781850594124957 usec, L: 0
0619 06:29:55.149759 (+ 2513us) write_op.cc:270] Start()
0619 06:29:55.149782 (+ 23us) write_op.cc:276] Timestamp: P: 1781850594166995 usec, L: 0
0619 06:29:55.190317 (+ 40535us) write_op.cc:270] Start()
0619 06:29:55.190344 (+ 27us) write_op.cc:276] Timestamp: P: 1781850594169445 usec, L: 0
0619 06:29:55.203997 (+ 13653us) write_op.cc:270] Start()
0619 06:29:55.204024 (+ 27us) write_op.cc:276] Timestamp: P: 1781850594230691 usec, L: 0
0619 06:29:55.204171 (+ 147us) write_op.cc:270] Start()
0619 06:29:55.204190 (+ 19us) write_op.cc:276] Timestamp: P: 1781850594231297 usec, L: 0
0619 06:29:55.212858 (+ 8668us) write_op.cc:270] Start()
0619 06:29:55.212882 (+ 24us) write_op.cc:276] Timestamp: P: 1781850594248176 usec, L: 0
0619 06:29:55.213059 (+ 177us) write_op.cc:270] Start()
0619 06:29:55.213080 (+ 21us) write_op.cc:276] Timestamp: P: 1781850594262224 usec, L: 0
0619 06:29:55.213260 (+ 180us) write_op.cc:270] Start()
0619 06:29:55.213284 (+ 24us) write_op.cc:276] Timestamp: P: 1781850594309317 usec, L: 0
0619 06:29:55.213437 (+ 153us) write_op.cc:270] Start()
0619 06:29:55.213467 (+ 30us) write_op.cc:276] Timestamp: P: 1781850594319465 usec, L: 0
0619 06:29:55.213609 (+ 142us) write_op.cc:270] Start()
0619 06:29:55.213633 (+ 24us) write_op.cc:276] Timestamp: P: 1781850594340867 usec, L: 0
0619 06:29:55.213778 (+ 145us) write_op.cc:270] Start()
0619 06:29:55.213798 (+ 20us) write_op.cc:276] Timestamp: P: 1781850594341550 usec, L: 0
0619 06:29:55.213933 (+ 135us) write_op.cc:270] Start()
0619 06:29:55.213952 (+ 19us) write_op.cc:276] Timestamp: P: 1781850594374936 usec, L: 0
0619 06:29:55.214534 (+ 582us) write_op.cc:270] Start()
0619 06:29:55.214562 (+ 28us) write_op.cc:276] Timestamp: P: 1781850594390559 usec, L: 0
0619 06:29:55.214712 (+ 150us) write_op.cc:270] Start()
0619 06:29:55.214734 (+ 22us) write_op.cc:276] Timestamp: P: 1781850594406371 usec, L: 0
0619 06:29:55.312587 (+ 97853us) log.cc:842] Serialized 118167 byte log entry
0619 06:29:55.314572 (+ 1985us) raft_consensus.cc:1631] Marking committed up to 1424
0619 06:29:55.494847 (+180275us) spinlock_profiling.cc:243] Waited 83.6 ms on lock 0x61600009c7a0. stack: 00007ff742e9066e 00007ff742e90430 00007ff741f175ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007ff74e2f817a 00007ff74e3adeb1 00007ff74e3a9ee9 00007ff751f50a6c 00007ff74c83bfa6 00007ff74c83bcd5 00007ff7499cc9be 00007ff7499cb79e 00007ff7499d1b25 00007ff7499d254f
0619 06:29:55.494858 (+ 11us) raft_consensus.cc:1683] Filling consensus response to leader.
0619 06:29:55.494884 (+ 26us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0619 06:29:55.497124 (+ 2240us) raft_consensus.cc:1671] finished
0619 06:29:55.497127 (+ 3us) raft_consensus.cc:1677] UpdateReplicas() finished
0619 06:29:55.497198 (+ 71us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0619 06:29:54.561087 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 6cffdcc0e99c47aead56bbaea58d3e4d
0619 06:29:54.592785 (+ 31698us) write_op.cc:432] Acquiring schema lock in shared mode
0619 06:29:54.592791 (+ 6us) write_op.cc:435] Acquired schema lock
0619 06:29:54.592793 (+ 2us) tablet.cc:660] Decoding operations
0619 06:29:54.592898 (+ 105us) write_op.cc:620] Acquiring the partition lock for write op
0619 06:29:54.592911 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0619 06:29:54.592916 (+ 5us) tablet.cc:683] Acquiring locks for 6 operations
0619 06:29:54.637061 (+ 44145us) tablet.cc:699] Row locks acquired
0619 06:29:54.637066 (+ 5us) write_op.cc:260] PREPARE: finished
0619 06:29:54.649389 (+ 12323us) spinlock_profiling.cc:243] Waited 1.76 ms on lock 0x61100006eb98. stack: 00007ff742e9066e 00007ff742e90430 00007ff741f175ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007ff74996157f 00007ff74f6d260f 00007ff74f6d0e71 00007ff74f6d0359 00007ff74f6d81bb 00007ff74f6d8038 00000000009edb7c 00007ff742ed6344 00007ff742ed991b 00007ff742ed9798
0619 06:29:55.314610 (+665221us) op_driver.cc:444] REPLICATION: finished
Related trace 'op':
0619 06:29:54.656858 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 6cffdcc0e99c47aead56bbaea58d3e4d
0619 06:29:54.656968 (+ 110us) write_op.cc:432] Acquiring schema lock in shared mode
0619 06:29:54.656976 (+ 8us) write_op.cc:435] Acquired schema lock
0619 06:29:54.656980 (+ 4us) tablet.cc:660] Decoding operations
0619 06:29:54.689365 (+ 32385us) write_op.cc:620] Acquiring the partition lock for write op
0619 06:29:54.689376 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0619 06:29:54.689381 (+ 5us) tablet.cc:683] Acquiring locks for 10 operations
0619 06:29:54.689491 (+ 110us) tablet.cc:699] Row locks acquired
0619 06:29:54.689493 (+ 2us) write_op.cc:260] PREPARE: finished
0619 06:29:55.314656 (+625163us) op_driver.cc:444] REPLICATION: finished
Related trace 'op':
0619 06:29:54.689575 (+ 0us)
I20260619 06:29:56.030692 8664 raft_consensus.cc:482] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3fc4e58423894a27a7b94de5c6013cf1)
I20260619 06:29:56.030870 8664 raft_consensus.cc:504] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:56.031733 8664 leader_election.cc:288] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063), 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499)
I20260619 06:29:56.033362 7861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cffdcc0e99c47aead56bbaea58d3e4d" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 1486 } } ignore_live_leader: false dest_uuid: "996381a7495d4720a6f6be44a1d4781b" is_pre_election: true
I20260619 06:29:56.036348 7993 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cffdcc0e99c47aead56bbaea58d3e4d" candidate_uuid: "b46f2dae92104884b86705d6bbc20003" candidate_term: 2 candidate_status { last_received { term: 1 index: 1486 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1" is_pre_election: true
I20260619 06:29:56.036887 8458 leader_election.cc:302] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b46f2dae92104884b86705d6bbc20003; no voters: 3fc4e58423894a27a7b94de5c6013cf1, 996381a7495d4720a6f6be44a1d4781b
I20260619 06:29:56.037168 8664 raft_consensus.cc:2726] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 06:29:57.919306 8360 ts_manager.cc:292] Set tserver state for b46f2dae92104884b86705d6bbc20003 to MAINTENANCE_MODE
I20260619 06:29:57.921622 7552 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu pid 8435
I20260619 06:29:57.923377 8604 generic_service.cc:196] Checking for leaks (request via RPC)
W20260619 06:29:58.497200 8099 log.cc:924] Time spent T 98eb40b379a24876b6334fff708de671 P 996381a7495d4720a6f6be44a1d4781b: Append to log took a long time: real 0.057s user 0.007s sys 0.005s
W20260619 06:29:58.680035 8604 rpcz_store.cc:267] Call kudu.server.GenericService.CheckLeaks from 127.0.0.1:41904 (request call id 77) took 757 ms (client timeout 1000 ms). Trace:
W20260619 06:29:58.680240 8604 rpcz_store.cc:269] 0619 06:29:57.923025 (+ 0us) service_pool.cc:170] Inserting onto call queue
0619 06:29:57.923077 (+ 52us) service_pool.cc:227] Handling call
0619 06:29:58.679992 (+756915us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260619 06:29:58.771138 8700 raft_consensus.cc:482] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3fc4e58423894a27a7b94de5c6013cf1)
I20260619 06:29:58.771390 8700 raft_consensus.cc:504] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:58.772548 8700 leader_election.cc:288] T 6cffdcc0e99c47aead56bbaea58d3e4d P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063), 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499)
I20260619 06:29:58.772709 8700 raft_consensus.cc:482] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 996381a7495d4720a6f6be44a1d4781b)
I20260619 06:29:58.772863 8700 raft_consensus.cc:504] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } } peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } }
I20260619 06:29:58.773478 8700 leader_election.cc:288] T 08686b31ffd64266bcdbd6f5eb29a87d P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499), 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063)
I20260619 06:29:58.773638 8700 raft_consensus.cc:482] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 996381a7495d4720a6f6be44a1d4781b)
I20260619 06:29:58.773763 8700 raft_consensus.cc:504] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:58.774430 8700 leader_election.cc:288] T 8e2da70288694680bec48ac95c14656f P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063), 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499)
I20260619 06:29:58.775547 8700 raft_consensus.cc:482] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3fc4e58423894a27a7b94de5c6013cf1)
I20260619 06:29:58.775946 8700 raft_consensus.cc:504] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:58.776646 8700 leader_election.cc:288] T 98eb40b379a24876b6334fff708de671 P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063), 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499)
I20260619 06:29:58.776892 8700 raft_consensus.cc:482] T f5c2224f852746c8893931fd3ff27126 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 996381a7495d4720a6f6be44a1d4781b)
I20260619 06:29:58.779727 8700 raft_consensus.cc:504] T f5c2224f852746c8893931fd3ff27126 P b46f2dae92104884b86705d6bbc20003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } }
I20260619 06:29:58.780447 8700 leader_election.cc:288] T f5c2224f852746c8893931fd3ff27126 P b46f2dae92104884b86705d6bbc20003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063), 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499)
I20260619 06:29:58.795507 7552 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu with pid 8435
W20260619 06:29:58.896245 7799 connection.cc:535] client connection to 127.7.96.1:33323 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260619 06:29:58.896391 7799 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107) [suppressed 61 similar messages]
W20260619 06:29:58.911463 7929 connection.cc:535] client connection to 127.7.96.1:33323 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260619 06:29:58.911633 7929 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107) [suppressed 58 similar messages]
W20260619 06:29:58.927424 8705 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:29:58.901197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.96.1:33323 (local address 127.7.96.2:55487)
0619 06:29:58.907047 (+ 5850us) negotiation.cc:107] Waiting for socket to connect
0619 06:29:58.907069 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0619 06:29:58.907190 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:29:58.926729 (+ 19539us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":5738,"thread_start_us":7913,"threads_started":1}
W20260619 06:29:58.927770 7799 consensus_peers.cc:487] T 8e2da70288694680bec48ac95c14656f P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107). This is attempt 1: this message will repeat every 5th retry.
W20260619 06:29:58.927973 7799 consensus_peers.cc:487] T 08686b31ffd64266bcdbd6f5eb29a87d P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107). This is attempt 1: this message will repeat every 5th retry.
W20260619 06:29:58.928119 7799 consensus_peers.cc:487] T f5c2224f852746c8893931fd3ff27126 P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107). This is attempt 1: this message will repeat every 5th retry.
W20260619 06:29:58.936008 7929 consensus_peers.cc:487] T 98eb40b379a24876b6334fff708de671 P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260619 06:29:58.936220 7929 consensus_peers.cc:487] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260619 06:29:58.936398 7929 consensus_peers.cc:487] T 6cffdcc0e99c47aead56bbaea58d3e4d P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260619 06:29:59.319104 7929 consensus_peers.cc:487] T 98eb40b379a24876b6334fff708de671 P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260619 06:29:59.357828 7929 consensus_peers.cc:487] T 6cffdcc0e99c47aead56bbaea58d3e4d P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260619 06:29:59.369204 7799 consensus_peers.cc:487] T 08686b31ffd64266bcdbd6f5eb29a87d P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260619 06:29:59.410619 7799 consensus_peers.cc:487] T f5c2224f852746c8893931fd3ff27126 P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260619 06:29:59.421526 7929 consensus_peers.cc:487] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260619 06:29:59.458395 7799 consensus_peers.cc:487] T 8e2da70288694680bec48ac95c14656f P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260619 06:29:59.852346 7929 consensus_peers.cc:487] T 6cffdcc0e99c47aead56bbaea58d3e4d P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260619 06:29:59.852483 7929 consensus_peers.cc:487] T 98eb40b379a24876b6334fff708de671 P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260619 06:29:59.871337 7799 consensus_peers.cc:487] T 08686b31ffd64266bcdbd6f5eb29a87d P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260619 06:29:59.928483 8710 consensus_queue.cc:579] T 6cffdcc0e99c47aead56bbaea58d3e4d P 3fc4e58423894a27a7b94de5c6013cf1 [LEADER]: Leader has been unable to successfully communicate with peer b46f2dae92104884b86705d6bbc20003 for more than 2 seconds (2.041s)
W20260619 06:29:59.934219 7799 consensus_peers.cc:487] T f5c2224f852746c8893931fd3ff27126 P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260619 06:29:59.959095 8710 consensus_queue.cc:579] T 98eb40b379a24876b6334fff708de671 P 3fc4e58423894a27a7b94de5c6013cf1 [LEADER]: Leader has been unable to successfully communicate with peer b46f2dae92104884b86705d6bbc20003 for more than 2 seconds (2.063s)
I20260619 06:29:59.966720 8698 consensus_queue.cc:579] T 08686b31ffd64266bcdbd6f5eb29a87d P 996381a7495d4720a6f6be44a1d4781b [LEADER]: Leader has been unable to successfully communicate with peer b46f2dae92104884b86705d6bbc20003 for more than 2 seconds (2.024s)
I20260619 06:29:59.972183 8698 consensus_queue.cc:579] T 8e2da70288694680bec48ac95c14656f P 996381a7495d4720a6f6be44a1d4781b [LEADER]: Leader has been unable to successfully communicate with peer b46f2dae92104884b86705d6bbc20003 for more than 2 seconds (2.036s)
W20260619 06:29:59.985617 7799 consensus_peers.cc:487] T 8e2da70288694680bec48ac95c14656f P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260619 06:30:00.028017 8687 consensus_queue.cc:579] T f5c2224f852746c8893931fd3ff27126 P 996381a7495d4720a6f6be44a1d4781b [LEADER]: Leader has been unable to successfully communicate with peer b46f2dae92104884b86705d6bbc20003 for more than 2 seconds (2.090s)
W20260619 06:30:00.037726 7929 consensus_peers.cc:487] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260619 06:30:00.395598 7799 consensus_peers.cc:487] T 08686b31ffd64266bcdbd6f5eb29a87d P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260619 06:30:00.398599 7929 consensus_peers.cc:487] T 98eb40b379a24876b6334fff708de671 P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260619 06:30:00.422441 7929 consensus_peers.cc:487] T 6cffdcc0e99c47aead56bbaea58d3e4d P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260619 06:30:00.429981 7799 consensus_peers.cc:487] T f5c2224f852746c8893931fd3ff27126 P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260619 06:30:00.520841 7799 consensus_peers.cc:487] T 8e2da70288694680bec48ac95c14656f P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260619 06:30:00.540977 7929 consensus_peers.cc:487] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260619 06:30:00.806653 7929 consensus_peers.cc:487] T 6cffdcc0e99c47aead56bbaea58d3e4d P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260619 06:30:00.849218 8669 consensus_queue.cc:579] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 3fc4e58423894a27a7b94de5c6013cf1 [LEADER]: Leader has been unable to successfully communicate with peer b46f2dae92104884b86705d6bbc20003 for more than 2 seconds (2.055s)
W20260619 06:30:00.894797 7929 consensus_peers.cc:487] T 98eb40b379a24876b6334fff708de671 P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260619 06:30:00.920461 7799 consensus_peers.cc:487] T 08686b31ffd64266bcdbd6f5eb29a87d P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260619 06:30:00.999640 7799 consensus_peers.cc:487] T f5c2224f852746c8893931fd3ff27126 P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260619 06:30:01.051587 7929 consensus_peers.cc:487] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260619 06:30:01.101985 7799 consensus_peers.cc:487] T 8e2da70288694680bec48ac95c14656f P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260619 06:30:01.339864 7929 consensus_peers.cc:487] T 6cffdcc0e99c47aead56bbaea58d3e4d P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260619 06:30:01.423784 7929 consensus_peers.cc:487] T 98eb40b379a24876b6334fff708de671 P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260619 06:30:01.465127 8361 ts_manager.cc:281] Unset tserver state for b46f2dae92104884b86705d6bbc20003 from MAINTENANCE_MODE
W20260619 06:30:01.512442 7799 consensus_peers.cc:487] T 08686b31ffd64266bcdbd6f5eb29a87d P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260619 06:30:01.524719 7799 consensus_peers.cc:487] T f5c2224f852746c8893931fd3ff27126 P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260619 06:30:01.555037 7929 consensus_peers.cc:487] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260619 06:30:01.646039 7799 consensus_peers.cc:487] T 8e2da70288694680bec48ac95c14656f P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260619 06:30:01.814541 7929 consensus_peers.cc:487] T 6cffdcc0e99c47aead56bbaea58d3e4d P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260619 06:30:01.858896 8038 heartbeater.cc:511] Master 127.7.96.62:40917 requested a full tablet report, sending...
I20260619 06:30:01.884802 7989 consensus_queue.cc:237] T 6cffdcc0e99c47aead56bbaea58d3e4d P 3fc4e58423894a27a7b94de5c6013cf1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1855, Committed index: 1855, Last appended: 1.1855, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 1856 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } } peers { permanent_uuid: "50e96b0fdd674f4396c6b2276d924f8a" member_type: NON_VOTER last_known_addr { host: "127.7.96.4" port: 42379 } attrs { promote: true } }
I20260619 06:30:01.885946 7992 consensus_queue.cc:237] T 98eb40b379a24876b6334fff708de671 P 3fc4e58423894a27a7b94de5c6013cf1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1856, Committed index: 1856, Last appended: 1.1857, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 1858 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } } peers { permanent_uuid: "50e96b0fdd674f4396c6b2276d924f8a" member_type: NON_VOTER last_known_addr { host: "127.7.96.4" port: 42379 } attrs { promote: true } }
I20260619 06:30:01.892083 7993 consensus_queue.cc:237] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 3fc4e58423894a27a7b94de5c6013cf1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1856, Committed index: 1856, Last appended: 1.1857, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 1858 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } } peers { permanent_uuid: "50e96b0fdd674f4396c6b2276d924f8a" member_type: NON_VOTER last_known_addr { host: "127.7.96.4" port: 42379 } attrs { promote: true } }
W20260619 06:30:01.907680 7929 consensus_peers.cc:487] T 98eb40b379a24876b6334fff708de671 P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260619 06:30:01.907830 7929 consensus_peers.cc:487] T 6cffdcc0e99c47aead56bbaea58d3e4d P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260619 06:30:01.908746 7863 raft_consensus.cc:1261] T 6cffdcc0e99c47aead56bbaea58d3e4d P 996381a7495d4720a6f6be44a1d4781b [term 1 FOLLOWER]: Refusing update from remote peer 3fc4e58423894a27a7b94de5c6013cf1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1855. Preceding OpId from leader: term: 1 index: 1856. (index mismatch)
I20260619 06:30:01.909574 7863 raft_consensus.cc:1261] T 98eb40b379a24876b6334fff708de671 P 996381a7495d4720a6f6be44a1d4781b [term 1 FOLLOWER]: Refusing update from remote peer 3fc4e58423894a27a7b94de5c6013cf1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1857. Preceding OpId from leader: term: 1 index: 1858. (index mismatch)
I20260619 06:30:01.910332 7863 raft_consensus.cc:1261] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 996381a7495d4720a6f6be44a1d4781b [term 1 FOLLOWER]: Refusing update from remote peer 3fc4e58423894a27a7b94de5c6013cf1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1857. Preceding OpId from leader: term: 1 index: 1859. (index mismatch)
I20260619 06:30:01.911154 8681 consensus_queue.cc:1035] T 6cffdcc0e99c47aead56bbaea58d3e4d P 3fc4e58423894a27a7b94de5c6013cf1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1856, Last known committed idx: 1855, Time since last communication: 0.000s
I20260619 06:30:01.912349 8681 consensus_queue.cc:1035] T 98eb40b379a24876b6334fff708de671 P 3fc4e58423894a27a7b94de5c6013cf1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1858, Last known committed idx: 1856, Time since last communication: 0.000s
I20260619 06:30:01.922472 8681 consensus_queue.cc:1035] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 3fc4e58423894a27a7b94de5c6013cf1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1858, Last known committed idx: 1856, Time since last communication: 0.000s
I20260619 06:30:01.929320 8681 raft_consensus.cc:2932] T 6cffdcc0e99c47aead56bbaea58d3e4d P 3fc4e58423894a27a7b94de5c6013cf1 [term 1 LEADER]: Committing config change with OpId 1.1856: config changed from index -1 to 1856, NON_VOTER 50e96b0fdd674f4396c6b2276d924f8a (127.7.96.4) added. New config: { opid_index: 1856 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } } peers { permanent_uuid: "50e96b0fdd674f4396c6b2276d924f8a" member_type: NON_VOTER last_known_addr { host: "127.7.96.4" port: 42379 } attrs { promote: true } } }
I20260619 06:30:01.931403 7860 raft_consensus.cc:2932] T 6cffdcc0e99c47aead56bbaea58d3e4d P 996381a7495d4720a6f6be44a1d4781b [term 1 FOLLOWER]: Committing config change with OpId 1.1856: config changed from index -1 to 1856, NON_VOTER 50e96b0fdd674f4396c6b2276d924f8a (127.7.96.4) added. New config: { opid_index: 1856 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } } peers { permanent_uuid: "50e96b0fdd674f4396c6b2276d924f8a" member_type: NON_VOTER last_known_addr { host: "127.7.96.4" port: 42379 } attrs { promote: true } } }
I20260619 06:30:01.929343 8710 raft_consensus.cc:2932] T 98eb40b379a24876b6334fff708de671 P 3fc4e58423894a27a7b94de5c6013cf1 [term 1 LEADER]: Committing config change with OpId 1.1858: config changed from index -1 to 1858, NON_VOTER 50e96b0fdd674f4396c6b2276d924f8a (127.7.96.4) added. New config: { opid_index: 1858 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } } peers { permanent_uuid: "50e96b0fdd674f4396c6b2276d924f8a" member_type: NON_VOTER last_known_addr { host: "127.7.96.4" port: 42379 } attrs { promote: true } } }
W20260619 06:30:01.935628 7926 consensus_peers.cc:487] T 98eb40b379a24876b6334fff708de671 P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer 50e96b0fdd674f4396c6b2276d924f8a (127.7.96.4:42379): Couldn't send request to peer 50e96b0fdd674f4396c6b2276d924f8a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 98eb40b379a24876b6334fff708de671. This is attempt 1: this message will repeat every 5th retry.
W20260619 06:30:01.935909 7926 consensus_peers.cc:487] T 6cffdcc0e99c47aead56bbaea58d3e4d P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer 50e96b0fdd674f4396c6b2276d924f8a (127.7.96.4:42379): Couldn't send request to peer 50e96b0fdd674f4396c6b2276d924f8a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6cffdcc0e99c47aead56bbaea58d3e4d. This is attempt 1: this message will repeat every 5th retry.
W20260619 06:30:01.936126 7926 consensus_peers.cc:487] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer 50e96b0fdd674f4396c6b2276d924f8a (127.7.96.4:42379): Couldn't send request to peer 50e96b0fdd674f4396c6b2276d924f8a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e3e5e97eabdf42cf8e46ccb4b61c5fb7. This is attempt 1: this message will repeat every 5th retry.
I20260619 06:30:01.936712 7862 raft_consensus.cc:2932] T 98eb40b379a24876b6334fff708de671 P 996381a7495d4720a6f6be44a1d4781b [term 1 FOLLOWER]: Committing config change with OpId 1.1858: config changed from index -1 to 1858, NON_VOTER 50e96b0fdd674f4396c6b2276d924f8a (127.7.96.4) added. New config: { opid_index: 1858 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } } peers { permanent_uuid: "50e96b0fdd674f4396c6b2276d924f8a" member_type: NON_VOTER last_known_addr { host: "127.7.96.4" port: 42379 } attrs { promote: true } } }
I20260619 06:30:01.936721 8361 catalog_manager.cc:5495] T 6cffdcc0e99c47aead56bbaea58d3e4d P 996381a7495d4720a6f6be44a1d4781b reported cstate change: config changed from index -1 to 1856, NON_VOTER 50e96b0fdd674f4396c6b2276d924f8a (127.7.96.4) added. New cstate: current_term: 1 leader_uuid: "3fc4e58423894a27a7b94de5c6013cf1" committed_config { opid_index: 1856 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } } peers { permanent_uuid: "50e96b0fdd674f4396c6b2276d924f8a" member_type: NON_VOTER last_known_addr { host: "127.7.96.4" port: 42379 } attrs { promote: true } } }
W20260619 06:30:01.938294 7929 consensus_peers.cc:487] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260619 06:30:01.941607 8345 catalog_manager.cc:5008] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 6cffdcc0e99c47aead56bbaea58d3e4d with cas_config_opid_index -1: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20260619 06:30:01.942165 8716 raft_consensus.cc:2932] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 3fc4e58423894a27a7b94de5c6013cf1 [term 1 LEADER]: Committing config change with OpId 1.1858: config changed from index -1 to 1858, NON_VOTER 50e96b0fdd674f4396c6b2276d924f8a (127.7.96.4) added. New config: { opid_index: 1858 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } } peers { permanent_uuid: "50e96b0fdd674f4396c6b2276d924f8a" member_type: NON_VOTER last_known_addr { host: "127.7.96.4" port: 42379 } attrs { promote: true } } }
I20260619 06:30:01.944666 7860 raft_consensus.cc:2932] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 996381a7495d4720a6f6be44a1d4781b [term 1 FOLLOWER]: Committing config change with OpId 1.1858: config changed from index -1 to 1858, NON_VOTER 50e96b0fdd674f4396c6b2276d924f8a (127.7.96.4) added. New config: { opid_index: 1858 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } } peers { permanent_uuid: "50e96b0fdd674f4396c6b2276d924f8a" member_type: NON_VOTER last_known_addr { host: "127.7.96.4" port: 42379 } attrs { promote: true } } }
I20260619 06:30:01.950784 7908 heartbeater.cc:511] Master 127.7.96.62:40917 requested a full tablet report, sending...
I20260619 06:30:01.952880 8361 catalog_manager.cc:5495] T 98eb40b379a24876b6334fff708de671 P 996381a7495d4720a6f6be44a1d4781b reported cstate change: config changed from index -1 to 1858, NON_VOTER 50e96b0fdd674f4396c6b2276d924f8a (127.7.96.4) added. New cstate: current_term: 1 leader_uuid: "3fc4e58423894a27a7b94de5c6013cf1" committed_config { opid_index: 1858 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } } peers { permanent_uuid: "50e96b0fdd674f4396c6b2276d924f8a" member_type: NON_VOTER last_known_addr { host: "127.7.96.4" port: 42379 } attrs { promote: true } } }
I20260619 06:30:01.953712 8361 catalog_manager.cc:5495] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 996381a7495d4720a6f6be44a1d4781b reported cstate change: config changed from index -1 to 1858, NON_VOTER 50e96b0fdd674f4396c6b2276d924f8a (127.7.96.4) added. New cstate: current_term: 1 leader_uuid: "3fc4e58423894a27a7b94de5c6013cf1" committed_config { opid_index: 1858 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } } peers { permanent_uuid: "50e96b0fdd674f4396c6b2276d924f8a" member_type: NON_VOTER last_known_addr { host: "127.7.96.4" port: 42379 } attrs { promote: true } } }
I20260619 06:30:01.960337 8345 catalog_manager.cc:5008] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet e3e5e97eabdf42cf8e46ccb4b61c5fb7 with cas_config_opid_index -1: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20260619 06:30:01.960721 8345 catalog_manager.cc:5008] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 98eb40b379a24876b6334fff708de671 with cas_config_opid_index -1: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20260619 06:30:01.989338 8737 ts_tablet_manager.cc:927] T 6cffdcc0e99c47aead56bbaea58d3e4d P 50e96b0fdd674f4396c6b2276d924f8a: Initiating tablet copy from peer 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499)
I20260619 06:30:02.003157 7862 consensus_queue.cc:237] T f5c2224f852746c8893931fd3ff27126 P 996381a7495d4720a6f6be44a1d4781b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1862, Committed index: 1862, Last appended: 1.1864, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 1865 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } } peers { permanent_uuid: "50e96b0fdd674f4396c6b2276d924f8a" member_type: NON_VOTER last_known_addr { host: "127.7.96.4" port: 42379 } attrs { promote: true } }
I20260619 06:30:02.003959 7860 consensus_queue.cc:237] T 08686b31ffd64266bcdbd6f5eb29a87d P 996381a7495d4720a6f6be44a1d4781b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1861, Committed index: 1861, Last appended: 1.1864, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 1865 OBSOLETE_local: false peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } } peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "50e96b0fdd674f4396c6b2276d924f8a" member_type: NON_VOTER last_known_addr { host: "127.7.96.4" port: 42379 } attrs { promote: true } }
I20260619 06:30:02.004130 7863 consensus_queue.cc:237] T 8e2da70288694680bec48ac95c14656f P 996381a7495d4720a6f6be44a1d4781b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1862, Committed index: 1862, Last appended: 1.1864, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 1865 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } } peers { permanent_uuid: "50e96b0fdd674f4396c6b2276d924f8a" member_type: NON_VOTER last_known_addr { host: "127.7.96.4" port: 42379 } attrs { promote: true } }
I20260619 06:30:02.011507 8737 tablet_copy_client.cc:316] T 6cffdcc0e99c47aead56bbaea58d3e4d P 50e96b0fdd674f4396c6b2276d924f8a: tablet copy: Beginning tablet copy session from remote peer at address 127.7.96.3:37499
I20260619 06:30:02.011958 8740 ts_tablet_manager.cc:927] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 50e96b0fdd674f4396c6b2276d924f8a: Initiating tablet copy from peer 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499)
W20260619 06:30:02.016937 7796 consensus_peers.cc:487] T 08686b31ffd64266bcdbd6f5eb29a87d P 996381a7495d4720a6f6be44a1d4781b -> Peer 50e96b0fdd674f4396c6b2276d924f8a (127.7.96.4:42379): Couldn't send request to peer 50e96b0fdd674f4396c6b2276d924f8a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 08686b31ffd64266bcdbd6f5eb29a87d. This is attempt 1: this message will repeat every 5th retry.
W20260619 06:30:02.017191 7796 consensus_peers.cc:487] T 8e2da70288694680bec48ac95c14656f P 996381a7495d4720a6f6be44a1d4781b -> Peer 50e96b0fdd674f4396c6b2276d924f8a (127.7.96.4:42379): Couldn't send request to peer 50e96b0fdd674f4396c6b2276d924f8a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8e2da70288694680bec48ac95c14656f. This is attempt 1: this message will repeat every 5th retry.
W20260619 06:30:02.017385 7796 consensus_peers.cc:487] T f5c2224f852746c8893931fd3ff27126 P 996381a7495d4720a6f6be44a1d4781b -> Peer 50e96b0fdd674f4396c6b2276d924f8a (127.7.96.4:42379): Couldn't send request to peer 50e96b0fdd674f4396c6b2276d924f8a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f5c2224f852746c8893931fd3ff27126. This is attempt 1: this message will repeat every 5th retry.
I20260619 06:30:02.024916 7989 raft_consensus.cc:1261] T f5c2224f852746c8893931fd3ff27126 P 3fc4e58423894a27a7b94de5c6013cf1 [term 1 FOLLOWER]: Refusing update from remote peer 996381a7495d4720a6f6be44a1d4781b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1862. Preceding OpId from leader: term: 1 index: 1865. (index mismatch)
I20260619 06:30:02.025758 8686 consensus_queue.cc:1035] T f5c2224f852746c8893931fd3ff27126 P 996381a7495d4720a6f6be44a1d4781b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1865, Last known committed idx: 1862, Time since last communication: 0.000s
I20260619 06:30:02.027813 7993 raft_consensus.cc:1261] T 8e2da70288694680bec48ac95c14656f P 3fc4e58423894a27a7b94de5c6013cf1 [term 1 FOLLOWER]: Refusing update from remote peer 996381a7495d4720a6f6be44a1d4781b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1862. Preceding OpId from leader: term: 1 index: 1865. (index mismatch)
I20260619 06:30:02.030094 7992 raft_consensus.cc:1261] T 08686b31ffd64266bcdbd6f5eb29a87d P 3fc4e58423894a27a7b94de5c6013cf1 [term 1 FOLLOWER]: Refusing update from remote peer 996381a7495d4720a6f6be44a1d4781b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1862. Preceding OpId from leader: term: 1 index: 1865. (index mismatch)
I20260619 06:30:02.030973 8740 tablet_copy_client.cc:316] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 50e96b0fdd674f4396c6b2276d924f8a: tablet copy: Beginning tablet copy session from remote peer at address 127.7.96.3:37499
I20260619 06:30:02.032572 8686 consensus_queue.cc:1035] T 8e2da70288694680bec48ac95c14656f P 996381a7495d4720a6f6be44a1d4781b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1865, Last known committed idx: 1862, Time since last communication: 0.000s
I20260619 06:30:02.032946 8712 consensus_queue.cc:1035] T 08686b31ffd64266bcdbd6f5eb29a87d P 996381a7495d4720a6f6be44a1d4781b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1865, Last known committed idx: 1861, Time since last communication: 0.000s
I20260619 06:30:02.033425 8713 raft_consensus.cc:2932] T f5c2224f852746c8893931fd3ff27126 P 996381a7495d4720a6f6be44a1d4781b [term 1 LEADER]: Committing config change with OpId 1.1865: config changed from index -1 to 1865, NON_VOTER 50e96b0fdd674f4396c6b2276d924f8a (127.7.96.4) added. New config: { opid_index: 1865 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } } peers { permanent_uuid: "50e96b0fdd674f4396c6b2276d924f8a" member_type: NON_VOTER last_known_addr { host: "127.7.96.4" port: 42379 } attrs { promote: true } } }
I20260619 06:30:02.044075 7989 raft_consensus.cc:2932] T f5c2224f852746c8893931fd3ff27126 P 3fc4e58423894a27a7b94de5c6013cf1 [term 1 FOLLOWER]: Committing config change with OpId 1.1865: config changed from index -1 to 1865, NON_VOTER 50e96b0fdd674f4396c6b2276d924f8a (127.7.96.4) added. New config: { opid_index: 1865 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } } peers { permanent_uuid: "50e96b0fdd674f4396c6b2276d924f8a" member_type: NON_VOTER last_known_addr { host: "127.7.96.4" port: 42379 } attrs { promote: true } } }
I20260619 06:30:02.046144 8345 catalog_manager.cc:5008] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet f5c2224f852746c8893931fd3ff27126 with cas_config_opid_index -1: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20260619 06:30:02.046753 8013 tablet_copy_service.cc:140] P 3fc4e58423894a27a7b94de5c6013cf1: Received BeginTabletCopySession request for tablet 6cffdcc0e99c47aead56bbaea58d3e4d from peer 50e96b0fdd674f4396c6b2276d924f8a ({username='slave'} at 127.7.96.4:36757)
I20260619 06:30:02.047053 8013 tablet_copy_service.cc:161] P 3fc4e58423894a27a7b94de5c6013cf1: Beginning new tablet copy session on tablet 6cffdcc0e99c47aead56bbaea58d3e4d from peer 50e96b0fdd674f4396c6b2276d924f8a at {username='slave'} at 127.7.96.4:36757: session id = 50e96b0fdd674f4396c6b2276d924f8a-6cffdcc0e99c47aead56bbaea58d3e4d
W20260619 06:30:02.047130 7799 consensus_peers.cc:487] T 8e2da70288694680bec48ac95c14656f P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260619 06:30:02.047264 7799 consensus_peers.cc:487] T f5c2224f852746c8893931fd3ff27126 P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260619 06:30:02.047366 7799 consensus_peers.cc:487] T 08686b31ffd64266bcdbd6f5eb29a87d P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260619 06:30:02.048810 8361 catalog_manager.cc:5495] T f5c2224f852746c8893931fd3ff27126 P 996381a7495d4720a6f6be44a1d4781b reported cstate change: config changed from index -1 to 1865, NON_VOTER 50e96b0fdd674f4396c6b2276d924f8a (127.7.96.4) added. New cstate: current_term: 1 leader_uuid: "996381a7495d4720a6f6be44a1d4781b" committed_config { opid_index: 1865 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50e96b0fdd674f4396c6b2276d924f8a" member_type: NON_VOTER last_known_addr { host: "127.7.96.4" port: 42379 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260619 06:30:02.050657 8012 tablet_copy_service.cc:140] P 3fc4e58423894a27a7b94de5c6013cf1: Received BeginTabletCopySession request for tablet e3e5e97eabdf42cf8e46ccb4b61c5fb7 from peer 50e96b0fdd674f4396c6b2276d924f8a ({username='slave'} at 127.7.96.4:36757)
I20260619 06:30:02.050901 8012 tablet_copy_service.cc:161] P 3fc4e58423894a27a7b94de5c6013cf1: Beginning new tablet copy session on tablet e3e5e97eabdf42cf8e46ccb4b61c5fb7 from peer 50e96b0fdd674f4396c6b2276d924f8a at {username='slave'} at 127.7.96.4:36757: session id = 50e96b0fdd674f4396c6b2276d924f8a-e3e5e97eabdf42cf8e46ccb4b61c5fb7
I20260619 06:30:02.051855 8744 ts_tablet_manager.cc:927] T 98eb40b379a24876b6334fff708de671 P 50e96b0fdd674f4396c6b2276d924f8a: Initiating tablet copy from peer 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499)
I20260619 06:30:02.060467 8729 raft_consensus.cc:2932] T 8e2da70288694680bec48ac95c14656f P 996381a7495d4720a6f6be44a1d4781b [term 1 LEADER]: Committing config change with OpId 1.1865: config changed from index -1 to 1865, NON_VOTER 50e96b0fdd674f4396c6b2276d924f8a (127.7.96.4) added. New config: { opid_index: 1865 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } } peers { permanent_uuid: "50e96b0fdd674f4396c6b2276d924f8a" member_type: NON_VOTER last_known_addr { host: "127.7.96.4" port: 42379 } attrs { promote: true } } }
I20260619 06:30:02.060818 8686 raft_consensus.cc:2932] T 08686b31ffd64266bcdbd6f5eb29a87d P 996381a7495d4720a6f6be44a1d4781b [term 1 LEADER]: Committing config change with OpId 1.1865: config changed from index -1 to 1865, NON_VOTER 50e96b0fdd674f4396c6b2276d924f8a (127.7.96.4) added. New config: { opid_index: 1865 OBSOLETE_local: false peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } } peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "50e96b0fdd674f4396c6b2276d924f8a" member_type: NON_VOTER last_known_addr { host: "127.7.96.4" port: 42379 } attrs { promote: true } } }
I20260619 06:30:02.066289 8345 catalog_manager.cc:5008] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 08686b31ffd64266bcdbd6f5eb29a87d with cas_config_opid_index -1: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20260619 06:30:02.066598 8012 tablet_copy_source_session.cc:205] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 3fc4e58423894a27a7b94de5c6013cf1: Tablet Copy: opened 0 blocks and 1 log segments
I20260619 06:30:02.068518 8360 catalog_manager.cc:5495] T 08686b31ffd64266bcdbd6f5eb29a87d P 996381a7495d4720a6f6be44a1d4781b reported cstate change: config changed from index -1 to 1865, NON_VOTER 50e96b0fdd674f4396c6b2276d924f8a (127.7.96.4) added. New cstate: current_term: 1 leader_uuid: "996381a7495d4720a6f6be44a1d4781b" committed_config { opid_index: 1865 OBSOLETE_local: false peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50e96b0fdd674f4396c6b2276d924f8a" member_type: NON_VOTER last_known_addr { host: "127.7.96.4" port: 42379 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260619 06:30:02.071727 8345 catalog_manager.cc:5008] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 8e2da70288694680bec48ac95c14656f with cas_config_opid_index -1: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20260619 06:30:02.073798 8360 catalog_manager.cc:5495] T 8e2da70288694680bec48ac95c14656f P 996381a7495d4720a6f6be44a1d4781b reported cstate change: config changed from index -1 to 1865, NON_VOTER 50e96b0fdd674f4396c6b2276d924f8a (127.7.96.4) added. New cstate: current_term: 1 leader_uuid: "996381a7495d4720a6f6be44a1d4781b" committed_config { opid_index: 1865 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50e96b0fdd674f4396c6b2276d924f8a" member_type: NON_VOTER last_known_addr { host: "127.7.96.4" port: 42379 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260619 06:30:02.067703 7992 raft_consensus.cc:2932] T 8e2da70288694680bec48ac95c14656f P 3fc4e58423894a27a7b94de5c6013cf1 [term 1 FOLLOWER]: Committing config change with OpId 1.1865: config changed from index -1 to 1865, NON_VOTER 50e96b0fdd674f4396c6b2276d924f8a (127.7.96.4) added. New config: { opid_index: 1865 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } } peers { permanent_uuid: "50e96b0fdd674f4396c6b2276d924f8a" member_type: NON_VOTER last_known_addr { host: "127.7.96.4" port: 42379 } attrs { promote: true } } }
I20260619 06:30:02.072918 7990 raft_consensus.cc:2932] T 08686b31ffd64266bcdbd6f5eb29a87d P 3fc4e58423894a27a7b94de5c6013cf1 [term 1 FOLLOWER]: Committing config change with OpId 1.1865: config changed from index -1 to 1865, NON_VOTER 50e96b0fdd674f4396c6b2276d924f8a (127.7.96.4) added. New config: { opid_index: 1865 OBSOLETE_local: false peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } } peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "50e96b0fdd674f4396c6b2276d924f8a" member_type: NON_VOTER last_known_addr { host: "127.7.96.4" port: 42379 } attrs { promote: true } } }
I20260619 06:30:02.091066 8013 tablet_copy_source_session.cc:205] T 6cffdcc0e99c47aead56bbaea58d3e4d P 3fc4e58423894a27a7b94de5c6013cf1: Tablet Copy: opened 0 blocks and 1 log segments
I20260619 06:30:02.094542 8737 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6cffdcc0e99c47aead56bbaea58d3e4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:30:02.095369 8740 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e3e5e97eabdf42cf8e46ccb4b61c5fb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:30:02.111029 8744 tablet_copy_client.cc:316] T 98eb40b379a24876b6334fff708de671 P 50e96b0fdd674f4396c6b2276d924f8a: tablet copy: Beginning tablet copy session from remote peer at address 127.7.96.3:37499
I20260619 06:30:02.111891 8746 ts_tablet_manager.cc:927] T 8e2da70288694680bec48ac95c14656f P 50e96b0fdd674f4396c6b2276d924f8a: Initiating tablet copy from peer 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063)
I20260619 06:30:02.112457 8013 tablet_copy_service.cc:140] P 3fc4e58423894a27a7b94de5c6013cf1: Received BeginTabletCopySession request for tablet 98eb40b379a24876b6334fff708de671 from peer 50e96b0fdd674f4396c6b2276d924f8a ({username='slave'} at 127.7.96.4:36757)
I20260619 06:30:02.112603 8013 tablet_copy_service.cc:161] P 3fc4e58423894a27a7b94de5c6013cf1: Beginning new tablet copy session on tablet 98eb40b379a24876b6334fff708de671 from peer 50e96b0fdd674f4396c6b2276d924f8a at {username='slave'} at 127.7.96.4:36757: session id = 50e96b0fdd674f4396c6b2276d924f8a-98eb40b379a24876b6334fff708de671
I20260619 06:30:02.112890 8747 ts_tablet_manager.cc:927] T 08686b31ffd64266bcdbd6f5eb29a87d P 50e96b0fdd674f4396c6b2276d924f8a: Initiating tablet copy from peer 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063)
I20260619 06:30:02.113269 8746 tablet_copy_client.cc:316] T 8e2da70288694680bec48ac95c14656f P 50e96b0fdd674f4396c6b2276d924f8a: tablet copy: Beginning tablet copy session from remote peer at address 127.7.96.2:37063
I20260619 06:30:02.113925 8747 tablet_copy_client.cc:316] T 08686b31ffd64266bcdbd6f5eb29a87d P 50e96b0fdd674f4396c6b2276d924f8a: tablet copy: Beginning tablet copy session from remote peer at address 127.7.96.2:37063
I20260619 06:30:02.116321 8013 tablet_copy_source_session.cc:205] T 98eb40b379a24876b6334fff708de671 P 3fc4e58423894a27a7b94de5c6013cf1: Tablet Copy: opened 0 blocks and 1 log segments
I20260619 06:30:02.122318 8740 tablet_copy_client.cc:791] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 50e96b0fdd674f4396c6b2276d924f8a: tablet copy: Starting download of 0 data blocks...
I20260619 06:30:02.122648 8740 tablet_copy_client.cc:655] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 50e96b0fdd674f4396c6b2276d924f8a: tablet copy: Starting download of 1 WAL segments...
I20260619 06:30:02.125799 8737 tablet_copy_client.cc:791] T 6cffdcc0e99c47aead56bbaea58d3e4d P 50e96b0fdd674f4396c6b2276d924f8a: tablet copy: Starting download of 0 data blocks...
I20260619 06:30:02.126094 8737 tablet_copy_client.cc:655] T 6cffdcc0e99c47aead56bbaea58d3e4d P 50e96b0fdd674f4396c6b2276d924f8a: tablet copy: Starting download of 1 WAL segments...
I20260619 06:30:02.133174 7883 tablet_copy_service.cc:140] P 996381a7495d4720a6f6be44a1d4781b: Received BeginTabletCopySession request for tablet 8e2da70288694680bec48ac95c14656f from peer 50e96b0fdd674f4396c6b2276d924f8a ({username='slave'} at 127.7.96.4:38583)
I20260619 06:30:02.133419 7883 tablet_copy_service.cc:161] P 996381a7495d4720a6f6be44a1d4781b: Beginning new tablet copy session on tablet 8e2da70288694680bec48ac95c14656f from peer 50e96b0fdd674f4396c6b2276d924f8a at {username='slave'} at 127.7.96.4:38583: session id = 50e96b0fdd674f4396c6b2276d924f8a-8e2da70288694680bec48ac95c14656f
I20260619 06:30:02.135121 7882 tablet_copy_service.cc:140] P 996381a7495d4720a6f6be44a1d4781b: Received BeginTabletCopySession request for tablet 08686b31ffd64266bcdbd6f5eb29a87d from peer 50e96b0fdd674f4396c6b2276d924f8a ({username='slave'} at 127.7.96.4:38583)
I20260619 06:30:02.135267 7882 tablet_copy_service.cc:161] P 996381a7495d4720a6f6be44a1d4781b: Beginning new tablet copy session on tablet 08686b31ffd64266bcdbd6f5eb29a87d from peer 50e96b0fdd674f4396c6b2276d924f8a at {username='slave'} at 127.7.96.4:38583: session id = 50e96b0fdd674f4396c6b2276d924f8a-08686b31ffd64266bcdbd6f5eb29a87d
I20260619 06:30:02.135310 8744 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98eb40b379a24876b6334fff708de671. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:30:02.137701 7883 tablet_copy_source_session.cc:205] T 8e2da70288694680bec48ac95c14656f P 996381a7495d4720a6f6be44a1d4781b: Tablet Copy: opened 0 blocks and 1 log segments
I20260619 06:30:02.138371 7882 tablet_copy_source_session.cc:205] T 08686b31ffd64266bcdbd6f5eb29a87d P 996381a7495d4720a6f6be44a1d4781b: Tablet Copy: opened 0 blocks and 1 log segments
I20260619 06:30:02.140497 8746 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e2da70288694680bec48ac95c14656f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:30:02.142809 8744 tablet_copy_client.cc:791] T 98eb40b379a24876b6334fff708de671 P 50e96b0fdd674f4396c6b2276d924f8a: tablet copy: Starting download of 0 data blocks...
I20260619 06:30:02.143316 8747 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08686b31ffd64266bcdbd6f5eb29a87d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:30:02.143357 8744 tablet_copy_client.cc:655] T 98eb40b379a24876b6334fff708de671 P 50e96b0fdd674f4396c6b2276d924f8a: tablet copy: Starting download of 1 WAL segments...
I20260619 06:30:02.146212 8740 tablet_copy_client.cc:531] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 50e96b0fdd674f4396c6b2276d924f8a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260619 06:30:02.146651 8746 tablet_copy_client.cc:791] T 8e2da70288694680bec48ac95c14656f P 50e96b0fdd674f4396c6b2276d924f8a: tablet copy: Starting download of 0 data blocks...
I20260619 06:30:02.146922 8746 tablet_copy_client.cc:655] T 8e2da70288694680bec48ac95c14656f P 50e96b0fdd674f4396c6b2276d924f8a: tablet copy: Starting download of 1 WAL segments...
I20260619 06:30:02.152674 8737 tablet_copy_client.cc:531] T 6cffdcc0e99c47aead56bbaea58d3e4d P 50e96b0fdd674f4396c6b2276d924f8a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260619 06:30:02.153188 8740 tablet_bootstrap.cc:492] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 50e96b0fdd674f4396c6b2276d924f8a: Bootstrap starting.
I20260619 06:30:02.158823 8737 tablet_bootstrap.cc:492] T 6cffdcc0e99c47aead56bbaea58d3e4d P 50e96b0fdd674f4396c6b2276d924f8a: Bootstrap starting.
I20260619 06:30:02.174392 8750 ts_tablet_manager.cc:927] T f5c2224f852746c8893931fd3ff27126 P 50e96b0fdd674f4396c6b2276d924f8a: Initiating tablet copy from peer 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063)
I20260619 06:30:02.175117 8744 tablet_copy_client.cc:531] T 98eb40b379a24876b6334fff708de671 P 50e96b0fdd674f4396c6b2276d924f8a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260619 06:30:02.178751 8744 tablet_bootstrap.cc:492] T 98eb40b379a24876b6334fff708de671 P 50e96b0fdd674f4396c6b2276d924f8a: Bootstrap starting.
I20260619 06:30:02.188688 8750 tablet_copy_client.cc:316] T f5c2224f852746c8893931fd3ff27126 P 50e96b0fdd674f4396c6b2276d924f8a: tablet copy: Beginning tablet copy session from remote peer at address 127.7.96.2:37063
I20260619 06:30:02.191023 8747 tablet_copy_client.cc:791] T 08686b31ffd64266bcdbd6f5eb29a87d P 50e96b0fdd674f4396c6b2276d924f8a: tablet copy: Starting download of 0 data blocks...
I20260619 06:30:02.192206 7882 tablet_copy_service.cc:140] P 996381a7495d4720a6f6be44a1d4781b: Received BeginTabletCopySession request for tablet f5c2224f852746c8893931fd3ff27126 from peer 50e96b0fdd674f4396c6b2276d924f8a ({username='slave'} at 127.7.96.4:38583)
I20260619 06:30:02.192397 7882 tablet_copy_service.cc:161] P 996381a7495d4720a6f6be44a1d4781b: Beginning new tablet copy session on tablet f5c2224f852746c8893931fd3ff27126 from peer 50e96b0fdd674f4396c6b2276d924f8a at {username='slave'} at 127.7.96.4:38583: session id = 50e96b0fdd674f4396c6b2276d924f8a-f5c2224f852746c8893931fd3ff27126
I20260619 06:30:02.192992 8747 tablet_copy_client.cc:655] T 08686b31ffd64266bcdbd6f5eb29a87d P 50e96b0fdd674f4396c6b2276d924f8a: tablet copy: Starting download of 1 WAL segments...
I20260619 06:30:02.196460 8746 tablet_copy_client.cc:531] T 8e2da70288694680bec48ac95c14656f P 50e96b0fdd674f4396c6b2276d924f8a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260619 06:30:02.198484 7882 tablet_copy_source_session.cc:205] T f5c2224f852746c8893931fd3ff27126 P 996381a7495d4720a6f6be44a1d4781b: Tablet Copy: opened 0 blocks and 1 log segments
I20260619 06:30:02.200493 8746 tablet_bootstrap.cc:492] T 8e2da70288694680bec48ac95c14656f P 50e96b0fdd674f4396c6b2276d924f8a: Bootstrap starting.
I20260619 06:30:02.200577 8750 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f5c2224f852746c8893931fd3ff27126. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:30:02.209477 8750 tablet_copy_client.cc:791] T f5c2224f852746c8893931fd3ff27126 P 50e96b0fdd674f4396c6b2276d924f8a: tablet copy: Starting download of 0 data blocks...
I20260619 06:30:02.209774 8750 tablet_copy_client.cc:655] T f5c2224f852746c8893931fd3ff27126 P 50e96b0fdd674f4396c6b2276d924f8a: tablet copy: Starting download of 1 WAL segments...
I20260619 06:30:02.219409 8747 tablet_copy_client.cc:531] T 08686b31ffd64266bcdbd6f5eb29a87d P 50e96b0fdd674f4396c6b2276d924f8a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260619 06:30:02.240633 8747 tablet_bootstrap.cc:492] T 08686b31ffd64266bcdbd6f5eb29a87d P 50e96b0fdd674f4396c6b2276d924f8a: Bootstrap starting.
I20260619 06:30:02.253957 8750 tablet_copy_client.cc:531] T f5c2224f852746c8893931fd3ff27126 P 50e96b0fdd674f4396c6b2276d924f8a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260619 06:30:02.257786 8750 tablet_bootstrap.cc:492] T f5c2224f852746c8893931fd3ff27126 P 50e96b0fdd674f4396c6b2276d924f8a: Bootstrap starting.
W20260619 06:30:02.387095 7929 consensus_peers.cc:487] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260619 06:30:02.406971 7929 consensus_peers.cc:487] T 98eb40b379a24876b6334fff708de671 P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260619 06:30:02.418627 8291 heartbeater.cc:511] Master 127.7.96.62:40917 requested a full tablet report, sending...
W20260619 06:30:02.461119 7929 consensus_peers.cc:487] T 6cffdcc0e99c47aead56bbaea58d3e4d P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260619 06:30:02.534359 7799 consensus_peers.cc:487] T f5c2224f852746c8893931fd3ff27126 P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260619 06:30:02.545607 7926 consensus_peers.cc:487] T 6cffdcc0e99c47aead56bbaea58d3e4d P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer 50e96b0fdd674f4396c6b2276d924f8a (127.7.96.4:42379): Couldn't send request to peer 50e96b0fdd674f4396c6b2276d924f8a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
W20260619 06:30:02.546098 7799 consensus_peers.cc:487] T 8e2da70288694680bec48ac95c14656f P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260619 06:30:02.570945 7926 consensus_peers.cc:487] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer 50e96b0fdd674f4396c6b2276d924f8a (127.7.96.4:42379): Couldn't send request to peer 50e96b0fdd674f4396c6b2276d924f8a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
I20260619 06:30:02.571317 7552 meta_cache.cc:1510] marking tablet server b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323) as failed
W20260619 06:30:02.571544 7552 meta_cache.cc:302] tablet e3e5e97eabdf42cf8e46ccb4b61c5fb7: replica b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323) has failed: Network error: TS failed: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111)
W20260619 06:30:02.589673 7799 consensus_peers.cc:487] T 08686b31ffd64266bcdbd6f5eb29a87d P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260619 06:30:02.596220 7796 consensus_peers.cc:487] T 8e2da70288694680bec48ac95c14656f P 996381a7495d4720a6f6be44a1d4781b -> Peer 50e96b0fdd674f4396c6b2276d924f8a (127.7.96.4:42379): Couldn't send request to peer 50e96b0fdd674f4396c6b2276d924f8a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
W20260619 06:30:02.607585 7796 consensus_peers.cc:487] T f5c2224f852746c8893931fd3ff27126 P 996381a7495d4720a6f6be44a1d4781b -> Peer 50e96b0fdd674f4396c6b2276d924f8a (127.7.96.4:42379): Couldn't send request to peer 50e96b0fdd674f4396c6b2276d924f8a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
W20260619 06:30:02.617136 7926 consensus_peers.cc:487] T 98eb40b379a24876b6334fff708de671 P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer 50e96b0fdd674f4396c6b2276d924f8a (127.7.96.4:42379): Couldn't send request to peer 50e96b0fdd674f4396c6b2276d924f8a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
W20260619 06:30:02.694453 7796 consensus_peers.cc:487] T 08686b31ffd64266bcdbd6f5eb29a87d P 996381a7495d4720a6f6be44a1d4781b -> Peer 50e96b0fdd674f4396c6b2276d924f8a (127.7.96.4:42379): Couldn't send request to peer 50e96b0fdd674f4396c6b2276d924f8a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
W20260619 06:30:02.855438 7929 consensus_peers.cc:487] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260619 06:30:02.908715 7929 consensus_peers.cc:487] T 98eb40b379a24876b6334fff708de671 P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260619 06:30:02.953023 7929 consensus_peers.cc:487] T 6cffdcc0e99c47aead56bbaea58d3e4d P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260619 06:30:03.035566 7799 consensus_peers.cc:487] T 8e2da70288694680bec48ac95c14656f P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260619 06:30:03.036378 7799 consensus_peers.cc:487] T f5c2224f852746c8893931fd3ff27126 P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260619 06:30:03.050273 7926 consensus_peers.cc:487] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer 50e96b0fdd674f4396c6b2276d924f8a (127.7.96.4:42379): Couldn't send request to peer 50e96b0fdd674f4396c6b2276d924f8a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
W20260619 06:30:03.088131 7799 consensus_peers.cc:487] T 08686b31ffd64266bcdbd6f5eb29a87d P 996381a7495d4720a6f6be44a1d4781b -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260619 06:30:03.103128 7926 consensus_peers.cc:487] T 6cffdcc0e99c47aead56bbaea58d3e4d P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer 50e96b0fdd674f4396c6b2276d924f8a (127.7.96.4:42379): Couldn't send request to peer 50e96b0fdd674f4396c6b2276d924f8a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
W20260619 06:30:03.123461 7796 consensus_peers.cc:487] T f5c2224f852746c8893931fd3ff27126 P 996381a7495d4720a6f6be44a1d4781b -> Peer 50e96b0fdd674f4396c6b2276d924f8a (127.7.96.4:42379): Couldn't send request to peer 50e96b0fdd674f4396c6b2276d924f8a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
W20260619 06:30:03.143111 7796 consensus_peers.cc:487] T 8e2da70288694680bec48ac95c14656f P 996381a7495d4720a6f6be44a1d4781b -> Peer 50e96b0fdd674f4396c6b2276d924f8a (127.7.96.4:42379): Couldn't send request to peer 50e96b0fdd674f4396c6b2276d924f8a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
W20260619 06:30:03.143719 7926 consensus_peers.cc:487] T 98eb40b379a24876b6334fff708de671 P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer 50e96b0fdd674f4396c6b2276d924f8a (127.7.96.4:42379): Couldn't send request to peer 50e96b0fdd674f4396c6b2276d924f8a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
I20260619 06:30:03.192613 7552 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu pid 7781
I20260619 06:30:03.196977 7903 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:30:03.232091 8746 log.cc:824] T 8e2da70288694680bec48ac95c14656f P 50e96b0fdd674f4396c6b2276d924f8a: Log is configured to *not* fsync() on all Append() calls
W20260619 06:30:03.324605 7929 consensus_peers.cc:487] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260619 06:30:03.396610 8718 raft_consensus.cc:482] T 08686b31ffd64266bcdbd6f5eb29a87d P 3fc4e58423894a27a7b94de5c6013cf1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 996381a7495d4720a6f6be44a1d4781b)
I20260619 06:30:03.396770 8718 raft_consensus.cc:504] T 08686b31ffd64266bcdbd6f5eb29a87d P 3fc4e58423894a27a7b94de5c6013cf1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 1865 OBSOLETE_local: false peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } } peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "50e96b0fdd674f4396c6b2276d924f8a" member_type: NON_VOTER last_known_addr { host: "127.7.96.4" port: 42379 } attrs { promote: true } }
I20260619 06:30:03.397317 8718 leader_election.cc:288] T 08686b31ffd64266bcdbd6f5eb29a87d P 3fc4e58423894a27a7b94de5c6013cf1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323), 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063)
W20260619 06:30:03.399019 7929 leader_election.cc:334] T 08686b31ffd64266bcdbd6f5eb29a87d P 3fc4e58423894a27a7b94de5c6013cf1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111)
W20260619 06:30:03.418650 7929 consensus_peers.cc:487] T 98eb40b379a24876b6334fff708de671 P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260619 06:30:03.442929 8718 raft_consensus.cc:482] T f5c2224f852746c8893931fd3ff27126 P 3fc4e58423894a27a7b94de5c6013cf1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 996381a7495d4720a6f6be44a1d4781b)
I20260619 06:30:03.443130 8718 raft_consensus.cc:504] T f5c2224f852746c8893931fd3ff27126 P 3fc4e58423894a27a7b94de5c6013cf1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 1865 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } } peers { permanent_uuid: "50e96b0fdd674f4396c6b2276d924f8a" member_type: NON_VOTER last_known_addr { host: "127.7.96.4" port: 42379 } attrs { promote: true } }
I20260619 06:30:03.443773 8718 leader_election.cc:288] T f5c2224f852746c8893931fd3ff27126 P 3fc4e58423894a27a7b94de5c6013cf1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323), 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063)
W20260619 06:30:03.445752 7929 leader_election.cc:334] T f5c2224f852746c8893931fd3ff27126 P 3fc4e58423894a27a7b94de5c6013cf1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111)
I20260619 06:30:03.473980 8718 raft_consensus.cc:482] T 8e2da70288694680bec48ac95c14656f P 3fc4e58423894a27a7b94de5c6013cf1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 996381a7495d4720a6f6be44a1d4781b)
I20260619 06:30:03.474170 8718 raft_consensus.cc:504] T 8e2da70288694680bec48ac95c14656f P 3fc4e58423894a27a7b94de5c6013cf1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 1865 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } } peers { permanent_uuid: "50e96b0fdd674f4396c6b2276d924f8a" member_type: NON_VOTER last_known_addr { host: "127.7.96.4" port: 42379 } attrs { promote: true } }
I20260619 06:30:03.474929 8718 leader_election.cc:288] T 8e2da70288694680bec48ac95c14656f P 3fc4e58423894a27a7b94de5c6013cf1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323), 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063)
W20260619 06:30:03.476567 7929 leader_election.cc:334] T 8e2da70288694680bec48ac95c14656f P 3fc4e58423894a27a7b94de5c6013cf1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111)
W20260619 06:30:03.490728 7926 consensus_peers.cc:487] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer 50e96b0fdd674f4396c6b2276d924f8a (127.7.96.4:42379): Couldn't send request to peer 50e96b0fdd674f4396c6b2276d924f8a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 16: this message will repeat every 5th retry.
W20260619 06:30:03.515461 7929 consensus_peers.cc:487] T 6cffdcc0e99c47aead56bbaea58d3e4d P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260619 06:30:03.601351 7926 consensus_peers.cc:487] T 6cffdcc0e99c47aead56bbaea58d3e4d P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer 50e96b0fdd674f4396c6b2276d924f8a (127.7.96.4:42379): Couldn't send request to peer 50e96b0fdd674f4396c6b2276d924f8a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 16: this message will repeat every 5th retry.
W20260619 06:30:03.605249 7926 consensus_peers.cc:487] T 98eb40b379a24876b6334fff708de671 P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer 50e96b0fdd674f4396c6b2276d924f8a (127.7.96.4:42379): Couldn't send request to peer 50e96b0fdd674f4396c6b2276d924f8a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 16: this message will repeat every 5th retry.
I20260619 06:30:03.772389 8684 raft_consensus.cc:482] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 996381a7495d4720a6f6be44a1d4781b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3fc4e58423894a27a7b94de5c6013cf1)
I20260619 06:30:03.772588 8684 raft_consensus.cc:504] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 996381a7495d4720a6f6be44a1d4781b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 1858 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } } peers { permanent_uuid: "50e96b0fdd674f4396c6b2276d924f8a" member_type: NON_VOTER last_known_addr { host: "127.7.96.4" port: 42379 } attrs { promote: true } }
I20260619 06:30:03.773193 8684 leader_election.cc:288] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 996381a7495d4720a6f6be44a1d4781b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323), 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499)
I20260619 06:30:03.784371 7989 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3e5e97eabdf42cf8e46ccb4b61c5fb7" candidate_uuid: "996381a7495d4720a6f6be44a1d4781b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1869 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1" is_pre_election: true
W20260619 06:30:03.792776 7796 consensus_peers.cc:487] T 08686b31ffd64266bcdbd6f5eb29a87d P 996381a7495d4720a6f6be44a1d4781b -> Peer 50e96b0fdd674f4396c6b2276d924f8a (127.7.96.4:42379): Couldn't send request to peer 50e96b0fdd674f4396c6b2276d924f8a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
I20260619 06:30:03.840938 8768 raft_consensus.cc:482] T 6cffdcc0e99c47aead56bbaea58d3e4d P 996381a7495d4720a6f6be44a1d4781b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3fc4e58423894a27a7b94de5c6013cf1)
I20260619 06:30:03.841115 8768 raft_consensus.cc:504] T 6cffdcc0e99c47aead56bbaea58d3e4d P 996381a7495d4720a6f6be44a1d4781b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 1856 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } } peers { permanent_uuid: "50e96b0fdd674f4396c6b2276d924f8a" member_type: NON_VOTER last_known_addr { host: "127.7.96.4" port: 42379 } attrs { promote: true } }
I20260619 06:30:03.841718 8768 leader_election.cc:288] T 6cffdcc0e99c47aead56bbaea58d3e4d P 996381a7495d4720a6f6be44a1d4781b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323), 3fc4e58423894a27a7b94de5c6013cf1 (127.7.96.3:37499)
I20260619 06:30:03.843084 7989 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cffdcc0e99c47aead56bbaea58d3e4d" candidate_uuid: "996381a7495d4720a6f6be44a1d4781b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1868 } } ignore_live_leader: false dest_uuid: "3fc4e58423894a27a7b94de5c6013cf1" is_pre_election: true
I20260619 06:30:03.850721 8771 raft_consensus.cc:482] T 98eb40b379a24876b6334fff708de671 P 996381a7495d4720a6f6be44a1d4781b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3fc4e58423894a27a7b94de5c6013cf1)
I20260619 06:30:03.850955 7552 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu with pid 7781
I20260619 06:30:03.887293 8718 consensus_queue.cc:579] T 6cffdcc0e99c47aead56bbaea58d3e4d P 3fc4e58423894a27a7b94de5c6013cf1 [LEADER]: Leader has been unable to successfully communicate with peer b46f2dae92104884b86705d6bbc20003 for more than 2 seconds (2.002s)
W20260619 06:30:03.887745 7929 consensus_peers.cc:487] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260619 06:30:03.900836 8718 consensus_queue.cc:579] T 98eb40b379a24876b6334fff708de671 P 3fc4e58423894a27a7b94de5c6013cf1 [LEADER]: Leader has been unable to successfully communicate with peer b46f2dae92104884b86705d6bbc20003 for more than 2 seconds (2.014s)
W20260619 06:30:03.902797 7929 consensus_peers.cc:487] T 98eb40b379a24876b6334fff708de671 P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323): Couldn't send request to peer b46f2dae92104884b86705d6bbc20003. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.1:33323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260619 06:30:03.963227 7926 connection.cc:535] client connection to 127.7.96.2:37063 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260619 06:30:03.963408 7926 leader_election.cc:334] T 8e2da70288694680bec48ac95c14656f P 3fc4e58423894a27a7b94de5c6013cf1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063): Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260619 06:30:03.963543 7926 leader_election.cc:302] T 8e2da70288694680bec48ac95c14656f P 3fc4e58423894a27a7b94de5c6013cf1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3fc4e58423894a27a7b94de5c6013cf1; no voters: 996381a7495d4720a6f6be44a1d4781b, b46f2dae92104884b86705d6bbc20003
I20260619 06:30:03.963828 8774 raft_consensus.cc:2726] T 8e2da70288694680bec48ac95c14656f P 3fc4e58423894a27a7b94de5c6013cf1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260619 06:30:03.963943 7926 leader_election.cc:334] T f5c2224f852746c8893931fd3ff27126 P 3fc4e58423894a27a7b94de5c6013cf1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063): Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260619 06:30:03.964056 7926 leader_election.cc:302] T f5c2224f852746c8893931fd3ff27126 P 3fc4e58423894a27a7b94de5c6013cf1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3fc4e58423894a27a7b94de5c6013cf1; no voters: 996381a7495d4720a6f6be44a1d4781b, b46f2dae92104884b86705d6bbc20003
I20260619 06:30:03.964205 7552 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu pid 7911
W20260619 06:30:03.964303 7926 leader_election.cc:334] T 08686b31ffd64266bcdbd6f5eb29a87d P 3fc4e58423894a27a7b94de5c6013cf1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063): Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260619 06:30:03.964392 7926 leader_election.cc:302] T 08686b31ffd64266bcdbd6f5eb29a87d P 3fc4e58423894a27a7b94de5c6013cf1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3fc4e58423894a27a7b94de5c6013cf1; no voters: 996381a7495d4720a6f6be44a1d4781b, b46f2dae92104884b86705d6bbc20003
W20260619 06:30:03.964653 7926 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107) [suppressed 157 similar messages]
I20260619 06:30:03.965770 8773 raft_consensus.cc:2726] T 08686b31ffd64266bcdbd6f5eb29a87d P 3fc4e58423894a27a7b94de5c6013cf1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 06:30:03.966122 8033 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:30:03.964648 8774 raft_consensus.cc:2726] T f5c2224f852746c8893931fd3ff27126 P 3fc4e58423894a27a7b94de5c6013cf1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 06:30:04.469480 8718 raft_consensus.cc:482] T 8e2da70288694680bec48ac95c14656f P 3fc4e58423894a27a7b94de5c6013cf1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 996381a7495d4720a6f6be44a1d4781b)
I20260619 06:30:04.470360 8718 raft_consensus.cc:504] T 8e2da70288694680bec48ac95c14656f P 3fc4e58423894a27a7b94de5c6013cf1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 1865 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } } peers { permanent_uuid: "50e96b0fdd674f4396c6b2276d924f8a" member_type: NON_VOTER last_known_addr { host: "127.7.96.4" port: 42379 } attrs { promote: true } }
I20260619 06:30:04.471243 8718 leader_election.cc:288] T 8e2da70288694680bec48ac95c14656f P 3fc4e58423894a27a7b94de5c6013cf1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323), 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063)
I20260619 06:30:04.469841 8773 raft_consensus.cc:482] T 08686b31ffd64266bcdbd6f5eb29a87d P 3fc4e58423894a27a7b94de5c6013cf1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 996381a7495d4720a6f6be44a1d4781b)
I20260619 06:30:04.471524 8773 raft_consensus.cc:504] T 08686b31ffd64266bcdbd6f5eb29a87d P 3fc4e58423894a27a7b94de5c6013cf1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 1865 OBSOLETE_local: false peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } } peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "50e96b0fdd674f4396c6b2276d924f8a" member_type: NON_VOTER last_known_addr { host: "127.7.96.4" port: 42379 } attrs { promote: true } }
I20260619 06:30:04.472025 8773 leader_election.cc:288] T 08686b31ffd64266bcdbd6f5eb29a87d P 3fc4e58423894a27a7b94de5c6013cf1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323), 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063)
I20260619 06:30:04.470579 8774 raft_consensus.cc:482] T f5c2224f852746c8893931fd3ff27126 P 3fc4e58423894a27a7b94de5c6013cf1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 996381a7495d4720a6f6be44a1d4781b)
I20260619 06:30:04.472287 8774 raft_consensus.cc:504] T f5c2224f852746c8893931fd3ff27126 P 3fc4e58423894a27a7b94de5c6013cf1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 1865 OBSOLETE_local: false peers { permanent_uuid: "b46f2dae92104884b86705d6bbc20003" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 33323 } } peers { permanent_uuid: "996381a7495d4720a6f6be44a1d4781b" member_type: VOTER last_known_addr { host: "127.7.96.2" port: 37063 } } peers { permanent_uuid: "3fc4e58423894a27a7b94de5c6013cf1" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 37499 } } peers { permanent_uuid: "50e96b0fdd674f4396c6b2276d924f8a" member_type: NON_VOTER last_known_addr { host: "127.7.96.4" port: 42379 } attrs { promote: true } }
I20260619 06:30:04.472802 8774 leader_election.cc:288] T f5c2224f852746c8893931fd3ff27126 P 3fc4e58423894a27a7b94de5c6013cf1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b46f2dae92104884b86705d6bbc20003 (127.7.96.1:33323), 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063)
W20260619 06:30:04.487334 7926 consensus_peers.cc:487] T e3e5e97eabdf42cf8e46ccb4b61c5fb7 P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063): Couldn't send request to peer 996381a7495d4720a6f6be44a1d4781b. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.2:37063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260619 06:30:04.490721 7926 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.96.2:37063, user_credentials={real_user=slave}} blocked reactor thread for 520699us
W20260619 06:30:04.492221 7926 consensus_peers.cc:487] T 98eb40b379a24876b6334fff708de671 P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063): Couldn't send request to peer 996381a7495d4720a6f6be44a1d4781b. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.2:37063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260619 06:30:04.492693 7926 consensus_peers.cc:487] T 6cffdcc0e99c47aead56bbaea58d3e4d P 3fc4e58423894a27a7b94de5c6013cf1 -> Peer 996381a7495d4720a6f6be44a1d4781b (127.7.96.2:37063): Couldn't send request to peer 996381a7495d4720a6f6be44a1d4781b. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.2:37063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260619 06:30:04.512187 7552 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu with pid 7911
W20260619 06:30:04.603473 8173 connection.cc:535] server connection from 127.7.96.3:46875 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260619 06:30:04.604112 7552 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu pid 8126
I20260619 06:30:04.605206 8285 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:30:04.803362 7552 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu with pid 8126
I20260619 06:30:04.833685 7552 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu pid 8325
I20260619 06:30:04.834893 8394 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:30:04.942170 7552 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu with pid 8325
2026-06-19T06:30:04Z chronyd exiting
[ OK ] MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate (39860 ms)
[----------] 1 test from MaintenanceModeRF3ITest (39860 ms total)
[----------] 1 test from RollingRestartArgs/RollingRestartITest
[ RUN ] RollingRestartArgs/RollingRestartITest.TestWorkloads/4
2026-06-19T06:30:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T06:30:05Z Disabled control of system clock
I20260619 06:30:05.034879 7552 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu
/tmp/dist-test-taskFG9pG8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.96.62:44861
--webserver_interface=127.7.96.62
--webserver_port=0
--builtin_ntp_servers=127.7.96.20:37673
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.96.62:44861
--location_mapping_cmd=/tmp/dist-test-taskFG9pG8/build/asan/bin/testdata/assign-location.py --state_store=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/location-assignment.state --map /L0:4
--master_client_location_assignment_enabled=false with env {}
W20260619 06:30:05.360432 8786 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:30:05.360761 8786 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:30:05.360916 8786 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:30:05.367986 8786 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 06:30:05.368124 8786 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:30:05.368217 8786 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 06:30:05.368321 8786 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 06:30:05.377300 8786 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.96.20:37673
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/master-0/wal
--location_mapping_cmd=/tmp/dist-test-taskFG9pG8/build/asan/bin/testdata/assign-location.py --state_store=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/location-assignment.state --map /L0:4
--ipki_ca_key_size=768
--master_addresses=127.7.96.62:44861
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.96.62:44861
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.96.62
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:40:48 UTC on ccycloud.quasar-zrzaui.root.comops.site
build id 4455154
ASAN enabled
I20260619 06:30:05.378616 8786 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:30:05.380419 8786 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:30:05.392992 8792 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:30:05.393033 8791 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:30:05.393033 8786 server_base.cc:1034] running on GCE node
W20260619 06:30:05.393265 8794 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:30:05.394209 8786 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:30:05.395558 8786 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:30:05.396804 8786 hybrid_clock.cc:648] HybridClock initialized: now 1781850605396743 us; error 39 us; skew 500 ppm
I20260619 06:30:05.397125 8786 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 06:30:05.399529 8786 webserver.cc:460] Webserver started at http://127.7.96.62:43699/ using document root <none> and password file <none>
I20260619 06:30:05.400190 8786 fs_manager.cc:359] Metadata directory not provided
I20260619 06:30:05.400334 8786 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:30:05.400691 8786 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:30:05.403350 8786 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/master-0/data/instance:
uuid: "991b158a165f4bf090245721ca9767b3"
format_stamp: "Formatted at 2026-06-19 06:30:05 on dist-test-slave-cvm7"
I20260619 06:30:05.404129 8786 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/master-0/wal/instance:
uuid: "991b158a165f4bf090245721ca9767b3"
format_stamp: "Formatted at 2026-06-19 06:30:05 on dist-test-slave-cvm7"
I20260619 06:30:05.409073 8786 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260619 06:30:05.412333 8800 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:30:05.413585 8786 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260619 06:30:05.413760 8786 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/master-0/data,/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/master-0/wal
uuid: "991b158a165f4bf090245721ca9767b3"
format_stamp: "Formatted at 2026-06-19 06:30:05 on dist-test-slave-cvm7"
I20260619 06:30:05.413968 8786 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:30:05.425935 8786 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:30:05.426843 8786 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:30:05.427141 8786 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:30:05.444986 8786 rpc_server.cc:307] RPC server started. Bound to: 127.7.96.62:44861
I20260619 06:30:05.445016 8851 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.96.62:44861 every 8 connection(s)
I20260619 06:30:05.446261 8786 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/master-0/data/info.pb
I20260619 06:30:05.447660 7552 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu as pid 8786
I20260619 06:30:05.447877 7552 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/master-0/wal/instance
I20260619 06:30:05.450958 8852 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:30:05.462920 8852 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 991b158a165f4bf090245721ca9767b3: Bootstrap starting.
I20260619 06:30:05.465731 8852 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 991b158a165f4bf090245721ca9767b3: Neither blocks nor log segments found. Creating new log.
I20260619 06:30:05.466812 8852 log.cc:824] T 00000000000000000000000000000000 P 991b158a165f4bf090245721ca9767b3: Log is configured to *not* fsync() on all Append() calls
I20260619 06:30:05.469372 8852 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 991b158a165f4bf090245721ca9767b3: No bootstrap required, opened a new log
I20260619 06:30:05.476468 8852 raft_consensus.cc:348] T 00000000000000000000000000000000 P 991b158a165f4bf090245721ca9767b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "991b158a165f4bf090245721ca9767b3" member_type: VOTER last_known_addr { host: "127.7.96.62" port: 44861 } }
I20260619 06:30:05.476827 8852 raft_consensus.cc:374] T 00000000000000000000000000000000 P 991b158a165f4bf090245721ca9767b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:30:05.476934 8852 raft_consensus.cc:729] T 00000000000000000000000000000000 P 991b158a165f4bf090245721ca9767b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 991b158a165f4bf090245721ca9767b3, State: Initialized, Role: FOLLOWER
I20260619 06:30:05.477460 8852 consensus_queue.cc:260] T 00000000000000000000000000000000 P 991b158a165f4bf090245721ca9767b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "991b158a165f4bf090245721ca9767b3" member_type: VOTER last_known_addr { host: "127.7.96.62" port: 44861 } }
I20260619 06:30:05.477695 8852 raft_consensus.cc:388] T 00000000000000000000000000000000 P 991b158a165f4bf090245721ca9767b3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 06:30:05.477838 8852 raft_consensus.cc:482] T 00000000000000000000000000000000 P 991b158a165f4bf090245721ca9767b3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 06:30:05.478000 8852 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 991b158a165f4bf090245721ca9767b3 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:30:05.480122 8852 raft_consensus.cc:504] T 00000000000000000000000000000000 P 991b158a165f4bf090245721ca9767b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "991b158a165f4bf090245721ca9767b3" member_type: VOTER last_known_addr { host: "127.7.96.62" port: 44861 } }
I20260619 06:30:05.480715 8852 leader_election.cc:302] T 00000000000000000000000000000000 P 991b158a165f4bf090245721ca9767b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 991b158a165f4bf090245721ca9767b3; no voters:
I20260619 06:30:05.481262 8852 leader_election.cc:288] T 00000000000000000000000000000000 P 991b158a165f4bf090245721ca9767b3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 06:30:05.481384 8857 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 991b158a165f4bf090245721ca9767b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:30:05.482064 8857 raft_consensus.cc:686] T 00000000000000000000000000000000 P 991b158a165f4bf090245721ca9767b3 [term 1 LEADER]: Becoming Leader. State: Replica: 991b158a165f4bf090245721ca9767b3, State: Running, Role: LEADER
I20260619 06:30:05.482723 8857 consensus_queue.cc:237] T 00000000000000000000000000000000 P 991b158a165f4bf090245721ca9767b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "991b158a165f4bf090245721ca9767b3" member_type: VOTER last_known_addr { host: "127.7.96.62" port: 44861 } }
I20260619 06:30:05.483228 8852 sys_catalog.cc:564] T 00000000000000000000000000000000 P 991b158a165f4bf090245721ca9767b3 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 06:30:05.485332 8858 sys_catalog.cc:455] T 00000000000000000000000000000000 P 991b158a165f4bf090245721ca9767b3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "991b158a165f4bf090245721ca9767b3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "991b158a165f4bf090245721ca9767b3" member_type: VOTER last_known_addr { host: "127.7.96.62" port: 44861 } } }
I20260619 06:30:05.485742 8858 sys_catalog.cc:458] T 00000000000000000000000000000000 P 991b158a165f4bf090245721ca9767b3 [sys.catalog]: This master's current role is: LEADER
I20260619 06:30:05.486625 8859 sys_catalog.cc:455] T 00000000000000000000000000000000 P 991b158a165f4bf090245721ca9767b3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 991b158a165f4bf090245721ca9767b3. Latest consensus state: current_term: 1 leader_uuid: "991b158a165f4bf090245721ca9767b3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "991b158a165f4bf090245721ca9767b3" member_type: VOTER last_known_addr { host: "127.7.96.62" port: 44861 } } }
I20260619 06:30:05.486940 8859 sys_catalog.cc:458] T 00000000000000000000000000000000 P 991b158a165f4bf090245721ca9767b3 [sys.catalog]: This master's current role is: LEADER
I20260619 06:30:05.487885 8866 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 06:30:05.492720 8866 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 06:30:05.500550 8866 catalog_manager.cc:1347] Generated new cluster ID: 5e06e53e7105476689bf31fc67ce0d9e
I20260619 06:30:05.500717 8866 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 06:30:05.518793 8866 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 06:30:05.520030 8866 catalog_manager.cc:1504] Loading token signing keys...
I20260619 06:30:05.525688 8866 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 991b158a165f4bf090245721ca9767b3: Generated new TSK 0
I20260619 06:30:05.526644 8866 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 06:30:05.539373 7552 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu
/tmp/dist-test-taskFG9pG8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.96.1:0
--local_ip_for_outbound_sockets=127.7.96.1
--webserver_interface=127.7.96.1
--webserver_port=0
--tserver_master_addrs=127.7.96.62:44861
--builtin_ntp_servers=127.7.96.20:37673
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
W20260619 06:30:05.863022 8876 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:30:05.863279 8876 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:30:05.863363 8876 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:30:05.870208 8876 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:30:05.870363 8876 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.96.1
I20260619 06:30:05.879057 8876 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.96.20:37673
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.96.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.96.1
--webserver_port=0
--tserver_master_addrs=127.7.96.62:44861
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.96.1
--log_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:40:48 UTC on ccycloud.quasar-zrzaui.root.comops.site
build id 4455154
ASAN enabled
I20260619 06:30:05.880227 8876 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:30:05.881819 8876 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:30:05.894794 8881 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:30:05.894840 8882 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:30:05.895030 8884 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:30:05.895656 8876 server_base.cc:1034] running on GCE node
I20260619 06:30:05.896211 8876 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:30:05.896975 8876 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:30:05.898175 8876 hybrid_clock.cc:648] HybridClock initialized: now 1781850605898105 us; error 49 us; skew 500 ppm
I20260619 06:30:05.898401 8876 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 06:30:05.900693 8876 webserver.cc:460] Webserver started at http://127.7.96.1:36055/ using document root <none> and password file <none>
I20260619 06:30:05.901291 8876 fs_manager.cc:359] Metadata directory not provided
I20260619 06:30:05.901381 8876 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:30:05.901628 8876 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:30:05.904064 8876 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-0/data/instance:
uuid: "c96ab909d8164eda8f3ebd210d06fbd7"
format_stamp: "Formatted at 2026-06-19 06:30:05 on dist-test-slave-cvm7"
I20260619 06:30:05.904747 8876 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-0/wal/instance:
uuid: "c96ab909d8164eda8f3ebd210d06fbd7"
format_stamp: "Formatted at 2026-06-19 06:30:05 on dist-test-slave-cvm7"
I20260619 06:30:05.909397 8876 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260619 06:30:05.912521 8890 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:30:05.913735 8876 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260619 06:30:05.913903 8876 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-0/data,/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-0/wal
uuid: "c96ab909d8164eda8f3ebd210d06fbd7"
format_stamp: "Formatted at 2026-06-19 06:30:05 on dist-test-slave-cvm7"
I20260619 06:30:05.914079 8876 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:30:05.956934 8876 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:30:05.957780 8876 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:30:05.958066 8876 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:30:05.959045 8876 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:30:05.960511 8876 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:30:05.960621 8876 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:30:05.960767 8876 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:30:05.960845 8876 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:30:05.993285 8876 rpc_server.cc:307] RPC server started. Bound to: 127.7.96.1:38305
I20260619 06:30:05.993320 9002 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.96.1:38305 every 8 connection(s)
I20260619 06:30:05.994659 8876 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-0/data/info.pb
I20260619 06:30:06.001504 7552 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu as pid 8876
I20260619 06:30:06.001699 7552 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-0/wal/instance
I20260619 06:30:06.004794 7552 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu
/tmp/dist-test-taskFG9pG8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.96.2:0
--local_ip_for_outbound_sockets=127.7.96.2
--webserver_interface=127.7.96.2
--webserver_port=0
--tserver_master_addrs=127.7.96.62:44861
--builtin_ntp_servers=127.7.96.20:37673
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
I20260619 06:30:06.008378 9003 heartbeater.cc:347] Connected to a master server at 127.7.96.62:44861
I20260619 06:30:06.008670 9003 heartbeater.cc:464] Registering TS with master...
I20260619 06:30:06.009367 9003 heartbeater.cc:511] Master 127.7.96.62:44861 requested a full tablet report, sending...
I20260619 06:30:06.054711 8817 ts_manager.cc:194] Registered new tserver with Master: c96ab909d8164eda8f3ebd210d06fbd7 (127.7.96.1:38305)
I20260619 06:30:06.056367 8817 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.96.1:45057
W20260619 06:30:06.325778 9007 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:30:06.326033 9007 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:30:06.326114 9007 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:30:06.333212 9007 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:30:06.333424 9007 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.96.2
I20260619 06:30:06.342190 9007 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.96.20:37673
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.96.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.96.2
--webserver_port=0
--tserver_master_addrs=127.7.96.62:44861
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.96.2
--log_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:40:48 UTC on ccycloud.quasar-zrzaui.root.comops.site
build id 4455154
ASAN enabled
I20260619 06:30:06.343456 9007 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:30:06.345148 9007 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:30:06.358399 9013 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:30:06.358429 9014 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:30:06.358362 9016 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:30:06.359263 9007 server_base.cc:1034] running on GCE node
I20260619 06:30:06.359815 9007 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:30:06.360646 9007 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:30:06.361856 9007 hybrid_clock.cc:648] HybridClock initialized: now 1781850606361801 us; error 30 us; skew 500 ppm
I20260619 06:30:06.362149 9007 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 06:30:06.364341 9007 webserver.cc:460] Webserver started at http://127.7.96.2:43635/ using document root <none> and password file <none>
I20260619 06:30:06.364989 9007 fs_manager.cc:359] Metadata directory not provided
I20260619 06:30:06.365125 9007 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:30:06.365413 9007 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:30:06.367975 9007 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-1/data/instance:
uuid: "65f402c7f0df45d09e231eab81183eb6"
format_stamp: "Formatted at 2026-06-19 06:30:06 on dist-test-slave-cvm7"
I20260619 06:30:06.368695 9007 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-1/wal/instance:
uuid: "65f402c7f0df45d09e231eab81183eb6"
format_stamp: "Formatted at 2026-06-19 06:30:06 on dist-test-slave-cvm7"
I20260619 06:30:06.373536 9007 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260619 06:30:06.376662 9022 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:30:06.377951 9007 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260619 06:30:06.378118 9007 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-1/data,/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-1/wal
uuid: "65f402c7f0df45d09e231eab81183eb6"
format_stamp: "Formatted at 2026-06-19 06:30:06 on dist-test-slave-cvm7"
I20260619 06:30:06.378289 9007 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:30:06.409016 9007 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:30:06.409858 9007 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:30:06.410162 9007 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:30:06.411124 9007 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:30:06.412546 9007 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:30:06.412648 9007 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:30:06.412803 9007 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:30:06.412889 9007 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:30:06.444718 9007 rpc_server.cc:307] RPC server started. Bound to: 127.7.96.2:33625
I20260619 06:30:06.444746 9134 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.96.2:33625 every 8 connection(s)
I20260619 06:30:06.446147 9007 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-1/data/info.pb
I20260619 06:30:06.448983 7552 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu as pid 9007
I20260619 06:30:06.449174 7552 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-1/wal/instance
I20260619 06:30:06.452648 7552 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu
/tmp/dist-test-taskFG9pG8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.96.3:0
--local_ip_for_outbound_sockets=127.7.96.3
--webserver_interface=127.7.96.3
--webserver_port=0
--tserver_master_addrs=127.7.96.62:44861
--builtin_ntp_servers=127.7.96.20:37673
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
I20260619 06:30:06.460201 9135 heartbeater.cc:347] Connected to a master server at 127.7.96.62:44861
I20260619 06:30:06.460505 9135 heartbeater.cc:464] Registering TS with master...
I20260619 06:30:06.461186 9135 heartbeater.cc:511] Master 127.7.96.62:44861 requested a full tablet report, sending...
I20260619 06:30:06.523736 8817 ts_manager.cc:194] Registered new tserver with Master: 65f402c7f0df45d09e231eab81183eb6 (127.7.96.2:33625)
I20260619 06:30:06.524700 8817 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.96.2:55841
W20260619 06:30:06.795238 9138 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:30:06.795492 9138 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:30:06.795640 9138 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:30:06.802788 9138 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:30:06.802994 9138 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.96.3
I20260619 06:30:06.811915 9138 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.96.20:37673
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.96.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.96.3
--webserver_port=0
--tserver_master_addrs=127.7.96.62:44861
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.96.3
--log_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:40:48 UTC on ccycloud.quasar-zrzaui.root.comops.site
build id 4455154
ASAN enabled
I20260619 06:30:06.813202 9138 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:30:06.815012 9138 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:30:06.828052 9144 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:30:06.828023 9147 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:30:06.828137 9145 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:30:06.828848 9138 server_base.cc:1034] running on GCE node
I20260619 06:30:06.829423 9138 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:30:06.830263 9138 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:30:06.831521 9138 hybrid_clock.cc:648] HybridClock initialized: now 1781850606831429 us; error 59 us; skew 500 ppm
I20260619 06:30:06.831840 9138 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 06:30:06.834142 9138 webserver.cc:460] Webserver started at http://127.7.96.3:42369/ using document root <none> and password file <none>
I20260619 06:30:06.834933 9138 fs_manager.cc:359] Metadata directory not provided
I20260619 06:30:06.835071 9138 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:30:06.835382 9138 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:30:06.838022 9138 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-2/data/instance:
uuid: "febe077b7c1645e1b8d47ba28c8f3832"
format_stamp: "Formatted at 2026-06-19 06:30:06 on dist-test-slave-cvm7"
I20260619 06:30:06.838896 9138 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-2/wal/instance:
uuid: "febe077b7c1645e1b8d47ba28c8f3832"
format_stamp: "Formatted at 2026-06-19 06:30:06 on dist-test-slave-cvm7"
I20260619 06:30:06.844072 9138 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.002s
I20260619 06:30:06.847509 9153 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:30:06.848879 9138 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260619 06:30:06.849061 9138 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-2/data,/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-2/wal
uuid: "febe077b7c1645e1b8d47ba28c8f3832"
format_stamp: "Formatted at 2026-06-19 06:30:06 on dist-test-slave-cvm7"
I20260619 06:30:06.849277 9138 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:30:06.872095 9138 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:30:06.872942 9138 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:30:06.873262 9138 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:30:06.874199 9138 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:30:06.875779 9138 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:30:06.875906 9138 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:30:06.876099 9138 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:30:06.876176 9138 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:30:06.910265 9138 rpc_server.cc:307] RPC server started. Bound to: 127.7.96.3:35437
I20260619 06:30:06.910297 9265 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.96.3:35437 every 8 connection(s)
I20260619 06:30:06.911612 9138 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-2/data/info.pb
I20260619 06:30:06.919632 7552 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu as pid 9138
I20260619 06:30:06.919819 7552 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-2/wal/instance
I20260619 06:30:06.923175 7552 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu
/tmp/dist-test-taskFG9pG8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.96.4:0
--local_ip_for_outbound_sockets=127.7.96.4
--webserver_interface=127.7.96.4
--webserver_port=0
--tserver_master_addrs=127.7.96.62:44861
--builtin_ntp_servers=127.7.96.20:37673
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
I20260619 06:30:06.925321 9266 heartbeater.cc:347] Connected to a master server at 127.7.96.62:44861
I20260619 06:30:06.925611 9266 heartbeater.cc:464] Registering TS with master...
I20260619 06:30:06.926318 9266 heartbeater.cc:511] Master 127.7.96.62:44861 requested a full tablet report, sending...
I20260619 06:30:06.970110 8817 ts_manager.cc:194] Registered new tserver with Master: febe077b7c1645e1b8d47ba28c8f3832 (127.7.96.3:35437)
I20260619 06:30:06.971139 8817 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.96.3:60307
I20260619 06:30:07.059573 9003 heartbeater.cc:503] Master 127.7.96.62:44861 was elected leader, sending a full tablet report...
W20260619 06:30:07.249532 9269 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:30:07.249792 9269 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:30:07.249877 9269 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:30:07.257125 9269 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:30:07.257282 9269 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.96.4
I20260619 06:30:07.265910 9269 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.96.20:37673
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.96.4:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-3/data/info.pb
--webserver_interface=127.7.96.4
--webserver_port=0
--tserver_master_addrs=127.7.96.62:44861
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.96.4
--log_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-3/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:40:48 UTC on ccycloud.quasar-zrzaui.root.comops.site
build id 4455154
ASAN enabled
I20260619 06:30:07.267220 9269 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:30:07.268884 9269 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:30:07.281953 9275 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:30:07.281853 9276 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:30:07.282078 9278 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:30:07.283196 9269 server_base.cc:1034] running on GCE node
I20260619 06:30:07.283808 9269 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:30:07.284787 9269 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:30:07.285988 9269 hybrid_clock.cc:648] HybridClock initialized: now 1781850607285930 us; error 31 us; skew 500 ppm
I20260619 06:30:07.286319 9269 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 06:30:07.291734 9269 webserver.cc:460] Webserver started at http://127.7.96.4:34311/ using document root <none> and password file <none>
I20260619 06:30:07.292532 9269 fs_manager.cc:359] Metadata directory not provided
I20260619 06:30:07.292639 9269 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:30:07.292898 9269 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:30:07.295451 9269 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-3/data/instance:
uuid: "b9391b0d0d0143fb8708b0fba4aec26d"
format_stamp: "Formatted at 2026-06-19 06:30:07 on dist-test-slave-cvm7"
I20260619 06:30:07.296141 9269 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-3/wal/instance:
uuid: "b9391b0d0d0143fb8708b0fba4aec26d"
format_stamp: "Formatted at 2026-06-19 06:30:07 on dist-test-slave-cvm7"
I20260619 06:30:07.300930 9269 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260619 06:30:07.304104 9284 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:30:07.305377 9269 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260619 06:30:07.305507 9269 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-3/data,/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-3/wal
uuid: "b9391b0d0d0143fb8708b0fba4aec26d"
format_stamp: "Formatted at 2026-06-19 06:30:07 on dist-test-slave-cvm7"
I20260619 06:30:07.305673 9269 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-3/wal
metadata directory: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-3/wal
1 data directories: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:30:07.320919 9269 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:30:07.321600 9269 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:30:07.321820 9269 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:30:07.322631 9269 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:30:07.324033 9269 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:30:07.324103 9269 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:30:07.324185 9269 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:30:07.324229 9269 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:30:07.357293 9269 rpc_server.cc:307] RPC server started. Bound to: 127.7.96.4:42679
I20260619 06:30:07.357331 9396 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.96.4:42679 every 8 connection(s)
I20260619 06:30:07.358593 9269 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-3/data/info.pb
I20260619 06:30:07.368568 7552 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu as pid 9269
I20260619 06:30:07.368754 7552 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-3/wal/instance
I20260619 06:30:07.371672 9397 heartbeater.cc:347] Connected to a master server at 127.7.96.62:44861
I20260619 06:30:07.372006 9397 heartbeater.cc:464] Registering TS with master...
I20260619 06:30:07.372783 9397 heartbeater.cc:511] Master 127.7.96.62:44861 requested a full tablet report, sending...
I20260619 06:30:07.417766 8817 ts_manager.cc:194] Registered new tserver with Master: b9391b0d0d0143fb8708b0fba4aec26d (127.7.96.4:42679)
I20260619 06:30:07.418927 8817 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.96.4:41739
I20260619 06:30:07.422276 7552 external_mini_cluster.cc:930] 4 TS(s) registered with all masters
I20260619 06:30:07.437577 7552 test_util.cc:268] Using random seed: 1820313311
I20260619 06:30:07.459537 8817 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47334:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 06:30:07.493789 9201 tablet_service.cc:1467] Processing CreateTablet for tablet f83defb033834a9a95a05a9e6182b3b8 (DEFAULT_TABLE table=test-workload [id=38bd77fca59c4b648c596ff19363c274]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:30:07.495311 9201 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f83defb033834a9a95a05a9e6182b3b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:30:07.502852 9332 tablet_service.cc:1467] Processing CreateTablet for tablet f83defb033834a9a95a05a9e6182b3b8 (DEFAULT_TABLE table=test-workload [id=38bd77fca59c4b648c596ff19363c274]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:30:07.503293 8938 tablet_service.cc:1467] Processing CreateTablet for tablet f83defb033834a9a95a05a9e6182b3b8 (DEFAULT_TABLE table=test-workload [id=38bd77fca59c4b648c596ff19363c274]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:30:07.504081 9332 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f83defb033834a9a95a05a9e6182b3b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:30:07.504473 8938 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f83defb033834a9a95a05a9e6182b3b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:30:07.510416 9421 tablet_bootstrap.cc:492] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832: Bootstrap starting.
I20260619 06:30:07.514428 9421 tablet_bootstrap.cc:654] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832: Neither blocks nor log segments found. Creating new log.
I20260619 06:30:07.515882 9421 log.cc:824] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832: Log is configured to *not* fsync() on all Append() calls
I20260619 06:30:07.519342 9423 tablet_bootstrap.cc:492] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d: Bootstrap starting.
I20260619 06:30:07.520131 9421 tablet_bootstrap.cc:492] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832: No bootstrap required, opened a new log
I20260619 06:30:07.520439 9421 ts_tablet_manager.cc:1397] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.006s
I20260619 06:30:07.523989 9423 tablet_bootstrap.cc:654] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d: Neither blocks nor log segments found. Creating new log.
I20260619 06:30:07.524945 9424 tablet_bootstrap.cc:492] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7: Bootstrap starting.
I20260619 06:30:07.525288 9423 log.cc:824] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d: Log is configured to *not* fsync() on all Append() calls
I20260619 06:30:07.527945 9135 heartbeater.cc:503] Master 127.7.96.62:44861 was elected leader, sending a full tablet report...
I20260619 06:30:07.527998 9423 tablet_bootstrap.cc:492] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d: No bootstrap required, opened a new log
I20260619 06:30:07.528285 9423 ts_tablet_manager.cc:1397] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260619 06:30:07.528878 9424 tablet_bootstrap.cc:654] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7: Neither blocks nor log segments found. Creating new log.
I20260619 06:30:07.530165 9424 log.cc:824] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7: Log is configured to *not* fsync() on all Append() calls
I20260619 06:30:07.531554 9421 raft_consensus.cc:348] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } }
I20260619 06:30:07.532015 9421 raft_consensus.cc:374] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:30:07.532130 9421 raft_consensus.cc:729] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: febe077b7c1645e1b8d47ba28c8f3832, State: Initialized, Role: FOLLOWER
I20260619 06:30:07.533238 9421 consensus_queue.cc:260] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } }
I20260619 06:30:07.533633 9424 tablet_bootstrap.cc:492] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7: No bootstrap required, opened a new log
I20260619 06:30:07.533962 9424 ts_tablet_manager.cc:1397] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260619 06:30:07.534368 9266 heartbeater.cc:503] Master 127.7.96.62:44861 was elected leader, sending a full tablet report...
I20260619 06:30:07.535178 9421 ts_tablet_manager.cc:1428] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832: Time spent starting tablet: real 0.015s user 0.013s sys 0.001s
I20260619 06:30:07.539875 9423 raft_consensus.cc:348] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } }
I20260619 06:30:07.540462 9423 raft_consensus.cc:374] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:30:07.540547 9423 raft_consensus.cc:729] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9391b0d0d0143fb8708b0fba4aec26d, State: Initialized, Role: FOLLOWER
I20260619 06:30:07.541157 9423 consensus_queue.cc:260] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } }
I20260619 06:30:07.542203 9397 heartbeater.cc:503] Master 127.7.96.62:44861 was elected leader, sending a full tablet report...
I20260619 06:30:07.542762 9423 ts_tablet_manager.cc:1428] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d: Time spent starting tablet: real 0.014s user 0.012s sys 0.000s
I20260619 06:30:07.542965 9424 raft_consensus.cc:348] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } }
I20260619 06:30:07.543329 9424 raft_consensus.cc:374] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:30:07.543457 9424 raft_consensus.cc:729] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c96ab909d8164eda8f3ebd210d06fbd7, State: Initialized, Role: FOLLOWER
I20260619 06:30:07.544037 9424 consensus_queue.cc:260] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } }
I20260619 06:30:07.545758 9424 ts_tablet_manager.cc:1428] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7: Time spent starting tablet: real 0.012s user 0.011s sys 0.000s
I20260619 06:30:07.550971 9427 raft_consensus.cc:482] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:30:07.551294 9427 raft_consensus.cc:504] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } }
I20260619 06:30:07.553027 9427 leader_election.cc:288] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c96ab909d8164eda8f3ebd210d06fbd7 (127.7.96.1:38305), b9391b0d0d0143fb8708b0fba4aec26d (127.7.96.4:42679)
I20260619 06:30:07.562469 9352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8" candidate_uuid: "febe077b7c1645e1b8d47ba28c8f3832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" is_pre_election: true
I20260619 06:30:07.562489 8958 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8" candidate_uuid: "febe077b7c1645e1b8d47ba28c8f3832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" is_pre_election: true
I20260619 06:30:07.563066 9352 raft_consensus.cc:2454] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate febe077b7c1645e1b8d47ba28c8f3832 in term 0.
I20260619 06:30:07.563099 8958 raft_consensus.cc:2454] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate febe077b7c1645e1b8d47ba28c8f3832 in term 0.
I20260619 06:30:07.563715 9156 leader_election.cc:302] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9391b0d0d0143fb8708b0fba4aec26d, febe077b7c1645e1b8d47ba28c8f3832; no voters:
I20260619 06:30:07.564085 9427 raft_consensus.cc:2781] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 06:30:07.564222 9427 raft_consensus.cc:482] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 06:30:07.564328 9427 raft_consensus.cc:3037] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:30:07.566316 9427 raft_consensus.cc:504] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } }
I20260619 06:30:07.566955 9427 leader_election.cc:288] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [CANDIDATE]: Term 1 election: Requested vote from peers c96ab909d8164eda8f3ebd210d06fbd7 (127.7.96.1:38305), b9391b0d0d0143fb8708b0fba4aec26d (127.7.96.4:42679)
I20260619 06:30:07.567345 8958 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8" candidate_uuid: "febe077b7c1645e1b8d47ba28c8f3832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c96ab909d8164eda8f3ebd210d06fbd7"
I20260619 06:30:07.567390 9352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8" candidate_uuid: "febe077b7c1645e1b8d47ba28c8f3832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9391b0d0d0143fb8708b0fba4aec26d"
I20260619 06:30:07.567561 8958 raft_consensus.cc:3037] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:30:07.567561 9352 raft_consensus.cc:3037] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:30:07.570576 9352 raft_consensus.cc:2454] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate febe077b7c1645e1b8d47ba28c8f3832 in term 1.
I20260619 06:30:07.570578 8958 raft_consensus.cc:2454] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate febe077b7c1645e1b8d47ba28c8f3832 in term 1.
I20260619 06:30:07.570966 9155 leader_election.cc:302] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c96ab909d8164eda8f3ebd210d06fbd7, febe077b7c1645e1b8d47ba28c8f3832; no voters:
I20260619 06:30:07.571257 9427 raft_consensus.cc:2781] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:30:07.571681 9427 raft_consensus.cc:686] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 1 LEADER]: Becoming Leader. State: Replica: febe077b7c1645e1b8d47ba28c8f3832, State: Running, Role: LEADER
I20260619 06:30:07.572144 9427 consensus_queue.cc:237] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } }
I20260619 06:30:07.576632 8816 catalog_manager.cc:5495] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 reported cstate change: term changed from 0 to 1, leader changed from <none> to febe077b7c1645e1b8d47ba28c8f3832 (127.7.96.3). New cstate: current_term: 1 leader_uuid: "febe077b7c1645e1b8d47ba28c8f3832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } health_report { overall_health: UNKNOWN } } }
I20260619 06:30:07.585022 7552 maintenance_mode-itest.cc:745] Restarting batch of 4 tservers: c96ab909d8164eda8f3ebd210d06fbd7,65f402c7f0df45d09e231eab81183eb6,febe077b7c1645e1b8d47ba28c8f3832,b9391b0d0d0143fb8708b0fba4aec26d
W20260619 06:30:07.611312 9398 tablet.cc:2369] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 06:30:07.660702 9427 consensus_queue.cc:1035] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260619 06:30:07.663864 9267 tablet.cc:2369] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 06:30:07.684567 9427 consensus_queue.cc:1035] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260619 06:30:07.838886 9156 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.96.4:42679, user_credentials={real_user=slave}} blocked reactor thread for 48536.8us
I20260619 06:30:08.670404 8810 ts_manager.cc:292] Set tserver state for 65f402c7f0df45d09e231eab81183eb6 to MAINTENANCE_MODE
I20260619 06:30:08.861270 8811 ts_manager.cc:292] Set tserver state for febe077b7c1645e1b8d47ba28c8f3832 to MAINTENANCE_MODE
I20260619 06:30:09.149242 8811 ts_manager.cc:292] Set tserver state for b9391b0d0d0143fb8708b0fba4aec26d to MAINTENANCE_MODE
W20260619 06:30:09.282482 9434 meta_cache.cc:1261] Time spent looking up entry by key: real 0.065s user 0.002s sys 0.000s
I20260619 06:30:09.865166 8811 ts_manager.cc:292] Set tserver state for c96ab909d8164eda8f3ebd210d06fbd7 to MAINTENANCE_MODE
I20260619 06:30:10.145121 9201 tablet_service.cc:1422] Tablet server febe077b7c1645e1b8d47ba28c8f3832 set to quiescing
I20260619 06:30:10.145393 9201 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20260619 06:30:10.149629 9432 raft_consensus.cc:979] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832: : Instructing follower c96ab909d8164eda8f3ebd210d06fbd7 to start an election
I20260619 06:30:10.149755 9432 raft_consensus.cc:1067] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 1 LEADER]: Signalling peer c96ab909d8164eda8f3ebd210d06fbd7 to start an election
I20260619 06:30:10.153259 8957 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8"
dest_uuid: "c96ab909d8164eda8f3ebd210d06fbd7"
from {username='slave'} at 127.7.96.3:43373
I20260619 06:30:10.153538 8957 raft_consensus.cc:482] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260619 06:30:10.153678 8957 raft_consensus.cc:3037] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 1 FOLLOWER]: Advancing to term 2
I20260619 06:30:10.155186 9427 raft_consensus.cc:979] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832: : Instructing follower c96ab909d8164eda8f3ebd210d06fbd7 to start an election
I20260619 06:30:10.155313 9427 raft_consensus.cc:1067] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 1 LEADER]: Signalling peer c96ab909d8164eda8f3ebd210d06fbd7 to start an election
I20260619 06:30:10.168141 8957 raft_consensus.cc:504] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } }
I20260619 06:30:10.169907 8957 leader_election.cc:288] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [CANDIDATE]: Term 2 election: Requested vote from peers febe077b7c1645e1b8d47ba28c8f3832 (127.7.96.3:35437), b9391b0d0d0143fb8708b0fba4aec26d (127.7.96.4:42679)
I20260619 06:30:10.170856 8956 raft_consensus.cc:1226] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 2 FOLLOWER]: Rejecting Update request from peer febe077b7c1645e1b8d47ba28c8f3832 for earlier term 1. Current term is 2. Ops: [1.104-1.104]
I20260619 06:30:10.171202 8958 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8"
dest_uuid: "c96ab909d8164eda8f3ebd210d06fbd7"
from {username='slave'} at 127.7.96.3:43373
I20260619 06:30:10.172029 8958 raft_consensus.cc:482] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260619 06:30:10.172159 8958 raft_consensus.cc:3037] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 2 FOLLOWER]: Advancing to term 3
I20260619 06:30:10.176112 8958 raft_consensus.cc:504] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } }
I20260619 06:30:10.176735 8958 leader_election.cc:288] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [CANDIDATE]: Term 3 election: Requested vote from peers febe077b7c1645e1b8d47ba28c8f3832 (127.7.96.3:35437), b9391b0d0d0143fb8708b0fba4aec26d (127.7.96.4:42679)
I20260619 06:30:10.196895 9462 raft_consensus.cc:979] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832: : Instructing follower b9391b0d0d0143fb8708b0fba4aec26d to start an election
I20260619 06:30:10.197031 9462 raft_consensus.cc:1067] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 1 LEADER]: Signalling peer b9391b0d0d0143fb8708b0fba4aec26d to start an election
I20260619 06:30:10.204632 9432 raft_consensus.cc:979] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832: : Instructing follower b9391b0d0d0143fb8708b0fba4aec26d to start an election
I20260619 06:30:10.204773 9432 raft_consensus.cc:1067] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 1 LEADER]: Signalling peer b9391b0d0d0143fb8708b0fba4aec26d to start an election
I20260619 06:30:10.205968 9350 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8"
dest_uuid: "b9391b0d0d0143fb8708b0fba4aec26d"
from {username='slave'} at 127.7.96.3:36229
I20260619 06:30:10.206282 9350 raft_consensus.cc:482] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260619 06:30:10.206480 9350 raft_consensus.cc:3037] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 1 FOLLOWER]: Advancing to term 2
I20260619 06:30:10.210258 9350 raft_consensus.cc:504] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } }
I20260619 06:30:10.231823 9352 raft_consensus.cc:1226] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 2 FOLLOWER]: Rejecting Update request from peer febe077b7c1645e1b8d47ba28c8f3832 for earlier term 1. Current term is 2. Ops: [1.107-1.107]
I20260619 06:30:10.232887 9462 consensus_queue.cc:1046] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 }, Status: INVALID_TERM, Last received: 1.106, Next index: 107, Last known committed idx: 106, Time since last communication: 0.000s
I20260619 06:30:10.233290 9427 raft_consensus.cc:3032] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 1 LEADER]: Stepping down as leader of term 1
I20260619 06:30:10.233381 9427 raft_consensus.cc:729] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: febe077b7c1645e1b8d47ba28c8f3832, State: Running, Role: LEADER
I20260619 06:30:10.233614 9427 consensus_queue.cc:260] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 106, Committed index: 106, Last appended: 1.108, Last appended by leader: 108, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } }
I20260619 06:30:10.234289 9427 raft_consensus.cc:3037] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 1 FOLLOWER]: Advancing to term 2
W20260619 06:30:10.238644 9450 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:58172: Illegal state: Cannot assign timestamp to op. Tablet is not in leader mode. Last heard from a leader: 0.009s ago.
I20260619 06:30:10.240267 9220 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8" candidate_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 103 } } ignore_live_leader: true dest_uuid: "febe077b7c1645e1b8d47ba28c8f3832"
I20260619 06:30:10.240705 9220 raft_consensus.cc:3037] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 2 FOLLOWER]: Advancing to term 3
I20260619 06:30:10.243566 9220 raft_consensus.cc:2396] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c96ab909d8164eda8f3ebd210d06fbd7 for term 3 because replica has last-logged OpId of term: 1 index: 108, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 103.
I20260619 06:30:10.240481 9221 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8" candidate_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 103 } } ignore_live_leader: true dest_uuid: "febe077b7c1645e1b8d47ba28c8f3832"
I20260619 06:30:10.244154 9221 raft_consensus.cc:2354] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c96ab909d8164eda8f3ebd210d06fbd7 for earlier term 2. Current term is 3.
I20260619 06:30:10.244927 8893 leader_election.cc:398] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [CANDIDATE]: Term 2 election: Vote denied by peer febe077b7c1645e1b8d47ba28c8f3832 (127.7.96.3:35437) with higher term. Message: Invalid argument: T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c96ab909d8164eda8f3ebd210d06fbd7 for earlier term 2. Current term is 3.
I20260619 06:30:10.245018 8893 leader_election.cc:401] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260619 06:30:10.250195 9351 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8"
dest_uuid: "b9391b0d0d0143fb8708b0fba4aec26d"
from {username='slave'} at 127.7.96.3:36229
I20260619 06:30:10.251158 9070 tablet_service.cc:1422] Tablet server 65f402c7f0df45d09e231eab81183eb6 set to quiescing
I20260619 06:30:10.251423 9070 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260619 06:30:10.259019 9351 raft_consensus.cc:482] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260619 06:30:10.259680 9351 raft_consensus.cc:3037] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 2 FOLLOWER]: Advancing to term 3
I20260619 06:30:10.270529 9350 leader_election.cc:288] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [CANDIDATE]: Term 2 election: Requested vote from peers c96ab909d8164eda8f3ebd210d06fbd7 (127.7.96.1:38305), febe077b7c1645e1b8d47ba28c8f3832 (127.7.96.3:35437)
I20260619 06:30:10.274485 9351 raft_consensus.cc:504] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } }
I20260619 06:30:10.280732 9351 leader_election.cc:288] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [CANDIDATE]: Term 3 election: Requested vote from peers c96ab909d8164eda8f3ebd210d06fbd7 (127.7.96.1:38305), febe077b7c1645e1b8d47ba28c8f3832 (127.7.96.3:35437)
I20260619 06:30:10.281359 9546 raft_consensus.cc:2726] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer febe077b7c1645e1b8d47ba28c8f3832 (127.7.96.3:35437) with higher term. Message: Invalid argument: T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c96ab909d8164eda8f3ebd210d06fbd7 for earlier term 2. Current term is 3.
I20260619 06:30:10.291635 9221 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8" candidate_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 106 } } ignore_live_leader: true dest_uuid: "febe077b7c1645e1b8d47ba28c8f3832"
I20260619 06:30:10.291914 9221 raft_consensus.cc:2354] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b9391b0d0d0143fb8708b0fba4aec26d for earlier term 2. Current term is 3.
I20260619 06:30:10.292220 9220 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8" candidate_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" candidate_term: 3 candidate_status { last_received { term: 1 index: 106 } } ignore_live_leader: true dest_uuid: "febe077b7c1645e1b8d47ba28c8f3832"
I20260619 06:30:10.292511 9220 raft_consensus.cc:2396] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b9391b0d0d0143fb8708b0fba4aec26d for term 3 because replica has last-logged OpId of term: 1 index: 108, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 106.
I20260619 06:30:10.293296 9287 leader_election.cc:398] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [CANDIDATE]: Term 2 election: Vote denied by peer febe077b7c1645e1b8d47ba28c8f3832 (127.7.96.3:35437) with higher term. Message: Invalid argument: T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b9391b0d0d0143fb8708b0fba4aec26d for earlier term 2. Current term is 3.
I20260619 06:30:10.293475 9287 leader_election.cc:401] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20260619 06:30:10.299469 8918 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:40082: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
I20260619 06:30:10.322907 9551 raft_consensus.cc:2726] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer febe077b7c1645e1b8d47ba28c8f3832 (127.7.96.3:35437) with higher term. Message: Invalid argument: T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b9391b0d0d0143fb8708b0fba4aec26d for earlier term 2. Current term is 3.
I20260619 06:30:10.323899 9351 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8" candidate_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 103 } } ignore_live_leader: true dest_uuid: "b9391b0d0d0143fb8708b0fba4aec26d"
I20260619 06:30:10.324210 9351 raft_consensus.cc:2354] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c96ab909d8164eda8f3ebd210d06fbd7 for earlier term 2. Current term is 3.
I20260619 06:30:10.325096 9351 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8" candidate_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 103 } } ignore_live_leader: true dest_uuid: "b9391b0d0d0143fb8708b0fba4aec26d"
I20260619 06:30:10.325189 8958 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8" candidate_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" candidate_term: 2 candidate_status { last_received { term: 1 index: 106 } } ignore_live_leader: true dest_uuid: "c96ab909d8164eda8f3ebd210d06fbd7"
I20260619 06:30:10.325346 9351 raft_consensus.cc:2379] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c96ab909d8164eda8f3ebd210d06fbd7 in current term 3: Already voted for candidate b9391b0d0d0143fb8708b0fba4aec26d in this term.
I20260619 06:30:10.325415 8958 raft_consensus.cc:2354] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b9391b0d0d0143fb8708b0fba4aec26d for earlier term 2. Current term is 3.
I20260619 06:30:10.326005 8958 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8" candidate_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" candidate_term: 3 candidate_status { last_received { term: 1 index: 106 } } ignore_live_leader: true dest_uuid: "c96ab909d8164eda8f3ebd210d06fbd7"
I20260619 06:30:10.326305 8958 raft_consensus.cc:2379] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b9391b0d0d0143fb8708b0fba4aec26d in current term 3: Already voted for candidate c96ab909d8164eda8f3ebd210d06fbd7 in this term.
I20260619 06:30:10.326880 8893 leader_election.cc:398] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [CANDIDATE]: Term 2 election: Vote denied by peer b9391b0d0d0143fb8708b0fba4aec26d (127.7.96.4:42679) with higher term. Message: Invalid argument: T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c96ab909d8164eda8f3ebd210d06fbd7 for earlier term 2. Current term is 3.
I20260619 06:30:10.326880 9286 leader_election.cc:398] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [CANDIDATE]: Term 2 election: Vote denied by peer c96ab909d8164eda8f3ebd210d06fbd7 (127.7.96.1:38305) with higher term. Message: Invalid argument: T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b9391b0d0d0143fb8708b0fba4aec26d for earlier term 2. Current term is 3.
I20260619 06:30:10.327294 8893 leader_election.cc:302] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c96ab909d8164eda8f3ebd210d06fbd7; no voters: b9391b0d0d0143fb8708b0fba4aec26d, febe077b7c1645e1b8d47ba28c8f3832
I20260619 06:30:10.327330 9286 leader_election.cc:302] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9391b0d0d0143fb8708b0fba4aec26d; no voters: c96ab909d8164eda8f3ebd210d06fbd7, febe077b7c1645e1b8d47ba28c8f3832
I20260619 06:30:10.327809 9546 raft_consensus.cc:2726] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260619 06:30:10.328034 9551 raft_consensus.cc:2726] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260619 06:30:10.353521 9312 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54404: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:10.367018 9181 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:58172: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:10.378039 8918 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:40082: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:10.396021 9312 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54404: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:10.409857 9181 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:58172: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:10.420971 8918 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:40082: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:10.434111 9312 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54404: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:10.451172 9181 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:58172: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:10.465147 8918 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:40082: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:10.480477 9312 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54404: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:10.496100 9181 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:58172: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:10.512239 8918 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:40082: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:10.528373 9312 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54404: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:10.547487 9181 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:58172: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:10.549984 9427 raft_consensus.cc:659] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832: failed to trigger leader election: Illegal state: leader elections are disabled
W20260619 06:30:10.565603 8918 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:40082: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
I20260619 06:30:10.569583 9332 tablet_service.cc:1422] Tablet server b9391b0d0d0143fb8708b0fba4aec26d set to quiescing
I20260619 06:30:10.569836 9332 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
W20260619 06:30:10.587972 9312 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54404: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:10.610215 9181 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:58172: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:10.633396 8918 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:40082: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:10.657132 9312 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54404: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
I20260619 06:30:10.683671 9546 raft_consensus.cc:482] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:30:10.683871 9546 raft_consensus.cc:504] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } }
I20260619 06:30:10.684641 9546 leader_election.cc:288] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers febe077b7c1645e1b8d47ba28c8f3832 (127.7.96.3:35437), b9391b0d0d0143fb8708b0fba4aec26d (127.7.96.4:42679)
I20260619 06:30:10.685788 9220 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8" candidate_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" candidate_term: 4 candidate_status { last_received { term: 1 index: 103 } } ignore_live_leader: false dest_uuid: "febe077b7c1645e1b8d47ba28c8f3832" is_pre_election: true
I20260619 06:30:10.686172 9220 raft_consensus.cc:2396] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c96ab909d8164eda8f3ebd210d06fbd7 for term 4 because replica has last-logged OpId of term: 1 index: 108, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 103.
I20260619 06:30:10.686523 9351 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8" candidate_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" candidate_term: 4 candidate_status { last_received { term: 1 index: 103 } } ignore_live_leader: false dest_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" is_pre_election: true
I20260619 06:30:10.686848 9351 raft_consensus.cc:2396] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c96ab909d8164eda8f3ebd210d06fbd7 for term 4 because replica has last-logged OpId of term: 1 index: 106, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 103.
W20260619 06:30:10.687466 9181 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:58172: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
I20260619 06:30:10.688311 8893 leader_election.cc:302] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c96ab909d8164eda8f3ebd210d06fbd7; no voters: b9391b0d0d0143fb8708b0fba4aec26d, febe077b7c1645e1b8d47ba28c8f3832
I20260619 06:30:10.689234 9546 raft_consensus.cc:2726] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260619 06:30:10.713433 8917 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:40082: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:10.743088 9312 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54404: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:10.772591 9181 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:58172: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:10.800756 8917 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:40082: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:10.830910 9312 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54404: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
I20260619 06:30:10.834632 8938 tablet_service.cc:1422] Tablet server c96ab909d8164eda8f3ebd210d06fbd7 set to quiescing
I20260619 06:30:10.834820 8938 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
W20260619 06:30:10.839896 9574 raft_consensus.cc:659] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d: failed to trigger leader election: Illegal state: leader elections are disabled
W20260619 06:30:10.866242 9181 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:58172: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:10.898125 8917 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:40082: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:10.933286 9312 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54404: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:10.971221 9181 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:58172: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:11.007319 8917 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:40082: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:11.044726 9312 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54404: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:11.083480 9181 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:58172: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:11.122604 8917 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:40082: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:11.161144 9312 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54404: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:11.200947 9181 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:58172: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:11.240248 8917 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:40082: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:11.280763 9312 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54404: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:11.327432 9181 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:58172: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:11.369592 8917 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:40082: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:11.416178 9312 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54404: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:11.432897 9577 raft_consensus.cc:659] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7: failed to trigger leader election: Illegal state: leader elections are disabled
W20260619 06:30:11.462031 9181 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:58172: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:11.509619 8917 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:40082: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:11.557504 9312 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54404: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:11.609138 9181 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:58172: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:11.662266 8917 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:40082: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:11.712580 9312 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54404: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
I20260619 06:30:11.761178 9201 tablet_service.cc:1422] Tablet server febe077b7c1645e1b8d47ba28c8f3832 set to quiescing
I20260619 06:30:11.761409 9201 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
W20260619 06:30:11.764557 9181 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:58172: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:11.816015 8917 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:40082: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
I20260619 06:30:11.840813 7552 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu pid 8876
I20260619 06:30:11.847609 8998 generic_service.cc:196] Checking for leaks (request via RPC)
W20260619 06:30:11.871376 9312 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54404: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:11.929126 9181 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:58172: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
I20260619 06:30:11.979653 7552 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu with pid 8876
W20260619 06:30:12.010409 8804 connection.cc:535] server connection from 127.7.96.1:45057 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260619 06:30:12.010852 9407 connection.cc:535] client connection to 127.7.96.1:38305 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260619 06:30:12.011170 9407 meta_cache.cc:302] tablet f83defb033834a9a95a05a9e6182b3b8: replica c96ab909d8164eda8f3ebd210d06fbd7 (127.7.96.1:38305) has failed: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260619 06:30:12.011324 7552 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu
/tmp/dist-test-taskFG9pG8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.96.1:38305
--local_ip_for_outbound_sockets=127.7.96.1
--tserver_master_addrs=127.7.96.62:44861
--webserver_port=36055
--webserver_interface=127.7.96.1
--builtin_ntp_servers=127.7.96.20:37673
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
W20260619 06:30:12.066648 9312 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54404: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:12.128923 9181 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:58172: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:12.247731 9312 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54404: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:12.309469 9181 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:58172: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:12.339468 9592 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:30:12.339715 9592 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:30:12.339912 9592 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:30:12.346856 9592 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:30:12.347208 9592 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.96.1
I20260619 06:30:12.356078 9592 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.96.20:37673
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.96.1:38305
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.96.1
--webserver_port=36055
--tserver_master_addrs=127.7.96.62:44861
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.96.1
--log_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:40:48 UTC on ccycloud.quasar-zrzaui.root.comops.site
build id 4455154
ASAN enabled
I20260619 06:30:12.357338 9592 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:30:12.359061 9592 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:30:12.372046 9601 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:30:12.372014 9599 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:30:12.372088 9598 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:30:12.372982 9592 server_base.cc:1034] running on GCE node
I20260619 06:30:12.373678 9592 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:30:12.374657 9592 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:30:12.375923 9592 hybrid_clock.cc:648] HybridClock initialized: now 1781850612375861 us; error 49 us; skew 500 ppm
I20260619 06:30:12.376278 9592 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 06:30:12.382905 9592 webserver.cc:460] Webserver started at http://127.7.96.1:36055/ using document root <none> and password file <none>
I20260619 06:30:12.383755 9592 fs_manager.cc:359] Metadata directory not provided
I20260619 06:30:12.383919 9592 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:30:12.389382 9592 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.006s sys 0.000s
I20260619 06:30:12.392503 9607 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:30:12.393800 9592 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260619 06:30:12.393950 9592 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-0/data,/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-0/wal
uuid: "c96ab909d8164eda8f3ebd210d06fbd7"
format_stamp: "Formatted at 2026-06-19 06:30:05 on dist-test-slave-cvm7"
I20260619 06:30:12.394902 9592 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:30:12.411381 9592 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:30:12.412056 9592 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:30:12.412285 9592 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:30:12.413141 9592 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:30:12.414995 9614 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260619 06:30:12.420598 9592 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260619 06:30:12.420745 9592 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.000s sys 0.000s
I20260619 06:30:12.420914 9592 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260619 06:30:12.424746 9592 ts_tablet_manager.cc:610] Registered 1 tablets
I20260619 06:30:12.424824 9592 ts_tablet_manager.cc:589] Time spent register tablets: real 0.004s user 0.002s sys 0.000s
I20260619 06:30:12.425185 9614 tablet_bootstrap.cc:492] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7: Bootstrap starting.
W20260619 06:30:12.434087 9312 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54404: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
I20260619 06:30:12.484350 9614 log.cc:824] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7: Log is configured to *not* fsync() on all Append() calls
I20260619 06:30:12.489494 9592 rpc_server.cc:307] RPC server started. Bound to: 127.7.96.1:38305
I20260619 06:30:12.489526 9721 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.96.1:38305 every 8 connection(s)
I20260619 06:30:12.490841 9592 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-0/data/info.pb
I20260619 06:30:12.496146 7552 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu as pid 9592
I20260619 06:30:12.496349 7552 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu pid 9007
W20260619 06:30:12.501063 9181 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:58172: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
I20260619 06:30:12.515290 9722 heartbeater.cc:347] Connected to a master server at 127.7.96.62:44861
I20260619 06:30:12.515641 9722 heartbeater.cc:464] Registering TS with master...
I20260619 06:30:12.516630 9722 heartbeater.cc:511] Master 127.7.96.62:44861 requested a full tablet report, sending...
I20260619 06:30:12.516793 9130 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:30:12.519994 8810 ts_manager.cc:194] Re-registered known tserver with Master: c96ab909d8164eda8f3ebd210d06fbd7 (127.7.96.1:38305)
I20260619 06:30:12.521533 8810 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.96.1:45161
W20260619 06:30:12.642673 9312 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54404: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
I20260619 06:30:12.652627 7552 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu with pid 9007
I20260619 06:30:12.675412 7552 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu
/tmp/dist-test-taskFG9pG8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.96.2:33625
--local_ip_for_outbound_sockets=127.7.96.2
--tserver_master_addrs=127.7.96.62:44861
--webserver_port=43635
--webserver_interface=127.7.96.2
--builtin_ntp_servers=127.7.96.20:37673
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
W20260619 06:30:12.710122 9181 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:58172: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
I20260619 06:30:12.828771 9614 tablet_bootstrap.cc:492] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7: Bootstrap replayed 1/1 log segments. Stats: ops{read=103 overwritten=0 applied=103 ignored=0} inserts{seen=5100 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260619 06:30:12.829308 9614 tablet_bootstrap.cc:492] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7: Bootstrap complete.
I20260619 06:30:12.830597 9614 ts_tablet_manager.cc:1397] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7: Time spent bootstrapping tablet: real 0.406s user 0.383s sys 0.016s
I20260619 06:30:12.835635 9614 raft_consensus.cc:348] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } }
I20260619 06:30:12.836410 9614 raft_consensus.cc:729] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: c96ab909d8164eda8f3ebd210d06fbd7, State: Initialized, Role: FOLLOWER
I20260619 06:30:12.836916 9614 consensus_queue.cc:260] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 103, Last appended: 1.103, Last appended by leader: 103, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } }
I20260619 06:30:12.837903 9722 heartbeater.cc:503] Master 127.7.96.62:44861 was elected leader, sending a full tablet report...
I20260619 06:30:12.838555 9614 ts_tablet_manager.cc:1428] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
W20260619 06:30:12.847502 9312 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54404: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:12.920511 9181 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:58172: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:12.994607 9636 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:46612: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:13.019961 9730 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:30:13.020210 9730 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:30:13.020367 9730 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:30:13.027781 9730 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:30:13.027990 9730 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.96.2
I20260619 06:30:13.037192 9730 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.96.20:37673
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.96.2:33625
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.96.2
--webserver_port=43635
--tserver_master_addrs=127.7.96.62:44861
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.96.2
--log_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:40:48 UTC on ccycloud.quasar-zrzaui.root.comops.site
build id 4455154
ASAN enabled
I20260619 06:30:13.038560 9730 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:30:13.040275 9730 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:30:13.052876 9736 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:30:13.052845 9737 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:30:13.052946 9739 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:30:13.053622 9730 server_base.cc:1034] running on GCE node
I20260619 06:30:13.054217 9730 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:30:13.055078 9730 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:30:13.056283 9730 hybrid_clock.cc:648] HybridClock initialized: now 1781850613056230 us; error 31 us; skew 500 ppm
I20260619 06:30:13.056510 9730 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 06:30:13.058656 9730 webserver.cc:460] Webserver started at http://127.7.96.2:43635/ using document root <none> and password file <none>
I20260619 06:30:13.059255 9730 fs_manager.cc:359] Metadata directory not provided
I20260619 06:30:13.059356 9730 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:30:13.065074 9730 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.003s
W20260619 06:30:13.066099 9312 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54404: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
I20260619 06:30:13.067973 9745 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:30:13.069187 9730 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260619 06:30:13.069327 9730 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-1/data,/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-1/wal
uuid: "65f402c7f0df45d09e231eab81183eb6"
format_stamp: "Formatted at 2026-06-19 06:30:06 on dist-test-slave-cvm7"
I20260619 06:30:13.070194 9730 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:30:13.092383 9730 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:30:13.093194 9730 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:30:13.093462 9730 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:30:13.094416 9730 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:30:13.095883 9730 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:30:13.095964 9730 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:30:13.096131 9730 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:30:13.096227 9730 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:30:13.119563 9731 raft_consensus.cc:482] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:30:13.119948 9731 raft_consensus.cc:504] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } }
I20260619 06:30:13.121554 9731 leader_election.cc:288] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers febe077b7c1645e1b8d47ba28c8f3832 (127.7.96.3:35437), b9391b0d0d0143fb8708b0fba4aec26d (127.7.96.4:42679)
I20260619 06:30:13.136885 9220 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8" candidate_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" candidate_term: 4 candidate_status { last_received { term: 1 index: 103 } } ignore_live_leader: false dest_uuid: "febe077b7c1645e1b8d47ba28c8f3832" is_pre_election: true
I20260619 06:30:13.137279 9220 raft_consensus.cc:2396] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c96ab909d8164eda8f3ebd210d06fbd7 for term 4 because replica has last-logged OpId of term: 1 index: 108, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 103.
I20260619 06:30:13.142001 9730 rpc_server.cc:307] RPC server started. Bound to: 127.7.96.2:33625
I20260619 06:30:13.142038 9861 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.96.2:33625 every 8 connection(s)
I20260619 06:30:13.142326 9351 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8" candidate_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" candidate_term: 4 candidate_status { last_received { term: 1 index: 103 } } ignore_live_leader: false dest_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" is_pre_election: true
I20260619 06:30:13.142681 9351 raft_consensus.cc:2396] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c96ab909d8164eda8f3ebd210d06fbd7 for term 4 because replica has last-logged OpId of term: 1 index: 106, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 103.
W20260619 06:30:13.142910 9181 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:58172: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
I20260619 06:30:13.143198 9610 leader_election.cc:302] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c96ab909d8164eda8f3ebd210d06fbd7; no voters: b9391b0d0d0143fb8708b0fba4aec26d, febe077b7c1645e1b8d47ba28c8f3832
I20260619 06:30:13.143702 9731 raft_consensus.cc:2726] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260619 06:30:13.143878 9730 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-1/data/info.pb
I20260619 06:30:13.154131 7552 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu as pid 9730
I20260619 06:30:13.154330 7552 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu pid 9138
I20260619 06:30:13.156805 9862 heartbeater.cc:347] Connected to a master server at 127.7.96.62:44861
I20260619 06:30:13.157110 9862 heartbeater.cc:464] Registering TS with master...
I20260619 06:30:13.157783 9862 heartbeater.cc:511] Master 127.7.96.62:44861 requested a full tablet report, sending...
I20260619 06:30:13.159229 8815 ts_manager.cc:194] Re-registered known tserver with Master: 65f402c7f0df45d09e231eab81183eb6 (127.7.96.2:33625)
I20260619 06:30:13.160231 8815 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.96.2:34855
I20260619 06:30:13.161497 9261 generic_service.cc:196] Checking for leaks (request via RPC)
W20260619 06:30:13.186021 9437 scanner-internal.cc:458] Time spent opening tablet: real 2.320s user 0.004s sys 0.001s
W20260619 06:30:13.209656 9439 scanner-internal.cc:458] Time spent opening tablet: real 2.314s user 0.004s sys 0.000s
W20260619 06:30:13.219113 9634 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:46612: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:13.227355 9438 scanner-internal.cc:458] Time spent opening tablet: real 2.315s user 0.004s sys 0.000s
I20260619 06:30:13.290174 7552 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu with pid 9138
W20260619 06:30:13.296555 9312 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54404: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:13.317340 9408 meta_cache.cc:302] tablet f83defb033834a9a95a05a9e6182b3b8: replica febe077b7c1645e1b8d47ba28c8f3832 (127.7.96.3:35437) has failed: Network error: recv got EOF from 127.7.96.3:35437 (error 108)
I20260619 06:30:13.318562 7552 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu
/tmp/dist-test-taskFG9pG8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.96.3:35437
--local_ip_for_outbound_sockets=127.7.96.3
--tserver_master_addrs=127.7.96.62:44861
--webserver_port=42369
--webserver_interface=127.7.96.3
--builtin_ntp_servers=127.7.96.20:37673
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
W20260619 06:30:13.330211 9312 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54404: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:13.331481 9312 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54404: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:13.338701 9634 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:46612: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:13.338711 9636 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:46612: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:13.381034 9635 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:46612: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:13.391160 9312 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54404: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:13.395969 9312 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54404: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:13.405926 9635 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:46612: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:13.411307 9635 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:46612: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:13.422688 9312 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54404: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:13.425297 9312 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54404: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:13.439954 9635 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:46612: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:13.448220 9635 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:46612: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:13.456486 9635 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:46612: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:13.472397 9635 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:46612: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:13.480047 9312 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54404: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:13.495616 9312 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54404: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:13.535036 9312 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54404: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:13.536291 9311 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54404: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:13.537336 9312 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54404: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
I20260619 06:30:13.544862 9731 raft_consensus.cc:482] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:30:13.545034 9731 raft_consensus.cc:504] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } }
I20260619 06:30:13.546999 9731 leader_election.cc:288] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers febe077b7c1645e1b8d47ba28c8f3832 (127.7.96.3:35437), b9391b0d0d0143fb8708b0fba4aec26d (127.7.96.4:42679)
W20260619 06:30:13.547997 9610 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.96.3:35437: connect: Connection refused (error 111)
I20260619 06:30:13.548091 9351 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8" candidate_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" candidate_term: 4 candidate_status { last_received { term: 1 index: 103 } } ignore_live_leader: false dest_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" is_pre_election: true
I20260619 06:30:13.548424 9351 raft_consensus.cc:2396] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c96ab909d8164eda8f3ebd210d06fbd7 for term 4 because replica has last-logged OpId of term: 1 index: 106, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 103.
W20260619 06:30:13.550253 9610 leader_election.cc:334] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer febe077b7c1645e1b8d47ba28c8f3832 (127.7.96.3:35437): Network error: Client connection negotiation failed: client connection to 127.7.96.3:35437: connect: Connection refused (error 111)
I20260619 06:30:13.550448 9610 leader_election.cc:302] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c96ab909d8164eda8f3ebd210d06fbd7; no voters: b9391b0d0d0143fb8708b0fba4aec26d, febe077b7c1645e1b8d47ba28c8f3832
I20260619 06:30:13.551198 9731 raft_consensus.cc:2726] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260619 06:30:13.558808 9634 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:46612: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:13.559119 9632 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:46612: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:13.620131 9632 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:46612: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:13.623040 9635 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:46612: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:13.644815 9312 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54404: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:13.646548 9312 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54404: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:13.695173 9634 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:46612: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:13.696345 9635 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:46612: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:13.698725 9635 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:46612: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:13.721447 9312 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54404: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:13.722636 9312 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54404: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:13.740906 9869 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:30:13.741175 9869 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:30:13.741353 9869 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:30:13.748999 9869 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:30:13.749313 9869 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.96.3
I20260619 06:30:13.758819 9869 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.96.20:37673
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.96.3:35437
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.96.3
--webserver_port=42369
--tserver_master_addrs=127.7.96.62:44861
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.96.3
--log_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:40:48 UTC on ccycloud.quasar-zrzaui.root.comops.site
build id 4455154
ASAN enabled
I20260619 06:30:13.760044 9869 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:30:13.762434 9869 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:30:13.778339 9312 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54404: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:13.779511 9312 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54404: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:13.779731 9311 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54404: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:13.781363 9877 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:30:13.782473 9879 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:30:13.782599 9869 server_base.cc:1034] running on GCE node
W20260619 06:30:13.782922 9876 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:30:13.783800 9869 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:30:13.784902 9869 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:30:13.786146 9869 hybrid_clock.cc:648] HybridClock initialized: now 1781850613786045 us; error 63 us; skew 500 ppm
I20260619 06:30:13.786580 9869 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 06:30:13.789455 9869 webserver.cc:460] Webserver started at http://127.7.96.3:42369/ using document root <none> and password file <none>
I20260619 06:30:13.790354 9869 fs_manager.cc:359] Metadata directory not provided
I20260619 06:30:13.790553 9869 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:30:13.796588 9869 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260619 06:30:13.799871 9885 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:30:13.801497 9869 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260619 06:30:13.801658 9869 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-2/data,/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-2/wal
uuid: "febe077b7c1645e1b8d47ba28c8f3832"
format_stamp: "Formatted at 2026-06-19 06:30:06 on dist-test-slave-cvm7"
I20260619 06:30:13.802959 9869 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260619 06:30:13.807583 9635 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:46612: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:13.810283 9632 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:46612: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
I20260619 06:30:13.829293 9869 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:30:13.830291 9869 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:30:13.830621 9869 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:30:13.831671 9869 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:30:13.834105 9892 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260619 06:30:13.840863 9869 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260619 06:30:13.840981 9869 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.007s user 0.001s sys 0.000s
I20260619 06:30:13.841112 9869 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260619 06:30:13.844945 9869 ts_tablet_manager.cc:610] Registered 1 tablets
I20260619 06:30:13.845048 9869 ts_tablet_manager.cc:589] Time spent register tablets: real 0.004s user 0.002s sys 0.000s
I20260619 06:30:13.845371 9892 tablet_bootstrap.cc:492] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832: Bootstrap starting.
W20260619 06:30:13.878746 9634 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:46612: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:13.901872 9632 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:46612: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:13.913296 9311 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54404: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:13.933171 9311 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54404: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
I20260619 06:30:13.948349 9892 log.cc:824] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832: Log is configured to *not* fsync() on all Append() calls
W20260619 06:30:13.979737 9633 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:46612: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
I20260619 06:30:13.992624 9869 rpc_server.cc:307] RPC server started. Bound to: 127.7.96.3:35437
I20260619 06:30:13.992673 9999 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.96.3:35437 every 8 connection(s)
I20260619 06:30:13.993932 9869 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-2/data/info.pb
I20260619 06:30:13.997957 7552 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu as pid 9869
I20260619 06:30:13.998198 7552 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu pid 9269
W20260619 06:30:14.004073 9634 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:46612: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:14.017707 9311 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54404: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
I20260619 06:30:14.020004 9392 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:30:14.038074 10000 heartbeater.cc:347] Connected to a master server at 127.7.96.62:44861
I20260619 06:30:14.038369 10000 heartbeater.cc:464] Registering TS with master...
I20260619 06:30:14.039378 10000 heartbeater.cc:511] Master 127.7.96.62:44861 requested a full tablet report, sending...
I20260619 06:30:14.042295 8810 ts_manager.cc:194] Re-registered known tserver with Master: febe077b7c1645e1b8d47ba28c8f3832 (127.7.96.3:35437)
I20260619 06:30:14.043743 8810 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.96.3:54017
W20260619 06:30:14.110847 9633 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:46612: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:14.156347 9311 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54404: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:14.158888 9312 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54404: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
I20260619 06:30:14.159390 7552 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu with pid 9269
I20260619 06:30:14.163509 9862 heartbeater.cc:503] Master 127.7.96.62:44861 was elected leader, sending a full tablet report...
I20260619 06:30:14.164494 10008 raft_consensus.cc:482] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:30:14.164762 10008 raft_consensus.cc:504] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } }
I20260619 06:30:14.165558 10008 leader_election.cc:288] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers febe077b7c1645e1b8d47ba28c8f3832 (127.7.96.3:35437), b9391b0d0d0143fb8708b0fba4aec26d (127.7.96.4:42679)
I20260619 06:30:14.175729 9955 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8" candidate_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" candidate_term: 4 candidate_status { last_received { term: 1 index: 103 } } ignore_live_leader: false dest_uuid: "febe077b7c1645e1b8d47ba28c8f3832" is_pre_election: true
W20260619 06:30:14.182830 9610 leader_election.cc:341] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [CANDIDATE]: Term 4 pre-election: Tablet error from VoteRequest() call to peer febe077b7c1645e1b8d47ba28c8f3832 (127.7.96.3:35437): Illegal state: must be running to vote when last-logged opid is not known
W20260619 06:30:14.189199 9610 connection.cc:535] client connection to 127.7.96.4:42679 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260619 06:30:14.191020 9610 leader_election.cc:334] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b9391b0d0d0143fb8708b0fba4aec26d (127.7.96.4:42679): Network error: Client connection negotiation failed: client connection to 127.7.96.4:42679: connect: Connection refused (error 111)
I20260619 06:30:14.191161 9610 leader_election.cc:302] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c96ab909d8164eda8f3ebd210d06fbd7; no voters: b9391b0d0d0143fb8708b0fba4aec26d, febe077b7c1645e1b8d47ba28c8f3832
I20260619 06:30:14.191215 7552 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu
/tmp/dist-test-taskFG9pG8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.96.4:42679
--local_ip_for_outbound_sockets=127.7.96.4
--tserver_master_addrs=127.7.96.62:44861
--webserver_port=34311
--webserver_interface=127.7.96.4
--builtin_ntp_servers=127.7.96.20:37673
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
I20260619 06:30:14.191682 10008 raft_consensus.cc:2726] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260619 06:30:14.269091 9634 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:46612: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
I20260619 06:30:14.319288 9892 tablet_bootstrap.cc:492] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832: Bootstrap replayed 1/1 log segments. Stats: ops{read=108 overwritten=0 applied=106 ignored=0} inserts{seen=5250 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 2 replicates
I20260619 06:30:14.319885 9892 tablet_bootstrap.cc:492] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832: Bootstrap complete.
I20260619 06:30:14.321071 9892 ts_tablet_manager.cc:1397] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832: Time spent bootstrapping tablet: real 0.476s user 0.396s sys 0.059s
I20260619 06:30:14.324056 9892 raft_consensus.cc:348] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 3 FOLLOWER]: Replica starting. Triggering 2 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } }
I20260619 06:30:14.327330 9892 raft_consensus.cc:729] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: febe077b7c1645e1b8d47ba28c8f3832, State: Initialized, Role: FOLLOWER
I20260619 06:30:14.327977 9892 consensus_queue.cc:260] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 106, Last appended: 1.108, Last appended by leader: 108, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } }
I20260619 06:30:14.329635 9892 ts_tablet_manager.cc:1428] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832: Time spent starting tablet: real 0.008s user 0.010s sys 0.000s
I20260619 06:30:14.329790 10000 heartbeater.cc:503] Master 127.7.96.62:44861 was elected leader, sending a full tablet report...
W20260619 06:30:14.329974 9633 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:46612: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:14.339339 9633 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:46612: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:14.378556 9408 meta_cache.cc:302] tablet f83defb033834a9a95a05a9e6182b3b8: replica b9391b0d0d0143fb8708b0fba4aec26d (127.7.96.4:42679) has failed: Network error: Client connection negotiation failed: client connection to 127.7.96.4:42679: connect: Connection refused (error 111)
W20260619 06:30:14.417210 9914 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:53498: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:14.504851 9633 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:46612: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:14.576757 10011 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:30:14.576997 10011 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:30:14.577172 10011 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:30:14.584651 10011 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:30:14.584879 10011 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.96.4
I20260619 06:30:14.594822 10011 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.96.20:37673
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.96.4:42679
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-3/data/info.pb
--webserver_interface=127.7.96.4
--webserver_port=34311
--tserver_master_addrs=127.7.96.62:44861
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.96.4
--log_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-3/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:40:48 UTC on ccycloud.quasar-zrzaui.root.comops.site
build id 4455154
ASAN enabled
I20260619 06:30:14.596390 10011 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:30:14.598388 10011 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:30:14.617238 10018 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:30:14.617210 10021 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:30:14.617555 10019 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:30:14.622772 10011 server_base.cc:1034] running on GCE node
I20260619 06:30:14.623574 10011 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:30:14.624863 10011 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:30:14.626106 10011 hybrid_clock.cc:648] HybridClock initialized: now 1781850614626020 us; error 49 us; skew 500 ppm
I20260619 06:30:14.626518 10011 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 06:30:14.630770 10011 webserver.cc:460] Webserver started at http://127.7.96.4:34311/ using document root <none> and password file <none>
I20260619 06:30:14.631438 10011 fs_manager.cc:359] Metadata directory not provided
I20260619 06:30:14.631596 10011 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:30:14.637842 10011 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.002s
I20260619 06:30:14.641469 10027 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:30:14.643433 10011 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260619 06:30:14.643640 10011 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-3/data,/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-3/wal
uuid: "b9391b0d0d0143fb8708b0fba4aec26d"
format_stamp: "Formatted at 2026-06-19 06:30:07 on dist-test-slave-cvm7"
I20260619 06:30:14.645032 10011 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-3/wal
metadata directory: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-3/wal
1 data directories: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:30:14.683578 10013 raft_consensus.cc:482] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:30:14.683885 10013 raft_consensus.cc:504] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } }
I20260619 06:30:14.685647 10013 leader_election.cc:288] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c96ab909d8164eda8f3ebd210d06fbd7 (127.7.96.1:38305), b9391b0d0d0143fb8708b0fba4aec26d (127.7.96.4:42679)
W20260619 06:30:14.688310 9888 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.96.4:42679: connect: Connection refused (error 111)
I20260619 06:30:14.689826 10008 raft_consensus.cc:482] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:30:14.690034 10008 raft_consensus.cc:504] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } }
I20260619 06:30:14.690797 10008 leader_election.cc:288] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers febe077b7c1645e1b8d47ba28c8f3832 (127.7.96.3:35437), b9391b0d0d0143fb8708b0fba4aec26d (127.7.96.4:42679)
I20260619 06:30:14.691116 9955 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8" candidate_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" candidate_term: 4 candidate_status { last_received { term: 1 index: 103 } } ignore_live_leader: false dest_uuid: "febe077b7c1645e1b8d47ba28c8f3832" is_pre_election: true
I20260619 06:30:14.691624 9955 raft_consensus.cc:2396] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c96ab909d8164eda8f3ebd210d06fbd7 for term 4 because replica has last-logged OpId of term: 1 index: 108, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 103.
I20260619 06:30:14.692256 10011 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:30:14.693142 10011 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:30:14.693485 10011 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:30:14.695493 10011 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
W20260619 06:30:14.699083 9610 leader_election.cc:334] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b9391b0d0d0143fb8708b0fba4aec26d (127.7.96.4:42679): Network error: Client connection negotiation failed: client connection to 127.7.96.4:42679: connect: Connection refused (error 111)
I20260619 06:30:14.699262 9610 leader_election.cc:302] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c96ab909d8164eda8f3ebd210d06fbd7; no voters: b9391b0d0d0143fb8708b0fba4aec26d, febe077b7c1645e1b8d47ba28c8f3832
I20260619 06:30:14.699577 10008 raft_consensus.cc:2726] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260619 06:30:14.701753 9888 leader_election.cc:334] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b9391b0d0d0143fb8708b0fba4aec26d (127.7.96.4:42679): Network error: Client connection negotiation failed: client connection to 127.7.96.4:42679: connect: Connection refused (error 111)
I20260619 06:30:14.702576 9676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8" candidate_uuid: "febe077b7c1645e1b8d47ba28c8f3832" candidate_term: 4 candidate_status { last_received { term: 1 index: 108 } } ignore_live_leader: false dest_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" is_pre_election: true
I20260619 06:30:14.703063 9676 raft_consensus.cc:2454] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate febe077b7c1645e1b8d47ba28c8f3832 in term 3.
I20260619 06:30:14.703686 9887 leader_election.cc:302] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c96ab909d8164eda8f3ebd210d06fbd7, febe077b7c1645e1b8d47ba28c8f3832; no voters: b9391b0d0d0143fb8708b0fba4aec26d
I20260619 06:30:14.704293 10013 raft_consensus.cc:2781] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260619 06:30:14.704401 10013 raft_consensus.cc:482] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 06:30:14.704468 10013 raft_consensus.cc:3037] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 3 FOLLOWER]: Advancing to term 4
I20260619 06:30:14.704932 10040 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260619 06:30:14.709098 10013 raft_consensus.cc:504] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } }
I20260619 06:30:14.709889 10013 leader_election.cc:288] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [CANDIDATE]: Term 4 election: Requested vote from peers c96ab909d8164eda8f3ebd210d06fbd7 (127.7.96.1:38305), b9391b0d0d0143fb8708b0fba4aec26d (127.7.96.4:42679)
I20260619 06:30:14.710294 9676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8" candidate_uuid: "febe077b7c1645e1b8d47ba28c8f3832" candidate_term: 4 candidate_status { last_received { term: 1 index: 108 } } ignore_live_leader: false dest_uuid: "c96ab909d8164eda8f3ebd210d06fbd7"
I20260619 06:30:14.710546 9676 raft_consensus.cc:3037] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 3 FOLLOWER]: Advancing to term 4
W20260619 06:30:14.711401 9888 leader_election.cc:334] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer b9391b0d0d0143fb8708b0fba4aec26d (127.7.96.4:42679): Network error: Client connection negotiation failed: client connection to 127.7.96.4:42679: connect: Connection refused (error 111)
I20260619 06:30:14.712255 10011 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260619 06:30:14.712379 10011 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.014s user 0.000s sys 0.007s
I20260619 06:30:14.712502 10011 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260619 06:30:14.714877 9676 raft_consensus.cc:2454] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate febe077b7c1645e1b8d47ba28c8f3832 in term 4.
I20260619 06:30:14.715250 9887 leader_election.cc:302] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c96ab909d8164eda8f3ebd210d06fbd7, febe077b7c1645e1b8d47ba28c8f3832; no voters: b9391b0d0d0143fb8708b0fba4aec26d
I20260619 06:30:14.715677 10013 raft_consensus.cc:2781] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 4 FOLLOWER]: Leader election won for term 4
I20260619 06:30:14.716481 10013 raft_consensus.cc:686] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 4 LEADER]: Becoming Leader. State: Replica: febe077b7c1645e1b8d47ba28c8f3832, State: Running, Role: LEADER
I20260619 06:30:14.716887 10011 ts_tablet_manager.cc:610] Registered 1 tablets
I20260619 06:30:14.716985 10011 ts_tablet_manager.cc:589] Time spent register tablets: real 0.004s user 0.000s sys 0.002s
I20260619 06:30:14.717454 10040 tablet_bootstrap.cc:492] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d: Bootstrap starting.
I20260619 06:30:14.717617 10013 consensus_queue.cc:237] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 106, Committed index: 106, Last appended: 1.108, Last appended by leader: 108, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } }
I20260619 06:30:14.730278 8810 catalog_manager.cc:5495] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "febe077b7c1645e1b8d47ba28c8f3832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } health_report { overall_health: UNKNOWN } } }
I20260619 06:30:14.779939 9676 raft_consensus.cc:1261] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 4 FOLLOWER]: Refusing update from remote peer febe077b7c1645e1b8d47ba28c8f3832: Log matching property violated. Preceding OpId in replica: term: 1 index: 103. Preceding OpId from leader: term: 4 index: 110. (index mismatch)
I20260619 06:30:14.780898 10013 consensus_queue.cc:1035] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 109, Last known committed idx: 103, Time since last communication: 0.000s
W20260619 06:30:14.781386 9888 consensus_peers.cc:487] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 -> Peer b9391b0d0d0143fb8708b0fba4aec26d (127.7.96.4:42679): Couldn't send request to peer b9391b0d0d0143fb8708b0fba4aec26d. Status: Network error: Client connection negotiation failed: client connection to 127.7.96.4:42679: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260619 06:30:14.807101 10040 log.cc:824] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d: Log is configured to *not* fsync() on all Append() calls
I20260619 06:30:14.814136 10096 mvcc.cc:205] Tried to move back new op lower bound from 7298460118127079424 to 7298460117888618496. Current Snapshot: MvccSnapshot[applied={T|T < 7298460099352297472}]
I20260619 06:30:15.114156 10011 rpc_server.cc:307] RPC server started. Bound to: 127.7.96.4:42679
I20260619 06:30:15.114202 10164 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.96.4:42679 every 8 connection(s)
I20260619 06:30:15.116279 10011 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-3/data/info.pb
I20260619 06:30:15.121208 7552 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu as pid 10011
I20260619 06:30:15.225548 10165 heartbeater.cc:347] Connected to a master server at 127.7.96.62:44861
I20260619 06:30:15.225905 10165 heartbeater.cc:464] Registering TS with master...
I20260619 06:30:15.226857 10165 heartbeater.cc:511] Master 127.7.96.62:44861 requested a full tablet report, sending...
I20260619 06:30:15.236130 8810 ts_manager.cc:194] Re-registered known tserver with Master: b9391b0d0d0143fb8708b0fba4aec26d (127.7.96.4:42679)
I20260619 06:30:15.237527 8810 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.96.4:50025
W20260619 06:30:15.304000 9888 consensus_peers.cc:487] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 -> Peer b9391b0d0d0143fb8708b0fba4aec26d (127.7.96.4:42679): Couldn't send request to peer b9391b0d0d0143fb8708b0fba4aec26d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
I20260619 06:30:15.401472 10040 tablet_bootstrap.cc:492] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d: Bootstrap replayed 1/1 log segments. Stats: ops{read=106 overwritten=0 applied=106 ignored=0} inserts{seen=5250 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260619 06:30:15.402297 10040 tablet_bootstrap.cc:492] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d: Bootstrap complete.
I20260619 06:30:15.403855 10040 ts_tablet_manager.cc:1397] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d: Time spent bootstrapping tablet: real 0.687s user 0.448s sys 0.071s
I20260619 06:30:15.414616 10040 raft_consensus.cc:348] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } }
I20260619 06:30:15.416448 10040 raft_consensus.cc:729] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9391b0d0d0143fb8708b0fba4aec26d, State: Initialized, Role: FOLLOWER
I20260619 06:30:15.424014 10040 consensus_queue.cc:260] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 106, Last appended: 1.106, Last appended by leader: 106, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } }
I20260619 06:30:15.439512 10165 heartbeater.cc:503] Master 127.7.96.62:44861 was elected leader, sending a full tablet report...
I20260619 06:30:15.439749 10040 ts_tablet_manager.cc:1428] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d: Time spent starting tablet: real 0.036s user 0.013s sys 0.004s
I20260619 06:30:15.488814 10116 raft_consensus.cc:3037] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 3 FOLLOWER]: Advancing to term 4
I20260619 06:30:15.496269 10116 raft_consensus.cc:1261] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 4 FOLLOWER]: Refusing update from remote peer febe077b7c1645e1b8d47ba28c8f3832: Log matching property violated. Preceding OpId in replica: term: 1 index: 106. Preceding OpId from leader: term: 1 index: 108. (index mismatch)
I20260619 06:30:15.503711 10126 consensus_queue.cc:1037] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [LEADER]: Got LMP mismatch error from peer: Peer: permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 109, Last known committed idx: 106, Time since last communication: 0.000s
I20260619 06:30:15.738880 10172 mvcc.cc:205] Tried to move back new op lower bound from 7298460121038544896 to 7298460117888618496. Current Snapshot: MvccSnapshot[applied={T|T < 7298460120806825984 or (T in {7298460120850518016})}]
I20260619 06:30:16.430379 10088 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260619 06:30:16.466367 9793 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260619 06:30:16.491724 9656 tablet_service.cc:1429] Tablet server has 0 leaders and 2 scanners
I20260619 06:30:16.536001 9935 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20260619 06:30:18.216012 8810 ts_manager.cc:281] Unset tserver state for c96ab909d8164eda8f3ebd210d06fbd7 from MAINTENANCE_MODE
I20260619 06:30:18.217316 9862 heartbeater.cc:511] Master 127.7.96.62:44861 requested a full tablet report, sending...
I20260619 06:30:18.250413 8815 ts_manager.cc:281] Unset tserver state for 65f402c7f0df45d09e231eab81183eb6 from MAINTENANCE_MODE
I20260619 06:30:18.530244 8815 ts_manager.cc:281] Unset tserver state for febe077b7c1645e1b8d47ba28c8f3832 from MAINTENANCE_MODE
I20260619 06:30:18.550679 10000 heartbeater.cc:511] Master 127.7.96.62:44861 requested a full tablet report, sending...
I20260619 06:30:18.561990 10165 heartbeater.cc:511] Master 127.7.96.62:44861 requested a full tablet report, sending...
I20260619 06:30:18.817572 8815 ts_manager.cc:281] Unset tserver state for b9391b0d0d0143fb8708b0fba4aec26d from MAINTENANCE_MODE
I20260619 06:30:18.839232 9722 heartbeater.cc:511] Master 127.7.96.62:44861 requested a full tablet report, sending...
I20260619 06:30:19.220542 9862 heartbeater.cc:511] Master 127.7.96.62:44861 requested a full tablet report, sending...
I20260619 06:30:19.566870 10165 heartbeater.cc:511] Master 127.7.96.62:44861 requested a full tablet report, sending...
I20260619 06:30:19.572889 10000 heartbeater.cc:511] Master 127.7.96.62:44861 requested a full tablet report, sending...
I20260619 06:30:20.078485 8815 ts_manager.cc:292] Set tserver state for febe077b7c1645e1b8d47ba28c8f3832 to MAINTENANCE_MODE
I20260619 06:30:20.452872 8815 ts_manager.cc:292] Set tserver state for c96ab909d8164eda8f3ebd210d06fbd7 to MAINTENANCE_MODE
I20260619 06:30:20.594486 8815 ts_manager.cc:292] Set tserver state for 65f402c7f0df45d09e231eab81183eb6 to MAINTENANCE_MODE
I20260619 06:30:20.766584 8815 ts_manager.cc:292] Set tserver state for b9391b0d0d0143fb8708b0fba4aec26d to MAINTENANCE_MODE
I20260619 06:30:21.931609 9793 tablet_service.cc:1422] Tablet server 65f402c7f0df45d09e231eab81183eb6 set to quiescing
I20260619 06:30:21.931870 9793 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260619 06:30:22.112833 9935 tablet_service.cc:1422] Tablet server febe077b7c1645e1b8d47ba28c8f3832 set to quiescing
I20260619 06:30:22.113121 9935 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20260619 06:30:22.119277 10178 raft_consensus.cc:979] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832: : Instructing follower b9391b0d0d0143fb8708b0fba4aec26d to start an election
I20260619 06:30:22.119410 10178 raft_consensus.cc:1067] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 4 LEADER]: Signalling peer b9391b0d0d0143fb8708b0fba4aec26d to start an election
I20260619 06:30:22.156845 10213 raft_consensus.cc:979] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832: : Instructing follower b9391b0d0d0143fb8708b0fba4aec26d to start an election
I20260619 06:30:22.157016 10213 raft_consensus.cc:1067] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 4 LEADER]: Signalling peer b9391b0d0d0143fb8708b0fba4aec26d to start an election
I20260619 06:30:22.157291 10213 raft_consensus.cc:979] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832: : Instructing follower c96ab909d8164eda8f3ebd210d06fbd7 to start an election
I20260619 06:30:22.157407 10213 raft_consensus.cc:1067] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 4 LEADER]: Signalling peer c96ab909d8164eda8f3ebd210d06fbd7 to start an election
I20260619 06:30:22.158941 10116 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8"
dest_uuid: "b9391b0d0d0143fb8708b0fba4aec26d"
from {username='slave'} at 127.7.96.3:47195
I20260619 06:30:22.159212 10116 raft_consensus.cc:482] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260619 06:30:22.159382 10116 raft_consensus.cc:3037] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 4 FOLLOWER]: Advancing to term 5
I20260619 06:30:22.162870 9676 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8"
dest_uuid: "c96ab909d8164eda8f3ebd210d06fbd7"
from {username='slave'} at 127.7.96.3:46303
I20260619 06:30:22.163077 9676 raft_consensus.cc:482] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260619 06:30:22.163169 9676 raft_consensus.cc:3037] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 4 FOLLOWER]: Advancing to term 5
I20260619 06:30:22.165840 9676 raft_consensus.cc:504] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } }
I20260619 06:30:22.166419 9676 leader_election.cc:288] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [CANDIDATE]: Term 5 election: Requested vote from peers febe077b7c1645e1b8d47ba28c8f3832 (127.7.96.3:35437), b9391b0d0d0143fb8708b0fba4aec26d (127.7.96.4:42679)
I20260619 06:30:22.166782 10113 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8"
dest_uuid: "b9391b0d0d0143fb8708b0fba4aec26d"
from {username='slave'} at 127.7.96.3:47195
I20260619 06:30:22.162428 10116 raft_consensus.cc:504] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } }
I20260619 06:30:22.167330 9955 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8" candidate_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" candidate_term: 5 candidate_status { last_received { term: 4 index: 591 } } ignore_live_leader: true dest_uuid: "febe077b7c1645e1b8d47ba28c8f3832"
I20260619 06:30:22.168113 10113 raft_consensus.cc:482] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260619 06:30:22.168272 10113 raft_consensus.cc:3037] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 5 FOLLOWER]: Advancing to term 6
I20260619 06:30:22.172689 10113 raft_consensus.cc:504] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } }
I20260619 06:30:22.176179 10113 leader_election.cc:288] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [CANDIDATE]: Term 6 election: Requested vote from peers c96ab909d8164eda8f3ebd210d06fbd7 (127.7.96.1:38305), febe077b7c1645e1b8d47ba28c8f3832 (127.7.96.3:35437)
I20260619 06:30:22.182878 10116 leader_election.cc:288] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [CANDIDATE]: Term 5 election: Requested vote from peers c96ab909d8164eda8f3ebd210d06fbd7 (127.7.96.1:38305), febe077b7c1645e1b8d47ba28c8f3832 (127.7.96.3:35437)
I20260619 06:30:22.195340 10088 tablet_service.cc:1422] Tablet server b9391b0d0d0143fb8708b0fba4aec26d set to quiescing
I20260619 06:30:22.195585 10088 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260619 06:30:22.206138 9676 raft_consensus.cc:1226] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 5 FOLLOWER]: Rejecting Update request from peer febe077b7c1645e1b8d47ba28c8f3832 for earlier term 4. Current term is 5. Ops: [4.592-4.592]
I20260619 06:30:22.206854 10178 consensus_queue.cc:1046] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 }, Status: INVALID_TERM, Last received: 4.591, Next index: 592, Last known committed idx: 591, Time since last communication: 0.000s
I20260619 06:30:22.207206 10178 raft_consensus.cc:3032] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 4 LEADER]: Stepping down as leader of term 4
I20260619 06:30:22.207306 10178 raft_consensus.cc:729] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: febe077b7c1645e1b8d47ba28c8f3832, State: Running, Role: LEADER
I20260619 06:30:22.207576 10178 consensus_queue.cc:260] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 591, Committed index: 591, Last appended: 4.592, Last appended by leader: 592, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } }
I20260619 06:30:22.218143 10178 raft_consensus.cc:3037] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 4 FOLLOWER]: Advancing to term 5
W20260619 06:30:22.222442 10012 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:53498: Illegal state: Cannot assign timestamp to op. Tablet is not in leader mode. Last heard from a leader: 0.018s ago.
W20260619 06:30:22.224730 10012 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:53498: Illegal state: Cannot assign timestamp to op. Tablet is not in leader mode. Last heard from a leader: 0.020s ago.
W20260619 06:30:22.225937 9636 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:46612: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:22.229224 9636 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:46612: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
I20260619 06:30:22.265499 10116 raft_consensus.cc:1226] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 6 FOLLOWER]: Rejecting Update request from peer febe077b7c1645e1b8d47ba28c8f3832 for earlier term 4. Current term is 6. Ops: [4.592-4.592]
I20260619 06:30:22.267020 9955 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8" candidate_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" candidate_term: 6 candidate_status { last_received { term: 4 index: 591 } } ignore_live_leader: true dest_uuid: "febe077b7c1645e1b8d47ba28c8f3832"
I20260619 06:30:22.267254 9955 raft_consensus.cc:3037] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 5 FOLLOWER]: Advancing to term 6
I20260619 06:30:22.270264 9955 raft_consensus.cc:2396] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b9391b0d0d0143fb8708b0fba4aec26d for term 6 because replica has last-logged OpId of term: 4 index: 592, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 591.
I20260619 06:30:22.270908 9955 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8" candidate_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" candidate_term: 5 candidate_status { last_received { term: 4 index: 591 } } ignore_live_leader: true dest_uuid: "febe077b7c1645e1b8d47ba28c8f3832"
I20260619 06:30:22.271166 9955 raft_consensus.cc:2354] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b9391b0d0d0143fb8708b0fba4aec26d for earlier term 5. Current term is 6.
I20260619 06:30:22.271996 10030 leader_election.cc:398] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [CANDIDATE]: Term 5 election: Vote denied by peer febe077b7c1645e1b8d47ba28c8f3832 (127.7.96.3:35437) with higher term. Message: Invalid argument: T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b9391b0d0d0143fb8708b0fba4aec26d for earlier term 5. Current term is 6.
I20260619 06:30:22.272178 10030 leader_election.cc:401] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260619 06:30:22.276376 10374 raft_consensus.cc:2726] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer febe077b7c1645e1b8d47ba28c8f3832 (127.7.96.3:35437) with higher term. Message: Invalid argument: T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b9391b0d0d0143fb8708b0fba4aec26d for earlier term 5. Current term is 6.
I20260619 06:30:22.281172 10116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8" candidate_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" candidate_term: 5 candidate_status { last_received { term: 4 index: 591 } } ignore_live_leader: true dest_uuid: "b9391b0d0d0143fb8708b0fba4aec26d"
I20260619 06:30:22.281539 10116 raft_consensus.cc:2354] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c96ab909d8164eda8f3ebd210d06fbd7 for earlier term 5. Current term is 6.
I20260619 06:30:22.282155 9610 leader_election.cc:398] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [CANDIDATE]: Term 5 election: Vote denied by peer b9391b0d0d0143fb8708b0fba4aec26d (127.7.96.4:42679) with higher term. Message: Invalid argument: T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c96ab909d8164eda8f3ebd210d06fbd7 for earlier term 5. Current term is 6.
I20260619 06:30:22.282299 9610 leader_election.cc:401] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
W20260619 06:30:22.300843 10068 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60402: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:22.302129 10067 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60402: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:22.311555 9914 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:53498: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:22.312554 9913 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:53498: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:22.321962 9635 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:46612: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:22.323837 9635 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:46612: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:22.329156 10067 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60402: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:22.331460 9610 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.96.4:42679, user_credentials={real_user=slave}} blocked reactor thread for 49390.8us
I20260619 06:30:22.332237 9676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8" candidate_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" candidate_term: 5 candidate_status { last_received { term: 4 index: 591 } } ignore_live_leader: true dest_uuid: "c96ab909d8164eda8f3ebd210d06fbd7"
I20260619 06:30:22.332592 9676 raft_consensus.cc:2379] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b9391b0d0d0143fb8708b0fba4aec26d in current term 5: Already voted for candidate c96ab909d8164eda8f3ebd210d06fbd7 in this term.
W20260619 06:30:22.333920 10067 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60402: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
I20260619 06:30:22.334460 9675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8" candidate_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" candidate_term: 6 candidate_status { last_received { term: 4 index: 591 } } ignore_live_leader: true dest_uuid: "c96ab909d8164eda8f3ebd210d06fbd7"
I20260619 06:30:22.334671 9675 raft_consensus.cc:3037] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 5 FOLLOWER]: Advancing to term 6
I20260619 06:30:22.337610 9675 raft_consensus.cc:2454] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9391b0d0d0143fb8708b0fba4aec26d in term 6.
I20260619 06:30:22.337747 10375 raft_consensus.cc:2726] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer b9391b0d0d0143fb8708b0fba4aec26d (127.7.96.4:42679) with higher term. Message: Invalid argument: T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c96ab909d8164eda8f3ebd210d06fbd7 for earlier term 5. Current term is 6.
W20260619 06:30:22.341229 9913 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:53498: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
I20260619 06:30:22.343887 10029 leader_election.cc:302] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9391b0d0d0143fb8708b0fba4aec26d, c96ab909d8164eda8f3ebd210d06fbd7; no voters: febe077b7c1645e1b8d47ba28c8f3832
I20260619 06:30:22.344336 10374 raft_consensus.cc:2781] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 6 FOLLOWER]: Leader election won for term 6
W20260619 06:30:22.347011 9913 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:53498: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:22.354032 9634 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:46612: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:22.357172 9636 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:46612: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:22.367904 10067 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60402: Service unavailable: leader is not yet ready
W20260619 06:30:22.371171 10067 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60402: Service unavailable: leader is not yet ready
I20260619 06:30:22.379648 10374 raft_consensus.cc:686] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 6 LEADER]: Becoming Leader. State: Replica: b9391b0d0d0143fb8708b0fba4aec26d, State: Running, Role: LEADER
I20260619 06:30:22.380236 10374 consensus_queue.cc:237] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 591, Committed index: 591, Last appended: 4.591, Last appended by leader: 591, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } }
W20260619 06:30:22.381783 10067 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60402: Service unavailable: leader is not yet ready
W20260619 06:30:22.383083 10067 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60402: Service unavailable: leader is not yet ready
I20260619 06:30:22.386514 8810 catalog_manager.cc:5495] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d reported cstate change: term changed from 4 to 6, leader changed from febe077b7c1645e1b8d47ba28c8f3832 (127.7.96.3) to b9391b0d0d0143fb8708b0fba4aec26d (127.7.96.4). New cstate: current_term: 6 leader_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } health_report { overall_health: HEALTHY } } }
I20260619 06:30:22.398689 9955 raft_consensus.cc:1261] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 6 FOLLOWER]: Refusing update from remote peer b9391b0d0d0143fb8708b0fba4aec26d: Log matching property violated. Preceding OpId in replica: term: 4 index: 592. Preceding OpId from leader: term: 6 index: 593. (index mismatch)
I20260619 06:30:22.398846 9675 raft_consensus.cc:1261] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 6 FOLLOWER]: Refusing update from remote peer b9391b0d0d0143fb8708b0fba4aec26d: Log matching property violated. Preceding OpId in replica: term: 4 index: 591. Preceding OpId from leader: term: 6 index: 593. (index mismatch)
I20260619 06:30:22.399616 10374 consensus_queue.cc:1035] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 592, Last known committed idx: 591, Time since last communication: 0.000s
I20260619 06:30:22.400408 10374 consensus_queue.cc:1035] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 592, Last known committed idx: 591, Time since last communication: 0.000s
I20260619 06:30:22.402045 10374 consensus_queue.cc:1225] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [LEADER]: Peer febe077b7c1645e1b8d47ba28c8f3832 log is divergent from this leader: its last log entry 4.592 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 591
I20260619 06:30:22.403271 9955 pending_rounds.cc:76] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832: Aborting all ops after (but not including) 591
I20260619 06:30:22.403400 9955 pending_rounds.cc:97] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832: Aborting uncommitted WRITE_OP operation due to leader change: 4.592
W20260619 06:30:22.403806 9955 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:53498: Aborted: Op aborted by new leader
I20260619 06:30:22.410907 10378 raft_consensus.cc:979] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d: : Instructing follower c96ab909d8164eda8f3ebd210d06fbd7 to start an election
I20260619 06:30:22.417402 10380 raft_consensus.cc:1067] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 6 LEADER]: Signalling peer c96ab909d8164eda8f3ebd210d06fbd7 to start an election
I20260619 06:30:22.420746 10012 mvcc.cc:205] Tried to move back new op lower bound from 7298460149343051776 to 7298460149284315136. Current Snapshot: MvccSnapshot[applied={T|T < 7298460149337444352}]
I20260619 06:30:22.421697 9675 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8"
dest_uuid: "c96ab909d8164eda8f3ebd210d06fbd7"
from {username='slave'} at 127.7.96.4:47467
I20260619 06:30:22.421850 9675 raft_consensus.cc:482] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260619 06:30:22.421928 9675 raft_consensus.cc:3037] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 6 FOLLOWER]: Advancing to term 7
I20260619 06:30:22.423848 10378 raft_consensus.cc:979] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d: : Instructing follower c96ab909d8164eda8f3ebd210d06fbd7 to start an election
I20260619 06:30:22.424033 10378 raft_consensus.cc:1067] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 6 LEADER]: Signalling peer c96ab909d8164eda8f3ebd210d06fbd7 to start an election
I20260619 06:30:22.424882 9675 raft_consensus.cc:504] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } }
I20260619 06:30:22.428514 9954 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8" candidate_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" candidate_term: 7 candidate_status { last_received { term: 6 index: 594 } } ignore_live_leader: true dest_uuid: "febe077b7c1645e1b8d47ba28c8f3832"
I20260619 06:30:22.428928 9675 leader_election.cc:288] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [CANDIDATE]: Term 7 election: Requested vote from peers febe077b7c1645e1b8d47ba28c8f3832 (127.7.96.3:35437), b9391b0d0d0143fb8708b0fba4aec26d (127.7.96.4:42679)
I20260619 06:30:22.429570 9675 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8"
dest_uuid: "c96ab909d8164eda8f3ebd210d06fbd7"
from {username='slave'} at 127.7.96.4:47467
I20260619 06:30:22.429817 9675 raft_consensus.cc:482] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260619 06:30:22.429961 9675 raft_consensus.cc:3037] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 7 FOLLOWER]: Advancing to term 8
I20260619 06:30:22.433414 10116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8" candidate_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" candidate_term: 7 candidate_status { last_received { term: 6 index: 594 } } ignore_live_leader: true dest_uuid: "b9391b0d0d0143fb8708b0fba4aec26d"
I20260619 06:30:22.433605 10116 raft_consensus.cc:3032] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 6 LEADER]: Stepping down as leader of term 6
I20260619 06:30:22.433712 10116 raft_consensus.cc:729] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b9391b0d0d0143fb8708b0fba4aec26d, State: Running, Role: LEADER
I20260619 06:30:22.433966 10116 consensus_queue.cc:260] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 594, Committed index: 594, Last appended: 6.596, Last appended by leader: 596, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } }
W20260619 06:30:22.434132 10068 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60402: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
I20260619 06:30:22.434320 10116 raft_consensus.cc:3037] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 6 FOLLOWER]: Advancing to term 7
I20260619 06:30:22.437382 10116 raft_consensus.cc:2396] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c96ab909d8164eda8f3ebd210d06fbd7 for term 7 because replica has last-logged OpId of term: 6 index: 596, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 594.
I20260619 06:30:22.438084 9610 leader_election.cc:302] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c96ab909d8164eda8f3ebd210d06fbd7; no voters: b9391b0d0d0143fb8708b0fba4aec26d, febe077b7c1645e1b8d47ba28c8f3832
W20260619 06:30:22.440442 9635 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:46612: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
I20260619 06:30:22.432641 9675 raft_consensus.cc:504] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } }
I20260619 06:30:22.441512 10375 raft_consensus.cc:2726] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260619 06:30:22.442463 9675 leader_election.cc:288] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [CANDIDATE]: Term 8 election: Requested vote from peers febe077b7c1645e1b8d47ba28c8f3832 (127.7.96.3:35437), b9391b0d0d0143fb8708b0fba4aec26d (127.7.96.4:42679)
I20260619 06:30:22.444316 10116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8" candidate_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 594 } } ignore_live_leader: true dest_uuid: "b9391b0d0d0143fb8708b0fba4aec26d"
I20260619 06:30:22.444557 10116 raft_consensus.cc:3037] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 7 FOLLOWER]: Advancing to term 8
I20260619 06:30:22.445652 9955 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8" candidate_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 594 } } ignore_live_leader: true dest_uuid: "febe077b7c1645e1b8d47ba28c8f3832"
I20260619 06:30:22.445869 9955 raft_consensus.cc:3037] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 6 FOLLOWER]: Advancing to term 8
W20260619 06:30:22.446897 9913 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:53498: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
I20260619 06:30:22.448191 10116 raft_consensus.cc:2396] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c96ab909d8164eda8f3ebd210d06fbd7 for term 8 because replica has last-logged OpId of term: 6 index: 596, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 594.
W20260619 06:30:22.457050 10068 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60402: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
I20260619 06:30:22.462790 9955 raft_consensus.cc:2396] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c96ab909d8164eda8f3ebd210d06fbd7 for term 8 because replica has last-logged OpId of term: 6 index: 595, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 594.
I20260619 06:30:22.463277 9610 leader_election.cc:302] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c96ab909d8164eda8f3ebd210d06fbd7; no voters: b9391b0d0d0143fb8708b0fba4aec26d, febe077b7c1645e1b8d47ba28c8f3832
I20260619 06:30:22.463681 10375 raft_consensus.cc:2726] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260619 06:30:22.465050 9636 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:46612: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:22.472712 9913 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:53498: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:22.484799 10068 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60402: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:22.498703 9634 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:46612: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:22.513446 9913 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:53498: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:22.528177 10068 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60402: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:22.542351 9634 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:46612: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:22.559964 9913 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:53498: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:22.578766 10068 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60402: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:22.593844 9635 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:46612: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:22.614394 9913 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:53498: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:22.635319 10068 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60402: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:22.655192 9634 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:46612: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
I20260619 06:30:22.657740 9656 tablet_service.cc:1422] Tablet server c96ab909d8164eda8f3ebd210d06fbd7 set to quiescing
I20260619 06:30:22.657971 9656 tablet_service.cc:1429] Tablet server has 0 leaders and 3 scanners
W20260619 06:30:22.664979 10374 raft_consensus.cc:659] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d: failed to trigger leader election: Illegal state: leader elections are disabled
W20260619 06:30:22.674937 9913 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:53498: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:22.696501 10068 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60402: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:22.721004 9631 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:46612: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:22.726944 10178 raft_consensus.cc:659] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832: failed to trigger leader election: Illegal state: leader elections are disabled
W20260619 06:30:22.745406 9913 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:53498: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:22.773191 10068 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60402: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:22.797969 9634 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:46612: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:22.825155 9913 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:53498: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:22.852993 10068 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60402: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:22.879935 9636 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:46612: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:22.889356 10375 raft_consensus.cc:659] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7: failed to trigger leader election: Illegal state: leader elections are disabled
W20260619 06:30:22.911499 9913 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:53498: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:22.946321 10068 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60402: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:22.980177 9631 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:46612: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:23.013327 9913 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:53498: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:23.050420 10068 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60402: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:23.083482 9636 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:46612: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:23.119813 9913 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:53498: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:23.156482 10068 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60402: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:23.193421 9636 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:46612: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:23.230391 9913 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:53498: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:23.272900 10068 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60402: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:23.312803 9636 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:46612: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:23.352967 9913 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:53498: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:23.396255 10068 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60402: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:23.442333 9636 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:46612: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:23.487823 9913 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:53498: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:23.534297 10068 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60402: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:23.582234 9636 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:46612: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:23.632531 9913 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:53498: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:23.683632 10068 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60402: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:23.732926 9636 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:46612: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:23.788015 9913 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:53498: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:23.841398 10068 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60402: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
I20260619 06:30:23.884660 9935 tablet_service.cc:1422] Tablet server febe077b7c1645e1b8d47ba28c8f3832 set to quiescing
I20260619 06:30:23.884927 9935 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
W20260619 06:30:23.893707 9636 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:46612: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:23.949360 9913 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:53498: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:24.006238 10068 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60402: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:24.062461 9636 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:46612: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:24.117708 9913 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:53498: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
I20260619 06:30:24.145188 9656 tablet_service.cc:1422] Tablet server c96ab909d8164eda8f3ebd210d06fbd7 set to quiescing
I20260619 06:30:24.145366 9656 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
W20260619 06:30:24.176939 10068 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60402: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
I20260619 06:30:24.223871 7552 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu pid 9592
I20260619 06:30:24.230719 9717 generic_service.cc:196] Checking for leaks (request via RPC)
W20260619 06:30:24.386823 9636 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:46612: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
I20260619 06:30:24.387349 7552 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu with pid 9592
I20260619 06:30:24.429980 7552 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu
/tmp/dist-test-taskFG9pG8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.96.1:38305
--local_ip_for_outbound_sockets=127.7.96.1
--tserver_master_addrs=127.7.96.62:44861
--webserver_port=36055
--webserver_interface=127.7.96.1
--builtin_ntp_servers=127.7.96.20:37673
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
W20260619 06:30:24.447924 9914 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:53498: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:24.510236 10067 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60402: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:24.570950 9407 meta_cache.cc:302] tablet f83defb033834a9a95a05a9e6182b3b8: replica c96ab909d8164eda8f3ebd210d06fbd7 (127.7.96.1:38305) has failed: Network error: Client connection negotiation failed: client connection to 127.7.96.1:38305: connect: Connection refused (error 111)
W20260619 06:30:24.631767 9914 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:53498: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:24.698472 10067 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60402: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:24.755081 10421 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:30:24.755380 10421 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:30:24.755543 10421 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:30:24.762485 10421 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:30:24.762714 10421 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.96.1
I20260619 06:30:24.771677 10421 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.96.20:37673
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.96.1:38305
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.96.1
--webserver_port=36055
--tserver_master_addrs=127.7.96.62:44861
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.96.1
--log_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:40:48 UTC on ccycloud.quasar-zrzaui.root.comops.site
build id 4455154
ASAN enabled
I20260619 06:30:24.773002 10421 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:30:24.774871 10421 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:30:24.788219 10427 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:30:24.788287 10430 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:30:24.788287 10428 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:30:24.788910 10421 server_base.cc:1034] running on GCE node
I20260619 06:30:24.789471 10421 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:30:24.790299 10421 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:30:24.791533 10421 hybrid_clock.cc:648] HybridClock initialized: now 1781850624791477 us; error 36 us; skew 500 ppm
I20260619 06:30:24.791823 10421 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 06:30:24.793928 10421 webserver.cc:460] Webserver started at http://127.7.96.1:36055/ using document root <none> and password file <none>
I20260619 06:30:24.794781 10421 fs_manager.cc:359] Metadata directory not provided
I20260619 06:30:24.794915 10421 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:30:24.799960 10421 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260619 06:30:24.802717 10436 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:30:24.803952 10421 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 06:30:24.804117 10421 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-0/data,/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-0/wal
uuid: "c96ab909d8164eda8f3ebd210d06fbd7"
format_stamp: "Formatted at 2026-06-19 06:30:05 on dist-test-slave-cvm7"
I20260619 06:30:24.805030 10421 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:30:24.823755 10421 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:30:24.824688 10421 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:30:24.824968 10421 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:30:24.825989 10421 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:30:24.827948 10443 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
W20260619 06:30:24.830998 9914 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:53498: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
I20260619 06:30:24.833408 10421 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260619 06:30:24.833499 10421 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.001s sys 0.000s
I20260619 06:30:24.833592 10421 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260619 06:30:24.836536 10421 ts_tablet_manager.cc:610] Registered 1 tablets
I20260619 06:30:24.836603 10421 ts_tablet_manager.cc:589] Time spent register tablets: real 0.003s user 0.001s sys 0.000s
I20260619 06:30:24.837023 10443 tablet_bootstrap.cc:492] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7: Bootstrap starting.
I20260619 06:30:24.884333 10421 rpc_server.cc:307] RPC server started. Bound to: 127.7.96.1:38305
I20260619 06:30:24.884415 10549 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.96.1:38305 every 8 connection(s)
I20260619 06:30:24.885831 10421 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-0/data/info.pb
I20260619 06:30:24.887890 7552 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu as pid 10421
I20260619 06:30:24.888087 7552 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu pid 9730
W20260619 06:30:24.900990 10067 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60402: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
I20260619 06:30:24.907301 9856 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:30:24.909592 10550 heartbeater.cc:347] Connected to a master server at 127.7.96.62:44861
I20260619 06:30:24.909968 10550 heartbeater.cc:464] Registering TS with master...
I20260619 06:30:24.910919 10550 heartbeater.cc:511] Master 127.7.96.62:44861 requested a full tablet report, sending...
I20260619 06:30:24.913538 8812 ts_manager.cc:194] Re-registered known tserver with Master: c96ab909d8164eda8f3ebd210d06fbd7 (127.7.96.1:38305)
I20260619 06:30:24.915186 8812 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.96.1:40179
I20260619 06:30:25.004351 7552 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu with pid 9730
I20260619 06:30:25.022982 7552 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu
/tmp/dist-test-taskFG9pG8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.96.2:33625
--local_ip_for_outbound_sockets=127.7.96.2
--tserver_master_addrs=127.7.96.62:44861
--webserver_port=43635
--webserver_interface=127.7.96.2
--builtin_ntp_servers=127.7.96.20:37673
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
I20260619 06:30:25.044051 10443 log.cc:824] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7: Log is configured to *not* fsync() on all Append() calls
W20260619 06:30:25.052078 9914 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:53498: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:25.124609 10067 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60402: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:25.271386 9914 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:53498: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:25.346396 10067 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60402: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:25.359699 10558 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:30:25.359938 10558 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:30:25.360074 10558 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:30:25.367051 10558 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:30:25.367259 10558 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.96.2
I20260619 06:30:25.376111 10558 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.96.20:37673
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.96.2:33625
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.96.2
--webserver_port=43635
--tserver_master_addrs=127.7.96.62:44861
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.96.2
--log_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:40:48 UTC on ccycloud.quasar-zrzaui.root.comops.site
build id 4455154
ASAN enabled
I20260619 06:30:25.377314 10558 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:30:25.379017 10558 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:30:25.394249 10564 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:30:25.394222 10565 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:30:25.394948 10567 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:30:25.395337 10558 server_base.cc:1034] running on GCE node
I20260619 06:30:25.396009 10558 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:30:25.397083 10558 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:30:25.398357 10558 hybrid_clock.cc:648] HybridClock initialized: now 1781850625398258 us; error 58 us; skew 500 ppm
I20260619 06:30:25.398700 10558 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 06:30:25.401435 10558 webserver.cc:460] Webserver started at http://127.7.96.2:43635/ using document root <none> and password file <none>
I20260619 06:30:25.402226 10558 fs_manager.cc:359] Metadata directory not provided
I20260619 06:30:25.402354 10558 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:30:25.408779 10558 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.001s
I20260619 06:30:25.412045 10573 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:30:25.413489 10558 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.001s
I20260619 06:30:25.413640 10558 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-1/data,/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-1/wal
uuid: "65f402c7f0df45d09e231eab81183eb6"
format_stamp: "Formatted at 2026-06-19 06:30:06 on dist-test-slave-cvm7"
I20260619 06:30:25.414894 10558 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:30:25.442358 10558 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:30:25.443343 10558 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:30:25.443615 10558 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:30:25.444782 10558 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:30:25.446485 10558 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:30:25.446637 10558 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260619 06:30:25.446744 10558 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:30:25.446815 10558 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:30:25.490002 10558 rpc_server.cc:307] RPC server started. Bound to: 127.7.96.2:33625
I20260619 06:30:25.490031 10685 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.96.2:33625 every 8 connection(s)
I20260619 06:30:25.491763 10558 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-1/data/info.pb
I20260619 06:30:25.493337 7552 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu as pid 10558
I20260619 06:30:25.493551 7552 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu pid 9869
W20260619 06:30:25.496927 9914 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:53498: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
I20260619 06:30:25.517233 9995 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:30:25.523975 10686 heartbeater.cc:347] Connected to a master server at 127.7.96.62:44861
I20260619 06:30:25.524312 10686 heartbeater.cc:464] Registering TS with master...
I20260619 06:30:25.525125 10686 heartbeater.cc:511] Master 127.7.96.62:44861 requested a full tablet report, sending...
I20260619 06:30:25.526737 8812 ts_manager.cc:194] Re-registered known tserver with Master: 65f402c7f0df45d09e231eab81183eb6 (127.7.96.2:33625)
I20260619 06:30:25.527783 8812 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.96.2:48245
W20260619 06:30:25.574313 10067 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60402: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
I20260619 06:30:25.656546 7552 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu with pid 9869
I20260619 06:30:25.682008 7552 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu
/tmp/dist-test-taskFG9pG8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.96.3:35437
--local_ip_for_outbound_sockets=127.7.96.3
--tserver_master_addrs=127.7.96.62:44861
--webserver_port=42369
--webserver_interface=127.7.96.3
--builtin_ntp_servers=127.7.96.20:37673
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
W20260619 06:30:25.730082 9408 meta_cache.cc:302] tablet f83defb033834a9a95a05a9e6182b3b8: replica febe077b7c1645e1b8d47ba28c8f3832 (127.7.96.3:35437) has failed: Network error: Client connection negotiation failed: client connection to 127.7.96.3:35437: connect: Connection refused (error 111)
W20260619 06:30:25.810359 10067 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60402: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
I20260619 06:30:25.919588 10550 heartbeater.cc:503] Master 127.7.96.62:44861 was elected leader, sending a full tablet report...
W20260619 06:30:26.016793 10693 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:30:26.017218 10693 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:30:26.017391 10693 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:30:26.025213 10693 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:30:26.025440 10693 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.96.3
I20260619 06:30:26.034623 10693 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.96.20:37673
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.96.3:35437
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.96.3
--webserver_port=42369
--tserver_master_addrs=127.7.96.62:44861
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.96.3
--log_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:40:48 UTC on ccycloud.quasar-zrzaui.root.comops.site
build id 4455154
ASAN enabled
I20260619 06:30:26.035946 10693 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:30:26.037726 10693 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:30:26.052829 10700 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:30:26.054791 10067 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60402: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:26.055836 10699 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:30:26.056471 10702 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:30:26.057735 10693 server_base.cc:1034] running on GCE node
I20260619 06:30:26.058539 10693 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:30:26.059757 10693 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:30:26.061090 10693 hybrid_clock.cc:648] HybridClock initialized: now 1781850626061014 us; error 39 us; skew 500 ppm
I20260619 06:30:26.061467 10693 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 06:30:26.064393 10693 webserver.cc:460] Webserver started at http://127.7.96.3:42369/ using document root <none> and password file <none>
I20260619 06:30:26.065294 10693 fs_manager.cc:359] Metadata directory not provided
I20260619 06:30:26.065424 10693 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:30:26.072157 10693 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.000s sys 0.004s
I20260619 06:30:26.075699 10708 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:30:26.077389 10693 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260619 06:30:26.077580 10693 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-2/data,/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-2/wal
uuid: "febe077b7c1645e1b8d47ba28c8f3832"
format_stamp: "Formatted at 2026-06-19 06:30:06 on dist-test-slave-cvm7"
I20260619 06:30:26.078851 10693 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:30:26.100234 10693 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:30:26.101145 10693 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:30:26.101511 10693 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:30:26.102701 10693 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:30:26.104985 10715 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260619 06:30:26.110432 10693 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260619 06:30:26.110566 10693 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.001s sys 0.000s
I20260619 06:30:26.110692 10693 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260619 06:30:26.115036 10693 ts_tablet_manager.cc:610] Registered 1 tablets
I20260619 06:30:26.115125 10693 ts_tablet_manager.cc:589] Time spent register tablets: real 0.004s user 0.001s sys 0.003s
I20260619 06:30:26.115553 10715 tablet_bootstrap.cc:492] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832: Bootstrap starting.
I20260619 06:30:26.196516 10693 rpc_server.cc:307] RPC server started. Bound to: 127.7.96.3:35437
I20260619 06:30:26.196568 10821 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.96.3:35437 every 8 connection(s)
I20260619 06:30:26.198316 10693 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-2/data/info.pb
I20260619 06:30:26.200531 7552 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu as pid 10693
I20260619 06:30:26.200712 7552 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu pid 10011
I20260619 06:30:26.268925 10160 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:30:26.277809 10822 heartbeater.cc:347] Connected to a master server at 127.7.96.62:44861
I20260619 06:30:26.278148 10822 heartbeater.cc:464] Registering TS with master...
I20260619 06:30:26.279125 10822 heartbeater.cc:511] Master 127.7.96.62:44861 requested a full tablet report, sending...
I20260619 06:30:26.281755 8812 ts_manager.cc:194] Re-registered known tserver with Master: febe077b7c1645e1b8d47ba28c8f3832 (127.7.96.3:35437)
I20260619 06:30:26.283183 8812 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.96.3:40939
I20260619 06:30:26.433449 10715 log.cc:824] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832: Log is configured to *not* fsync() on all Append() calls
W20260619 06:30:26.486845 10067 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60402: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
I20260619 06:30:26.487882 7552 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu with pid 10011
I20260619 06:30:26.522078 7552 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu
/tmp/dist-test-taskFG9pG8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.96.4:42679
--local_ip_for_outbound_sockets=127.7.96.4
--tserver_master_addrs=127.7.96.62:44861
--webserver_port=34311
--webserver_interface=127.7.96.4
--builtin_ntp_servers=127.7.96.20:37673
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
I20260619 06:30:26.530923 10686 heartbeater.cc:503] Master 127.7.96.62:44861 was elected leader, sending a full tablet report...
W20260619 06:30:26.736877 9408 meta_cache.cc:302] tablet f83defb033834a9a95a05a9e6182b3b8: replica b9391b0d0d0143fb8708b0fba4aec26d (127.7.96.4:42679) has failed: Network error: Client connection negotiation failed: client connection to 127.7.96.4:42679: connect: Connection refused (error 111)
I20260619 06:30:26.797284 10443 tablet_bootstrap.cc:492] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7: Bootstrap replayed 1/1 log segments. Stats: ops{read=594 overwritten=0 applied=594 ignored=0} inserts{seen=29550 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260619 06:30:26.797940 10443 tablet_bootstrap.cc:492] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7: Bootstrap complete.
I20260619 06:30:26.799791 10443 ts_tablet_manager.cc:1397] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7: Time spent bootstrapping tablet: real 1.963s user 1.819s sys 0.136s
I20260619 06:30:26.807343 10443 raft_consensus.cc:348] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 8 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } }
I20260619 06:30:26.808589 10443 raft_consensus.cc:729] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 8 FOLLOWER]: Becoming Follower/Learner. State: Replica: c96ab909d8164eda8f3ebd210d06fbd7, State: Initialized, Role: FOLLOWER
I20260619 06:30:26.809273 10443 consensus_queue.cc:260] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 594, Last appended: 6.594, Last appended by leader: 594, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } }
I20260619 06:30:26.812208 10443 ts_tablet_manager.cc:1428] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7: Time spent starting tablet: real 0.012s user 0.012s sys 0.000s
W20260619 06:30:26.832136 10464 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:26.840797 10464 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:26.889874 10464 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:26.910254 10831 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:30:26.910681 10831 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:30:26.910856 10831 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:30:26.913633 10464 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:26.920009 10831 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:30:26.920248 10831 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.96.4
I20260619 06:30:26.929970 10831 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.96.20:37673
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.96.4:42679
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-3/data/info.pb
--webserver_interface=127.7.96.4
--webserver_port=34311
--tserver_master_addrs=127.7.96.62:44861
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.96.4
--log_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-3/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:40:48 UTC on ccycloud.quasar-zrzaui.root.comops.site
build id 4455154
ASAN enabled
I20260619 06:30:26.931547 10831 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:30:26.933580 10831 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:30:26.949790 10838 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:30:26.949995 10840 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:30:26.950417 10837 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:30:26.951340 10831 server_base.cc:1034] running on GCE node
I20260619 06:30:26.952041 10831 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:30:26.953145 10831 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:30:26.954407 10831 hybrid_clock.cc:648] HybridClock initialized: now 1781850626954336 us; error 50 us; skew 500 ppm
I20260619 06:30:26.954782 10831 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 06:30:26.957444 10831 webserver.cc:460] Webserver started at http://127.7.96.4:34311/ using document root <none> and password file <none>
I20260619 06:30:26.958279 10831 fs_manager.cc:359] Metadata directory not provided
I20260619 06:30:26.958411 10831 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:30:26.964874 10831 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260619 06:30:26.968248 10846 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:30:26.969781 10831 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260619 06:30:26.969942 10831 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-3/data,/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-3/wal
uuid: "b9391b0d0d0143fb8708b0fba4aec26d"
format_stamp: "Formatted at 2026-06-19 06:30:07 on dist-test-slave-cvm7"
I20260619 06:30:26.971231 10831 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-3/wal
metadata directory: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-3/wal
1 data directories: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260619 06:30:26.978257 10464 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
I20260619 06:30:26.994295 10831 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:30:26.995288 10831 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:30:26.995589 10831 kserver.cc:163] Server-wide thread pool size limit: 3276
W20260619 06:30:26.998517 9439 scanner-internal.cc:458] Time spent opening tablet: real 4.024s user 0.005s sys 0.001s
I20260619 06:30:26.998699 10831 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
W20260619 06:30:27.005476 10465 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
I20260619 06:30:27.006054 10854 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260619 06:30:27.013654 10831 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260619 06:30:27.013829 10831 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.012s user 0.005s sys 0.000s
I20260619 06:30:27.014016 10831 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260619 06:30:27.018970 10854 tablet_bootstrap.cc:492] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d: Bootstrap starting.
I20260619 06:30:27.030591 10831 ts_tablet_manager.cc:610] Registered 1 tablets
I20260619 06:30:27.030761 10831 ts_tablet_manager.cc:589] Time spent register tablets: real 0.017s user 0.002s sys 0.003s
I20260619 06:30:27.049337 10832 raft_consensus.cc:482] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:30:27.049746 10832 raft_consensus.cc:504] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } }
I20260619 06:30:27.051744 10832 leader_election.cc:288] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers febe077b7c1645e1b8d47ba28c8f3832 (127.7.96.3:35437), b9391b0d0d0143fb8708b0fba4aec26d (127.7.96.4:42679)
W20260619 06:30:27.072662 10464 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:27.097179 10439 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.96.4:42679: connect: Connection refused (error 111)
W20260619 06:30:27.104067 10464 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:27.115259 10464 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
I20260619 06:30:27.132707 10777 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8" candidate_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" candidate_term: 9 candidate_status { last_received { term: 6 index: 594 } } ignore_live_leader: false dest_uuid: "febe077b7c1645e1b8d47ba28c8f3832" is_pre_election: true
W20260619 06:30:27.140697 10439 leader_election.cc:341] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [CANDIDATE]: Term 9 pre-election: Tablet error from VoteRequest() call to peer febe077b7c1645e1b8d47ba28c8f3832 (127.7.96.3:35437): Illegal state: must be running to vote when last-logged opid is not known
W20260619 06:30:27.165843 10439 leader_election.cc:334] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b9391b0d0d0143fb8708b0fba4aec26d (127.7.96.4:42679): Network error: Client connection negotiation failed: client connection to 127.7.96.4:42679: connect: Connection refused (error 111)
I20260619 06:30:27.166014 10439 leader_election.cc:302] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c96ab909d8164eda8f3ebd210d06fbd7; no voters: b9391b0d0d0143fb8708b0fba4aec26d, febe077b7c1645e1b8d47ba28c8f3832
I20260619 06:30:27.167057 10832 raft_consensus.cc:2726] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260619 06:30:27.185982 10463 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:27.248942 10465 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:27.264698 9437 scanner-internal.cc:458] Time spent opening tablet: real 4.214s user 0.006s sys 0.000s
W20260619 06:30:27.264701 9438 scanner-internal.cc:458] Time spent opening tablet: real 4.123s user 0.005s sys 0.001s
W20260619 06:30:27.271021 10464 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
I20260619 06:30:27.286803 10822 heartbeater.cc:503] Master 127.7.96.62:44861 was elected leader, sending a full tablet report...
W20260619 06:30:27.372726 10465 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:27.387630 10463 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:27.423887 10464 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:27.499522 10463 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:27.518903 10464 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
I20260619 06:30:27.597900 10832 raft_consensus.cc:482] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:30:27.598098 10832 raft_consensus.cc:504] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } }
I20260619 06:30:27.598814 10832 leader_election.cc:288] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers febe077b7c1645e1b8d47ba28c8f3832 (127.7.96.3:35437), b9391b0d0d0143fb8708b0fba4aec26d (127.7.96.4:42679)
I20260619 06:30:27.599862 10777 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8" candidate_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" candidate_term: 9 candidate_status { last_received { term: 6 index: 594 } } ignore_live_leader: false dest_uuid: "febe077b7c1645e1b8d47ba28c8f3832" is_pre_election: true
W20260619 06:30:27.600811 10439 leader_election.cc:341] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [CANDIDATE]: Term 9 pre-election: Tablet error from VoteRequest() call to peer febe077b7c1645e1b8d47ba28c8f3832 (127.7.96.3:35437): Illegal state: must be running to vote when last-logged opid is not known
W20260619 06:30:27.601267 10439 leader_election.cc:334] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b9391b0d0d0143fb8708b0fba4aec26d (127.7.96.4:42679): Network error: Client connection negotiation failed: client connection to 127.7.96.4:42679: connect: Connection refused (error 111)
I20260619 06:30:27.601415 10439 leader_election.cc:302] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c96ab909d8164eda8f3ebd210d06fbd7; no voters: b9391b0d0d0143fb8708b0fba4aec26d, febe077b7c1645e1b8d47ba28c8f3832
I20260619 06:30:27.601852 10832 raft_consensus.cc:2726] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260619 06:30:27.642827 10460 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
I20260619 06:30:27.657407 10854 log.cc:824] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d: Log is configured to *not* fsync() on all Append() calls
W20260619 06:30:27.667634 10461 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:27.767696 9408 meta_cache.cc:302] tablet f83defb033834a9a95a05a9e6182b3b8: replica b9391b0d0d0143fb8708b0fba4aec26d (127.7.96.4:42679) has failed: Network error: Client connection negotiation failed: client connection to 127.7.96.4:42679: connect: Connection refused (error 111)
W20260619 06:30:27.793864 10461 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:27.818825 10460 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:27.821813 10460 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
I20260619 06:30:27.944522 10965 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.96.4:42679 every 8 connection(s)
I20260619 06:30:27.944921 10831 rpc_server.cc:307] RPC server started. Bound to: 127.7.96.4:42679
I20260619 06:30:27.946808 10831 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-3/data/info.pb
W20260619 06:30:27.951931 10465 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
I20260619 06:30:27.955822 7552 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu as pid 10831
W20260619 06:30:27.986405 10465 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
I20260619 06:30:28.026959 10966 heartbeater.cc:347] Connected to a master server at 127.7.96.62:44861
I20260619 06:30:28.027334 10966 heartbeater.cc:464] Registering TS with master...
I20260619 06:30:28.028366 10966 heartbeater.cc:511] Master 127.7.96.62:44861 requested a full tablet report, sending...
I20260619 06:30:28.031198 8815 ts_manager.cc:194] Re-registered known tserver with Master: b9391b0d0d0143fb8708b0fba4aec26d (127.7.96.4:42679)
I20260619 06:30:28.032961 8815 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.96.4:50877
I20260619 06:30:28.083495 10832 raft_consensus.cc:482] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:30:28.083685 10832 raft_consensus.cc:504] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } }
I20260619 06:30:28.084416 10832 leader_election.cc:288] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers febe077b7c1645e1b8d47ba28c8f3832 (127.7.96.3:35437), b9391b0d0d0143fb8708b0fba4aec26d (127.7.96.4:42679)
I20260619 06:30:28.084877 10777 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8" candidate_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" candidate_term: 9 candidate_status { last_received { term: 6 index: 594 } } ignore_live_leader: false dest_uuid: "febe077b7c1645e1b8d47ba28c8f3832" is_pre_election: true
W20260619 06:30:28.085654 10439 leader_election.cc:341] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [CANDIDATE]: Term 9 pre-election: Tablet error from VoteRequest() call to peer febe077b7c1645e1b8d47ba28c8f3832 (127.7.96.3:35437): Illegal state: must be running to vote when last-logged opid is not known
I20260619 06:30:28.117594 10920 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8" candidate_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" candidate_term: 9 candidate_status { last_received { term: 6 index: 594 } } ignore_live_leader: false dest_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" is_pre_election: true
W20260619 06:30:28.124607 10439 leader_election.cc:341] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [CANDIDATE]: Term 9 pre-election: Tablet error from VoteRequest() call to peer b9391b0d0d0143fb8708b0fba4aec26d (127.7.96.4:42679): Illegal state: must be running to vote when last-logged opid is not known
I20260619 06:30:28.124783 10439 leader_election.cc:302] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c96ab909d8164eda8f3ebd210d06fbd7; no voters: b9391b0d0d0143fb8708b0fba4aec26d, febe077b7c1645e1b8d47ba28c8f3832
I20260619 06:30:28.125113 10832 raft_consensus.cc:2726] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260619 06:30:28.197692 10465 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:28.344309 10460 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:28.367139 10465 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:28.374557 10464 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:28.505843 10460 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:28.553890 10460 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:28.563994 10460 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:28.696128 10464 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:28.745999 10460 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:28.889025 10465 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:28.896973 10461 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
I20260619 06:30:28.944350 10995 raft_consensus.cc:482] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:30:28.944980 10995 raft_consensus.cc:504] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } }
W20260619 06:30:28.948534 10460 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
I20260619 06:30:28.950205 10777 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8" candidate_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" candidate_term: 9 candidate_status { last_received { term: 6 index: 594 } } ignore_live_leader: false dest_uuid: "febe077b7c1645e1b8d47ba28c8f3832" is_pre_election: true
W20260619 06:30:28.951090 10439 leader_election.cc:341] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [CANDIDATE]: Term 9 pre-election: Tablet error from VoteRequest() call to peer febe077b7c1645e1b8d47ba28c8f3832 (127.7.96.3:35437): Illegal state: must be running to vote when last-logged opid is not known
I20260619 06:30:28.954803 10920 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8" candidate_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" candidate_term: 9 candidate_status { last_received { term: 6 index: 594 } } ignore_live_leader: false dest_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" is_pre_election: true
W20260619 06:30:28.955461 10439 leader_election.cc:341] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [CANDIDATE]: Term 9 pre-election: Tablet error from VoteRequest() call to peer b9391b0d0d0143fb8708b0fba4aec26d (127.7.96.4:42679): Illegal state: must be running to vote when last-logged opid is not known
I20260619 06:30:28.955605 10439 leader_election.cc:302] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c96ab909d8164eda8f3ebd210d06fbd7; no voters: b9391b0d0d0143fb8708b0fba4aec26d, febe077b7c1645e1b8d47ba28c8f3832
I20260619 06:30:28.964195 10995 leader_election.cc:288] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers febe077b7c1645e1b8d47ba28c8f3832 (127.7.96.3:35437), b9391b0d0d0143fb8708b0fba4aec26d (127.7.96.4:42679)
I20260619 06:30:28.965760 10995 raft_consensus.cc:2726] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260619 06:30:29.038686 10966 heartbeater.cc:503] Master 127.7.96.62:44861 was elected leader, sending a full tablet report...
I20260619 06:30:29.076431 10621 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
W20260619 06:30:29.116443 10464 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
I20260619 06:30:29.120260 10485 tablet_service.cc:1429] Tablet server has 0 leaders and 3 scanners
W20260619 06:30:29.150153 10465 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
I20260619 06:30:29.156447 10757 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260619 06:30:29.157373 10900 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
W20260619 06:30:29.334005 10465 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:29.339927 10465 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
I20260619 06:30:29.341147 10997 raft_consensus.cc:482] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:30:29.341931 10997 raft_consensus.cc:504] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } }
I20260619 06:30:29.342978 10997 leader_election.cc:288] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers febe077b7c1645e1b8d47ba28c8f3832 (127.7.96.3:35437), b9391b0d0d0143fb8708b0fba4aec26d (127.7.96.4:42679)
I20260619 06:30:29.343677 10777 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8" candidate_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" candidate_term: 9 candidate_status { last_received { term: 6 index: 594 } } ignore_live_leader: false dest_uuid: "febe077b7c1645e1b8d47ba28c8f3832" is_pre_election: true
I20260619 06:30:29.344264 10920 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8" candidate_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" candidate_term: 9 candidate_status { last_received { term: 6 index: 594 } } ignore_live_leader: false dest_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" is_pre_election: true
W20260619 06:30:29.345049 10439 leader_election.cc:341] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [CANDIDATE]: Term 9 pre-election: Tablet error from VoteRequest() call to peer b9391b0d0d0143fb8708b0fba4aec26d (127.7.96.4:42679): Illegal state: must be running to vote when last-logged opid is not known
W20260619 06:30:29.345276 10439 leader_election.cc:341] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [CANDIDATE]: Term 9 pre-election: Tablet error from VoteRequest() call to peer febe077b7c1645e1b8d47ba28c8f3832 (127.7.96.3:35437): Illegal state: must be running to vote when last-logged opid is not known
I20260619 06:30:29.345371 10439 leader_election.cc:302] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c96ab909d8164eda8f3ebd210d06fbd7; no voters: b9391b0d0d0143fb8708b0fba4aec26d, febe077b7c1645e1b8d47ba28c8f3832
I20260619 06:30:29.345815 10997 raft_consensus.cc:2726] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260619 06:30:29.364526 10464 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
I20260619 06:30:29.477402 10715 tablet_bootstrap.cc:492] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832: Bootstrap replayed 1/1 log segments. Stats: ops{read=596 overwritten=1 applied=594 ignored=0} inserts{seen=29550 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260619 06:30:29.478188 10715 tablet_bootstrap.cc:492] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832: Bootstrap complete.
I20260619 06:30:29.481402 10715 ts_tablet_manager.cc:1397] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832: Time spent bootstrapping tablet: real 3.366s user 2.343s sys 0.168s
I20260619 06:30:29.487250 10715 raft_consensus.cc:348] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 8 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } }
I20260619 06:30:29.525741 10715 raft_consensus.cc:729] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 8 FOLLOWER]: Becoming Follower/Learner. State: Replica: febe077b7c1645e1b8d47ba28c8f3832, State: Initialized, Role: FOLLOWER
I20260619 06:30:29.526882 10715 consensus_queue.cc:260] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 594, Last appended: 6.595, Last appended by leader: 595, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } }
I20260619 06:30:29.533416 10715 ts_tablet_manager.cc:1428] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832: Time spent starting tablet: real 0.052s user 0.014s sys 0.017s
W20260619 06:30:29.556226 10464 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:29.574700 10464 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:29.586016 10464 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:29.660805 10737 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:33944: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:29.687570 10737 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:33944: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:29.816010 10465 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
I20260619 06:30:29.818758 11010 raft_consensus.cc:482] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:30:29.819078 11010 raft_consensus.cc:504] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } }
I20260619 06:30:29.820823 11010 leader_election.cc:288] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c96ab909d8164eda8f3ebd210d06fbd7 (127.7.96.1:38305), b9391b0d0d0143fb8708b0fba4aec26d (127.7.96.4:42679)
I20260619 06:30:29.852082 10920 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8" candidate_uuid: "febe077b7c1645e1b8d47ba28c8f3832" candidate_term: 9 candidate_status { last_received { term: 6 index: 595 } } ignore_live_leader: false dest_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" is_pre_election: true
W20260619 06:30:29.853175 10711 leader_election.cc:341] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [CANDIDATE]: Term 9 pre-election: Tablet error from VoteRequest() call to peer b9391b0d0d0143fb8708b0fba4aec26d (127.7.96.4:42679): Illegal state: must be running to vote when last-logged opid is not known
I20260619 06:30:29.853617 10505 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8" candidate_uuid: "febe077b7c1645e1b8d47ba28c8f3832" candidate_term: 9 candidate_status { last_received { term: 6 index: 595 } } ignore_live_leader: false dest_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" is_pre_election: true
I20260619 06:30:29.854044 10505 raft_consensus.cc:2454] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate febe077b7c1645e1b8d47ba28c8f3832 in term 8.
I20260619 06:30:29.854609 10710 leader_election.cc:302] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c96ab909d8164eda8f3ebd210d06fbd7, febe077b7c1645e1b8d47ba28c8f3832; no voters: b9391b0d0d0143fb8708b0fba4aec26d
I20260619 06:30:29.855057 11010 raft_consensus.cc:2781] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260619 06:30:29.855249 11010 raft_consensus.cc:482] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 06:30:29.855368 11010 raft_consensus.cc:3037] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 8 FOLLOWER]: Advancing to term 9
I20260619 06:30:29.860618 11010 raft_consensus.cc:504] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } }
I20260619 06:30:29.861348 11010 leader_election.cc:288] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [CANDIDATE]: Term 9 election: Requested vote from peers c96ab909d8164eda8f3ebd210d06fbd7 (127.7.96.1:38305), b9391b0d0d0143fb8708b0fba4aec26d (127.7.96.4:42679)
I20260619 06:30:29.861609 10505 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8" candidate_uuid: "febe077b7c1645e1b8d47ba28c8f3832" candidate_term: 9 candidate_status { last_received { term: 6 index: 595 } } ignore_live_leader: false dest_uuid: "c96ab909d8164eda8f3ebd210d06fbd7"
I20260619 06:30:29.861809 10505 raft_consensus.cc:3037] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 8 FOLLOWER]: Advancing to term 9
I20260619 06:30:29.861846 10920 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8" candidate_uuid: "febe077b7c1645e1b8d47ba28c8f3832" candidate_term: 9 candidate_status { last_received { term: 6 index: 595 } } ignore_live_leader: false dest_uuid: "b9391b0d0d0143fb8708b0fba4aec26d"
W20260619 06:30:29.862360 10711 leader_election.cc:341] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [CANDIDATE]: Term 9 election: Tablet error from VoteRequest() call to peer b9391b0d0d0143fb8708b0fba4aec26d (127.7.96.4:42679): Illegal state: must be running to vote when last-logged opid is not known
I20260619 06:30:29.866740 10505 raft_consensus.cc:2454] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate febe077b7c1645e1b8d47ba28c8f3832 in term 9.
I20260619 06:30:29.867187 10710 leader_election.cc:302] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c96ab909d8164eda8f3ebd210d06fbd7, febe077b7c1645e1b8d47ba28c8f3832; no voters: b9391b0d0d0143fb8708b0fba4aec26d
I20260619 06:30:29.867491 11010 raft_consensus.cc:2781] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 9 FOLLOWER]: Leader election won for term 9
I20260619 06:30:29.868386 11010 raft_consensus.cc:686] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 9 LEADER]: Becoming Leader. State: Replica: febe077b7c1645e1b8d47ba28c8f3832, State: Running, Role: LEADER
I20260619 06:30:29.868999 11010 consensus_queue.cc:237] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 594, Committed index: 594, Last appended: 6.595, Last appended by leader: 595, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } }
I20260619 06:30:29.875445 8815 catalog_manager.cc:5495] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 reported cstate change: term changed from 6 to 9, leader changed from b9391b0d0d0143fb8708b0fba4aec26d (127.7.96.4) to febe077b7c1645e1b8d47ba28c8f3832 (127.7.96.3). New cstate: current_term: 9 leader_uuid: "febe077b7c1645e1b8d47ba28c8f3832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } health_report { overall_health: UNKNOWN } } }
I20260619 06:30:29.896998 10505 raft_consensus.cc:1261] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 9 FOLLOWER]: Refusing update from remote peer febe077b7c1645e1b8d47ba28c8f3832: Log matching property violated. Preceding OpId in replica: term: 6 index: 594. Preceding OpId from leader: term: 9 index: 597. (index mismatch)
W20260619 06:30:29.897065 10711 consensus_peers.cc:487] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 -> Peer b9391b0d0d0143fb8708b0fba4aec26d (127.7.96.4:42679): Couldn't send request to peer b9391b0d0d0143fb8708b0fba4aec26d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260619 06:30:29.897955 11015 consensus_queue.cc:1035] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 596, Last known committed idx: 594, Time since last communication: 0.000s
I20260619 06:30:29.975659 11009 mvcc.cc:205] Tried to move back new op lower bound from 7298460180049575936 to 7298460179948294144. Current Snapshot: MvccSnapshot[applied={T|T < 7298460180049575936 or (T in {7298460180049575936})}]
W20260619 06:30:30.331563 10711 consensus_peers.cc:487] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 -> Peer b9391b0d0d0143fb8708b0fba4aec26d (127.7.96.4:42679): Couldn't send request to peer b9391b0d0d0143fb8708b0fba4aec26d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
I20260619 06:30:30.430017 10854 tablet_bootstrap.cc:492] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d: Bootstrap replayed 1/1 log segments. Stats: ops{read=596 overwritten=0 applied=594 ignored=0} inserts{seen=29550 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 2 replicates
I20260619 06:30:30.430939 10854 tablet_bootstrap.cc:492] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d: Bootstrap complete.
I20260619 06:30:30.432757 10854 ts_tablet_manager.cc:1397] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d: Time spent bootstrapping tablet: real 3.414s user 2.729s sys 0.173s
I20260619 06:30:30.437112 10854 raft_consensus.cc:348] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 8 FOLLOWER]: Replica starting. Triggering 2 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } }
I20260619 06:30:30.451280 10854 raft_consensus.cc:729] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 8 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9391b0d0d0143fb8708b0fba4aec26d, State: Initialized, Role: FOLLOWER
I20260619 06:30:30.452039 10854 consensus_queue.cc:260] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 594, Last appended: 6.596, Last appended by leader: 596, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } }
I20260619 06:30:30.470371 10854 ts_tablet_manager.cc:1428] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d: Time spent starting tablet: real 0.037s user 0.021s sys 0.008s
I20260619 06:30:30.529508 10920 raft_consensus.cc:3037] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 8 FOLLOWER]: Advancing to term 9
I20260619 06:30:30.542027 10920 pending_rounds.cc:76] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d: Aborting all ops after (but not including) 595
I20260619 06:30:30.542249 10920 pending_rounds.cc:97] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d: Aborting uncommitted WRITE_OP operation due to leader change: 6.596
I20260619 06:30:30.768065 11033 mvcc.cc:205] Tried to move back new op lower bound from 7298460182600876032 to 7298460179948294144. Current Snapshot: MvccSnapshot[applied={T|T < 7298460182575611904 or (T in {7298460182593986560,7298460182600876032})}]
I20260619 06:30:35.838932 10621 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260619 06:30:35.883980 10900 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260619 06:30:35.908481 10757 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20260619 06:30:35.912261 10485 tablet_service.cc:1429] Tablet server has 0 leaders and 3 scanners
I20260619 06:30:37.290061 8815 ts_manager.cc:281] Unset tserver state for c96ab909d8164eda8f3ebd210d06fbd7 from MAINTENANCE_MODE
I20260619 06:30:37.560366 10686 heartbeater.cc:511] Master 127.7.96.62:44861 requested a full tablet report, sending...
I20260619 06:30:37.694289 10966 heartbeater.cc:511] Master 127.7.96.62:44861 requested a full tablet report, sending...
I20260619 06:30:37.696731 10822 heartbeater.cc:511] Master 127.7.96.62:44861 requested a full tablet report, sending...
W20260619 06:30:37.936307 9435 meta_cache.cc:1261] Time spent looking up entry by key: real 0.053s user 0.001s sys 0.000s
I20260619 06:30:37.965896 10550 heartbeater.cc:511] Master 127.7.96.62:44861 requested a full tablet report, sending...
I20260619 06:30:38.070050 8815 ts_manager.cc:281] Unset tserver state for b9391b0d0d0143fb8708b0fba4aec26d from MAINTENANCE_MODE
I20260619 06:30:38.223439 8815 ts_manager.cc:281] Unset tserver state for 65f402c7f0df45d09e231eab81183eb6 from MAINTENANCE_MODE
I20260619 06:30:38.412307 8815 ts_manager.cc:281] Unset tserver state for febe077b7c1645e1b8d47ba28c8f3832 from MAINTENANCE_MODE
I20260619 06:30:38.563895 10686 heartbeater.cc:511] Master 127.7.96.62:44861 requested a full tablet report, sending...
I20260619 06:30:38.698518 10966 heartbeater.cc:511] Master 127.7.96.62:44861 requested a full tablet report, sending...
I20260619 06:30:38.701124 10822 heartbeater.cc:511] Master 127.7.96.62:44861 requested a full tablet report, sending...
I20260619 06:30:38.969573 10550 heartbeater.cc:511] Master 127.7.96.62:44861 requested a full tablet report, sending...
I20260619 06:30:40.288492 8812 ts_manager.cc:292] Set tserver state for b9391b0d0d0143fb8708b0fba4aec26d to MAINTENANCE_MODE
I20260619 06:30:40.701457 8812 ts_manager.cc:292] Set tserver state for febe077b7c1645e1b8d47ba28c8f3832 to MAINTENANCE_MODE
I20260619 06:30:40.788486 8812 ts_manager.cc:292] Set tserver state for 65f402c7f0df45d09e231eab81183eb6 to MAINTENANCE_MODE
I20260619 06:30:41.483048 8812 ts_manager.cc:292] Set tserver state for c96ab909d8164eda8f3ebd210d06fbd7 to MAINTENANCE_MODE
I20260619 06:30:42.355075 10485 tablet_service.cc:1422] Tablet server c96ab909d8164eda8f3ebd210d06fbd7 set to quiescing
I20260619 06:30:42.355324 10485 tablet_service.cc:1429] Tablet server has 0 leaders and 3 scanners
I20260619 06:30:42.510874 10757 tablet_service.cc:1422] Tablet server febe077b7c1645e1b8d47ba28c8f3832 set to quiescing
I20260619 06:30:42.511116 10757 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20260619 06:30:42.512827 11152 raft_consensus.cc:979] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832: : Instructing follower b9391b0d0d0143fb8708b0fba4aec26d to start an election
I20260619 06:30:42.512972 11152 raft_consensus.cc:1067] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 9 LEADER]: Signalling peer b9391b0d0d0143fb8708b0fba4aec26d to start an election
I20260619 06:30:42.525141 11096 raft_consensus.cc:979] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832: : Instructing follower b9391b0d0d0143fb8708b0fba4aec26d to start an election
I20260619 06:30:42.525287 11096 raft_consensus.cc:1067] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 9 LEADER]: Signalling peer b9391b0d0d0143fb8708b0fba4aec26d to start an election
I20260619 06:30:42.526244 10919 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8"
dest_uuid: "b9391b0d0d0143fb8708b0fba4aec26d"
from {username='slave'} at 127.7.96.3:51847
I20260619 06:30:42.526547 10919 raft_consensus.cc:482] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260619 06:30:42.526755 10919 raft_consensus.cc:3037] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 9 FOLLOWER]: Advancing to term 10
I20260619 06:30:42.526731 10920 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8"
dest_uuid: "b9391b0d0d0143fb8708b0fba4aec26d"
from {username='slave'} at 127.7.96.3:51847
I20260619 06:30:42.529560 10919 raft_consensus.cc:504] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } }
I20260619 06:30:42.530081 10920 raft_consensus.cc:482] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260619 06:30:42.530205 10920 raft_consensus.cc:3037] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 10 FOLLOWER]: Advancing to term 11
I20260619 06:30:42.533218 10920 raft_consensus.cc:504] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } }
I20260619 06:30:42.536424 10919 leader_election.cc:288] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [CANDIDATE]: Term 10 election: Requested vote from peers c96ab909d8164eda8f3ebd210d06fbd7 (127.7.96.1:38305), febe077b7c1645e1b8d47ba28c8f3832 (127.7.96.3:35437)
I20260619 06:30:42.541252 10920 leader_election.cc:288] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [CANDIDATE]: Term 11 election: Requested vote from peers c96ab909d8164eda8f3ebd210d06fbd7 (127.7.96.1:38305), febe077b7c1645e1b8d47ba28c8f3832 (127.7.96.3:35437)
I20260619 06:30:42.548460 10920 raft_consensus.cc:1226] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 11 FOLLOWER]: Rejecting Update request from peer febe077b7c1645e1b8d47ba28c8f3832 for earlier term 9. Current term is 11. Ops: [9.1709-9.1709]
I20260619 06:30:42.549168 11152 consensus_queue.cc:1046] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 }, Status: INVALID_TERM, Last received: 9.1708, Next index: 1709, Last known committed idx: 1708, Time since last communication: 0.000s
I20260619 06:30:42.549676 11152 raft_consensus.cc:3032] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 9 LEADER]: Stepping down as leader of term 9
I20260619 06:30:42.549845 11152 raft_consensus.cc:729] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: febe077b7c1645e1b8d47ba28c8f3832, State: Running, Role: LEADER
I20260619 06:30:42.550303 11152 consensus_queue.cc:260] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1709, Committed index: 1709, Last appended: 9.1709, Last appended by leader: 1709, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } }
I20260619 06:30:42.551589 11152 raft_consensus.cc:3037] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 9 FOLLOWER]: Advancing to term 11
W20260619 06:30:42.552508 11009 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:33944: Illegal state: Cannot assign timestamp to op. Tablet is not in leader mode. Last heard from a leader: 0.002s ago.
W20260619 06:30:42.559744 11009 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:33944: Illegal state: Cannot assign timestamp to op. Tablet is not in leader mode. Last heard from a leader: 0.009s ago.
W20260619 06:30:42.561532 10462 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:42.565491 10460 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:42.567466 10879 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60728: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:42.570925 10879 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60728: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
I20260619 06:30:42.571372 10504 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8" candidate_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" candidate_term: 10 candidate_status { last_received { term: 9 index: 1708 } } ignore_live_leader: true dest_uuid: "c96ab909d8164eda8f3ebd210d06fbd7"
I20260619 06:30:42.571604 10504 raft_consensus.cc:3037] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 9 FOLLOWER]: Advancing to term 10
I20260619 06:30:42.572160 10503 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8" candidate_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" candidate_term: 11 candidate_status { last_received { term: 9 index: 1708 } } ignore_live_leader: true dest_uuid: "c96ab909d8164eda8f3ebd210d06fbd7"
I20260619 06:30:42.573024 10777 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8" candidate_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" candidate_term: 11 candidate_status { last_received { term: 9 index: 1708 } } ignore_live_leader: true dest_uuid: "febe077b7c1645e1b8d47ba28c8f3832"
I20260619 06:30:42.574445 10777 raft_consensus.cc:2396] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b9391b0d0d0143fb8708b0fba4aec26d for term 11 because replica has last-logged OpId of term: 9 index: 1709, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 1708.
I20260619 06:30:42.574648 10504 raft_consensus.cc:2396] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b9391b0d0d0143fb8708b0fba4aec26d for term 10 because replica has last-logged OpId of term: 9 index: 1709, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 1708.
I20260619 06:30:42.573207 10776 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8" candidate_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" candidate_term: 10 candidate_status { last_received { term: 9 index: 1708 } } ignore_live_leader: true dest_uuid: "febe077b7c1645e1b8d47ba28c8f3832"
I20260619 06:30:42.575078 10776 raft_consensus.cc:2354] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b9391b0d0d0143fb8708b0fba4aec26d for earlier term 10. Current term is 11.
I20260619 06:30:42.575021 10849 leader_election.cc:302] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9391b0d0d0143fb8708b0fba4aec26d; no voters: c96ab909d8164eda8f3ebd210d06fbd7, febe077b7c1645e1b8d47ba28c8f3832
I20260619 06:30:42.575788 11249 raft_consensus.cc:2726] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260619 06:30:42.576208 10849 leader_election.cc:398] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [CANDIDATE]: Term 10 election: Vote denied by peer febe077b7c1645e1b8d47ba28c8f3832 (127.7.96.3:35437) with higher term. Message: Invalid argument: T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b9391b0d0d0143fb8708b0fba4aec26d for earlier term 10. Current term is 11.
I20260619 06:30:42.576303 10849 leader_election.cc:401] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260619 06:30:42.576706 11249 raft_consensus.cc:2726] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer febe077b7c1645e1b8d47ba28c8f3832 (127.7.96.3:35437) with higher term. Message: Invalid argument: T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b9391b0d0d0143fb8708b0fba4aec26d for earlier term 10. Current term is 11.
W20260619 06:30:42.577593 10736 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:33944: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:42.581310 10736 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:33944: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:42.589210 10462 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:42.592460 10461 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:42.597857 10879 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60728: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:42.599258 10879 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60728: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:42.609867 10736 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:33944: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:42.611084 10736 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:33944: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:42.622987 10461 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:42.624755 10460 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:42.638882 10879 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60728: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:42.640053 10879 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60728: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:42.652719 10736 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:33944: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:42.655418 10736 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:33944: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:42.670861 10461 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:42.671446 10463 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:42.689038 10879 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60728: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:42.693102 10879 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60728: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:42.707948 10736 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:33944: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:42.711871 10736 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:33944: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:42.727035 10463 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:42.727865 10463 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:42.742888 10879 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60728: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:42.744867 10879 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60728: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:42.764966 10736 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:33944: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:42.765506 10735 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:33944: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:42.783878 10465 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:42.790468 10463 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
I20260619 06:30:42.794457 10900 tablet_service.cc:1422] Tablet server b9391b0d0d0143fb8708b0fba4aec26d set to quiescing
I20260619 06:30:42.794715 10900 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
W20260619 06:30:42.805778 10879 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60728: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:42.812964 10879 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60728: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:42.829493 10735 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:33944: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:42.836740 10735 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:33944: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:42.851843 10461 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:42.853418 11271 raft_consensus.cc:659] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7: failed to trigger leader election: Illegal state: leader elections are disabled
I20260619 06:30:42.859452 10621 tablet_service.cc:1422] Tablet server 65f402c7f0df45d09e231eab81183eb6 set to quiescing
I20260619 06:30:42.859695 10621 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
W20260619 06:30:42.861419 10463 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:42.876703 10879 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60728: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:42.884320 10879 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60728: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:42.903163 10735 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:33944: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:42.909173 10735 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:33944: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:42.911087 11249 raft_consensus.cc:659] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d: failed to trigger leader election: Illegal state: leader elections are disabled
W20260619 06:30:42.914754 11152 raft_consensus.cc:659] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832: failed to trigger leader election: Illegal state: leader elections are disabled
W20260619 06:30:42.931200 10465 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:42.937049 10463 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:42.957023 10879 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60728: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:42.965525 10879 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60728: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:42.987234 10735 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:33944: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:42.993317 10735 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:33944: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:43.017597 10461 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:43.024308 10461 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:43.047416 10879 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60728: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:43.056187 10879 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60728: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:43.078827 10735 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:33944: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:43.090221 10735 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:33944: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:43.113176 10461 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:43.120213 10463 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:43.148787 10879 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60728: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:43.151090 10879 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60728: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:43.186020 10735 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:33944: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:43.186072 10736 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:33944: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:43.219513 10465 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:43.221551 10461 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:43.256542 10879 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60728: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:43.257005 10878 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60728: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:43.297058 10736 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:33944: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:43.297783 10735 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:33944: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:43.333323 10461 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:43.334642 10461 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:43.374425 10878 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60728: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:43.374519 10879 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60728: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:43.415421 10735 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:33944: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:43.416446 10735 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:33944: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:43.455314 10465 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:43.456384 10465 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:43.497754 10878 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60728: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:43.498827 10878 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60728: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:43.541913 10735 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:33944: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:43.544960 10735 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:33944: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:43.585232 10465 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:43.587080 10465 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:43.630416 10878 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60728: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:43.632254 10878 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60728: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:43.678350 10735 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:33944: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:43.679275 10736 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:33944: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:43.724526 10465 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:43.727702 10465 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:43.774520 10878 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60728: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:43.775386 10879 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60728: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:43.827136 10736 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:33944: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:43.827858 10735 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:33944: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:43.878228 10465 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:43.880151 10465 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:43.930960 10879 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60728: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:43.932533 10879 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60728: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
I20260619 06:30:43.934193 10485 tablet_service.cc:1422] Tablet server c96ab909d8164eda8f3ebd210d06fbd7 set to quiescing
I20260619 06:30:43.934420 10485 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
W20260619 06:30:43.986212 10735 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:33944: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:43.987587 10735 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:33944: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:44.040674 10465 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:44.042577 10461 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:34224: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
I20260619 06:30:44.091193 10757 tablet_service.cc:1422] Tablet server febe077b7c1645e1b8d47ba28c8f3832 set to quiescing
I20260619 06:30:44.091485 10757 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
W20260619 06:30:44.093081 10879 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60728: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:44.099201 10879 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60728: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:44.150410 10735 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:33944: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:44.157949 10735 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:33944: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
I20260619 06:30:44.170673 7552 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu pid 10421
I20260619 06:30:44.177277 10544 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:30:44.366250 7552 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu with pid 10421
W20260619 06:30:44.411001 9407 meta_cache.cc:302] tablet f83defb033834a9a95a05a9e6182b3b8: replica c96ab909d8164eda8f3ebd210d06fbd7 (127.7.96.1:38305) has failed: Network error: recv got EOF from 127.7.96.1:38305 (error 108)
I20260619 06:30:44.411689 7552 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu
/tmp/dist-test-taskFG9pG8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.96.1:38305
--local_ip_for_outbound_sockets=127.7.96.1
--tserver_master_addrs=127.7.96.62:44861
--webserver_port=36055
--webserver_interface=127.7.96.1
--builtin_ntp_servers=127.7.96.20:37673
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
W20260619 06:30:44.468264 10879 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60728: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:44.469347 10879 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60728: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:44.530030 10735 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:33944: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:44.531217 10735 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:33944: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:44.649704 10879 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60728: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:44.652755 10879 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60728: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:44.712996 10735 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:33944: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:44.742654 11299 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:30:44.742967 11299 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:30:44.743103 11299 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:30:44.750057 11299 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:30:44.750264 11299 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.96.1
I20260619 06:30:44.759125 11299 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.96.20:37673
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.96.1:38305
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.96.1
--webserver_port=36055
--tserver_master_addrs=127.7.96.62:44861
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.96.1
--log_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:40:48 UTC on ccycloud.quasar-zrzaui.root.comops.site
build id 4455154
ASAN enabled
I20260619 06:30:44.760347 11299 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:30:44.762076 11299 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:30:44.774816 11306 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:30:44.774878 11308 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:30:44.775380 11305 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:30:44.776443 10735 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:33944: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:44.776417 10879 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60728: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
I20260619 06:30:44.780082 11299 server_base.cc:1034] running on GCE node
I20260619 06:30:44.780735 11299 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:30:44.781585 11299 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:30:44.782789 11299 hybrid_clock.cc:648] HybridClock initialized: now 1781850644782704 us; error 55 us; skew 500 ppm
I20260619 06:30:44.783092 11299 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 06:30:44.785419 11299 webserver.cc:460] Webserver started at http://127.7.96.1:36055/ using document root <none> and password file <none>
I20260619 06:30:44.786175 11299 fs_manager.cc:359] Metadata directory not provided
I20260619 06:30:44.786270 11299 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:30:44.791370 11299 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20260619 06:30:44.794180 11314 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:30:44.795552 11299 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260619 06:30:44.795683 11299 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-0/data,/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-0/wal
uuid: "c96ab909d8164eda8f3ebd210d06fbd7"
format_stamp: "Formatted at 2026-06-19 06:30:05 on dist-test-slave-cvm7"
I20260619 06:30:44.796610 11299 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:30:44.819562 11299 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:30:44.820385 11299 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:30:44.820631 11299 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:30:44.821584 11299 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:30:44.823315 11321 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260619 06:30:44.828635 11299 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260619 06:30:44.828763 11299 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.000s sys 0.001s
I20260619 06:30:44.828881 11299 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260619 06:30:44.831844 11299 ts_tablet_manager.cc:610] Registered 1 tablets
I20260619 06:30:44.831938 11299 ts_tablet_manager.cc:589] Time spent register tablets: real 0.003s user 0.000s sys 0.002s
I20260619 06:30:44.832221 11321 tablet_bootstrap.cc:492] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7: Bootstrap starting.
W20260619 06:30:44.839191 10879 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60728: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
I20260619 06:30:44.887538 11299 rpc_server.cc:307] RPC server started. Bound to: 127.7.96.1:38305
I20260619 06:30:44.887581 11427 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.96.1:38305 every 8 connection(s)
I20260619 06:30:44.889055 11299 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-0/data/info.pb
I20260619 06:30:44.890702 7552 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu as pid 11299
I20260619 06:30:44.890910 7552 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu pid 10558
W20260619 06:30:44.903311 10735 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:33944: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:44.904843 10735 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:33944: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
I20260619 06:30:44.921185 10680 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:30:44.923581 11428 heartbeater.cc:347] Connected to a master server at 127.7.96.62:44861
I20260619 06:30:44.923898 11428 heartbeater.cc:464] Registering TS with master...
I20260619 06:30:44.924649 11428 heartbeater.cc:511] Master 127.7.96.62:44861 requested a full tablet report, sending...
I20260619 06:30:44.927211 8815 ts_manager.cc:194] Re-registered known tserver with Master: c96ab909d8164eda8f3ebd210d06fbd7 (127.7.96.1:38305)
I20260619 06:30:44.928884 8815 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.96.1:55369
I20260619 06:30:45.035503 7552 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu with pid 10558
W20260619 06:30:45.049660 10879 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60728: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:45.050892 10879 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60728: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
I20260619 06:30:45.059141 7552 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu
/tmp/dist-test-taskFG9pG8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.96.2:33625
--local_ip_for_outbound_sockets=127.7.96.2
--tserver_master_addrs=127.7.96.62:44861
--webserver_port=43635
--webserver_interface=127.7.96.2
--builtin_ntp_servers=127.7.96.20:37673
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
W20260619 06:30:45.117931 10735 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:33944: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:45.119029 10736 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:33944: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:45.253367 10879 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60728: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:45.256532 10879 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60728: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:45.323784 10736 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:33944: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:45.329347 10736 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:33944: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
I20260619 06:30:45.349436 11321 log.cc:824] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7: Log is configured to *not* fsync() on all Append() calls
W20260619 06:30:45.392488 11436 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:30:45.392730 11436 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:30:45.392861 11436 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:30:45.402474 11436 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:30:45.402778 11436 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.96.2
I20260619 06:30:45.413913 11436 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.96.20:37673
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.96.2:33625
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.96.2
--webserver_port=43635
--tserver_master_addrs=127.7.96.62:44861
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.96.2
--log_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:40:48 UTC on ccycloud.quasar-zrzaui.root.comops.site
build id 4455154
ASAN enabled
I20260619 06:30:45.415160 11436 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:30:45.416796 11436 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:30:45.430905 11445 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:30:45.430809 11443 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:30:45.431237 11442 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:30:45.431794 11436 server_base.cc:1034] running on GCE node
I20260619 06:30:45.432348 11436 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:30:45.433315 11436 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:30:45.434584 11436 hybrid_clock.cc:648] HybridClock initialized: now 1781850645434484 us; error 34 us; skew 500 ppm
I20260619 06:30:45.434855 11436 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 06:30:45.437024 11436 webserver.cc:460] Webserver started at http://127.7.96.2:43635/ using document root <none> and password file <none>
I20260619 06:30:45.437714 11436 fs_manager.cc:359] Metadata directory not provided
I20260619 06:30:45.437855 11436 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:30:45.442723 11436 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260619 06:30:45.445281 11451 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:30:45.446684 11436 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 06:30:45.446842 11436 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-1/data,/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-1/wal
uuid: "65f402c7f0df45d09e231eab81183eb6"
format_stamp: "Formatted at 2026-06-19 06:30:06 on dist-test-slave-cvm7"
I20260619 06:30:45.447779 11436 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:30:45.466850 11436 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:30:45.467586 11436 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:30:45.467854 11436 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:30:45.469424 11436 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
W20260619 06:30:45.469498 10879 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60728: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
I20260619 06:30:45.471004 11436 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:30:45.471114 11436 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:30:45.471230 11436 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:30:45.471311 11436 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
W20260619 06:30:45.479707 10879 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60728: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
I20260619 06:30:45.512744 11436 rpc_server.cc:307] RPC server started. Bound to: 127.7.96.2:33625
I20260619 06:30:45.512835 11563 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.96.2:33625 every 8 connection(s)
I20260619 06:30:45.514158 11436 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-1/data/info.pb
I20260619 06:30:45.519331 7552 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu as pid 11436
I20260619 06:30:45.519496 7552 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu pid 10693
I20260619 06:30:45.529719 10816 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:30:45.529949 11564 heartbeater.cc:347] Connected to a master server at 127.7.96.62:44861
I20260619 06:30:45.530234 11564 heartbeater.cc:464] Registering TS with master...
I20260619 06:30:45.531102 11564 heartbeater.cc:511] Master 127.7.96.62:44861 requested a full tablet report, sending...
I20260619 06:30:45.532456 8815 ts_manager.cc:194] Re-registered known tserver with Master: 65f402c7f0df45d09e231eab81183eb6 (127.7.96.2:33625)
I20260619 06:30:45.533612 8815 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.96.2:58995
W20260619 06:30:45.747394 10736 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:33944: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:45.748201 10735 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:33944: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
I20260619 06:30:45.748288 7552 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu with pid 10693
W20260619 06:30:45.780301 8801 connection.cc:535] server connection from 127.7.96.3:40939 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260619 06:30:45.780776 7552 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu
/tmp/dist-test-taskFG9pG8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.96.3:35437
--local_ip_for_outbound_sockets=127.7.96.3
--tserver_master_addrs=127.7.96.62:44861
--webserver_port=42369
--webserver_interface=127.7.96.3
--builtin_ntp_servers=127.7.96.20:37673
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
W20260619 06:30:45.780755 9408 meta_cache.cc:302] tablet f83defb033834a9a95a05a9e6182b3b8: replica febe077b7c1645e1b8d47ba28c8f3832 (127.7.96.3:35437) has failed: Network error: recv got EOF from 127.7.96.3:35437 (error 108)
W20260619 06:30:45.799448 10879 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60728: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:45.830250 10879 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60728: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:45.866518 10879 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60728: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:45.896845 10879 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60728: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:45.910985 10879 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60728: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
I20260619 06:30:45.932942 11428 heartbeater.cc:503] Master 127.7.96.62:44861 was elected leader, sending a full tablet report...
W20260619 06:30:45.937309 10879 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60728: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:45.941179 10879 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60728: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:46.037449 10879 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60728: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:46.050639 10879 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60728: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:46.111886 10879 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60728: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:46.132499 11571 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:30:46.132800 11571 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:30:46.132956 11571 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:30:46.140336 11571 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:30:46.140524 11571 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.96.3
I20260619 06:30:46.149034 11571 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.96.20:37673
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.96.3:35437
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.96.3
--webserver_port=42369
--tserver_master_addrs=127.7.96.62:44861
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.96.3
--log_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:40:48 UTC on ccycloud.quasar-zrzaui.root.comops.site
build id 4455154
ASAN enabled
I20260619 06:30:46.150300 11571 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:30:46.152221 11571 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:30:46.164932 11580 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:30:46.164882 11578 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:30:46.165583 11577 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:30:46.166723 11571 server_base.cc:1034] running on GCE node
I20260619 06:30:46.167309 11571 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:30:46.168450 11571 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:30:46.169740 11571 hybrid_clock.cc:648] HybridClock initialized: now 1781850646169683 us; error 60 us; skew 500 ppm
I20260619 06:30:46.170028 11571 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
W20260619 06:30:46.173028 10879 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60728: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
I20260619 06:30:46.177811 11571 webserver.cc:460] Webserver started at http://127.7.96.3:42369/ using document root <none> and password file <none>
I20260619 06:30:46.178597 11571 fs_manager.cc:359] Metadata directory not provided
I20260619 06:30:46.178751 11571 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:30:46.184185 11571 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260619 06:30:46.187064 11586 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:30:46.188367 11571 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260619 06:30:46.188509 11571 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-2/data,/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-2/wal
uuid: "febe077b7c1645e1b8d47ba28c8f3832"
format_stamp: "Formatted at 2026-06-19 06:30:06 on dist-test-slave-cvm7"
I20260619 06:30:46.189479 11571 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260619 06:30:46.192667 10879 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60728: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
I20260619 06:30:46.209803 11571 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:30:46.210572 11571 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:30:46.210829 11571 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:30:46.211819 11571 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:30:46.214941 11593 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260619 06:30:46.220206 11571 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260619 06:30:46.220299 11571 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.007s user 0.000s sys 0.002s
I20260619 06:30:46.220413 11571 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260619 06:30:46.223297 11571 ts_tablet_manager.cc:610] Registered 1 tablets
I20260619 06:30:46.223429 11571 ts_tablet_manager.cc:589] Time spent register tablets: real 0.003s user 0.002s sys 0.001s
I20260619 06:30:46.223693 11593 tablet_bootstrap.cc:492] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832: Bootstrap starting.
W20260619 06:30:46.283099 10879 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60728: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:46.287405 10879 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60728: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
I20260619 06:30:46.298545 11571 rpc_server.cc:307] RPC server started. Bound to: 127.7.96.3:35437
I20260619 06:30:46.298579 11699 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.96.3:35437 every 8 connection(s)
I20260619 06:30:46.300101 11571 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-2/data/info.pb
I20260619 06:30:46.303632 7552 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu as pid 11571
I20260619 06:30:46.303809 7552 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu pid 10831
I20260619 06:30:46.327888 10960 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:30:46.342372 11700 heartbeater.cc:347] Connected to a master server at 127.7.96.62:44861
I20260619 06:30:46.342731 11700 heartbeater.cc:464] Registering TS with master...
I20260619 06:30:46.343510 11700 heartbeater.cc:511] Master 127.7.96.62:44861 requested a full tablet report, sending...
I20260619 06:30:46.345938 8815 ts_manager.cc:194] Re-registered known tserver with Master: febe077b7c1645e1b8d47ba28c8f3832 (127.7.96.3:35437)
I20260619 06:30:46.347436 8815 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.96.3:42855
I20260619 06:30:46.536013 11564 heartbeater.cc:503] Master 127.7.96.62:44861 was elected leader, sending a full tablet report...
W20260619 06:30:46.588918 10879 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60728: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
W20260619 06:30:46.590654 10879 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:60728: Illegal state: replica b9391b0d0d0143fb8708b0fba4aec26d is not leader of this config: current role FOLLOWER
I20260619 06:30:46.590758 7552 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu with pid 10831
I20260619 06:30:46.641213 7552 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu
/tmp/dist-test-taskFG9pG8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.96.4:42679
--local_ip_for_outbound_sockets=127.7.96.4
--tserver_master_addrs=127.7.96.62:44861
--webserver_port=34311
--webserver_interface=127.7.96.4
--builtin_ntp_servers=127.7.96.20:37673
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
W20260619 06:30:46.802820 9408 meta_cache.cc:302] tablet f83defb033834a9a95a05a9e6182b3b8: replica b9391b0d0d0143fb8708b0fba4aec26d (127.7.96.4:42679) has failed: Network error: Client connection negotiation failed: client connection to 127.7.96.4:42679: connect: Connection refused (error 111)
I20260619 06:30:46.843806 11593 log.cc:824] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832: Log is configured to *not* fsync() on all Append() calls
I20260619 06:30:46.856652 9439 meta_cache.cc:1510] marking tablet server b9391b0d0d0143fb8708b0fba4aec26d (127.7.96.4:42679) as failed
W20260619 06:30:47.105782 11708 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:30:47.106161 11708 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:30:47.106341 11708 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:30:47.117565 11708 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:30:47.117811 11708 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.96.4
I20260619 06:30:47.132261 11708 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.96.20:37673
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.96.4:42679
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-3/data/info.pb
--webserver_interface=127.7.96.4
--webserver_port=34311
--tserver_master_addrs=127.7.96.62:44861
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.96.4
--log_dir=/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-3/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:40:48 UTC on ccycloud.quasar-zrzaui.root.comops.site
build id 4455154
ASAN enabled
I20260619 06:30:47.133981 11708 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:30:47.136281 11708 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:30:47.153282 11714 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:30:47.153877 11715 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:30:47.158262 11718 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:30:47.158485 11708 server_base.cc:1034] running on GCE node
I20260619 06:30:47.159227 11708 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:30:47.160343 11708 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:30:47.161689 11708 hybrid_clock.cc:648] HybridClock initialized: now 1781850647161440 us; error 213 us; skew 500 ppm
I20260619 06:30:47.162042 11708 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 06:30:47.164862 11708 webserver.cc:460] Webserver started at http://127.7.96.4:34311/ using document root <none> and password file <none>
I20260619 06:30:47.165726 11708 fs_manager.cc:359] Metadata directory not provided
I20260619 06:30:47.165859 11708 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:30:47.172613 11708 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260619 06:30:47.176134 11723 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:30:47.177735 11708 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260619 06:30:47.177902 11708 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-3/data,/tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-3/wal
uuid: "b9391b0d0d0143fb8708b0fba4aec26d"
format_stamp: "Formatted at 2026-06-19 06:30:07 on dist-test-slave-cvm7"
I20260619 06:30:47.179219 11708 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-3/wal
metadata directory: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-3/wal
1 data directories: /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:30:47.198258 11708 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:30:47.199256 11708 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:30:47.199548 11708 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:30:47.202050 11708 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:30:47.203915 9438 meta_cache.cc:1510] marking tablet server b9391b0d0d0143fb8708b0fba4aec26d (127.7.96.4:42679) as failed
I20260619 06:30:47.206660 11730 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260619 06:30:47.214147 11708 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260619 06:30:47.214267 11708 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.008s user 0.000s sys 0.001s
I20260619 06:30:47.214389 11708 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260619 06:30:47.218778 11708 ts_tablet_manager.cc:610] Registered 1 tablets
I20260619 06:30:47.218860 11708 ts_tablet_manager.cc:589] Time spent register tablets: real 0.004s user 0.002s sys 0.003s
I20260619 06:30:47.219473 11730 tablet_bootstrap.cc:492] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d: Bootstrap starting.
I20260619 06:30:47.355715 11700 heartbeater.cc:503] Master 127.7.96.62:44861 was elected leader, sending a full tablet report...
W20260619 06:30:47.849697 9408 meta_cache.cc:302] tablet f83defb033834a9a95a05a9e6182b3b8: replica b9391b0d0d0143fb8708b0fba4aec26d (127.7.96.4:42679) has failed: Network error: Client connection negotiation failed: client connection to 127.7.96.4:42679: connect: Connection refused (error 111)
I20260619 06:30:48.026234 11730 log.cc:824] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d: Log is configured to *not* fsync() on all Append() calls
I20260619 06:30:48.114326 11708 rpc_server.cc:307] RPC server started. Bound to: 127.7.96.4:42679
I20260619 06:30:48.116163 11708 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0/minicluster-data/ts-3/data/info.pb
I20260619 06:30:48.117036 11837 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.96.4:42679 every 8 connection(s)
I20260619 06:30:48.119928 7552 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu as pid 11708
I20260619 06:30:48.181958 11838 heartbeater.cc:347] Connected to a master server at 127.7.96.62:44861
I20260619 06:30:48.182309 11838 heartbeater.cc:464] Registering TS with master...
I20260619 06:30:48.183277 11838 heartbeater.cc:511] Master 127.7.96.62:44861 requested a full tablet report, sending...
I20260619 06:30:48.186054 8815 ts_manager.cc:194] Re-registered known tserver with Master: b9391b0d0d0143fb8708b0fba4aec26d (127.7.96.4:42679)
I20260619 06:30:48.187570 8815 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.96.4:50675
I20260619 06:30:49.089599 11499 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260619 06:30:49.091631 11772 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260619 06:30:49.114790 11363 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260619 06:30:49.118417 11635 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260619 06:30:49.193550 11838 heartbeater.cc:503] Master 127.7.96.62:44861 was elected leader, sending a full tablet report...
I20260619 06:30:50.354611 11321 tablet_bootstrap.cc:492] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7: Bootstrap replaying log segment 1/1 (2.37M/2.93M this segment, stats: ops{read=1386 overwritten=0 applied=1386 ignored=0} inserts{seen=69100 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0)
I20260619 06:30:51.232535 11321 tablet_bootstrap.cc:492] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1709 overwritten=0 applied=1709 ignored=0} inserts{seen=85250 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260619 06:30:51.233290 11321 tablet_bootstrap.cc:492] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7: Bootstrap complete.
I20260619 06:30:51.235394 11321 ts_tablet_manager.cc:1397] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7: Time spent bootstrapping tablet: real 6.403s user 5.894s sys 0.450s
I20260619 06:30:51.242153 11321 raft_consensus.cc:348] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 10 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } }
I20260619 06:30:51.243407 11321 raft_consensus.cc:729] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 10 FOLLOWER]: Becoming Follower/Learner. State: Replica: c96ab909d8164eda8f3ebd210d06fbd7, State: Initialized, Role: FOLLOWER
I20260619 06:30:51.244123 11321 consensus_queue.cc:260] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1709, Last appended: 9.1709, Last appended by leader: 1709, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } }
I20260619 06:30:51.246767 11321 ts_tablet_manager.cc:1428] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7: Time spent starting tablet: real 0.011s user 0.012s sys 0.000s
W20260619 06:30:51.272030 9439 scanner-internal.cc:458] Time spent opening tablet: real 8.437s user 0.007s sys 0.000s
W20260619 06:30:51.279026 11343 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:36046: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:51.495162 11343 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:36046: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
I20260619 06:30:51.524042 11878 raft_consensus.cc:482] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:30:51.524410 11878 raft_consensus.cc:504] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } }
I20260619 06:30:51.526403 11878 leader_election.cc:288] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers febe077b7c1645e1b8d47ba28c8f3832 (127.7.96.3:35437), b9391b0d0d0143fb8708b0fba4aec26d (127.7.96.4:42679)
I20260619 06:30:51.555321 11655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8" candidate_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 1709 } } ignore_live_leader: false dest_uuid: "febe077b7c1645e1b8d47ba28c8f3832" is_pre_election: true
W20260619 06:30:51.560491 11317 leader_election.cc:341] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [CANDIDATE]: Term 11 pre-election: Tablet error from VoteRequest() call to peer febe077b7c1645e1b8d47ba28c8f3832 (127.7.96.3:35437): Illegal state: must be running to vote when last-logged opid is not known
I20260619 06:30:51.573472 11792 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8" candidate_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 1709 } } ignore_live_leader: false dest_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" is_pre_election: true
W20260619 06:30:51.579180 11317 leader_election.cc:341] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [CANDIDATE]: Term 11 pre-election: Tablet error from VoteRequest() call to peer b9391b0d0d0143fb8708b0fba4aec26d (127.7.96.4:42679): Illegal state: must be running to vote when last-logged opid is not known
I20260619 06:30:51.579355 11317 leader_election.cc:302] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c96ab909d8164eda8f3ebd210d06fbd7; no voters: b9391b0d0d0143fb8708b0fba4aec26d, febe077b7c1645e1b8d47ba28c8f3832
I20260619 06:30:51.580174 11878 raft_consensus.cc:2726] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260619 06:30:51.599385 11338 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:36046: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:51.626916 11341 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:36046: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:51.665829 11340 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:36046: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:51.670127 11340 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:36046: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:51.703126 11342 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:36046: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:51.760183 11339 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:36046: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:51.763554 11339 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:36046: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:51.840260 11342 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:36046: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
I20260619 06:30:51.851976 11593 tablet_bootstrap.cc:492] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832: Bootstrap replaying log segment 1/1 (2.16M/2.95M this segment, stats: ops{read=1252 overwritten=1 applied=1250 ignored=0} inserts{seen=62300 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0)
W20260619 06:30:51.888140 11343 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:36046: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
I20260619 06:30:51.948984 11878 raft_consensus.cc:482] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:30:51.949188 11878 raft_consensus.cc:504] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } }
I20260619 06:30:51.949877 11878 leader_election.cc:288] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers febe077b7c1645e1b8d47ba28c8f3832 (127.7.96.3:35437), b9391b0d0d0143fb8708b0fba4aec26d (127.7.96.4:42679)
I20260619 06:30:51.950636 11655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8" candidate_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 1709 } } ignore_live_leader: false dest_uuid: "febe077b7c1645e1b8d47ba28c8f3832" is_pre_election: true
I20260619 06:30:51.950663 11792 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8" candidate_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 1709 } } ignore_live_leader: false dest_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" is_pre_election: true
W20260619 06:30:51.951184 11317 leader_election.cc:341] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [CANDIDATE]: Term 11 pre-election: Tablet error from VoteRequest() call to peer febe077b7c1645e1b8d47ba28c8f3832 (127.7.96.3:35437): Illegal state: must be running to vote when last-logged opid is not known
W20260619 06:30:51.951436 11317 leader_election.cc:341] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [CANDIDATE]: Term 11 pre-election: Tablet error from VoteRequest() call to peer b9391b0d0d0143fb8708b0fba4aec26d (127.7.96.4:42679): Illegal state: must be running to vote when last-logged opid is not known
I20260619 06:30:51.951540 11317 leader_election.cc:302] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c96ab909d8164eda8f3ebd210d06fbd7; no voters: b9391b0d0d0143fb8708b0fba4aec26d, febe077b7c1645e1b8d47ba28c8f3832
I20260619 06:30:51.951938 11878 raft_consensus.cc:2726] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260619 06:30:51.965044 11342 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:36046: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:52.048012 11342 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:36046: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:52.062659 11342 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:36046: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:52.144901 11342 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:36046: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:52.167457 11342 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:36046: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:52.248561 11343 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:36046: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:52.366076 11342 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:36046: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
I20260619 06:30:52.424612 11878 raft_consensus.cc:482] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:30:52.424832 11878 raft_consensus.cc:504] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } }
I20260619 06:30:52.425573 11878 leader_election.cc:288] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers febe077b7c1645e1b8d47ba28c8f3832 (127.7.96.3:35437), b9391b0d0d0143fb8708b0fba4aec26d (127.7.96.4:42679)
I20260619 06:30:52.426359 11792 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8" candidate_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 1709 } } ignore_live_leader: false dest_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" is_pre_election: true
I20260619 06:30:52.426375 11655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8" candidate_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 1709 } } ignore_live_leader: false dest_uuid: "febe077b7c1645e1b8d47ba28c8f3832" is_pre_election: true
W20260619 06:30:52.427013 11317 leader_election.cc:341] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [CANDIDATE]: Term 11 pre-election: Tablet error from VoteRequest() call to peer febe077b7c1645e1b8d47ba28c8f3832 (127.7.96.3:35437): Illegal state: must be running to vote when last-logged opid is not known
W20260619 06:30:52.427233 11317 leader_election.cc:341] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [CANDIDATE]: Term 11 pre-election: Tablet error from VoteRequest() call to peer b9391b0d0d0143fb8708b0fba4aec26d (127.7.96.4:42679): Illegal state: must be running to vote when last-logged opid is not known
I20260619 06:30:52.427328 11317 leader_election.cc:302] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c96ab909d8164eda8f3ebd210d06fbd7; no voters: b9391b0d0d0143fb8708b0fba4aec26d, febe077b7c1645e1b8d47ba28c8f3832
I20260619 06:30:52.427544 11878 raft_consensus.cc:2726] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260619 06:30:52.459761 11342 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:36046: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:52.487221 11343 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:36046: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:52.576606 11342 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:36046: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:52.664824 11342 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:36046: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:52.760159 11343 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:36046: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:52.872056 11343 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:36046: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:52.911394 11343 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:36046: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
I20260619 06:30:53.036784 11730 tablet_bootstrap.cc:492] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d: Bootstrap replaying log segment 1/1 (2.08M/2.91M this segment, stats: ops{read=1225 overwritten=1 applied=1221 ignored=0} inserts{seen=60850 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0)
W20260619 06:30:53.071195 11343 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:36046: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:53.141511 11342 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:36046: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:53.238654 11343 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:36046: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
I20260619 06:30:53.262199 11884 raft_consensus.cc:482] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:30:53.262390 11884 raft_consensus.cc:504] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } }
I20260619 06:30:53.263317 11884 leader_election.cc:288] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers febe077b7c1645e1b8d47ba28c8f3832 (127.7.96.3:35437), b9391b0d0d0143fb8708b0fba4aec26d (127.7.96.4:42679)
I20260619 06:30:53.264323 11792 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8" candidate_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 1709 } } ignore_live_leader: false dest_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" is_pre_election: true
I20260619 06:30:53.264816 11655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8" candidate_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 1709 } } ignore_live_leader: false dest_uuid: "febe077b7c1645e1b8d47ba28c8f3832" is_pre_election: true
W20260619 06:30:53.265492 11317 leader_election.cc:341] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [CANDIDATE]: Term 11 pre-election: Tablet error from VoteRequest() call to peer febe077b7c1645e1b8d47ba28c8f3832 (127.7.96.3:35437): Illegal state: must be running to vote when last-logged opid is not known
W20260619 06:30:53.265676 11317 leader_election.cc:341] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [CANDIDATE]: Term 11 pre-election: Tablet error from VoteRequest() call to peer b9391b0d0d0143fb8708b0fba4aec26d (127.7.96.4:42679): Illegal state: must be running to vote when last-logged opid is not known
I20260619 06:30:53.265750 11317 leader_election.cc:302] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c96ab909d8164eda8f3ebd210d06fbd7; no voters: b9391b0d0d0143fb8708b0fba4aec26d, febe077b7c1645e1b8d47ba28c8f3832
I20260619 06:30:53.266150 11884 raft_consensus.cc:2726] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260619 06:30:53.284157 11342 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:36046: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:53.410604 11343 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:36046: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:53.424750 11343 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:36046: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
I20260619 06:30:53.536618 11593 tablet_bootstrap.cc:492] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832: Bootstrap replayed 1/1 log segments. Stats: ops{read=1710 overwritten=1 applied=1708 ignored=0} inserts{seen=85200 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260619 06:30:53.537475 11593 tablet_bootstrap.cc:492] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832: Bootstrap complete.
I20260619 06:30:53.539490 11593 ts_tablet_manager.cc:1397] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832: Time spent bootstrapping tablet: real 7.316s user 6.641s sys 0.360s
I20260619 06:30:53.545137 11593 raft_consensus.cc:348] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 11 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } }
I20260619 06:30:53.548609 11593 raft_consensus.cc:729] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 11 FOLLOWER]: Becoming Follower/Learner. State: Replica: febe077b7c1645e1b8d47ba28c8f3832, State: Initialized, Role: FOLLOWER
I20260619 06:30:53.549321 11593 consensus_queue.cc:260] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1708, Last appended: 9.1709, Last appended by leader: 1709, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } }
I20260619 06:30:53.552848 11593 ts_tablet_manager.cc:1428] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832: Time spent starting tablet: real 0.013s user 0.010s sys 0.002s
W20260619 06:30:53.568531 11614 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:43606: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:53.657462 11343 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:36046: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
I20260619 06:30:53.665635 9437 scanner-internal.cc:172] Scan of tablet f83defb033834a9a95a05a9e6182b3b8 at c96ab909d8164eda8f3ebd210d06fbd7 (127.7.96.1:38305) deadline exceeded after 10.000s
W20260619 06:30:53.665969 9437 scanner-internal.cc:458] Time spent opening tablet: real 10.029s user 0.008s sys 0.001s
W20260619 06:30:53.713284 11342 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:36046: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:53.716235 11614 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:43606: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:53.721828 11614 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:43606: Illegal state: replica febe077b7c1645e1b8d47ba28c8f3832 is not leader of this config: current role FOLLOWER
W20260619 06:30:53.785943 11343 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:36046: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
I20260619 06:30:53.813239 9438 scanner-internal.cc:172] Scan of tablet f83defb033834a9a95a05a9e6182b3b8 at c96ab909d8164eda8f3ebd210d06fbd7 (127.7.96.1:38305) deadline exceeded after 10.000s
W20260619 06:30:53.813467 9438 scanner-internal.cc:458] Time spent opening tablet: real 10.330s user 0.008s sys 0.001s
I20260619 06:30:53.818552 11886 raft_consensus.cc:482] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:30:53.818907 11886 raft_consensus.cc:504] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } }
I20260619 06:30:53.820799 11886 leader_election.cc:288] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c96ab909d8164eda8f3ebd210d06fbd7 (127.7.96.1:38305), b9391b0d0d0143fb8708b0fba4aec26d (127.7.96.4:42679)
I20260619 06:30:53.846336 11383 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8" candidate_uuid: "febe077b7c1645e1b8d47ba28c8f3832" candidate_term: 12 candidate_status { last_received { term: 9 index: 1709 } } ignore_live_leader: false dest_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" is_pre_election: true
I20260619 06:30:53.846794 11383 raft_consensus.cc:2454] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate febe077b7c1645e1b8d47ba28c8f3832 in term 10.
I20260619 06:30:53.847347 11588 leader_election.cc:302] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c96ab909d8164eda8f3ebd210d06fbd7, febe077b7c1645e1b8d47ba28c8f3832; no voters:
I20260619 06:30:53.847784 11886 raft_consensus.cc:2781] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260619 06:30:53.847949 11886 raft_consensus.cc:482] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 06:30:53.848058 11886 raft_consensus.cc:3037] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 11 FOLLOWER]: Advancing to term 12
I20260619 06:30:53.849562 11792 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8" candidate_uuid: "febe077b7c1645e1b8d47ba28c8f3832" candidate_term: 12 candidate_status { last_received { term: 9 index: 1709 } } ignore_live_leader: false dest_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" is_pre_election: true
W20260619 06:30:53.851012 11589 leader_election.cc:341] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [CANDIDATE]: Term 12 pre-election: Tablet error from VoteRequest() call to peer b9391b0d0d0143fb8708b0fba4aec26d (127.7.96.4:42679): Illegal state: must be running to vote when last-logged opid is not known
I20260619 06:30:53.853341 11886 raft_consensus.cc:504] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } }
I20260619 06:30:53.854074 11886 leader_election.cc:288] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [CANDIDATE]: Term 12 election: Requested vote from peers c96ab909d8164eda8f3ebd210d06fbd7 (127.7.96.1:38305), b9391b0d0d0143fb8708b0fba4aec26d (127.7.96.4:42679)
I20260619 06:30:53.854539 11383 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8" candidate_uuid: "febe077b7c1645e1b8d47ba28c8f3832" candidate_term: 12 candidate_status { last_received { term: 9 index: 1709 } } ignore_live_leader: false dest_uuid: "c96ab909d8164eda8f3ebd210d06fbd7"
I20260619 06:30:53.854755 11383 raft_consensus.cc:3037] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 10 FOLLOWER]: Advancing to term 12
I20260619 06:30:53.854700 11792 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8" candidate_uuid: "febe077b7c1645e1b8d47ba28c8f3832" candidate_term: 12 candidate_status { last_received { term: 9 index: 1709 } } ignore_live_leader: false dest_uuid: "b9391b0d0d0143fb8708b0fba4aec26d"
W20260619 06:30:53.855126 11589 leader_election.cc:341] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [CANDIDATE]: Term 12 election: Tablet error from VoteRequest() call to peer b9391b0d0d0143fb8708b0fba4aec26d (127.7.96.4:42679): Illegal state: must be running to vote when last-logged opid is not known
I20260619 06:30:53.859563 11383 raft_consensus.cc:2454] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate febe077b7c1645e1b8d47ba28c8f3832 in term 12.
I20260619 06:30:53.859951 11588 leader_election.cc:302] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c96ab909d8164eda8f3ebd210d06fbd7, febe077b7c1645e1b8d47ba28c8f3832; no voters: b9391b0d0d0143fb8708b0fba4aec26d
I20260619 06:30:53.860364 11886 raft_consensus.cc:2781] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 12 FOLLOWER]: Leader election won for term 12
I20260619 06:30:53.860803 11886 raft_consensus.cc:686] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 12 LEADER]: Becoming Leader. State: Replica: febe077b7c1645e1b8d47ba28c8f3832, State: Running, Role: LEADER
I20260619 06:30:53.861392 11886 consensus_queue.cc:237] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1708, Committed index: 1708, Last appended: 9.1709, Last appended by leader: 1709, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } }
I20260619 06:30:53.869014 8812 catalog_manager.cc:5495] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "febe077b7c1645e1b8d47ba28c8f3832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } health_report { overall_health: UNKNOWN } } }
I20260619 06:30:53.923753 11383 raft_consensus.cc:1261] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 12 FOLLOWER]: Refusing update from remote peer febe077b7c1645e1b8d47ba28c8f3832: Log matching property violated. Preceding OpId in replica: term: 9 index: 1709. Preceding OpId from leader: term: 12 index: 1711. (index mismatch)
W20260619 06:30:53.923842 11589 consensus_peers.cc:487] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 -> Peer b9391b0d0d0143fb8708b0fba4aec26d (127.7.96.4:42679): Couldn't send request to peer b9391b0d0d0143fb8708b0fba4aec26d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260619 06:30:53.924691 11891 consensus_queue.cc:1035] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1710, Last known committed idx: 1709, Time since last communication: 0.000s
I20260619 06:30:53.932421 11885 mvcc.cc:205] Tried to move back new op lower bound from 7298460278462169088 to 7298460278220500992. Current Snapshot: MvccSnapshot[applied={T|T < 7298460231799189504}]
I20260619 06:30:53.932649 11898 mvcc.cc:205] Tried to move back new op lower bound from 7298460278462169088 to 7298460278220500992. Current Snapshot: MvccSnapshot[applied={T|T < 7298460278462169088}]
W20260619 06:30:54.013707 11342 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:36046: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:54.169608 11343 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:36046: Illegal state: replica c96ab909d8164eda8f3ebd210d06fbd7 is not leader of this config: current role FOLLOWER
W20260619 06:30:54.437773 11589 consensus_peers.cc:487] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 -> Peer b9391b0d0d0143fb8708b0fba4aec26d (127.7.96.4:42679): Couldn't send request to peer b9391b0d0d0143fb8708b0fba4aec26d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
I20260619 06:30:54.798956 11730 tablet_bootstrap.cc:492] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1709 overwritten=1 applied=1708 ignored=0} inserts{seen=85200 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260619 06:30:54.799721 11730 tablet_bootstrap.cc:492] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d: Bootstrap complete.
I20260619 06:30:54.801733 11730 ts_tablet_manager.cc:1397] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d: Time spent bootstrapping tablet: real 7.583s user 6.769s sys 0.456s
I20260619 06:30:54.806195 11730 raft_consensus.cc:348] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 11 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } }
I20260619 06:30:54.807523 11730 raft_consensus.cc:729] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 11 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9391b0d0d0143fb8708b0fba4aec26d, State: Initialized, Role: FOLLOWER
I20260619 06:30:54.808290 11730 consensus_queue.cc:260] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1708, Last appended: 9.1708, Last appended by leader: 1708, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } }
I20260619 06:30:54.823220 11730 ts_tablet_manager.cc:1428] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d: Time spent starting tablet: real 0.021s user 0.009s sys 0.004s
I20260619 06:30:54.905402 11792 raft_consensus.cc:3037] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 11 FOLLOWER]: Advancing to term 12
I20260619 06:30:54.924341 11792 raft_consensus.cc:1261] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 12 FOLLOWER]: Refusing update from remote peer febe077b7c1645e1b8d47ba28c8f3832: Log matching property violated. Preceding OpId in replica: term: 9 index: 1708. Preceding OpId from leader: term: 9 index: 1709. (index mismatch)
I20260619 06:30:54.932545 11891 consensus_queue.cc:1037] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [LEADER]: Got LMP mismatch error from peer: Peer: permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1710, Last known committed idx: 1708, Time since last communication: 0.000s
I20260619 06:30:55.280975 11909 raft_consensus.cc:482] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader febe077b7c1645e1b8d47ba28c8f3832)
I20260619 06:30:55.281324 11909 raft_consensus.cc:504] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } }
I20260619 06:30:55.283439 11909 leader_election.cc:288] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c96ab909d8164eda8f3ebd210d06fbd7 (127.7.96.1:38305), febe077b7c1645e1b8d47ba28c8f3832 (127.7.96.3:35437)
I20260619 06:30:55.342442 11383 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8" candidate_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" candidate_term: 13 candidate_status { last_received { term: 12 index: 1832 } } ignore_live_leader: false dest_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" is_pre_election: true
I20260619 06:30:55.346594 11655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8" candidate_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" candidate_term: 13 candidate_status { last_received { term: 12 index: 1832 } } ignore_live_leader: false dest_uuid: "febe077b7c1645e1b8d47ba28c8f3832" is_pre_election: true
I20260619 06:30:55.347481 11726 leader_election.cc:302] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9391b0d0d0143fb8708b0fba4aec26d; no voters: c96ab909d8164eda8f3ebd210d06fbd7, febe077b7c1645e1b8d47ba28c8f3832
I20260619 06:30:55.395596 11909 raft_consensus.cc:2726] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260619 06:30:55.483767 11910 mvcc.cc:205] Tried to move back new op lower bound from 7298460282589507584 to 7298460278220500992. Current Snapshot: MvccSnapshot[applied={T|T < 7298460280797581312 or (T in {7298460280806973440,7298460280866992128,7298460280873230336,7298460280971685888,7298460281066258432,7298460281017069568,7298460281089847296,7298460281140371456})}]
I20260619 06:30:55.857985 11499 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260619 06:30:55.911152 11772 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260619 06:30:55.941632 11363 tablet_service.cc:1429] Tablet server has 0 leaders and 3 scanners
I20260619 06:30:56.031972 11635 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20260619 06:30:57.562297 8815 ts_manager.cc:281] Unset tserver state for febe077b7c1645e1b8d47ba28c8f3832 from MAINTENANCE_MODE
I20260619 06:30:57.566670 11564 heartbeater.cc:511] Master 127.7.96.62:44861 requested a full tablet report, sending...
I20260619 06:30:57.577039 8815 ts_manager.cc:281] Unset tserver state for c96ab909d8164eda8f3ebd210d06fbd7 from MAINTENANCE_MODE
I20260619 06:30:57.589681 8815 ts_manager.cc:281] Unset tserver state for 65f402c7f0df45d09e231eab81183eb6 from MAINTENANCE_MODE
I20260619 06:30:57.965698 11428 heartbeater.cc:511] Master 127.7.96.62:44861 requested a full tablet report, sending...
I20260619 06:30:58.285226 8815 ts_manager.cc:281] Unset tserver state for b9391b0d0d0143fb8708b0fba4aec26d from MAINTENANCE_MODE
I20260619 06:30:58.322192 11838 heartbeater.cc:511] Master 127.7.96.62:44861 requested a full tablet report, sending...
I20260619 06:30:58.327973 11700 heartbeater.cc:511] Master 127.7.96.62:44861 requested a full tablet report, sending...
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/maintenance_mode-itest.cc:750: Failure
Value of: s.ok()
Actual: true
Expected: false
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/util/test_util.cc:395: Failure
Failed
Timed out waiting for assertion to pass.
I20260619 06:30:58.570711 11564 heartbeater.cc:511] Master 127.7.96.62:44861 requested a full tablet report, sending...
I20260619 06:30:58.971076 11428 heartbeater.cc:511] Master 127.7.96.62:44861 requested a full tablet report, sending...
I20260619 06:30:59.291010 7552 external_mini_cluster-itest-base.cc:80] Found fatal failure
I20260619 06:30:59.291580 7552 external_mini_cluster-itest-base.cc:86] Attempting to dump stacks of TS 0 with UUID c96ab909d8164eda8f3ebd210d06fbd7 and pid 11299
************************ BEGIN STACKS **************************
[New LWP 11301]
[New LWP 11302]
[New LWP 11303]
[New LWP 11304]
[New LWP 11310]
[New LWP 11311]
[New LWP 11312]
[New LWP 11315]
[New LWP 11316]
[New LWP 11317]
[New LWP 11318]
[New LWP 11319]
[New LWP 11320]
[New LWP 11322]
[New LWP 11323]
[New LWP 11324]
[New LWP 11325]
[New LWP 11326]
[New LWP 11327]
[New LWP 11328]
[New LWP 11329]
[New LWP 11330]
[New LWP 11331]
[New LWP 11332]
[New LWP 11333]
[New LWP 11334]
[New LWP 11335]
[New LWP 11336]
[New LWP 11337]
[New LWP 11338]
[New LWP 11339]
[New LWP 11340]
[New LWP 11341]
[New LWP 11342]
[New LWP 11343]
[New LWP 11344]
[New LWP 11345]
[New LWP 11346]
[New LWP 11347]
[New LWP 11348]
[New LWP 11349]
[New LWP 11350]
[New LWP 11351]
[New LWP 11352]
[New LWP 11353]
[New LWP 11354]
[New LWP 11355]
[New LWP 11356]
[New LWP 11357]
[New LWP 11358]
[New LWP 11359]
[New LWP 11360]
[New LWP 11361]
[New LWP 11362]
[New LWP 11363]
[New LWP 11364]
[New LWP 11365]
[New LWP 11366]
[New LWP 11367]
[New LWP 11368]
[New LWP 11369]
[New LWP 11370]
[New LWP 11371]
[New LWP 11372]
[New LWP 11373]
[New LWP 11374]
[New LWP 11375]
[New LWP 11376]
[New LWP 11377]
[New LWP 11378]
[New LWP 11379]
[New LWP 11380]
[New LWP 11381]
[New LWP 11382]
[New LWP 11383]
[New LWP 11384]
[New LWP 11385]
[New LWP 11386]
[New LWP 11387]
[New LWP 11388]
[New LWP 11389]
[New LWP 11390]
[New LWP 11391]
[New LWP 11392]
[New LWP 11393]
[New LWP 11394]
[New LWP 11395]
[New LWP 11396]
[New LWP 11397]
[New LWP 11398]
[New LWP 11399]
[New LWP 11400]
[New LWP 11401]
[New LWP 11402]
[New LWP 11403]
[New LWP 11404]
[New LWP 11405]
[New LWP 11406]
[New LWP 11407]
[New LWP 11408]
[New LWP 11409]
[New LWP 11410]
[New LWP 11411]
[New LWP 11412]
[New LWP 11413]
[New LWP 11414]
[New LWP 11415]
[New LWP 11416]
[New LWP 11417]
[New LWP 11418]
[New LWP 11419]
[New LWP 11420]
[New LWP 11421]
[New LWP 11422]
[New LWP 11423]
[New LWP 11424]
[New LWP 11425]
[New LWP 11426]
[New LWP 11427]
[New LWP 11428]
[New LWP 11429]
Cannot access memory at address 0x746e657265666671
Cannot access memory at address 0x746e657265666669
Cannot access memory at address 0x746e657265666671
Cannot access memory at address 0x746e657265666671
Cannot access memory at address 0x746e657265666669
0x00007f5272cdfd50 in ?? ()
Id Target Id Frame
* 1 LWP 11299 "kudu" 0x00007f5272cdfd50 in ?? ()
2 LWP 11301 "kudu" 0x00007f5272cdbfb9 in ?? ()
3 LWP 11302 "kudu" 0x00007f5272cdbfb9 in ?? ()
4 LWP 11303 "kudu" 0x00007f5272cdbfb9 in ?? ()
5 LWP 11304 "kernel-watcher-" 0x00007f5272cdbfb9 in ?? ()
6 LWP 11310 "ntp client-1131" 0x00007f5272cdf9e2 in ?? ()
7 LWP 11311 "file cache-evic" 0x00007f5272cdbfb9 in ?? ()
8 LWP 11312 "sq_acceptor" 0x00007f526bc5ebb9 in ?? ()
9 LWP 11315 "rpc reactor-113" 0x00007f526bc6b947 in ?? ()
10 LWP 11316 "rpc reactor-113" 0x00007f526bc6b947 in ?? ()
11 LWP 11317 "rpc reactor-113" 0x00007f526bc6b947 in ?? ()
12 LWP 11318 "rpc reactor-113" 0x00007f526bc6b947 in ?? ()
13 LWP 11319 "MaintenanceMgr " 0x00007f5272cdbad3 in ?? ()
14 LWP 11320 "txn-status-mana" 0x00007f5272cdbfb9 in ?? ()
15 LWP 11322 "collect_and_rem" 0x00007f5272cdbfb9 in ?? ()
16 LWP 11323 "tc-session-exp-" 0x00007f5272cdbfb9 in ?? ()
17 LWP 11324 "rpc worker-1132" 0x00007f5272cdbad3 in ?? ()
18 LWP 11325 "rpc worker-1132" 0x00007f5272cdbad3 in ?? ()
19 LWP 11326 "rpc worker-1132" 0x00007f5272cdbad3 in ?? ()
20 LWP 11327 "rpc worker-1132" 0x00007f5272cdbad3 in ?? ()
21 LWP 11328 "rpc worker-1132" 0x00007f5272cdbad3 in ?? ()
22 LWP 11329 "rpc worker-1132" 0x00007f5272cdbad3 in ?? ()
23 LWP 11330 "rpc worker-1133" 0x00007f5272cdbad3 in ?? ()
24 LWP 11331 "rpc worker-1133" 0x00007f5272cdbad3 in ?? ()
25 LWP 11332 "rpc worker-1133" 0x00007f5272cdbad3 in ?? ()
26 LWP 11333 "rpc worker-1133" 0x00007f5272cdbad3 in ?? ()
27 LWP 11334 "rpc worker-1133" 0x00007f5272cdbad3 in ?? ()
28 LWP 11335 "rpc worker-1133" 0x00007f5272cdbad3 in ?? ()
29 LWP 11336 "rpc worker-1133" 0x00007f5272cdbad3 in ?? ()
30 LWP 11337 "rpc worker-1133" 0x00007f5272cdbad3 in ?? ()
31 LWP 11338 "rpc worker-1133" 0x00007f5272cdbad3 in ?? ()
32 LWP 11339 "rpc worker-1133" 0x00007f5272cdbad3 in ?? ()
33 LWP 11340 "rpc worker-1134" 0x00007f5272cdbad3 in ?? ()
34 LWP 11341 "rpc worker-1134" 0x00007f5272cdbad3 in ?? ()
35 LWP 11342 "rpc worker-1134" 0x00007f5272cdbad3 in ?? ()
36 LWP 11343 "rpc worker-1134" 0x00007f5272cdbad3 in ?? ()
37 LWP 11344 "rpc worker-1134" 0x00007f5272cdbad3 in ?? ()
38 LWP 11345 "rpc worker-1134" 0x00007f5272cdbad3 in ?? ()
39 LWP 11346 "rpc worker-1134" 0x00007f5272cdbad3 in ?? ()
40 LWP 11347 "rpc worker-1134" 0x00007f5272cdbad3 in ?? ()
41 LWP 11348 "rpc worker-1134" 0x00007f5272cdbad3 in ?? ()
42 LWP 11349 "rpc worker-1134" 0x00007f5272cdbad3 in ?? ()
43 LWP 11350 "rpc worker-1135" 0x00007f5272cdbad3 in ?? ()
44 LWP 11351 "rpc worker-1135" 0x00007f5272cdbad3 in ?? ()
45 LWP 11352 "rpc worker-1135" 0x00007f5272cdbad3 in ?? ()
46 LWP 11353 "rpc worker-1135" 0x00007f5272cdbad3 in ?? ()
47 LWP 11354 "rpc worker-1135" 0x00007f5272cdbad3 in ?? ()
48 LWP 11355 "rpc worker-1135" 0x00007f5272cdbad3 in ?? ()
49 LWP 11356 "rpc worker-1135" 0x00007f5272cdbad3 in ?? ()
50 LWP 11357 "rpc worker-1135" 0x00007f5272cdbad3 in ?? ()
51 LWP 11358 "rpc worker-1135" 0x00007f5272cdbad3 in ?? ()
52 LWP 11359 "rpc worker-1135" 0x00007f5272cdbad3 in ?? ()
53 LWP 11360 "rpc worker-1136" 0x00007f5272cdbad3 in ?? ()
54 LWP 11361 "rpc worker-1136" 0x00007f5272cdbad3 in ?? ()
55 LWP 11362 "rpc worker-1136" 0x00007f5272cdbad3 in ?? ()
56 LWP 11363 "rpc worker-1136" 0x00007f5272cdbad3 in ?? ()
57 LWP 11364 "rpc worker-1136" 0x00007f5272cdbad3 in ?? ()
58 LWP 11365 "rpc worker-1136" 0x00007f5272cdbad3 in ?? ()
59 LWP 11366 "rpc worker-1136" 0x00007f5272cdbad3 in ?? ()
60 LWP 11367 "rpc worker-1136" 0x00007f5272cdbad3 in ?? ()
61 LWP 11368 "rpc worker-1136" 0x00007f5272cdbad3 in ?? ()
62 LWP 11369 "rpc worker-1136" 0x00007f5272cdbad3 in ?? ()
63 LWP 11370 "rpc worker-1137" 0x00007f5272cdbad3 in ?? ()
64 LWP 11371 "rpc worker-1137" 0x00007f5272cdbad3 in ?? ()
65 LWP 11372 "rpc worker-1137" 0x00007f5272cdbad3 in ?? ()
66 LWP 11373 "rpc worker-1137" 0x00007f5272cdbad3 in ?? ()
67 LWP 11374 "rpc worker-1137" 0x00007f5272cdbad3 in ?? ()
68 LWP 11375 "rpc worker-1137" 0x00007f5272cdbad3 in ?? ()
69 LWP 11376 "rpc worker-1137" 0x00007f5272cdbad3 in ?? ()
70 LWP 11377 "rpc worker-1137" 0x00007f5272cdbad3 in ?? ()
71 LWP 11378 "rpc worker-1137" 0x00007f5272cdbad3 in ?? ()
72 LWP 11379 "rpc worker-1137" 0x00007f5272cdbad3 in ?? ()
73 LWP 11380 "rpc worker-1138" 0x00007f5272cdbad3 in ?? ()
74 LWP 11381 "rpc worker-1138" 0x00007f5272cdbad3 in ?? ()
75 LWP 11382 "rpc worker-1138" 0x00007f5272cdbad3 in ?? ()
76 LWP 11383 "rpc worker-1138" 0x00007f5272cdbad3 in ?? ()
77 LWP 11384 "rpc worker-1138" 0x00007f5272cdbad3 in ?? ()
78 LWP 11385 "rpc worker-1138" 0x00007f5272cdbad3 in ?? ()
79 LWP 11386 "rpc worker-1138" 0x00007f5272cdbad3 in ?? ()
80 LWP 11387 "rpc worker-1138" 0x00007f5272cdbad3 in ?? ()
81 LWP 11388 "rpc worker-1138" 0x00007f5272cdbad3 in ?? ()
82 LWP 11389 "rpc worker-1138" 0x00007f5272cdbad3 in ?? ()
83 LWP 11390 "rpc worker-1139" 0x00007f5272cdbad3 in ?? ()
84 LWP 11391 "rpc worker-1139" 0x00007f5272cdbad3 in ?? ()
85 LWP 11392 "rpc worker-1139" 0x00007f5272cdbad3 in ?? ()
86 LWP 11393 "rpc worker-1139" 0x00007f5272cdbad3 in ?? ()
87 LWP 11394 "rpc worker-1139" 0x00007f5272cdbad3 in ?? ()
88 LWP 11395 "rpc worker-1139" 0x00007f5272cdbad3 in ?? ()
89 LWP 11396 "rpc worker-1139" 0x00007f5272cdbad3 in ?? ()
90 LWP 11397 "rpc worker-1139" 0x00007f5272cdbad3 in ?? ()
91 LWP 11398 "rpc worker-1139" 0x00007f5272cdbad3 in ?? ()
92 LWP 11399 "rpc worker-1139" 0x00007f5272cdbad3 in ?? ()
93 LWP 11400 "rpc worker-1140" 0x00007f5272cdbad3 in ?? ()
94 LWP 11401 "rpc worker-1140" 0x00007f5272cdbad3 in ?? ()
95 LWP 11402 "rpc worker-1140" 0x00007f5272cdbad3 in ?? ()
96 LWP 11403 "rpc worker-1140" 0x00007f5272cdbad3 in ?? ()
97 LWP 11404 "rpc worker-1140" 0x00007f5272cdbad3 in ?? ()
98 LWP 11405 "rpc worker-1140" 0x00007f5272cdbad3 in ?? ()
99 LWP 11406 "rpc worker-1140" 0x00007f5272cdbad3 in ?? ()
100 LWP 11407 "rpc worker-1140" 0x00007f5272cdbad3 in ?? ()
101 LWP 11408 "rpc worker-1140" 0x00007f5272cdbad3 in ?? ()
102 LWP 11409 "rpc worker-1140" 0x00007f5272cdbad3 in ?? ()
103 LWP 11410 "rpc worker-1141" 0x00007f5272cdbad3 in ?? ()
104 LWP 11411 "rpc worker-1141" 0x00007f5272cdbad3 in ?? ()
105 LWP 11412 "rpc worker-1141" 0x00007f5272cdbad3 in ?? ()
106 LWP 11413 "rpc worker-1141" 0x00007f5272cdbad3 in ?? ()
107 LWP 11414 "rpc worker-1141" 0x00007f5272cdbad3 in ?? ()
108 LWP 11415 "rpc worker-1141" 0x00007f5272cdbad3 in ?? ()
109 LWP 11416 "rpc worker-1141" 0x00007f5272cdbad3 in ?? ()
110 LWP 11417 "rpc worker-1141" 0x00007f5272cdbad3 in ?? ()
111 LWP 11418 "rpc worker-1141" 0x00007f5272cdbad3 in ?? ()
112 LWP 11419 "rpc worker-1141" 0x00007f5272cdbad3 in ?? ()
113 LWP 11420 "rpc worker-1142" 0x00007f5272cdbad3 in ?? ()
114 LWP 11421 "rpc worker-1142" 0x00007f5272cdbad3 in ?? ()
115 LWP 11422 "rpc worker-1142" 0x00007f5272cdbad3 in ?? ()
116 LWP 11423 "rpc worker-1142" 0x00007f5272cdbad3 in ?? ()
117 LWP 11424 "diag-logger-114" 0x00007f5272cdbfb9 in ?? ()
118 LWP 11425 "result-tracker-" 0x00007f5272cdbfb9 in ?? ()
119 LWP 11426 "excess-log-dele" 0x00007f5272cdbfb9 in ?? ()
120 LWP 11427 "acceptor-11427" 0x00007f526bc6cfc7 in ?? ()
121 LWP 11428 "heartbeat-11428" 0x00007f5272cdbfb9 in ?? ()
122 LWP 11429 "maintenance_sch" 0x00007f5272cdbfb9 in ?? ()
Thread 122 (LWP 11429):
#0 0x00007f5272cdbfb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 121 (LWP 11428):
#0 0x00007f5272cdbfb9 in ?? ()
#1 0xffffffffffffffff in ?? ()
#2 0x0000000000000010 in ?? ()
#3 0x0000000100000081 in ?? ()
#4 0x000061300001826c in ?? ()
#5 0x00007f52288a8770 in ?? ()
#6 0x0000000000000021 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x00007f52288a8790 in ?? ()
#9 0x0000000200000000 in ?? ()
#10 0x0000008000000189 in ?? ()
#11 0x00007f52288a8810 in ?? ()
#12 0x00000fea45115104 in ?? ()
#13 0x0000000000000000 in ?? ()
Thread 120 (LWP 11427):
#0 0x00007f526bc6cfc7 in ?? ()
#1 0x0000614000009090 in ?? ()
#2 0x00007f52290cffa0 in ?? ()
#3 0x00007f52290cffc0 in ?? ()
#4 0x00007f52290d00e0 in ?? ()
#5 0x00007f52290cffd0 in ?? ()
#6 0x00007f52290d0040 in ?? ()
#7 0x0000000000000080 in ?? ()
#8 0x000000000082c9d2 in __sanitizer::theDepot ()
#9 0x00000000008c3cc9 in __sanitizer::theDepot ()
#10 0x00000000008f35b0 in __sanitizer::theDepot ()
#11 0x0000000000000032 in ?? ()
#12 0x000060c000066058 in ?? ()
#13 0x000060c0000660b1 in ?? ()
#14 0x00000000008875e1 in __sanitizer::theDepot ()
#15 0x0000000000000059 in ?? ()
#16 0x000000000088348c in __sanitizer::theDepot ()
#17 0x0000000000000380 in ?? ()
#18 0x0000000000897749 in __sanitizer::theDepot ()
#19 0x0000000000010000 in ?? ()
#20 0x0000000000895799 in __sanitizer::theDepot ()
#21 0x0000000000e377a0 in ?? ()
#22 0x00000000007f9413 in __sanitizer::theDepot ()
#23 0x00000000009edb7d in __sanitizer::theDepot ()
#24 0x0000000000000700 in ?? ()
#25 0x00007f5272cd56db in ?? ()
#26 0x00007f526bc1d346 in ?? ()
#27 0x00007f52290cf842 in ?? ()
#28 0x000000006a34e214 in ?? ()
#29 0x000000006a34e214 in ?? ()
#30 0x0000640000001140 in ?? ()
#31 0x00007f52288c9e60 in ?? ()
#32 0x0000000000000049 in ?? ()
#33 0x0000017000000000 in ?? ()
#34 0x0000000000000017 in ?? ()
#35 0x0000640000001140 in ?? ()
#36 0x00000000008b1acd in __sanitizer::theDepot ()
#37 0x0000000000e377a0 in ?? ()
#38 0x00007f5227062878 in ?? ()
#39 0x0000000000000000 in ?? ()
Thread 119 (LWP 11426):
#0 0x00007f5272cdbfb9 in ?? ()
#1 0x00007fff3ff0a0f0 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 118 (LWP 11425):
#0 0x00007f5272cdbfb9 in ?? ()
#1 0x00007f522a102160 in ?? ()
#2 0x000000000000000f in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061100006e4b0 in ?? ()
#5 0x00007f522a102110 in ?? ()
#6 0x000000000000001e in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 117 (LWP 11424):
#0 0x00007f5272cdbfb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 116 (LWP 11423):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000004 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d0002b6848 in ?? ()
#4 0x00007f522b131eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f522b131ed0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 115 (LWP 11422):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000004 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d0002b0048 in ?? ()
#4 0x00007f522b949eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f522b949ed0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 114 (LWP 11421):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 113 (LWP 11420):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 112 (LWP 11419):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 111 (LWP 11418):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 110 (LWP 11417):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 109 (LWP 11416):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 108 (LWP 11415):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 107 (LWP 11414):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 106 (LWP 11413):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 105 (LWP 11412):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 104 (LWP 11411):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 103 (LWP 11410):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 102 (LWP 11409):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 101 (LWP 11408):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 100 (LWP 11407):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 99 (LWP 11406):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 98 (LWP 11405):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 97 (LWP 11404):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 96 (LWP 11403):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 95 (LWP 11402):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 94 (LWP 11401):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 93 (LWP 11400):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 92 (LWP 11399):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 91 (LWP 11398):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 90 (LWP 11397):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 89 (LWP 11396):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 88 (LWP 11395):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 87 (LWP 11394):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 86 (LWP 11393):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 85 (LWP 11392):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 84 (LWP 11391):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 83 (LWP 11390):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 82 (LWP 11389):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 81 (LWP 11388):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 80 (LWP 11387):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 79 (LWP 11386):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 78 (LWP 11385):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 77 (LWP 11384):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 76 (LWP 11383):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x000000000000013d in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d0001b007c in ?? ()
#4 0x00007f523f4f2eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f523f4f2ed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0001b0030 in ?? ()
#9 0x00007f5272cdb770 in ?? ()
#10 0x00007f523f4f2ed0 in ?? ()
#11 0x00007f523f4f2fa0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 75 (LWP 11382):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000131 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d0001ad08c in ?? ()
#4 0x00007f523fd0aeb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f523fd0aed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0001ad040 in ?? ()
#9 0x00007f5272cdb770 in ?? ()
#10 0x00007f523fd0aed0 in ?? ()
#11 0x00007f523fd0afa0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 74 (LWP 11381):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 73 (LWP 11380):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 72 (LWP 11379):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 71 (LWP 11378):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 70 (LWP 11377):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 69 (LWP 11376):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 68 (LWP 11375):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 67 (LWP 11374):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 66 (LWP 11373):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 65 (LWP 11372):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 64 (LWP 11371):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 63 (LWP 11370):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 62 (LWP 11369):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 61 (LWP 11368):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 60 (LWP 11367):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 59 (LWP 11366):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 58 (LWP 11365):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 57 (LWP 11364):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 56 (LWP 11363):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000002 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d00012d038 in ?? ()
#4 0x00007f52496d3eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f52496d3ed0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 55 (LWP 11362):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 54 (LWP 11361):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 53 (LWP 11360):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 52 (LWP 11359):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 51 (LWP 11358):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 50 (LWP 11357):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 49 (LWP 11356):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 48 (LWP 11355):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 47 (LWP 11354):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 46 (LWP 11353):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 45 (LWP 11352):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 44 (LWP 11351):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 43 (LWP 11350):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 42 (LWP 11349):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 41 (LWP 11348):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 40 (LWP 11347):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 39 (LWP 11346):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 38 (LWP 11345):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 37 (LWP 11344):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 36 (LWP 11343):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x000000000000061e in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d0000a67e8 in ?? ()
#4 0x00007f52538b4eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f52538b4ed0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 35 (LWP 11342):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000233 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00009ffec in ?? ()
#4 0x00007f52540cceb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f52540cced0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d00009ffa0 in ?? ()
#9 0x00007f5272cdb770 in ?? ()
#10 0x00007f52540cced0 in ?? ()
#11 0x00007f52540ccfa0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 34 (LWP 11341):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x00000000000000cb in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00009cffc in ?? ()
#4 0x00007f52548e4eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f52548e4ed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d00009cfb0 in ?? ()
#9 0x00007f5272cdb770 in ?? ()
#10 0x00007f52548e4ed0 in ?? ()
#11 0x00007f52548e4fa0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 33 (LWP 11340):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x000000000000002c in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d0000967f8 in ?? ()
#4 0x00007f52550fceb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f52550fced0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 32 (LWP 11339):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000011 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00008fffc in ?? ()
#4 0x00007f5255914eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f5255914ed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d00008ffb0 in ?? ()
#9 0x00007f5272cdb770 in ?? ()
#10 0x00007f5255914ed0 in ?? ()
#11 0x00007f5255914fa0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 31 (LWP 11338):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x000000000000027e in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d000086808 in ?? ()
#4 0x00007f525612ceb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f525612ced0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 30 (LWP 11337):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 29 (LWP 11336):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 28 (LWP 11335):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 27 (LWP 11334):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 26 (LWP 11333):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 25 (LWP 11332):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 24 (LWP 11331):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 23 (LWP 11330):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 22 (LWP 11329):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 21 (LWP 11328):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 20 (LWP 11327):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 19 (LWP 11326):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 18 (LWP 11325):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 17 (LWP 11324):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 16 (LWP 11323):
#0 0x00007f5272cdbfb9 in ?? ()
#1 0x00000000ffffffff in ?? ()
#2 0x0000000000000001 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x0000613000018ea0 in ?? ()
#5 0x00007f525dabcd30 in ?? ()
#6 0x0000000000000002 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 15 (LWP 11322):
#0 0x00007f5272cdbfb9 in ?? ()
#1 0x4008000000000000 in ?? ()
#2 0x0000000000000003 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061200001a498 in ?? ()
#5 0x00007f525e2de270 in ?? ()
#6 0x0000000000000006 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 14 (LWP 11320):
#0 0x00007f5272cdbfb9 in ?? ()
#1 0x00007f525f2df5e0 in ?? ()
#2 0x0000000000000001 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x0000618000004da8 in ?? ()
#5 0x00007f525f2df250 in ?? ()
#6 0x0000000000000002 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 13 (LWP 11319):
#0 0x00007f5272cdbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 12 (LWP 11318):
#0 0x00007f526bc6b947 in ?? ()
#1 0x0000614000009680 in ?? ()
#2 0x0000619000059680 in ?? ()
#3 0x00007f52602e2340 in ?? ()
#4 0x00007f52602e2540 in ?? ()
#5 0x00007f52602e2390 in ?? ()
#6 0x0000614000009680 in ?? ()
#7 0x00007f52602e2400 in ?? ()
#8 0x00007f526e272bda in ?? ()
#9 0x3fb9832a8ec52000 in ?? ()
#10 0x0000619000059680 in ?? ()
#11 0x54b249ad2594c37d in ?? ()
#12 0x0000619000059680 in ?? ()
#13 0x421cdc1d6c000000 in ?? ()
#14 0x00007f52602e2540 in ?? ()
#15 0x41da8d37bc1d1665 in ?? ()
#16 0x00000000cc054480 in ?? ()
#17 0x00007f52602e23e0 in ?? ()
#18 0x00007f526e276228 in ?? ()
#19 0x00000000602e23c0 in ?? ()
#20 0x0000619000059680 in ?? ()
#21 0x0000614000009680 in ?? ()
#22 0x00007f52602e2400 in ?? ()
#23 0x3fb9832a8ec52000 in ?? ()
#24 0x40899b9189b3502d in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 11 (LWP 11317):
#0 0x00007f526bc6b947 in ?? ()
#1 0x0000614000009480 in ?? ()
#2 0x0000619000059180 in ?? ()
#3 0x00007f5260ae3340 in ?? ()
#4 0x00007f5260ae3540 in ?? ()
#5 0x00007f5260ae3390 in ?? ()
#6 0x0000614000009480 in ?? ()
#7 0x00007f5260ae3400 in ?? ()
#8 0x00007f526e272bda in ?? ()
#9 0x3fb97082001b0000 in ?? ()
#10 0x0000619000059180 in ?? ()
#11 0x54b249ad2594c37d in ?? ()
#12 0x0000619000059180 in ?? ()
#13 0x4211ade65f000000 in ?? ()
#14 0x00007f5260ae3540 in ?? ()
#15 0x41da8d37bc1d1666 in ?? ()
#16 0x00000000cc154680 in ?? ()
#17 0x00007f5260ae33e0 in ?? ()
#18 0x00007f526e276228 in ?? ()
#19 0x0000000060ae33c0 in ?? ()
#20 0x0000619000059180 in ?? ()
#21 0x0000614000009480 in ?? ()
#22 0x00007f5260ae3400 in ?? ()
#23 0x3fb97082001b0000 in ?? ()
#24 0x40899b9219cc1dbf in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 10 (LWP 11316):
#0 0x00007f526bc6b947 in ?? ()
#1 0x0000614000009280 in ?? ()
#2 0x0000619000058c80 in ?? ()
#3 0x00007f52612e4340 in ?? ()
#4 0x00007f52612e4540 in ?? ()
#5 0x00007f52612e4390 in ?? ()
#6 0x0000614000009280 in ?? ()
#7 0x00007f52612e4400 in ?? ()
#8 0x00007f526e272bda in ?? ()
#9 0x3fb1b988f836c000 in ?? ()
#10 0x0000619000058c80 in ?? ()
#11 0x54b249ad2594c37d in ?? ()
#12 0x0000619000058c80 in ?? ()
#13 0x425247d802300000 in ?? ()
#14 0x00007f52612e4540 in ?? ()
#15 0x41da8d37bc1d1665 in ?? ()
#16 0x00000000cc254880 in ?? ()
#17 0x00007f52612e43e0 in ?? ()
#18 0x00007f526e276228 in ?? ()
#19 0x00000000612e43c0 in ?? ()
#20 0x0000619000058c80 in ?? ()
#21 0x0000614000009280 in ?? ()
#22 0x00007f52612e4400 in ?? ()
#23 0x3fb1b988f836c000 in ?? ()
#24 0x40899bae9c098b6f in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 9 (LWP 11315):
#0 0x00007f526bc6b947 in ?? ()
#1 0x0000614000009080 in ?? ()
#2 0x0000619000058780 in ?? ()
#3 0x00007f52628ad340 in ?? ()
#4 0x00007f52628ad540 in ?? ()
#5 0x00007f52628ad390 in ?? ()
#6 0x0000614000009080 in ?? ()
#7 0x00007f52628ad400 in ?? ()
#8 0x00007f526e272bda in ?? ()
#9 0x3fb95f0b2855e000 in ?? ()
#10 0x0000619000058780 in ?? ()
#11 0x54b249ad2594c37d in ?? ()
#12 0x0000619000058780 in ?? ()
#13 0x420e88caa2000000 in ?? ()
#14 0x00007f52628ad540 in ?? ()
#15 0x41da8d37bc1d1664 in ?? ()
#16 0x00000000cc50da80 in ?? ()
#17 0x00007f52628ad3e0 in ?? ()
#18 0x00007f526e276228 in ?? ()
#19 0x0000000000000000 in ?? ()
Thread 8 (LWP 11312):
#0 0x00007f526bc5ebb9 in ?? ()
#1 0x00000000000000c8 in ?? ()
#2 0x00007f52642b77d8 in ?? ()
#3 0x000060200004d5f0 in ?? ()
#4 0x0000000000000002 in ?? ()
#5 0x00000000000000c8 in ?? ()
#6 0x0000000000823a92 in __sanitizer::theDepot ()
#7 0x00007f52642b7800 in ?? ()
#8 0x0000000000000000 in ?? ()
Thread 7 (LWP 11311):
#0 0x00007f5272cdbfb9 in ?? ()
#1 0x00007f5263ab6140 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 6 (LWP 11310):
#0 0x00007f5272cdf9e2 in ?? ()
#1 0x00007f52632b4430 in ?? ()
#2 0x00007f52632b3f20 in ?? ()
#3 0x00007f52632b3650 in ?? ()
#4 0x00007f52632b51c0 in ?? ()
#5 0x00007f52632b3ed0 in ?? ()
#6 0x0000000000000030 in ?? ()
#7 0x00007f52632b3f30 in ?? ()
#8 0x000061100006f950 in ?? ()
#9 0x00007f52632b3f20 in ?? ()
#10 0x000000000081de90 in __sanitizer::theDepot ()
#11 0x00007f52784a3269 in ?? ()
#12 0x00000000009edb7d in __sanitizer::theDepot ()
#13 0x00007f526f9fbeaf in ?? ()
#14 0x00007f5272cd56db in ?? ()
#15 0x00007f52632b36b0 in ?? ()
#16 0x00007f52784b1e61 in ?? ()
#17 0x00007f52632b3770 in ?? ()
#18 0x00007f52784b18ea in ?? ()
#19 0x0000000045e0360e in ?? ()
#20 0x00007f527843bb62 in ?? ()
#21 0x000061100006f960 in ?? ()
#22 0x0000000000000000 in ?? ()
Thread 5 (LWP 11304):
#0 0x00007f5272cdbfb9 in ?? ()
#1 0x00007f52652b8c90 in ?? ()
#2 0x000000000000004b in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061200001a9a8 in ?? ()
#5 0x00007f52652b8cd0 in ?? ()
#6 0x0000000000000096 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 4 (LWP 11303):
#0 0x00007f5272cdbfb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 3 (LWP 11302):
#0 0x00007f5272cdbfb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 2 (LWP 11301):
#0 0x00007f5272cdbfb9 in ?? ()
#1 0x0000000000008000 in ?? ()
#2 0x0000000000000002 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x00006120000096b8 in ?? ()
#5 0x00007f5266abc450 in ?? ()
#6 0x0000000000000004 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 1 (LWP 11299):
#0 0x00007f5272cdfd50 in ?? ()
#1 0x0000000000000000 in ?? ()
************************* END STACKS ***************************
I20260619 06:31:00.037087 7552 external_mini_cluster-itest-base.cc:86] Attempting to dump stacks of TS 1 with UUID 65f402c7f0df45d09e231eab81183eb6 and pid 11436
************************ BEGIN STACKS **************************
[New LWP 11438]
[New LWP 11439]
[New LWP 11440]
[New LWP 11441]
[New LWP 11447]
[New LWP 11448]
[New LWP 11449]
[New LWP 11452]
[New LWP 11453]
[New LWP 11454]
[New LWP 11455]
[New LWP 11456]
[New LWP 11457]
[New LWP 11458]
[New LWP 11459]
[New LWP 11460]
[New LWP 11461]
[New LWP 11462]
[New LWP 11463]
[New LWP 11464]
[New LWP 11465]
[New LWP 11466]
[New LWP 11467]
[New LWP 11468]
[New LWP 11469]
[New LWP 11470]
[New LWP 11471]
[New LWP 11472]
[New LWP 11473]
[New LWP 11474]
[New LWP 11475]
[New LWP 11476]
[New LWP 11477]
[New LWP 11478]
[New LWP 11479]
[New LWP 11480]
[New LWP 11481]
[New LWP 11482]
[New LWP 11483]
[New LWP 11484]
[New LWP 11485]
[New LWP 11486]
[New LWP 11487]
[New LWP 11488]
[New LWP 11489]
[New LWP 11490]
[New LWP 11491]
[New LWP 11492]
[New LWP 11493]
[New LWP 11494]
[New LWP 11495]
[New LWP 11496]
[New LWP 11497]
[New LWP 11498]
[New LWP 11499]
[New LWP 11500]
[New LWP 11501]
[New LWP 11502]
[New LWP 11503]
[New LWP 11504]
[New LWP 11505]
[New LWP 11506]
[New LWP 11507]
[New LWP 11508]
[New LWP 11509]
[New LWP 11510]
[New LWP 11511]
[New LWP 11512]
[New LWP 11513]
[New LWP 11514]
[New LWP 11515]
[New LWP 11516]
[New LWP 11517]
[New LWP 11518]
[New LWP 11519]
[New LWP 11520]
[New LWP 11521]
[New LWP 11522]
[New LWP 11523]
[New LWP 11524]
[New LWP 11525]
[New LWP 11526]
[New LWP 11527]
[New LWP 11528]
[New LWP 11529]
[New LWP 11530]
[New LWP 11531]
[New LWP 11532]
[New LWP 11533]
[New LWP 11534]
[New LWP 11535]
[New LWP 11536]
[New LWP 11537]
[New LWP 11538]
[New LWP 11539]
[New LWP 11540]
[New LWP 11541]
[New LWP 11542]
[New LWP 11543]
[New LWP 11544]
[New LWP 11545]
[New LWP 11546]
[New LWP 11547]
[New LWP 11548]
[New LWP 11549]
[New LWP 11550]
[New LWP 11551]
[New LWP 11552]
[New LWP 11553]
[New LWP 11554]
[New LWP 11555]
[New LWP 11556]
[New LWP 11557]
[New LWP 11558]
[New LWP 11559]
[New LWP 11560]
[New LWP 11561]
[New LWP 11562]
[New LWP 11563]
[New LWP 11564]
[New LWP 11565]
Cannot access memory at address 0x746e657265666671
Cannot access memory at address 0x746e657265666669
Cannot access memory at address 0x746e657265666671
Cannot access memory at address 0x746e657265666671
Cannot access memory at address 0x746e657265666669
0x00007f2fbd1dfd50 in ?? ()
Id Target Id Frame
* 1 LWP 11436 "kudu" 0x00007f2fbd1dfd50 in ?? ()
2 LWP 11438 "kudu" 0x00007f2fbd1dbfb9 in ?? ()
3 LWP 11439 "kudu" 0x00007f2fbd1dbfb9 in ?? ()
4 LWP 11440 "kudu" 0x00007f2fbd1dbfb9 in ?? ()
5 LWP 11441 "kernel-watcher-" 0x00007f2fbd1dbfb9 in ?? ()
6 LWP 11447 "ntp client-1144" 0x00007f2fbd1df9e2 in ?? ()
7 LWP 11448 "file cache-evic" 0x00007f2fbd1dbfb9 in ?? ()
8 LWP 11449 "sq_acceptor" 0x00007f2fb615ebb9 in ?? ()
9 LWP 11452 "rpc reactor-114" 0x00007f2fb616b947 in ?? ()
10 LWP 11453 "rpc reactor-114" 0x00007f2fb616b947 in ?? ()
11 LWP 11454 "rpc reactor-114" 0x00007f2fb616b947 in ?? ()
12 LWP 11455 "rpc reactor-114" 0x00007f2fb616b947 in ?? ()
13 LWP 11456 "MaintenanceMgr " 0x00007f2fbd1dbad3 in ?? ()
14 LWP 11457 "txn-status-mana" 0x00007f2fbd1dbfb9 in ?? ()
15 LWP 11458 "collect_and_rem" 0x00007f2fbd1dbfb9 in ?? ()
16 LWP 11459 "tc-session-exp-" 0x00007f2fbd1dbfb9 in ?? ()
17 LWP 11460 "rpc worker-1146" 0x00007f2fbd1dbad3 in ?? ()
18 LWP 11461 "rpc worker-1146" 0x00007f2fbd1dbad3 in ?? ()
19 LWP 11462 "rpc worker-1146" 0x00007f2fbd1dbad3 in ?? ()
20 LWP 11463 "rpc worker-1146" 0x00007f2fbd1dbad3 in ?? ()
21 LWP 11464 "rpc worker-1146" 0x00007f2fbd1dbad3 in ?? ()
22 LWP 11465 "rpc worker-1146" 0x00007f2fbd1dbad3 in ?? ()
23 LWP 11466 "rpc worker-1146" 0x00007f2fbd1dbad3 in ?? ()
24 LWP 11467 "rpc worker-1146" 0x00007f2fbd1dbad3 in ?? ()
25 LWP 11468 "rpc worker-1146" 0x00007f2fbd1dbad3 in ?? ()
26 LWP 11469 "rpc worker-1146" 0x00007f2fbd1dbad3 in ?? ()
27 LWP 11470 "rpc worker-1147" 0x00007f2fbd1dbad3 in ?? ()
28 LWP 11471 "rpc worker-1147" 0x00007f2fbd1dbad3 in ?? ()
29 LWP 11472 "rpc worker-1147" 0x00007f2fbd1dbad3 in ?? ()
30 LWP 11473 "rpc worker-1147" 0x00007f2fbd1dbad3 in ?? ()
31 LWP 11474 "rpc worker-1147" 0x00007f2fbd1dbad3 in ?? ()
32 LWP 11475 "rpc worker-1147" 0x00007f2fbd1dbad3 in ?? ()
33 LWP 11476 "rpc worker-1147" 0x00007f2fbd1dbad3 in ?? ()
34 LWP 11477 "rpc worker-1147" 0x00007f2fbd1dbad3 in ?? ()
35 LWP 11478 "rpc worker-1147" 0x00007f2fbd1dbad3 in ?? ()
36 LWP 11479 "rpc worker-1147" 0x00007f2fbd1dbad3 in ?? ()
37 LWP 11480 "rpc worker-1148" 0x00007f2fbd1dbad3 in ?? ()
38 LWP 11481 "rpc worker-1148" 0x00007f2fbd1dbad3 in ?? ()
39 LWP 11482 "rpc worker-1148" 0x00007f2fbd1dbad3 in ?? ()
40 LWP 11483 "rpc worker-1148" 0x00007f2fbd1dbad3 in ?? ()
41 LWP 11484 "rpc worker-1148" 0x00007f2fbd1dbad3 in ?? ()
42 LWP 11485 "rpc worker-1148" 0x00007f2fbd1dbad3 in ?? ()
43 LWP 11486 "rpc worker-1148" 0x00007f2fbd1dbad3 in ?? ()
44 LWP 11487 "rpc worker-1148" 0x00007f2fbd1dbad3 in ?? ()
45 LWP 11488 "rpc worker-1148" 0x00007f2fbd1dbad3 in ?? ()
46 LWP 11489 "rpc worker-1148" 0x00007f2fbd1dbad3 in ?? ()
47 LWP 11490 "rpc worker-1149" 0x00007f2fbd1dbad3 in ?? ()
48 LWP 11491 "rpc worker-1149" 0x00007f2fbd1dbad3 in ?? ()
49 LWP 11492 "rpc worker-1149" 0x00007f2fbd1dbad3 in ?? ()
50 LWP 11493 "rpc worker-1149" 0x00007f2fbd1dbad3 in ?? ()
51 LWP 11494 "rpc worker-1149" 0x00007f2fbd1dbad3 in ?? ()
52 LWP 11495 "rpc worker-1149" 0x00007f2fbd1dbad3 in ?? ()
53 LWP 11496 "rpc worker-1149" 0x00007f2fbd1dbad3 in ?? ()
54 LWP 11497 "rpc worker-1149" 0x00007f2fbd1dbad3 in ?? ()
55 LWP 11498 "rpc worker-1149" 0x00007f2fbd1dbad3 in ?? ()
56 LWP 11499 "rpc worker-1149" 0x00007f2fbd1dbad3 in ?? ()
57 LWP 11500 "rpc worker-1150" 0x00007f2fbd1dbad3 in ?? ()
58 LWP 11501 "rpc worker-1150" 0x00007f2fbd1dbad3 in ?? ()
59 LWP 11502 "rpc worker-1150" 0x00007f2fbd1dbad3 in ?? ()
60 LWP 11503 "rpc worker-1150" 0x00007f2fbd1dbad3 in ?? ()
61 LWP 11504 "rpc worker-1150" 0x00007f2fbd1dbad3 in ?? ()
62 LWP 11505 "rpc worker-1150" 0x00007f2fbd1dbad3 in ?? ()
63 LWP 11506 "rpc worker-1150" 0x00007f2fbd1dbad3 in ?? ()
64 LWP 11507 "rpc worker-1150" 0x00007f2fbd1dbad3 in ?? ()
65 LWP 11508 "rpc worker-1150" 0x00007f2fbd1dbad3 in ?? ()
66 LWP 11509 "rpc worker-1150" 0x00007f2fbd1dbad3 in ?? ()
67 LWP 11510 "rpc worker-1151" 0x00007f2fbd1dbad3 in ?? ()
68 LWP 11511 "rpc worker-1151" 0x00007f2fbd1dbad3 in ?? ()
69 LWP 11512 "rpc worker-1151" 0x00007f2fbd1dbad3 in ?? ()
70 LWP 11513 "rpc worker-1151" 0x00007f2fbd1dbad3 in ?? ()
71 LWP 11514 "rpc worker-1151" 0x00007f2fbd1dbad3 in ?? ()
72 LWP 11515 "rpc worker-1151" 0x00007f2fbd1dbad3 in ?? ()
73 LWP 11516 "rpc worker-1151" 0x00007f2fbd1dbad3 in ?? ()
74 LWP 11517 "rpc worker-1151" 0x00007f2fbd1dbad3 in ?? ()
75 LWP 11518 "rpc worker-1151" 0x00007f2fbd1dbad3 in ?? ()
76 LWP 11519 "rpc worker-1151" 0x00007f2fbd1dbad3 in ?? ()
77 LWP 11520 "rpc worker-1152" 0x00007f2fbd1dbad3 in ?? ()
78 LWP 11521 "rpc worker-1152" 0x00007f2fbd1dbad3 in ?? ()
79 LWP 11522 "rpc worker-1152" 0x00007f2fbd1dbad3 in ?? ()
80 LWP 11523 "rpc worker-1152" 0x00007f2fbd1dbad3 in ?? ()
81 LWP 11524 "rpc worker-1152" 0x00007f2fbd1dbad3 in ?? ()
82 LWP 11525 "rpc worker-1152" 0x00007f2fbd1dbad3 in ?? ()
83 LWP 11526 "rpc worker-1152" 0x00007f2fbd1dbad3 in ?? ()
84 LWP 11527 "rpc worker-1152" 0x00007f2fbd1dbad3 in ?? ()
85 LWP 11528 "rpc worker-1152" 0x00007f2fbd1dbad3 in ?? ()
86 LWP 11529 "rpc worker-1152" 0x00007f2fbd1dbad3 in ?? ()
87 LWP 11530 "rpc worker-1153" 0x00007f2fbd1dbad3 in ?? ()
88 LWP 11531 "rpc worker-1153" 0x00007f2fbd1dbad3 in ?? ()
89 LWP 11532 "rpc worker-1153" 0x00007f2fbd1dbad3 in ?? ()
90 LWP 11533 "rpc worker-1153" 0x00007f2fbd1dbad3 in ?? ()
91 LWP 11534 "rpc worker-1153" 0x00007f2fbd1dbad3 in ?? ()
92 LWP 11535 "rpc worker-1153" 0x00007f2fbd1dbad3 in ?? ()
93 LWP 11536 "rpc worker-1153" 0x00007f2fbd1dbad3 in ?? ()
94 LWP 11537 "rpc worker-1153" 0x00007f2fbd1dbad3 in ?? ()
95 LWP 11538 "rpc worker-1153" 0x00007f2fbd1dbad3 in ?? ()
96 LWP 11539 "rpc worker-1153" 0x00007f2fbd1dbad3 in ?? ()
97 LWP 11540 "rpc worker-1154" 0x00007f2fbd1dbad3 in ?? ()
98 LWP 11541 "rpc worker-1154" 0x00007f2fbd1dbad3 in ?? ()
99 LWP 11542 "rpc worker-1154" 0x00007f2fbd1dbad3 in ?? ()
100 LWP 11543 "rpc worker-1154" 0x00007f2fbd1dbad3 in ?? ()
101 LWP 11544 "rpc worker-1154" 0x00007f2fbd1dbad3 in ?? ()
102 LWP 11545 "rpc worker-1154" 0x00007f2fbd1dbad3 in ?? ()
103 LWP 11546 "rpc worker-1154" 0x00007f2fbd1dbad3 in ?? ()
104 LWP 11547 "rpc worker-1154" 0x00007f2fbd1dbad3 in ?? ()
105 LWP 11548 "rpc worker-1154" 0x00007f2fbd1dbad3 in ?? ()
106 LWP 11549 "rpc worker-1154" 0x00007f2fbd1dbad3 in ?? ()
107 LWP 11550 "rpc worker-1155" 0x00007f2fbd1dbad3 in ?? ()
108 LWP 11551 "rpc worker-1155" 0x00007f2fbd1dbad3 in ?? ()
109 LWP 11552 "rpc worker-1155" 0x00007f2fbd1dbad3 in ?? ()
110 LWP 11553 "rpc worker-1155" 0x00007f2fbd1dbad3 in ?? ()
111 LWP 11554 "rpc worker-1155" 0x00007f2fbd1dbad3 in ?? ()
112 LWP 11555 "rpc worker-1155" 0x00007f2fbd1dbad3 in ?? ()
113 LWP 11556 "rpc worker-1155" 0x00007f2fbd1dbad3 in ?? ()
114 LWP 11557 "rpc worker-1155" 0x00007f2fbd1dbad3 in ?? ()
115 LWP 11558 "rpc worker-1155" 0x00007f2fbd1dbad3 in ?? ()
116 LWP 11559 "rpc worker-1155" 0x00007f2fbd1dbad3 in ?? ()
117 LWP 11560 "diag-logger-115" 0x00007f2fbd1dbfb9 in ?? ()
118 LWP 11561 "result-tracker-" 0x00007f2fbd1dbfb9 in ?? ()
119 LWP 11562 "excess-log-dele" 0x00007f2fbd1dbfb9 in ?? ()
120 LWP 11563 "acceptor-11563" 0x00007f2fb616cfc7 in ?? ()
121 LWP 11564 "heartbeat-11564" 0x00007f2fbd1dbfb9 in ?? ()
122 LWP 11565 "maintenance_sch" 0x00007f2fbd1dbfb9 in ?? ()
Thread 122 (LWP 11565):
#0 0x00007f2fbd1dbfb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 121 (LWP 11564):
#0 0x00007f2fbd1dbfb9 in ?? ()
#1 0xffffffffffffffff in ?? ()
#2 0x000000000000000f in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x0000613000018268 in ?? ()
#5 0x00007f2f73600770 in ?? ()
#6 0x000000000000001e in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 120 (LWP 11563):
#0 0x00007f2fb616cfc7 in ?? ()
#1 0x0000614000009490 in ?? ()
#2 0x00007f2f73e27fa0 in ?? ()
#3 0x00007f2f73e27fc0 in ?? ()
#4 0x00007f2f73e280e0 in ?? ()
#5 0x00007f2f73e27fd0 in ?? ()
#6 0x00007f2f73e28040 in ?? ()
#7 0x0000000000000080 in ?? ()
#8 0x000000000082c9d2 in __sanitizer::theDepot ()
#9 0x00000000008c3cc9 in __sanitizer::theDepot ()
#10 0x00000000008f35b0 in __sanitizer::theDepot ()
#11 0x00000000008f34b8 in __sanitizer::theDepot ()
#12 0x000060c000060058 in ?? ()
#13 0x000060c0000600b1 in ?? ()
#14 0x00000000008875e1 in __sanitizer::theDepot ()
#15 0x0000000000000059 in ?? ()
#16 0x000000000088348c in __sanitizer::theDepot ()
#17 0x000060c000060058 in ?? ()
#18 0x0000000000883aba in __sanitizer::theDepot ()
#19 0x00000000008d30d7 in __sanitizer::theDepot ()
#20 0x00007f2fc08ced85 in ?? ()
#21 0x00007f2fc08d174c in ?? ()
#22 0x00007f2fc08d15c9 in ?? ()
#23 0x00000000009edb7d in __sanitizer::theDepot ()
#24 0x00007f2fb9efbeaf in ?? ()
#25 0x00007f2fbd1d56db in ?? ()
#26 0x00007f2fb611d346 in ?? ()
#27 0x00007f2f73e27842 in ?? ()
#28 0x000000006a34e215 in ?? ()
#29 0x000000006a34e215 in ?? ()
#30 0x000000000080e8d4 in __sanitizer::theDepot ()
#31 0x0000001e0000002d in ?? ()
#32 0x0000001300000006 in ?? ()
#33 0x0000640000001140 in ?? ()
#34 0x00007f2f73621e60 in ?? ()
#35 0x0000640000001140 in ?? ()
#36 0x00000000008b1acd in __sanitizer::theDepot ()
#37 0x0000000000e377a0 in ?? ()
#38 0x00007f2fb1b28150 in ?? ()
#39 0x0000000000000000 in ?? ()
Thread 119 (LWP 11562):
#0 0x00007f2fbd1dbfb9 in ?? ()
#1 0x00007ffef4c4c8d0 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 118 (LWP 11561):
#0 0x00007f2fbd1dbfb9 in ?? ()
#1 0x00007f2f74e5a160 in ?? ()
#2 0x000000000000000f in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061100006e4b0 in ?? ()
#5 0x00007f2f74e5a110 in ?? ()
#6 0x000000000000001e in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 117 (LWP 11560):
#0 0x00007f2fbd1dbfb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 116 (LWP 11559):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000007 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d0002b004c in ?? ()
#4 0x00007f2f75e89eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f2f75e89ed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0002b0000 in ?? ()
#9 0x00007f2fbd1db770 in ?? ()
#10 0x00007f2f75e89ed0 in ?? ()
#11 0x00007f2f75e89fa0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 115 (LWP 11558):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000001 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d0002a685c in ?? ()
#4 0x00007f2f766a1eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f2f766a1ed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0002a6810 in ?? ()
#9 0x00007f2fbd1db770 in ?? ()
#10 0x00007f2f766a1ed0 in ?? ()
#11 0x00007f2f766a1fa0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 114 (LWP 11557):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 113 (LWP 11556):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 112 (LWP 11555):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 111 (LWP 11554):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 110 (LWP 11553):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 109 (LWP 11552):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 108 (LWP 11551):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 107 (LWP 11550):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 106 (LWP 11549):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 105 (LWP 11548):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 104 (LWP 11547):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 103 (LWP 11546):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 102 (LWP 11545):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 101 (LWP 11544):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 100 (LWP 11543):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 99 (LWP 11542):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 98 (LWP 11541):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 97 (LWP 11540):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 96 (LWP 11539):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 95 (LWP 11538):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 94 (LWP 11537):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 93 (LWP 11536):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 92 (LWP 11535):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 91 (LWP 11534):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 90 (LWP 11533):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 89 (LWP 11532):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 88 (LWP 11531):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 87 (LWP 11530):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 86 (LWP 11529):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 85 (LWP 11528):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 84 (LWP 11527):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 83 (LWP 11526):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 82 (LWP 11525):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 81 (LWP 11524):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 80 (LWP 11523):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 79 (LWP 11522):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 78 (LWP 11521):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 77 (LWP 11520):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 76 (LWP 11519):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000002 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d0001a6888 in ?? ()
#4 0x00007f2f8a24aeb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f2f8a24aed0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 75 (LWP 11518):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 74 (LWP 11517):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 73 (LWP 11516):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 72 (LWP 11515):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 71 (LWP 11514):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 70 (LWP 11513):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 69 (LWP 11512):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 68 (LWP 11511):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 67 (LWP 11510):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 66 (LWP 11509):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 65 (LWP 11508):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 64 (LWP 11507):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 63 (LWP 11506):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 62 (LWP 11505):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 61 (LWP 11504):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 60 (LWP 11503):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 59 (LWP 11502):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 58 (LWP 11501):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 57 (LWP 11500):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 56 (LWP 11499):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000002 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d000126838 in ?? ()
#4 0x00007f2f9442beb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f2f9442bed0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 55 (LWP 11498):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 54 (LWP 11497):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 53 (LWP 11496):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 52 (LWP 11495):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 51 (LWP 11494):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 50 (LWP 11493):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 49 (LWP 11492):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 48 (LWP 11491):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 47 (LWP 11490):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 46 (LWP 11489):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 45 (LWP 11488):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 44 (LWP 11487):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 43 (LWP 11486):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 42 (LWP 11485):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 41 (LWP 11484):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 40 (LWP 11483):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 39 (LWP 11482):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 38 (LWP 11481):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 37 (LWP 11480):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 36 (LWP 11479):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000002 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d00009ffe8 in ?? ()
#4 0x00007f2f9e60ceb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f2f9e60ced0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 35 (LWP 11478):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 34 (LWP 11477):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 33 (LWP 11476):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 32 (LWP 11475):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 31 (LWP 11474):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 30 (LWP 11473):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 29 (LWP 11472):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 28 (LWP 11471):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 27 (LWP 11470):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 26 (LWP 11469):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 25 (LWP 11468):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 24 (LWP 11467):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 23 (LWP 11466):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 22 (LWP 11465):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 21 (LWP 11464):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 20 (LWP 11463):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 19 (LWP 11462):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 18 (LWP 11461):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 17 (LWP 11460):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 16 (LWP 11459):
#0 0x00007f2fbd1dbfb9 in ?? ()
#1 0x00000000ffffffff in ?? ()
#2 0x0000000000000001 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x0000613000018b20 in ?? ()
#5 0x00007f2fa87ddd30 in ?? ()
#6 0x0000000000000002 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 15 (LWP 11458):
#0 0x00007f2fbd1dbfb9 in ?? ()
#1 0x4008000000000000 in ?? ()
#2 0x0000000000000003 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061200001a498 in ?? ()
#5 0x00007f2fa8fdf270 in ?? ()
#6 0x0000000000000006 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 14 (LWP 11457):
#0 0x00007f2fbd1dbfb9 in ?? ()
#1 0x0000000045e0360e in ?? ()
#2 0x0000000000000001 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x0000618000004da8 in ?? ()
#5 0x00007f2fa97df250 in ?? ()
#6 0x0000000000000002 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 13 (LWP 11456):
#0 0x00007f2fbd1dbad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 12 (LWP 11455):
#0 0x00007f2fb616b947 in ?? ()
#1 0x0000614000009680 in ?? ()
#2 0x0000619000059680 in ?? ()
#3 0x00007f2faa7e2340 in ?? ()
#4 0x00007f2faa7e2540 in ?? ()
#5 0x00007f2faa7e2390 in ?? ()
#6 0x0000614000009680 in ?? ()
#7 0x00007f2faa7e2400 in ?? ()
#8 0x00007f2fb8772bda in ?? ()
#9 0x3fb97245a4a02000 in ?? ()
#10 0x0000619000059680 in ?? ()
#11 0x54b249ad2594c37d in ?? ()
#12 0x0000619000059680 in ?? ()
#13 0x422136b0cb000000 in ?? ()
#14 0x00007f2faa7e2540 in ?? ()
#15 0x41da8d37bc1d1665 in ?? ()
#16 0x00000000754f4480 in ?? ()
#17 0x00007f2faa7e23e0 in ?? ()
#18 0x00007f2fb8776228 in ?? ()
#19 0x00000000aa7e23c0 in ?? ()
#20 0x0000619000059680 in ?? ()
#21 0x0000614000009680 in ?? ()
#22 0x00007f2faa7e2400 in ?? ()
#23 0x3fb97245a4a02000 in ?? ()
#24 0x4089a194887e1bed in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 11 (LWP 11454):
#0 0x00007f2fb616b947 in ?? ()
#1 0x0000614000009480 in ?? ()
#2 0x0000619000059180 in ?? ()
#3 0x00007f2faafe3340 in ?? ()
#4 0x00007f2faafe3540 in ?? ()
#5 0x00007f2faafe3390 in ?? ()
#6 0x0000614000009480 in ?? ()
#7 0x00007f2faafe3400 in ?? ()
#8 0x00007f2fb8772bda in ?? ()
#9 0x3fb967ad70366000 in ?? ()
#10 0x0000619000059180 in ?? ()
#11 0x54b249ad2594c37d in ?? ()
#12 0x0000619000059180 in ?? ()
#13 0x4213c46f31000000 in ?? ()
#14 0x00007f2faafe3540 in ?? ()
#15 0x41da8d37bc1d1664 in ?? ()
#16 0x00000000755f4680 in ?? ()
#17 0x00007f2faafe33e0 in ?? ()
#18 0x00007f2fb8776228 in ?? ()
#19 0x00000000aafe33c0 in ?? ()
#20 0x0000619000059180 in ?? ()
#21 0x0000614000009480 in ?? ()
#22 0x00007f2faafe3400 in ?? ()
#23 0x3fb967ad70366000 in ?? ()
#24 0x4089a194d86dbfcc in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 10 (LWP 11453):
#0 0x00007f2fb616b947 in ?? ()
#1 0x0000614000009280 in ?? ()
#2 0x0000619000058c80 in ?? ()
#3 0x00007f2fab7e4340 in ?? ()
#4 0x00007f2fab7e4540 in ?? ()
#5 0x00007f2fab7e4390 in ?? ()
#6 0x0000614000009280 in ?? ()
#7 0x00007f2fab7e4400 in ?? ()
#8 0x00007f2fb8772bda in ?? ()
#9 0x3fb96e45873b6000 in ?? ()
#10 0x0000619000058c80 in ?? ()
#11 0x54b249ad2594c37d in ?? ()
#12 0x0000619000058c80 in ?? ()
#13 0x422130d96e800000 in ?? ()
#14 0x00007f2fab7e4540 in ?? ()
#15 0x41da8d37bc1d1665 in ?? ()
#16 0x00000000756f4880 in ?? ()
#17 0x00007f2fab7e43e0 in ?? ()
#18 0x00007f2fb8776228 in ?? ()
#19 0x00000000ab7e43c0 in ?? ()
#20 0x0000619000058c80 in ?? ()
#21 0x0000614000009280 in ?? ()
#22 0x00007f2fab7e4400 in ?? ()
#23 0x3fb96e45873b6000 in ?? ()
#24 0x4089a194887db4d9 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 9 (LWP 11452):
#0 0x00007f2fb616b947 in ?? ()
#1 0x0000614000009080 in ?? ()
#2 0x0000619000058780 in ?? ()
#3 0x00007f2facdad340 in ?? ()
#4 0x00007f2facdad540 in ?? ()
#5 0x00007f2facdad390 in ?? ()
#6 0x0000614000009080 in ?? ()
#7 0x00007f2facdad400 in ?? ()
#8 0x00007f2fb8772bda in ?? ()
#9 0x3fb996212deac000 in ?? ()
#10 0x0000619000058780 in ?? ()
#11 0x54b249ad2594c37d in ?? ()
#12 0x0000619000058780 in ?? ()
#13 0x42280aa80a800000 in ?? ()
#14 0x00007f2facdad540 in ?? ()
#15 0x41da8d37bc1d1666 in ?? ()
#16 0x00000000759ada80 in ?? ()
#17 0x00007f2facdad3e0 in ?? ()
#18 0x00007f2fb8776228 in ?? ()
#19 0x0000000000000000 in ?? ()
Thread 8 (LWP 11449):
#0 0x00007f2fb615ebb9 in ?? ()
#1 0x00000000000000c8 in ?? ()
#2 0x00007f2fae7b77d8 in ?? ()
#3 0x000060200004b610 in ?? ()
#4 0x0000000000000002 in ?? ()
#5 0x00000000000000c8 in ?? ()
#6 0x0000000000823a92 in __sanitizer::theDepot ()
#7 0x00007f2fae7b7800 in ?? ()
#8 0x00000000000fe000 in ?? ()
#9 0x0000000000000000 in ?? ()
Thread 7 (LWP 11448):
#0 0x00007f2fbd1dbfb9 in ?? ()
#1 0x00007f2fadfb6140 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 6 (LWP 11447):
#0 0x00007f2fbd1df9e2 in ?? ()
#1 0x00007f2fad7b4430 in ?? ()
#2 0x00007f2fad7b3f20 in ?? ()
#3 0x00007f2fad7b3650 in ?? ()
#4 0x00007f2fad7b51c0 in ?? ()
#5 0x00007f2fad7b3ed0 in ?? ()
#6 0x0000000000000030 in ?? ()
#7 0x00007f2fad7b3f30 in ?? ()
#8 0x000061100006f950 in ?? ()
#9 0x00007f2fad7b3f20 in ?? ()
#10 0x000000000081de90 in __sanitizer::theDepot ()
#11 0x00007f2fc29a3269 in ?? ()
#12 0x00000000009edb7d in __sanitizer::theDepot ()
#13 0x00007f2fb9efbeaf in ?? ()
#14 0x00007f2fbd1d56db in ?? ()
#15 0x00007f2fad7b36b0 in ?? ()
#16 0x00007f2fc29b1e61 in ?? ()
#17 0x00007f2fad7b3770 in ?? ()
#18 0x00007f2fc29b18ea in ?? ()
#19 0x0000000045e0360e in ?? ()
#20 0x00007f2fc293bb62 in ?? ()
#21 0x000061100006f960 in ?? ()
#22 0x0000000000000000 in ?? ()
Thread 5 (LWP 11441):
#0 0x00007f2fbd1dbfb9 in ?? ()
#1 0x00007f2faf7b90a0 in ?? ()
#2 0x000000000000004c in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061200001a9a8 in ?? ()
#5 0x00007f2faf7b8cd0 in ?? ()
#6 0x0000000000000098 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 4 (LWP 11440):
#0 0x00007f2fbd1dbfb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 3 (LWP 11439):
#0 0x00007f2fbd1dbfb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 2 (LWP 11438):
#0 0x00007f2fbd1dbfb9 in ?? ()
#1 0x0000000000008000 in ?? ()
#2 0x0000000000000002 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x00006120000096b8 in ?? ()
#5 0x00007f2fb0fbc450 in ?? ()
#6 0x0000000000000004 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 1 (LWP 11436):
#0 0x00007f2fbd1dfd50 in ?? ()
#1 0x0000000000000000 in ?? ()
************************* END STACKS ***************************
I20260619 06:31:01.003443 7552 external_mini_cluster-itest-base.cc:86] Attempting to dump stacks of TS 2 with UUID febe077b7c1645e1b8d47ba28c8f3832 and pid 11571
************************ BEGIN STACKS **************************
[New LWP 11573]
[New LWP 11574]
[New LWP 11575]
[New LWP 11576]
[New LWP 11582]
[New LWP 11583]
[New LWP 11584]
[New LWP 11587]
[New LWP 11588]
[New LWP 11589]
[New LWP 11590]
[New LWP 11591]
[New LWP 11592]
[New LWP 11594]
[New LWP 11595]
[New LWP 11596]
[New LWP 11597]
[New LWP 11598]
[New LWP 11599]
[New LWP 11600]
[New LWP 11601]
[New LWP 11602]
[New LWP 11603]
[New LWP 11604]
[New LWP 11605]
[New LWP 11606]
[New LWP 11607]
[New LWP 11608]
[New LWP 11609]
[New LWP 11610]
[New LWP 11611]
[New LWP 11612]
[New LWP 11613]
[New LWP 11614]
[New LWP 11615]
[New LWP 11616]
[New LWP 11617]
[New LWP 11618]
[New LWP 11619]
[New LWP 11620]
[New LWP 11621]
[New LWP 11622]
[New LWP 11623]
[New LWP 11624]
[New LWP 11625]
[New LWP 11626]
[New LWP 11627]
[New LWP 11628]
[New LWP 11629]
[New LWP 11630]
[New LWP 11631]
[New LWP 11632]
[New LWP 11633]
[New LWP 11634]
[New LWP 11635]
[New LWP 11636]
[New LWP 11637]
[New LWP 11638]
[New LWP 11639]
[New LWP 11640]
[New LWP 11641]
[New LWP 11642]
[New LWP 11643]
[New LWP 11644]
[New LWP 11645]
[New LWP 11646]
[New LWP 11647]
[New LWP 11648]
[New LWP 11649]
[New LWP 11650]
[New LWP 11651]
[New LWP 11652]
[New LWP 11653]
[New LWP 11654]
[New LWP 11655]
[New LWP 11656]
[New LWP 11657]
[New LWP 11658]
[New LWP 11659]
[New LWP 11660]
[New LWP 11661]
[New LWP 11662]
[New LWP 11663]
[New LWP 11664]
[New LWP 11665]
[New LWP 11666]
[New LWP 11667]
[New LWP 11668]
[New LWP 11669]
[New LWP 11670]
[New LWP 11671]
[New LWP 11672]
[New LWP 11673]
[New LWP 11674]
[New LWP 11675]
[New LWP 11676]
[New LWP 11677]
[New LWP 11678]
[New LWP 11679]
[New LWP 11680]
[New LWP 11681]
[New LWP 11682]
[New LWP 11683]
[New LWP 11684]
[New LWP 11685]
[New LWP 11686]
[New LWP 11687]
[New LWP 11688]
[New LWP 11689]
[New LWP 11690]
[New LWP 11691]
[New LWP 11692]
[New LWP 11693]
[New LWP 11694]
[New LWP 11695]
[New LWP 11696]
[New LWP 11697]
[New LWP 11698]
[New LWP 11699]
[New LWP 11700]
[New LWP 11701]
[New LWP 12006]
Cannot access memory at address 0x746e657265666671
Cannot access memory at address 0x746e657265666669
Cannot access memory at address 0x746e657265666671
Cannot access memory at address 0x746e657265666671
Cannot access memory at address 0x746e657265666669
0x00007fda90c50d50 in ?? ()
Id Target Id Frame
* 1 LWP 11571 "kudu" 0x00007fda90c50d50 in ?? ()
2 LWP 11573 "kudu" 0x00007fda90c4cfb9 in ?? ()
3 LWP 11574 "kudu" 0x00007fda90c4cfb9 in ?? ()
4 LWP 11575 "kudu" 0x00007fda90c4cfb9 in ?? ()
5 LWP 11576 "kernel-watcher-" 0x00007fda90c4cfb9 in ?? ()
6 LWP 11582 "ntp client-1158" 0x00007fda90c509e2 in ?? ()
7 LWP 11583 "file cache-evic" 0x00007fda90c4cfb9 in ?? ()
8 LWP 11584 "sq_acceptor" 0x00007fda89bcfbb9 in ?? ()
9 LWP 11587 "rpc reactor-115" 0x00007fda89bdc947 in ?? ()
10 LWP 11588 "rpc reactor-115" 0x00007fda89bdc947 in ?? ()
11 LWP 11589 "rpc reactor-115" 0x00007fda89bdc947 in ?? ()
12 LWP 11590 "rpc reactor-115" 0x00007fda89bdc947 in ?? ()
13 LWP 11591 "MaintenanceMgr " 0x00007fda90c4cad3 in ?? ()
14 LWP 11592 "txn-status-mana" 0x00007fda90c4cfb9 in ?? ()
15 LWP 11594 "collect_and_rem" 0x00007fda90c4cfb9 in ?? ()
16 LWP 11595 "tc-session-exp-" 0x00007fda90c4cfb9 in ?? ()
17 LWP 11596 "rpc worker-1159" 0x00007fda90c4cad3 in ?? ()
18 LWP 11597 "rpc worker-1159" 0x00007fda90c4cad3 in ?? ()
19 LWP 11598 "rpc worker-1159" 0x00007fda90c4cad3 in ?? ()
20 LWP 11599 "rpc worker-1159" 0x00007fda90c4cad3 in ?? ()
21 LWP 11600 "rpc worker-1160" 0x00007fda90c4cad3 in ?? ()
22 LWP 11601 "rpc worker-1160" 0x00007fda90c4cad3 in ?? ()
23 LWP 11602 "rpc worker-1160" 0x00007fda90c4cad3 in ?? ()
24 LWP 11603 "rpc worker-1160" 0x00007fda90c4cad3 in ?? ()
25 LWP 11604 "rpc worker-1160" 0x00007fda90c4cad3 in ?? ()
26 LWP 11605 "rpc worker-1160" 0x00007fda90c4cad3 in ?? ()
27 LWP 11606 "rpc worker-1160" 0x00007fda90c4cad3 in ?? ()
28 LWP 11607 "rpc worker-1160" 0x00007fda90c4cad3 in ?? ()
29 LWP 11608 "rpc worker-1160" 0x00007fda90c4cad3 in ?? ()
30 LWP 11609 "rpc worker-1160" 0x00007fda90c4cad3 in ?? ()
31 LWP 11610 "rpc worker-1161" 0x00007fda90c4cad3 in ?? ()
32 LWP 11611 "rpc worker-1161" 0x00007fda90c4cad3 in ?? ()
33 LWP 11612 "rpc worker-1161" 0x00007fda90c4cad3 in ?? ()
34 LWP 11613 "rpc worker-1161" 0x00007fda90c4cad3 in ?? ()
35 LWP 11614 "rpc worker-1161" 0x00007fda90c4cad3 in ?? ()
36 LWP 11615 "rpc worker-1161" 0x00007fda90c4cad3 in ?? ()
37 LWP 11616 "rpc worker-1161" 0x00007fda90c4cad3 in ?? ()
38 LWP 11617 "rpc worker-1161" 0x00007fda90c4cad3 in ?? ()
39 LWP 11618 "rpc worker-1161" 0x00007fda90c4cad3 in ?? ()
40 LWP 11619 "rpc worker-1161" 0x00007fda90c4cad3 in ?? ()
41 LWP 11620 "rpc worker-1162" 0x00007fda90c4cad3 in ?? ()
42 LWP 11621 "rpc worker-1162" 0x00007fda90c4cad3 in ?? ()
43 LWP 11622 "rpc worker-1162" 0x00007fda90c4cad3 in ?? ()
44 LWP 11623 "rpc worker-1162" 0x00007fda90c4cad3 in ?? ()
45 LWP 11624 "rpc worker-1162" 0x00007fda90c4cad3 in ?? ()
46 LWP 11625 "rpc worker-1162" 0x00007fda90c4cad3 in ?? ()
47 LWP 11626 "rpc worker-1162" 0x00007fda90c4cad3 in ?? ()
48 LWP 11627 "rpc worker-1162" 0x00007fda90c4cad3 in ?? ()
49 LWP 11628 "rpc worker-1162" 0x00007fda90c4cad3 in ?? ()
50 LWP 11629 "rpc worker-1162" 0x00007fda90c4cad3 in ?? ()
51 LWP 11630 "rpc worker-1163" 0x00007fda90c4cad3 in ?? ()
52 LWP 11631 "rpc worker-1163" 0x00007fda90c4cad3 in ?? ()
53 LWP 11632 "rpc worker-1163" 0x00007fda90c4cad3 in ?? ()
54 LWP 11633 "rpc worker-1163" 0x00007fda90c4cad3 in ?? ()
55 LWP 11634 "rpc worker-1163" 0x00007fda90c4cad3 in ?? ()
56 LWP 11635 "rpc worker-1163" 0x00007fda90c4cad3 in ?? ()
57 LWP 11636 "rpc worker-1163" 0x00007fda90c4cad3 in ?? ()
58 LWP 11637 "rpc worker-1163" 0x00007fda90c4cad3 in ?? ()
59 LWP 11638 "rpc worker-1163" 0x00007fda90c4cad3 in ?? ()
60 LWP 11639 "rpc worker-1163" 0x00007fda90c4cad3 in ?? ()
61 LWP 11640 "rpc worker-1164" 0x00007fda90c4cad3 in ?? ()
62 LWP 11641 "rpc worker-1164" 0x00007fda90c4cad3 in ?? ()
63 LWP 11642 "rpc worker-1164" 0x00007fda90c4cad3 in ?? ()
64 LWP 11643 "rpc worker-1164" 0x00007fda90c4cad3 in ?? ()
65 LWP 11644 "rpc worker-1164" 0x00007fda90c4cad3 in ?? ()
66 LWP 11645 "rpc worker-1164" 0x00007fda90c4cad3 in ?? ()
67 LWP 11646 "rpc worker-1164" 0x00007fda90c4cad3 in ?? ()
68 LWP 11647 "rpc worker-1164" 0x00007fda90c4cad3 in ?? ()
69 LWP 11648 "rpc worker-1164" 0x00007fda90c4cad3 in ?? ()
70 LWP 11649 "rpc worker-1164" 0x00007fda90c4cad3 in ?? ()
71 LWP 11650 "rpc worker-1165" 0x00007fda90c4cad3 in ?? ()
72 LWP 11651 "rpc worker-1165" 0x00007fda90c4cad3 in ?? ()
73 LWP 11652 "rpc worker-1165" 0x00007fda90c4cad3 in ?? ()
74 LWP 11653 "rpc worker-1165" 0x00007fda90c4cad3 in ?? ()
75 LWP 11654 "rpc worker-1165" 0x00007fda90c4cad3 in ?? ()
76 LWP 11655 "rpc worker-1165" 0x00007fda90c4cad3 in ?? ()
77 LWP 11656 "rpc worker-1165" 0x00007fda90c4cad3 in ?? ()
78 LWP 11657 "rpc worker-1165" 0x00007fda90c4cad3 in ?? ()
79 LWP 11658 "rpc worker-1165" 0x00007fda90c4cad3 in ?? ()
80 LWP 11659 "rpc worker-1165" 0x00007fda90c4cad3 in ?? ()
81 LWP 11660 "rpc worker-1166" 0x00007fda90c4cad3 in ?? ()
82 LWP 11661 "rpc worker-1166" 0x00007fda90c4cad3 in ?? ()
83 LWP 11662 "rpc worker-1166" 0x00007fda90c4cad3 in ?? ()
84 LWP 11663 "rpc worker-1166" 0x00007fda90c4cad3 in ?? ()
85 LWP 11664 "rpc worker-1166" 0x00007fda90c4cad3 in ?? ()
86 LWP 11665 "rpc worker-1166" 0x00007fda90c4cad3 in ?? ()
87 LWP 11666 "rpc worker-1166" 0x00007fda90c4cad3 in ?? ()
88 LWP 11667 "rpc worker-1166" 0x00007fda90c4cad3 in ?? ()
89 LWP 11668 "rpc worker-1166" 0x00007fda90c4cad3 in ?? ()
90 LWP 11669 "rpc worker-1166" 0x00007fda90c4cad3 in ?? ()
91 LWP 11670 "rpc worker-1167" 0x00007fda90c4cad3 in ?? ()
92 LWP 11671 "rpc worker-1167" 0x00007fda90c4cad3 in ?? ()
93 LWP 11672 "rpc worker-1167" 0x00007fda90c4cad3 in ?? ()
94 LWP 11673 "rpc worker-1167" 0x00007fda90c4cad3 in ?? ()
95 LWP 11674 "rpc worker-1167" 0x00007fda90c4cad3 in ?? ()
96 LWP 11675 "rpc worker-1167" 0x00007fda90c4cad3 in ?? ()
97 LWP 11676 "rpc worker-1167" 0x00007fda90c4cad3 in ?? ()
98 LWP 11677 "rpc worker-1167" 0x00007fda90c4cad3 in ?? ()
99 LWP 11678 "rpc worker-1167" 0x00007fda90c4cad3 in ?? ()
100 LWP 11679 "rpc worker-1167" 0x00007fda90c4cad3 in ?? ()
101 LWP 11680 "rpc worker-1168" 0x00007fda90c4cad3 in ?? ()
102 LWP 11681 "rpc worker-1168" 0x00007fda90c4cad3 in ?? ()
103 LWP 11682 "rpc worker-1168" 0x00007fda90c4cad3 in ?? ()
104 LWP 11683 "rpc worker-1168" 0x00007fda90c4cad3 in ?? ()
105 LWP 11684 "rpc worker-1168" 0x00007fda90c4cad3 in ?? ()
106 LWP 11685 "rpc worker-1168" 0x00007fda90c4cad3 in ?? ()
107 LWP 11686 "rpc worker-1168" 0x00007fda90c4cad3 in ?? ()
108 LWP 11687 "rpc worker-1168" 0x00007fda90c4cad3 in ?? ()
109 LWP 11688 "rpc worker-1168" 0x00007fda90c4cad3 in ?? ()
110 LWP 11689 "rpc worker-1168" 0x00007fda90c4cad3 in ?? ()
111 LWP 11690 "rpc worker-1169" 0x00007fda90c4cad3 in ?? ()
112 LWP 11691 "rpc worker-1169" 0x00007fda90c4cad3 in ?? ()
113 LWP 11692 "rpc worker-1169" 0x00007fda90c4cad3 in ?? ()
114 LWP 11693 "rpc worker-1169" 0x00007fda90c4cad3 in ?? ()
115 LWP 11694 "rpc worker-1169" 0x00007fda90c4cad3 in ?? ()
116 LWP 11695 "rpc worker-1169" 0x00007fda90c4cad3 in ?? ()
117 LWP 11696 "diag-logger-116" 0x00007fda90c4cfb9 in ?? ()
118 LWP 11697 "result-tracker-" 0x00007fda90c4cfb9 in ?? ()
119 LWP 11698 "excess-log-dele" 0x00007fda90c4cfb9 in ?? ()
120 LWP 11699 "acceptor-11699" 0x00007fda89bddfc7 in ?? ()
121 LWP 11700 "heartbeat-11700" 0x00007fda90c4cfb9 in ?? ()
122 LWP 11701 "maintenance_sch" 0x00007fda90c4cfb9 in ?? ()
123 LWP 12006 "raft [worker]-1" 0x00007fda90c4cfb9 in ?? ()
Thread 123 (LWP 12006):
#0 0x00007fda90c4cfb9 in ?? ()
#1 0x0000000045e0360e in ?? ()
#2 0x00000000000000e2 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x00007fda829b7ba0 in ?? ()
#5 0x00007fda829b7830 in ?? ()
#6 0x00000000000001c4 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 122 (LWP 11701):
#0 0x00007fda90c4cfb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 121 (LWP 11700):
#0 0x00007fda90c4cfb9 in ?? ()
#1 0xffffffffffffffff in ?? ()
#2 0x0000000000000012 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x0000613000018268 in ?? ()
#5 0x00007fda46819770 in ?? ()
#6 0x0000000000000024 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 120 (LWP 11699):
#0 0x00007fda89bddfc7 in ?? ()
#1 0x0000614000009290 in ?? ()
#2 0x00007fda47040fa0 in ?? ()
#3 0x00007fda47040fc0 in ?? ()
#4 0x00007fda470410e0 in ?? ()
#5 0x00007fda47040fd0 in ?? ()
#6 0x00007fda47041040 in ?? ()
#7 0x0000000000000080 in ?? ()
#8 0x000000000082c9d2 in __sanitizer::theDepot ()
#9 0x00000000008c3cc9 in __sanitizer::theDepot ()
#10 0x00000000008f35b0 in __sanitizer::theDepot ()
#11 0x0000000000000032 in ?? ()
#12 0x000060c000066058 in ?? ()
#13 0x000060c0000660b1 in ?? ()
#14 0x00000000008875e1 in __sanitizer::theDepot ()
#15 0x0000000000000059 in ?? ()
#16 0x000000000088348c in __sanitizer::theDepot ()
#17 0x0000000000000380 in ?? ()
#18 0x0000000000897749 in __sanitizer::theDepot ()
#19 0x0000000000010000 in ?? ()
#20 0x0000000000895799 in __sanitizer::theDepot ()
#21 0x0000000000e377a0 in ?? ()
#22 0x00000000007f9413 in __sanitizer::theDepot ()
#23 0x00000000009edb7d in __sanitizer::theDepot ()
#24 0x0000000000000700 in ?? ()
#25 0x00007fda90c466db in ?? ()
#26 0x00007fda89b8e346 in ?? ()
#27 0x00007fda47040842 in ?? ()
#28 0x000000006a34e216 in ?? ()
#29 0x000000006a34e216 in ?? ()
#30 0x0000640000001140 in ?? ()
#31 0x00007fda4683ae60 in ?? ()
#32 0x0000000000000049 in ?? ()
#33 0x0000017000000000 in ?? ()
#34 0x0000000000000017 in ?? ()
#35 0x0000640000001140 in ?? ()
#36 0x00000000008b1acd in __sanitizer::theDepot ()
#37 0x0000000000e377a0 in ?? ()
#38 0x00007fda46829328 in ?? ()
#39 0x0000000000000000 in ?? ()
Thread 119 (LWP 11698):
#0 0x00007fda90c4cfb9 in ?? ()
#1 0x00007ffd03cdf130 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 118 (LWP 11697):
#0 0x00007fda90c4cfb9 in ?? ()
#1 0x00007fda48073160 in ?? ()
#2 0x000000000000000f in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061100006e4b0 in ?? ()
#5 0x00007fda48073110 in ?? ()
#6 0x000000000000001e in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 117 (LWP 11696):
#0 0x00007fda90c4cfb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 116 (LWP 11695):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000003 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d0002b684c in ?? ()
#4 0x00007fda490a2eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fda490a2ed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0002b6800 in ?? ()
#9 0x00007fda90c4c770 in ?? ()
#10 0x00007fda490a2ed0 in ?? ()
#11 0x00007fda490a2fa0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 115 (LWP 11694):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000005 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d0002b004c in ?? ()
#4 0x00007fda498baeb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fda498baed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0002b0000 in ?? ()
#9 0x00007fda90c4c770 in ?? ()
#10 0x00007fda498baed0 in ?? ()
#11 0x00007fda498bafa0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 114 (LWP 11693):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 113 (LWP 11692):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 112 (LWP 11691):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 111 (LWP 11690):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 110 (LWP 11689):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 109 (LWP 11688):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 108 (LWP 11687):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 107 (LWP 11686):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 106 (LWP 11685):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 105 (LWP 11684):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 104 (LWP 11683):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 103 (LWP 11682):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 102 (LWP 11681):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 101 (LWP 11680):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 100 (LWP 11679):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 99 (LWP 11678):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 98 (LWP 11677):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 97 (LWP 11676):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 96 (LWP 11675):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 95 (LWP 11674):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 94 (LWP 11673):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 93 (LWP 11672):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 92 (LWP 11671):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 91 (LWP 11670):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 90 (LWP 11669):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 89 (LWP 11668):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 88 (LWP 11667):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 87 (LWP 11666):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 86 (LWP 11665):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 85 (LWP 11664):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 84 (LWP 11663):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 83 (LWP 11662):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 82 (LWP 11661):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 81 (LWP 11660):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 80 (LWP 11659):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 79 (LWP 11658):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 78 (LWP 11657):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 77 (LWP 11656):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 76 (LWP 11655):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000007 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d0001b007c in ?? ()
#4 0x00007fda5d463eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fda5d463ed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0001b0030 in ?? ()
#9 0x00007fda90c4c770 in ?? ()
#10 0x00007fda5d463ed0 in ?? ()
#11 0x00007fda5d463fa0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 75 (LWP 11654):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 74 (LWP 11653):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 73 (LWP 11652):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 72 (LWP 11651):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 71 (LWP 11650):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 70 (LWP 11649):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 69 (LWP 11648):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 68 (LWP 11647):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 67 (LWP 11646):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 66 (LWP 11645):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 65 (LWP 11644):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 64 (LWP 11643):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 63 (LWP 11642):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 62 (LWP 11641):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 61 (LWP 11640):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 60 (LWP 11639):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 59 (LWP 11638):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 58 (LWP 11637):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 57 (LWP 11636):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 56 (LWP 11635):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000002 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d00012d038 in ?? ()
#4 0x00007fda67644eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fda67644ed0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 55 (LWP 11634):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 54 (LWP 11633):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 53 (LWP 11632):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 52 (LWP 11631):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 51 (LWP 11630):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 50 (LWP 11629):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 49 (LWP 11628):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 48 (LWP 11627):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 47 (LWP 11626):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 46 (LWP 11625):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 45 (LWP 11624):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 44 (LWP 11623):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 43 (LWP 11622):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 42 (LWP 11621):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 41 (LWP 11620):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 40 (LWP 11619):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 39 (LWP 11618):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 38 (LWP 11617):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 37 (LWP 11616):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 36 (LWP 11615):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000098 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d0000a67e8 in ?? ()
#4 0x00007fda71825eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fda71825ed0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 35 (LWP 11614):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x00000000000000af in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00009ffec in ?? ()
#4 0x00007fda7203deb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fda7203ded0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d00009ffa0 in ?? ()
#9 0x00007fda90c4c770 in ?? ()
#10 0x00007fda7203ded0 in ?? ()
#11 0x00007fda7203dfa0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 34 (LWP 11613):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x00000000000000b3 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00009cffc in ?? ()
#4 0x00007fda72855eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fda72855ed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d00009cfb0 in ?? ()
#9 0x00007fda90c4c770 in ?? ()
#10 0x00007fda72855ed0 in ?? ()
#11 0x00007fda72855fa0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 33 (LWP 11612):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 32 (LWP 11611):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 31 (LWP 11610):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 30 (LWP 11609):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 29 (LWP 11608):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 28 (LWP 11607):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 27 (LWP 11606):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 26 (LWP 11605):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 25 (LWP 11604):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 24 (LWP 11603):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 23 (LWP 11602):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 22 (LWP 11601):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 21 (LWP 11600):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 20 (LWP 11599):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 19 (LWP 11598):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 18 (LWP 11597):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 17 (LWP 11596):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 16 (LWP 11595):
#0 0x00007fda90c4cfb9 in ?? ()
#1 0x00000000ffffffff in ?? ()
#2 0x0000000000000001 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x0000613000018ea0 in ?? ()
#5 0x00007fda7b9dcd30 in ?? ()
#6 0x0000000000000002 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 15 (LWP 11594):
#0 0x00007fda90c4cfb9 in ?? ()
#1 0x4008000000000000 in ?? ()
#2 0x0000000000000003 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061200001a498 in ?? ()
#5 0x00007fda7c1de270 in ?? ()
#6 0x0000000000000006 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 14 (LWP 11592):
#0 0x00007fda90c4cfb9 in ?? ()
#1 0x00007fda7d1df5e0 in ?? ()
#2 0x0000000000000001 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x0000618000004da8 in ?? ()
#5 0x00007fda7d1df250 in ?? ()
#6 0x0000000000000002 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 13 (LWP 11591):
#0 0x00007fda90c4cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 12 (LWP 11590):
#0 0x00007fda89bdc947 in ?? ()
#1 0x0000614000009680 in ?? ()
#2 0x0000619000059680 in ?? ()
#3 0x00007fda7e1e2340 in ?? ()
#4 0x00007fda7e1e2540 in ?? ()
#5 0x00007fda7e1e2390 in ?? ()
#6 0x0000614000009680 in ?? ()
#7 0x00007fda7e1e2400 in ?? ()
#8 0x00007fda8c1e3bda in ?? ()
#9 0x3fb95fab9084c000 in ?? ()
#10 0x0000619000059680 in ?? ()
#11 0x54b249ad2594c37d in ?? ()
#12 0x0000619000059680 in ?? ()
#13 0x421fd5dcbf000000 in ?? ()
#14 0x00007fda7e1e2540 in ?? ()
#15 0x41da8d37bc1d1665 in ?? ()
#16 0x00000000cfc34480 in ?? ()
#17 0x00007fda7e1e23e0 in ?? ()
#18 0x00007fda8c1e7228 in ?? ()
#19 0x000000007e1e23c0 in ?? ()
#20 0x0000619000059680 in ?? ()
#21 0x0000614000009680 in ?? ()
#22 0x00007fda7e1e2400 in ?? ()
#23 0x3fb95fab9084c000 in ?? ()
#24 0x4089a91f14305b09 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 11 (LWP 11589):
#0 0x00007fda89bdc947 in ?? ()
#1 0x0000614000009480 in ?? ()
#2 0x0000619000059180 in ?? ()
#3 0x00007fda7e9e3340 in ?? ()
#4 0x00007fda7e9e3540 in ?? ()
#5 0x00007fda7e9e3390 in ?? ()
#6 0x0000614000009480 in ?? ()
#7 0x00007fda7e9e3400 in ?? ()
#8 0x00007fda8c1e3bda in ?? ()
#9 0x3fa6fdc602cfc000 in ?? ()
#10 0x0000619000059180 in ?? ()
#11 0x54b249ad2594c37d in ?? ()
#12 0x0000619000059180 in ?? ()
#13 0x4205aedc82000000 in ?? ()
#14 0x00007fda7e9e3540 in ?? ()
#15 0x41da8d37bc1d1665 in ?? ()
#16 0x00000000cfd34680 in ?? ()
#17 0x00007fda7e9e33e0 in ?? ()
#18 0x00007fda8c1e7228 in ?? ()
#19 0x000000007e9e33c0 in ?? ()
#20 0x0000619000059180 in ?? ()
#21 0x0000614000009480 in ?? ()
#22 0x00007fda7e9e3400 in ?? ()
#23 0x3fa6fdc602cfc000 in ?? ()
#24 0x4089a98e182c2ceb in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 10 (LWP 11588):
#0 0x00007fda89bdc947 in ?? ()
#1 0x0000614000009280 in ?? ()
#2 0x0000619000058c80 in ?? ()
#3 0x00007fda7f1e4340 in ?? ()
#4 0x00007fda7f1e4540 in ?? ()
#5 0x00007fda7f1e4390 in ?? ()
#6 0x0000614000009280 in ?? ()
#7 0x00007fda7f1e4400 in ?? ()
#8 0x00007fda8c1e3bda in ?? ()
#9 0x3f7f592b61d00000 in ?? ()
#10 0x0000619000058c80 in ?? ()
#11 0x54b249ad2594c37d in ?? ()
#12 0x0000619000058c80 in ?? ()
#13 0x425a2bc17b500000 in ?? ()
#14 0x00007fda7f1e4540 in ?? ()
#15 0x41da8d37bc1d1667 in ?? ()
#16 0x00000000cfe34880 in ?? ()
#17 0x00007fda7f1e43e0 in ?? ()
#18 0x00007fda8c1e7228 in ?? ()
#19 0x000000007f1e43c0 in ?? ()
#20 0x0000619000058c80 in ?? ()
#21 0x0000614000009280 in ?? ()
#22 0x00007fda7f1e4400 in ?? ()
#23 0x3f7f592b61d00000 in ?? ()
#24 0x4089a99133394e91 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 9 (LWP 11587):
#0 0x00007fda89bdc947 in ?? ()
#1 0x0000614000009080 in ?? ()
#2 0x0000619000058780 in ?? ()
#3 0x00007fda807ad340 in ?? ()
#4 0x00007fda807ad540 in ?? ()
#5 0x00007fda807ad390 in ?? ()
#6 0x0000614000009080 in ?? ()
#7 0x00007fda807ad400 in ?? ()
#8 0x00007fda8c1e3bda in ?? ()
#9 0x3fb96ed7ed1de000 in ?? ()
#10 0x0000619000058780 in ?? ()
#11 0x54b249ad2594c37d in ?? ()
#12 0x0000619000058780 in ?? ()
#13 0x421fb84c63000000 in ?? ()
#14 0x00007fda807ad540 in ?? ()
#15 0x41da8d37bc1d1662 in ?? ()
#16 0x00000000d00eda80 in ?? ()
#17 0x00007fda807ad3e0 in ?? ()
#18 0x00007fda8c1e7228 in ?? ()
#19 0x0000000000000000 in ?? ()
Thread 8 (LWP 11584):
#0 0x00007fda89bcfbb9 in ?? ()
#1 0x00000000000000c8 in ?? ()
#2 0x00007fda821b77d8 in ?? ()
#3 0x000060200004e3b0 in ?? ()
#4 0x0000000000000002 in ?? ()
#5 0x00000000000000c8 in ?? ()
#6 0x0000000000823a92 in __sanitizer::theDepot ()
#7 0x00007fda821b7800 in ?? ()
#8 0x00000000000fe000 in ?? ()
#9 0x0000000000000000 in ?? ()
I20260619 06:31:01.872538 12047 raft_consensus.cc:482] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader febe077b7c1645e1b8d47ba28c8f3832)
I20260619 06:31:01.872816 12047 raft_consensus.cc:504] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } }
I20260619 06:31:01.873554 12047 leader_election.cc:288] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c96ab909d8164eda8f3ebd210d06fbd7 (127.7.96.1:38305), febe077b7c1645e1b8d47ba28c8f3832 (127.7.96.3:35437)
I20260619 06:31:01.874141 11383 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8" candidate_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" candidate_term: 13 candidate_status { last_received { term: 12 index: 2115 } } ignore_live_leader: false dest_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" is_pre_election: true
I20260619 06:31:01.951684 12048 raft_consensus.cc:482] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader febe077b7c1645e1b8d47ba28c8f3832)
I20260619 06:31:01.951897 12048 raft_consensus.cc:504] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } }
I20260619 06:31:01.952472 12048 leader_election.cc:288] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers febe077b7c1645e1b8d47ba28c8f3832 (127.7.96.3:35437), b9391b0d0d0143fb8708b0fba4aec26d (127.7.96.4:42679)
Thread 7 (LWP 11583):
#0 0x00007fda90c4cfb9 in ?? ()
#1 0x00007fda819b6140 in ?? ()
#2 0x0000000000000000 in ?? ()
I20260619 06:31:01.953291 11791 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8" candidate_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" candidate_term: 13 candidate_status { last_received { term: 12 index: 2115 } } ignore_live_leader: false dest_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" is_pre_election: true
Thread 6 (LWP 11582):
#0 0x00007fda90c509e2 in ?? ()
#1 0x00007fda811b4430 in ?? ()
#2 0x00007fda811b3f20 in ?? ()
#3 0x00007fda811b3650 in ?? ()
#4 0x00007fda811b51c0 in ?? ()
I20260619 06:31:01.953640 11791 raft_consensus.cc:2454] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c96ab909d8164eda8f3ebd210d06fbd7 in term 12.
#5 0x00007fda811b3ed0 in ?? ()
#6 0x0000000000000030 in ?? ()
#7 0x00007fda811b3f30 in ?? ()
#8 0x000061100006f950 in ?? ()
#9 0x00007fda811b3f20 in ?? ()
#10 0x000000000081de90 in __sanitizer::theDepot ()
#11 0x00007fda96414269 in ?? ()
#12 0x00000000009edb7d in __sanitizer::theDepot ()
I20260619 06:31:01.954205 11317 leader_election.cc:302] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9391b0d0d0143fb8708b0fba4aec26d, c96ab909d8164eda8f3ebd210d06fbd7; no voters:
#13 0x00007fda8d96ceaf in ?? ()
#14 0x00007fda90c466db in ?? ()
#15 0x00007fda811b36b0 in ?? ()
#16 0x00007fda96422e61 in ?? ()
#17 0x00007fda811b3770 in ?? ()
I20260619 06:31:01.954510 12048 raft_consensus.cc:2781] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 12 FOLLOWER]: Leader pre-election won for term 13
#18 0x00007fda964228ea in ?? ()
I20260619 06:31:01.954625 12048 raft_consensus.cc:482] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader febe077b7c1645e1b8d47ba28c8f3832)
#19 0x0000000045e0360e in ?? ()
I20260619 06:31:01.954704 12048 raft_consensus.cc:3037] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 12 FOLLOWER]: Advancing to term 13
#20 0x00007fda963acb62 in ?? ()
#21 0x000061100006f960 in ?? ()
#22 0x0000000000000000 in ?? ()
Thread 5 (LWP 11576):
#0 0x00007fda90c4cfb9 in ?? ()
#1 0x00007fda831b8c90 in ?? ()
#2 0x000000000000004d in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061200001a9a8 in ?? ()
#5 0x00007fda831b8cd0 in ?? ()
#6 0x000000000000009a in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 4 (LWP 11575):
#0 0x00007fda90c4cfb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 3 (LWP 11574):
#0 0x00007fda90c4cfb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 2 (LWP 11573):
#0 0x00007fda90c4cfb9 in ?? ()
#1 0x0000000000008000 in ?? ()
#2 0x0000000000000002 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x00006120000096b8 in ?? ()
#5 0x00007fda849bc450 in ?? ()
#6 0x0000000000000004 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 1 (LWP 11571):
#0 0x00007fda90c50d50 in ?? ()
#1 0x0000000000000000 in ?? ()
I20260619 06:31:01.957352 12048 raft_consensus.cc:504] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } }
I20260619 06:31:01.957975 12048 leader_election.cc:288] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [CANDIDATE]: Term 13 election: Requested vote from peers febe077b7c1645e1b8d47ba28c8f3832 (127.7.96.3:35437), b9391b0d0d0143fb8708b0fba4aec26d (127.7.96.4:42679)
I20260619 06:31:01.958575 11791 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8" candidate_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" candidate_term: 13 candidate_status { last_received { term: 12 index: 2115 } } ignore_live_leader: false dest_uuid: "b9391b0d0d0143fb8708b0fba4aec26d"
I20260619 06:31:01.958796 11791 raft_consensus.cc:3037] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 12 FOLLOWER]: Advancing to term 13
I20260619 06:31:01.959179 11653 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8" candidate_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" candidate_term: 13 candidate_status { last_received { term: 12 index: 2115 } } ignore_live_leader: false dest_uuid: "febe077b7c1645e1b8d47ba28c8f3832" is_pre_election: true
I20260619 06:31:01.959900 11726 leader_election.cc:302] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9391b0d0d0143fb8708b0fba4aec26d; no voters: c96ab909d8164eda8f3ebd210d06fbd7, febe077b7c1645e1b8d47ba28c8f3832
I20260619 06:31:01.961930 11791 raft_consensus.cc:2454] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c96ab909d8164eda8f3ebd210d06fbd7 in term 13.
I20260619 06:31:01.962119 12047 raft_consensus.cc:2726] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260619 06:31:01.962375 11792 raft_consensus.cc:1226] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 13 FOLLOWER]: Rejecting Update request from peer febe077b7c1645e1b8d47ba28c8f3832 for earlier term 12. Current term is 13. Ops: []
I20260619 06:31:01.962488 11383 raft_consensus.cc:1226] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 13 FOLLOWER]: Rejecting Update request from peer febe077b7c1645e1b8d47ba28c8f3832 for earlier term 12. Current term is 13. Ops: []
I20260619 06:31:01.962767 11654 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8" candidate_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" candidate_term: 13 candidate_status { last_received { term: 12 index: 2115 } } ignore_live_leader: false dest_uuid: "febe077b7c1645e1b8d47ba28c8f3832"
I20260619 06:31:01.963160 12006 consensus_queue.cc:1046] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 }, Status: INVALID_TERM, Last received: 12.2115, Next index: 2116, Last known committed idx: 2115, Time since last communication: 0.000s
I20260619 06:31:01.963238 11655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8" candidate_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" candidate_term: 13 candidate_status { last_received { term: 12 index: 2115 } } ignore_live_leader: false dest_uuid: "febe077b7c1645e1b8d47ba28c8f3832" is_pre_election: true
I20260619 06:31:01.963992 11317 leader_election.cc:302] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9391b0d0d0143fb8708b0fba4aec26d, c96ab909d8164eda8f3ebd210d06fbd7; no voters: febe077b7c1645e1b8d47ba28c8f3832
I20260619 06:31:01.964967 12048 raft_consensus.cc:2781] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 13 FOLLOWER]: Leader election won for term 13
I20260619 06:31:01.965341 12048 raft_consensus.cc:686] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [term 13 LEADER]: Becoming Leader. State: Replica: c96ab909d8164eda8f3ebd210d06fbd7, State: Running, Role: LEADER
I20260619 06:31:01.965766 12048 consensus_queue.cc:237] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2115, Committed index: 2115, Last appended: 12.2115, Last appended by leader: 2115, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } }
I20260619 06:31:01.971271 12049 consensus_queue.cc:1046] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 }, Status: INVALID_TERM, Last received: 12.2115, Next index: 2116, Last known committed idx: 2115, Time since last communication: 0.000s
I20260619 06:31:01.972018 12050 raft_consensus.cc:3032] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 12 LEADER]: Stepping down as leader of term 12
I20260619 06:31:01.972141 12050 raft_consensus.cc:729] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: febe077b7c1645e1b8d47ba28c8f3832, State: Running, Role: LEADER
I20260619 06:31:01.972484 12050 consensus_queue.cc:260] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2115, Committed index: 2115, Last appended: 12.2115, Last appended by leader: 2115, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } }
I20260619 06:31:01.973160 12050 raft_consensus.cc:3037] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 12 FOLLOWER]: Advancing to term 13
I20260619 06:31:01.973542 8815 catalog_manager.cc:5495] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 reported cstate change: term changed from 12 to 13, leader changed from febe077b7c1645e1b8d47ba28c8f3832 (127.7.96.3) to c96ab909d8164eda8f3ebd210d06fbd7 (127.7.96.1). New cstate: current_term: 13 leader_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } health_report { overall_health: UNKNOWN } } }
************************* END STACKS ***************************
I20260619 06:31:01.976665 7552 external_mini_cluster-itest-base.cc:86] Attempting to dump stacks of TS 3 with UUID b9391b0d0d0143fb8708b0fba4aec26d and pid 11708
I20260619 06:31:02.049095 11792 raft_consensus.cc:1261] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 13 FOLLOWER]: Refusing update from remote peer c96ab909d8164eda8f3ebd210d06fbd7: Log matching property violated. Preceding OpId in replica: term: 12 index: 2115. Preceding OpId from leader: term: 13 index: 2116. (index mismatch)
I20260619 06:31:02.049760 12048 consensus_queue.cc:1035] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2116, Last known committed idx: 2115, Time since last communication: 0.000s
I20260619 06:31:02.055240 11655 raft_consensus.cc:1261] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 13 FOLLOWER]: Refusing update from remote peer c96ab909d8164eda8f3ebd210d06fbd7: Log matching property violated. Preceding OpId in replica: term: 12 index: 2115. Preceding OpId from leader: term: 13 index: 2116. (index mismatch)
I20260619 06:31:02.056047 12048 consensus_queue.cc:1035] T f83defb033834a9a95a05a9e6182b3b8 P c96ab909d8164eda8f3ebd210d06fbd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2116, Last known committed idx: 2115, Time since last communication: 0.000s
************************ BEGIN STACKS **************************
[New LWP 11710]
[New LWP 11711]
[New LWP 11712]
[New LWP 11713]
[New LWP 11719]
[New LWP 11720]
[New LWP 11721]
[New LWP 11724]
[New LWP 11725]
[New LWP 11726]
[New LWP 11727]
[New LWP 11728]
[New LWP 11729]
[New LWP 11731]
[New LWP 11732]
[New LWP 11733]
[New LWP 11734]
[New LWP 11735]
[New LWP 11736]
[New LWP 11737]
[New LWP 11738]
[New LWP 11739]
[New LWP 11740]
[New LWP 11741]
[New LWP 11742]
[New LWP 11743]
[New LWP 11744]
[New LWP 11745]
[New LWP 11746]
[New LWP 11747]
[New LWP 11748]
[New LWP 11749]
[New LWP 11750]
[New LWP 11751]
[New LWP 11752]
[New LWP 11753]
[New LWP 11754]
[New LWP 11755]
[New LWP 11756]
[New LWP 11757]
[New LWP 11758]
[New LWP 11759]
[New LWP 11760]
[New LWP 11761]
[New LWP 11762]
[New LWP 11763]
[New LWP 11764]
[New LWP 11765]
[New LWP 11766]
[New LWP 11767]
[New LWP 11768]
[New LWP 11769]
[New LWP 11770]
[New LWP 11771]
[New LWP 11772]
[New LWP 11773]
[New LWP 11774]
[New LWP 11775]
[New LWP 11776]
[New LWP 11777]
[New LWP 11778]
[New LWP 11779]
[New LWP 11780]
[New LWP 11781]
[New LWP 11782]
[New LWP 11783]
[New LWP 11784]
[New LWP 11785]
[New LWP 11786]
[New LWP 11787]
[New LWP 11788]
[New LWP 11789]
[New LWP 11790]
[New LWP 11791]
[New LWP 11792]
[New LWP 11793]
[New LWP 11794]
[New LWP 11795]
[New LWP 11796]
[New LWP 11797]
[New LWP 11798]
[New LWP 11799]
[New LWP 11800]
[New LWP 11801]
[New LWP 11802]
[New LWP 11803]
[New LWP 11804]
[New LWP 11805]
[New LWP 11806]
[New LWP 11807]
[New LWP 11808]
[New LWP 11809]
[New LWP 11810]
[New LWP 11811]
[New LWP 11812]
[New LWP 11813]
[New LWP 11814]
[New LWP 11815]
[New LWP 11816]
[New LWP 11817]
[New LWP 11818]
[New LWP 11819]
[New LWP 11820]
[New LWP 11821]
[New LWP 11822]
[New LWP 11823]
[New LWP 11824]
[New LWP 11826]
[New LWP 11827]
[New LWP 11828]
[New LWP 11829]
[New LWP 11830]
[New LWP 11831]
[New LWP 11832]
[New LWP 11833]
[New LWP 11834]
[New LWP 11835]
[New LWP 11836]
[New LWP 11837]
[New LWP 11838]
[New LWP 11839]
[New LWP 12059]
Cannot access memory at address 0x746e657265666671
Cannot access memory at address 0x746e657265666669
Cannot access memory at address 0x746e657265666671
Cannot access memory at address 0x746e657265666671
Cannot access memory at address 0x746e657265666669
0x00007f618efbcd50 in ?? ()
Id Target Id Frame
* 1 LWP 11708 "kudu" 0x00007f618efbcd50 in ?? ()
2 LWP 11710 "kudu" 0x00007f618efb8fb9 in ?? ()
3 LWP 11711 "kudu" 0x00007f618efb8fb9 in ?? ()
4 LWP 11712 "kudu" 0x00007f618efb8fb9 in ?? ()
5 LWP 11713 "kernel-watcher-" 0x00007f618efb8fb9 in ?? ()
6 LWP 11719 "ntp client-1171" 0x00007f618efbc9e2 in ?? ()
7 LWP 11720 "file cache-evic" 0x00007f618efb8fb9 in ?? ()
8 LWP 11721 "sq_acceptor" 0x00007f6187f3bbb9 in ?? ()
9 LWP 11724 "rpc reactor-117" 0x00007f6187f48947 in ?? ()
10 LWP 11725 "rpc reactor-117" 0x00007f6187f48947 in ?? ()
11 LWP 11726 "rpc reactor-117" 0x00007f6187f48947 in ?? ()
12 LWP 11727 "rpc reactor-117" 0x00007f6187f48947 in ?? ()
13 LWP 11728 "MaintenanceMgr " 0x00007f618efb8ad3 in ?? ()
14 LWP 11729 "txn-status-mana" 0x00007f618efb8fb9 in ?? ()
15 LWP 11731 "collect_and_rem" 0x00007f618efb8fb9 in ?? ()
16 LWP 11732 "tc-session-exp-" 0x00007f618efb8fb9 in ?? ()
17 LWP 11733 "rpc worker-1173" 0x00007f618efb8ad3 in ?? ()
18 LWP 11734 "rpc worker-1173" 0x00007f618efb8ad3 in ?? ()
19 LWP 11735 "rpc worker-1173" 0x00007f618efb8ad3 in ?? ()
20 LWP 11736 "rpc worker-1173" 0x00007f618efb8ad3 in ?? ()
21 LWP 11737 "rpc worker-1173" 0x00007f618efb8ad3 in ?? ()
22 LWP 11738 "rpc worker-1173" 0x00007f618efb8ad3 in ?? ()
23 LWP 11739 "rpc worker-1173" 0x00007f618efb8ad3 in ?? ()
24 LWP 11740 "rpc worker-1174" 0x00007f618efb8ad3 in ?? ()
25 LWP 11741 "rpc worker-1174" 0x00007f618efb8ad3 in ?? ()
26 LWP 11742 "rpc worker-1174" 0x00007f618efb8ad3 in ?? ()
27 LWP 11743 "rpc worker-1174" 0x00007f618efb8ad3 in ?? ()
28 LWP 11744 "rpc worker-1174" 0x00007f618efb8ad3 in ?? ()
29 LWP 11745 "rpc worker-1174" 0x00007f618efb8ad3 in ?? ()
30 LWP 11746 "rpc worker-1174" 0x00007f618efb8ad3 in ?? ()
31 LWP 11747 "rpc worker-1174" 0x00007f618efb8ad3 in ?? ()
32 LWP 11748 "rpc worker-1174" 0x00007f618efb8ad3 in ?? ()
33 LWP 11749 "rpc worker-1174" 0x00007f618efb8ad3 in ?? ()
34 LWP 11750 "rpc worker-1175" 0x00007f618efb8ad3 in ?? ()
35 LWP 11751 "rpc worker-1175" 0x00007f618efb8ad3 in ?? ()
36 LWP 11752 "rpc worker-1175" 0x00007f618efb8ad3 in ?? ()
37 LWP 11753 "rpc worker-1175" 0x00007f618efb8ad3 in ?? ()
38 LWP 11754 "rpc worker-1175" 0x00007f618efb8ad3 in ?? ()
39 LWP 11755 "rpc worker-1175" 0x00007f618efb8ad3 in ?? ()
40 LWP 11756 "rpc worker-1175" 0x00007f618efb8ad3 in ?? ()
41 LWP 11757 "rpc worker-1175" 0x00007f618efb8ad3 in ?? ()
42 LWP 11758 "rpc worker-1175" 0x00007f618efb8ad3 in ?? ()
43 LWP 11759 "rpc worker-1175" 0x00007f618efb8ad3 in ?? ()
44 LWP 11760 "rpc worker-1176" 0x00007f618efb8ad3 in ?? ()
45 LWP 11761 "rpc worker-1176" 0x00007f618efb8ad3 in ?? ()
46 LWP 11762 "rpc worker-1176" 0x00007f618efb8ad3 in ?? ()
47 LWP 11763 "rpc worker-1176" 0x00007f618efb8ad3 in ?? ()
48 LWP 11764 "rpc worker-1176" 0x00007f618efb8ad3 in ?? ()
49 LWP 11765 "rpc worker-1176" 0x00007f618efb8ad3 in ?? ()
50 LWP 11766 "rpc worker-1176" 0x00007f618efb8ad3 in ?? ()
51 LWP 11767 "rpc worker-1176" 0x00007f618efb8ad3 in ?? ()
52 LWP 11768 "rpc worker-1176" 0x00007f618efb8ad3 in ?? ()
53 LWP 11769 "rpc worker-1176" 0x00007f618efb8ad3 in ?? ()
54 LWP 11770 "rpc worker-1177" 0x00007f618efb8ad3 in ?? ()
55 LWP 11771 "rpc worker-1177" 0x00007f618efb8ad3 in ?? ()
56 LWP 11772 "rpc worker-1177" 0x00007f618efb8ad3 in ?? ()
57 LWP 11773 "rpc worker-1177" 0x00007f618efb8ad3 in ?? ()
58 LWP 11774 "rpc worker-1177" 0x00007f618efb8ad3 in ?? ()
59 LWP 11775 "rpc worker-1177" 0x00007f618efb8ad3 in ?? ()
60 LWP 11776 "rpc worker-1177" 0x00007f618efb8ad3 in ?? ()
61 LWP 11777 "rpc worker-1177" 0x00007f618efb8ad3 in ?? ()
62 LWP 11778 "rpc worker-1177" 0x00007f618efb8ad3 in ?? ()
63 LWP 11779 "rpc worker-1177" 0x00007f618efb8ad3 in ?? ()
64 LWP 11780 "rpc worker-1178" 0x00007f618efb8ad3 in ?? ()
65 LWP 11781 "rpc worker-1178" 0x00007f618efb8ad3 in ?? ()
66 LWP 11782 "rpc worker-1178" 0x00007f618efb8ad3 in ?? ()
67 LWP 11783 "rpc worker-1178" 0x00007f618efb8ad3 in ?? ()
68 LWP 11784 "rpc worker-1178" 0x00007f618efb8ad3 in ?? ()
69 LWP 11785 "rpc worker-1178" 0x00007f618efb8ad3 in ?? ()
70 LWP 11786 "rpc worker-1178" 0x00007f618efb8ad3 in ?? ()
71 LWP 11787 "rpc worker-1178" 0x00007f618efb8ad3 in ?? ()
72 LWP 11788 "rpc worker-1178" 0x00007f618efb8ad3 in ?? ()
73 LWP 11789 "rpc worker-1178" 0x00007f618efb8ad3 in ?? ()
74 LWP 11790 "rpc worker-1179" 0x00007f618efb8ad3 in ?? ()
75 LWP 11791 "rpc worker-1179" 0x00007f618efb8ad3 in ?? ()
76 LWP 11792 "rpc worker-1179" 0x00007f618efb8ad3 in ?? ()
77 LWP 11793 "rpc worker-1179" 0x00007f618efb8ad3 in ?? ()
78 LWP 11794 "rpc worker-1179" 0x00007f618efb8ad3 in ?? ()
79 LWP 11795 "rpc worker-1179" 0x00007f618efb8ad3 in ?? ()
80 LWP 11796 "rpc worker-1179" 0x00007f618efb8ad3 in ?? ()
81 LWP 11797 "rpc worker-1179" 0x00007f618efb8ad3 in ?? ()
82 LWP 11798 "rpc worker-1179" 0x00007f618efb8ad3 in ?? ()
83 LWP 11799 "rpc worker-1179" 0x00007f618efb8ad3 in ?? ()
84 LWP 11800 "rpc worker-1180" 0x00007f618efb8ad3 in ?? ()
85 LWP 11801 "rpc worker-1180" 0x00007f618efb8ad3 in ?? ()
86 LWP 11802 "rpc worker-1180" 0x00007f618efb8ad3 in ?? ()
87 LWP 11803 "rpc worker-1180" 0x00007f618efb8ad3 in ?? ()
88 LWP 11804 "rpc worker-1180" 0x00007f618efb8ad3 in ?? ()
89 LWP 11805 "rpc worker-1180" 0x00007f618efb8ad3 in ?? ()
90 LWP 11806 "rpc worker-1180" 0x00007f618efb8ad3 in ?? ()
91 LWP 11807 "rpc worker-1180" 0x00007f618efb8ad3 in ?? ()
92 LWP 11808 "rpc worker-1180" 0x00007f618efb8ad3 in ?? ()
93 LWP 11809 "rpc worker-1180" 0x00007f618efb8ad3 in ?? ()
94 LWP 11810 "rpc worker-1181" 0x00007f618efb8ad3 in ?? ()
95 LWP 11811 "rpc worker-1181" 0x00007f618efb8ad3 in ?? ()
96 LWP 11812 "rpc worker-1181" 0x00007f618efb8ad3 in ?? ()
97 LWP 11813 "rpc worker-1181" 0x00007f618efb8ad3 in ?? ()
98 LWP 11814 "rpc worker-1181" 0x00007f618efb8ad3 in ?? ()
99 LWP 11815 "rpc worker-1181" 0x00007f618efb8ad3 in ?? ()
100 LWP 11816 "rpc worker-1181" 0x00007f618efb8ad3 in ?? ()
101 LWP 11817 "rpc worker-1181" 0x00007f618efb8ad3 in ?? ()
102 LWP 11818 "rpc worker-1181" 0x00007f618efb8ad3 in ?? ()
103 LWP 11819 "rpc worker-1181" 0x00007f618efb8ad3 in ?? ()
104 LWP 11820 "rpc worker-1182" 0x00007f618efb8ad3 in ?? ()
105 LWP 11821 "rpc worker-1182" 0x00007f618efb8ad3 in ?? ()
106 LWP 11822 "rpc worker-1182" 0x00007f618efb8ad3 in ?? ()
107 LWP 11823 "rpc worker-1182" 0x00007f618efb8ad3 in ?? ()
108 LWP 11824 "rpc worker-1182" 0x00007f618efb8ad3 in ?? ()
109 LWP 11826 "rpc worker-1182" 0x00007f618efb8ad3 in ?? ()
110 LWP 11827 "rpc worker-1182" 0x00007f618efb8ad3 in ?? ()
111 LWP 11828 "rpc worker-1182" 0x00007f618efb8ad3 in ?? ()
112 LWP 11829 "rpc worker-1182" 0x00007f618efb8ad3 in ?? ()
113 LWP 11830 "rpc worker-1183" 0x00007f618efb8ad3 in ?? ()
114 LWP 11831 "rpc worker-1183" 0x00007f618efb8ad3 in ?? ()
115 LWP 11832 "rpc worker-1183" 0x00007f618efb8ad3 in ?? ()
116 LWP 11833 "rpc worker-1183" 0x00007f618efb8ad3 in ?? ()
117 LWP 11834 "diag-logger-118" 0x00007f618efb8fb9 in ?? ()
118 LWP 11835 "result-tracker-" 0x00007f618efb8fb9 in ?? ()
119 LWP 11836 "excess-log-dele" 0x00007f618efb8fb9 in ?? ()
120 LWP 11837 "acceptor-11837" 0x00007f6187f49fc7 in ?? ()
121 LWP 11838 "heartbeat-11838" 0x00007f618efb8fb9 in ?? ()
122 LWP 11839 "maintenance_sch" 0x00007f618efb8fb9 in ?? ()
123 LWP 12059 "wal-append [wor" 0x00007f618efb8fb9 in ?? ()
Thread 123 (LWP 12059):
#0 0x00007f618efb8fb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 122 (LWP 11839):
#0 0x00007f618efb8fb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 121 (LWP 11838):
#0 0x00007f618efb8fb9 in ?? ()
#1 0xffffffffffffffff in ?? ()
#2 0x0000000000000010 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x0000613000018268 in ?? ()
#5 0x00007f6144a22770 in ?? ()
#6 0x0000000000000020 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 120 (LWP 11837):
#0 0x00007f6187f49fc7 in ?? ()
#1 0x0000614000009090 in ?? ()
#2 0x00007f6145239fa0 in ?? ()
#3 0x00007f6145239fc0 in ?? ()
#4 0x00007f614523a0e0 in ?? ()
#5 0x00007f6145239fd0 in ?? ()
#6 0x00007f614523a040 in ?? ()
#7 0x0000000000000080 in ?? ()
#8 0x000000000082c9d2 in __sanitizer::theDepot ()
#9 0x00000000008c3cc9 in __sanitizer::theDepot ()
#10 0x00000000008f35b0 in __sanitizer::theDepot ()
#11 0x0000000000000032 in ?? ()
#12 0x000060c00006c058 in ?? ()
#13 0x000060c00006c0b1 in ?? ()
#14 0x00000000008875e1 in __sanitizer::theDepot ()
#15 0x0000000000000059 in ?? ()
#16 0x000000000088348c in __sanitizer::theDepot ()
#17 0x0000000000000380 in ?? ()
#18 0x0000000000897749 in __sanitizer::theDepot ()
#19 0x0000000000010000 in ?? ()
#20 0x0000000000895799 in __sanitizer::theDepot ()
#21 0x0000000000e377a0 in ?? ()
#22 0x00000000007f9413 in __sanitizer::theDepot ()
#23 0x00000000009edb7d in __sanitizer::theDepot ()
#24 0x0000000000000700 in ?? ()
#25 0x00007f618efb26db in ?? ()
#26 0x00007f6187efa346 in ?? ()
#27 0x00007f6145239842 in ?? ()
#28 0x000000006a34e218 in ?? ()
#29 0x000000006a34e218 in ?? ()
#30 0x0000640000001140 in ?? ()
#31 0x00007f6144a33e60 in ?? ()
#32 0x0000000000000049 in ?? ()
#33 0x0000017000000000 in ?? ()
#34 0x0000000000000017 in ?? ()
#35 0x0000640000001140 in ?? ()
#36 0x00000000008b1acd in __sanitizer::theDepot ()
#37 0x0000000000e377a0 in ?? ()
#38 0x00007f61439f5e68 in ?? ()
#39 0x0000000000000000 in ?? ()
Thread 119 (LWP 11836):
#0 0x00007f618efb8fb9 in ?? ()
#1 0x00007fff13a3f2b0 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 118 (LWP 11835):
#0 0x00007f618efb8fb9 in ?? ()
#1 0x00007f614626b160 in ?? ()
#2 0x000000000000000e in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061100006e4b0 in ?? ()
#5 0x00007f614626b110 in ?? ()
#6 0x000000000000001c in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 117 (LWP 11834):
#0 0x00007f618efb8fb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 116 (LWP 11833):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000003 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00032cfdc in ?? ()
#4 0x00007f61472abeb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f61472abed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d00032cf90 in ?? ()
#9 0x00007f618efb8770 in ?? ()
#10 0x00007f61472abed0 in ?? ()
#11 0x00007f61472abfa0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 115 (LWP 11832):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000005 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00031ffdc in ?? ()
#4 0x00007f6147ac3eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f6147ac3ed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d00031ff90 in ?? ()
#9 0x00007f618efb8770 in ?? ()
#10 0x00007f6147ac3ed0 in ?? ()
#11 0x00007f6147ac3fa0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 114 (LWP 11831):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 113 (LWP 11830):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 112 (LWP 11829):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 111 (LWP 11828):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 110 (LWP 11827):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 109 (LWP 11826):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 108 (LWP 11824):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 107 (LWP 11823):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 106 (LWP 11822):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 105 (LWP 11821):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 104 (LWP 11820):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 103 (LWP 11819):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 102 (LWP 11818):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 101 (LWP 11817):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 100 (LWP 11816):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 99 (LWP 11815):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 98 (LWP 11814):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 97 (LWP 11813):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 96 (LWP 11812):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 95 (LWP 11811):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 94 (LWP 11810):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 93 (LWP 11809):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 92 (LWP 11808):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 91 (LWP 11807):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 90 (LWP 11806):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 89 (LWP 11805):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 88 (LWP 11804):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 87 (LWP 11803):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 86 (LWP 11802):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 85 (LWP 11801):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 84 (LWP 11800):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 83 (LWP 11799):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 82 (LWP 11798):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 81 (LWP 11797):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 80 (LWP 11796):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 79 (LWP 11795):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 78 (LWP 11794):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 77 (LWP 11793):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 76 (LWP 11792):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000106 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d0001f0038 in ?? ()
#4 0x00007f615bfa6eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f615bfa6ed0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 75 (LWP 11791):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000087 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d0001e684c in ?? ()
#4 0x00007f615c7beeb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f615c7beed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0001e6800 in ?? ()
#9 0x00007f618efb8770 in ?? ()
#10 0x00007f615c7beed0 in ?? ()
#11 0x00007f615c7befa0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 74 (LWP 11790):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 73 (LWP 11789):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 72 (LWP 11788):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 71 (LWP 11787):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 70 (LWP 11786):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 69 (LWP 11785):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 68 (LWP 11784):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 67 (LWP 11783):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 66 (LWP 11782):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 65 (LWP 11781):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 64 (LWP 11780):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 63 (LWP 11779):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 62 (LWP 11778):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 61 (LWP 11777):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 60 (LWP 11776):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 59 (LWP 11775):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 58 (LWP 11774):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 57 (LWP 11773):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 56 (LWP 11772):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000002 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d000150008 in ?? ()
#4 0x00007f616596feb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f616596fed0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 55 (LWP 11771):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 54 (LWP 11770):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 53 (LWP 11769):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 52 (LWP 11768):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 51 (LWP 11767):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 50 (LWP 11766):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 49 (LWP 11765):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 48 (LWP 11764):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 47 (LWP 11763):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 46 (LWP 11762):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 45 (LWP 11761):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 44 (LWP 11760):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 43 (LWP 11759):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 42 (LWP 11758):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 41 (LWP 11757):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 40 (LWP 11756):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 39 (LWP 11755):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 38 (LWP 11754):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 37 (LWP 11753):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 36 (LWP 11752):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000001 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d0000bffcc in ?? ()
#4 0x00007f616fb91eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f616fb91ed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0000bff80 in ?? ()
#9 0x00007f618efb8770 in ?? ()
#10 0x00007f616fb91ed0 in ?? ()
#11 0x00007f616fb91fa0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 35 (LWP 11751):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000002 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d0000b67d8 in ?? ()
#4 0x00007f61703a9eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f61703a9ed0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 34 (LWP 11750):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000047 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d0000affdc in ?? ()
#4 0x00007f6170bc1eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f6170bc1ed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0000aff90 in ?? ()
#9 0x00007f618efb8770 in ?? ()
#10 0x00007f6170bc1ed0 in ?? ()
#11 0x00007f6170bc1fa0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 33 (LWP 11749):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 32 (LWP 11748):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 31 (LWP 11747):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 30 (LWP 11746):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 29 (LWP 11745):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 28 (LWP 11744):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 27 (LWP 11743):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 26 (LWP 11742):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 25 (LWP 11741):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 24 (LWP 11740):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 23 (LWP 11739):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 22 (LWP 11738):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 21 (LWP 11737):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 20 (LWP 11736):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 19 (LWP 11735):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 18 (LWP 11734):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 17 (LWP 11733):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 16 (LWP 11732):
#0 0x00007f618efb8fb9 in ?? ()
#1 0x00000000ffffffff in ?? ()
#2 0x0000000000000001 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x0000613000018ea0 in ?? ()
#5 0x00007f6179c92d30 in ?? ()
#6 0x0000000000000002 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 15 (LWP 11731):
#0 0x00007f618efb8fb9 in ?? ()
#1 0x4008000000000000 in ?? ()
#2 0x0000000000000003 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061200001a498 in ?? ()
#5 0x00007f617a494270 in ?? ()
#6 0x0000000000000006 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 14 (LWP 11729):
#0 0x00007f618efb8fb9 in ?? ()
#1 0x00007f617b4955e0 in ?? ()
#2 0x0000000000000001 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x0000618000004da8 in ?? ()
#5 0x00007f617b495250 in ?? ()
#6 0x0000000000000002 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 13 (LWP 11728):
#0 0x00007f618efb8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 12 (LWP 11727):
#0 0x00007f6187f48947 in ?? ()
#1 0x0000614000009680 in ?? ()
#2 0x0000619000059680 in ?? ()
#3 0x00007f617c498340 in ?? ()
#4 0x00007f617c498540 in ?? ()
#5 0x00007f617c498390 in ?? ()
#6 0x0000614000009680 in ?? ()
#7 0x00007f617c498400 in ?? ()
#8 0x00007f618a54fbda in ?? ()
#9 0x3fb955ccfb9fa000 in ?? ()
#10 0x0000619000059680 in ?? ()
#11 0x54b249ad2594c37d in ?? ()
#12 0x0000619000059680 in ?? ()
#13 0x42105d40bb000000 in ?? ()
#14 0x00007f617c498540 in ?? ()
#15 0x41da8d37bc1d1664 in ?? ()
#16 0x00000000af88b080 in ?? ()
#17 0x00007f617c4983e0 in ?? ()
#18 0x00007f618a553228 in ?? ()
#19 0x000000007c4983c0 in ?? ()
#20 0x0000619000059680 in ?? ()
#21 0x0000614000009680 in ?? ()
#22 0x00007f617c498400 in ?? ()
#23 0x3fb955ccfb9fa000 in ?? ()
#24 0x4089b10c6d8297fe in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 11 (LWP 11726):
#0 0x00007f6187f48947 in ?? ()
#1 0x0000614000009480 in ?? ()
#2 0x0000619000059180 in ?? ()
#3 0x00007f617cc99340 in ?? ()
#4 0x00007f617cc99540 in ?? ()
#5 0x00007f617cc99390 in ?? ()
#6 0x0000614000009480 in ?? ()
#7 0x00007f617cc99400 in ?? ()
#8 0x00007f618a54fbda in ?? ()
#9 0x3fb96715abf04000 in ?? ()
#10 0x0000619000059180 in ?? ()
#11 0x54b249ad2594c37d in ?? ()
#12 0x0000619000059180 in ?? ()
#13 0x4221608876800000 in ?? ()
#14 0x00007f617cc99540 in ?? ()
#15 0x41da8d37bc1d1667 in ?? ()
#16 0x00000000af98b280 in ?? ()
#17 0x00007f617cc993e0 in ?? ()
#18 0x00007f618a553228 in ?? ()
#19 0x000000007cc993c0 in ?? ()
#20 0x0000619000059180 in ?? ()
#21 0x0000614000009480 in ?? ()
#22 0x00007f617cc99400 in ?? ()
#23 0x3fb96715abf04000 in ?? ()
#24 0x4089b10bd147b95b in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 10 (LWP 11725):
#0 0x00007f6187f48947 in ?? ()
#1 0x0000614000009280 in ?? ()
#2 0x0000619000058c80 in ?? ()
#3 0x00007f617d49a340 in ?? ()
#4 0x00007f617d49a540 in ?? ()
#5 0x00007f617d49a390 in ?? ()
#6 0x0000614000009280 in ?? ()
#7 0x00007f617d49a400 in ?? ()
#8 0x00007f618a54fbda in ?? ()
#9 0x3fab2a594d898000 in ?? ()
#10 0x0000619000058c80 in ?? ()
#11 0x54b249ad2594c37d in ?? ()
#12 0x0000619000058c80 in ?? ()
#13 0x42050cbc9a000000 in ?? ()
#14 0x00007f617d49a540 in ?? ()
#15 0x41da8d37bc1d1663 in ?? ()
#16 0x00000000afa8b480 in ?? ()
#17 0x00007f617d49a3e0 in ?? ()
#18 0x00007f618a553228 in ?? ()
#19 0x000000007d49a3c0 in ?? ()
#20 0x0000619000058c80 in ?? ()
#21 0x0000614000009280 in ?? ()
#22 0x00007f617d49a400 in ?? ()
#23 0x3fab2a594d898000 in ?? ()
#24 0x4089b16a4b02543b in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 9 (LWP 11724):
#0 0x00007f6187f48947 in ?? ()
#1 0x0000614000009080 in ?? ()
#2 0x0000619000058780 in ?? ()
#3 0x00007f617e4b3340 in ?? ()
#4 0x00007f617e4b3540 in ?? ()
#5 0x00007f617e4b3390 in ?? ()
#6 0x0000614000009080 in ?? ()
#7 0x00007f617e4b3400 in ?? ()
#8 0x00007f618a54fbda in ?? ()
#9 0x3fb9560e02eaa000 in ?? ()
#10 0x0000619000058780 in ?? ()
#11 0x54b249ad2594c37d in ?? ()
#12 0x0000619000058780 in ?? ()
#13 0x421c3be5cc000000 in ?? ()
#14 0x00007f617e4b3540 in ?? ()
#15 0x41da8d37bc1d1665 in ?? ()
#16 0x00000000afc8e680 in ?? ()
#17 0x00007f617e4b33e0 in ?? ()
#18 0x00007f618a553228 in ?? ()
#19 0x0000000000000000 in ?? ()
Thread 8 (LWP 11721):
#0 0x00007f6187f3bbb9 in ?? ()
#1 0x00000000000000c8 in ?? ()
#2 0x00007f61804b77d8 in ?? ()
#3 0x000060200004a810 in ?? ()
#4 0x0000000000000002 in ?? ()
#5 0x00000000000000c8 in ?? ()
#6 0x0000000000823a92 in __sanitizer::theDepot ()
#7 0x00007f61804b7800 in ?? ()
#8 0x00000000000fe000 in ?? ()
#9 0x0000000000000000 in ?? ()
Thread 7 (LWP 11720):
#0 0x00007f618efb8fb9 in ?? ()
#1 0x00007f617fcb6140 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 6 (LWP 11719):
#0 0x00007f618efbc9e2 in ?? ()
#1 0x00007f617ecb3430 in ?? ()
#2 0x00007f617ecb2f20 in ?? ()
#3 0x00007f617ecb2650 in ?? ()
#4 0x00007f617ecb41c0 in ?? ()
#5 0x00007f617ecb2ed0 in ?? ()
#6 0x0000000000000030 in ?? ()
#7 0x00007f617ecb2f30 in ?? ()
#8 0x000061100006f950 in ?? ()
#9 0x00007f617ecb2f20 in ?? ()
#10 0x000000000081de90 in __sanitizer::theDepot ()
#11 0x00007f6194780269 in ?? ()
#12 0x00000000009edb7d in __sanitizer::theDepot ()
#13 0x00007f618bcd8eaf in ?? ()
#14 0x00007f618efb26db in ?? ()
#15 0x00007f617ecb26b0 in ?? ()
#16 0x00007f619478ee61 in ?? ()
#17 0x00007f617ecb2770 in ?? ()
#18 0x00007f619478e8ea in ?? ()
#19 0x0000000045e0360e in ?? ()
#20 0x00007f6194718b62 in ?? ()
#21 0x000061100006f960 in ?? ()
#22 0x0000000000000000 in ?? ()
Thread 5 (LWP 11713):
#0 0x00007f618efb8fb9 in ?? ()
#1 0x00007f61814b8c90 in ?? ()
#2 0x000000000000004d in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061200001a9a8 in ?? ()
#5 0x00007f61814b8cd0 in ?? ()
#6 0x000000000000009a in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 4 (LWP 11712):
#0 0x00007f618efb8fb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 3 (LWP 11711):
#0 0x00007f618efb8fb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 2 (LWP 11710):
#0 0x00007f618efb8fb9 in ?? ()
#1 0x0000000000008000 in ?? ()
#2 0x0000000000000002 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x00006120000096b8 in ?? ()
#5 0x00007f6182cbc450 in ?? ()
#6 0x0000000000000004 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 1 (LWP 11708):
#0 0x00007f618efbcd50 in ?? ()
#1 0x0000000000000000 in ?? ()
I20260619 06:31:02.951771 12071 raft_consensus.cc:482] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c96ab909d8164eda8f3ebd210d06fbd7)
I20260619 06:31:02.951982 12071 raft_consensus.cc:504] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } }
I20260619 06:31:02.952813 12071 leader_election.cc:288] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c96ab909d8164eda8f3ebd210d06fbd7 (127.7.96.1:38305), febe077b7c1645e1b8d47ba28c8f3832 (127.7.96.3:35437)
I20260619 06:31:02.953229 11383 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8" candidate_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" candidate_term: 14 candidate_status { last_received { term: 13 index: 2116 } } ignore_live_leader: false dest_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" is_pre_election: true
I20260619 06:31:02.953811 11655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8" candidate_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" candidate_term: 14 candidate_status { last_received { term: 13 index: 2116 } } ignore_live_leader: false dest_uuid: "febe077b7c1645e1b8d47ba28c8f3832" is_pre_election: true
I20260619 06:31:02.954380 11726 leader_election.cc:302] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9391b0d0d0143fb8708b0fba4aec26d; no voters: c96ab909d8164eda8f3ebd210d06fbd7, febe077b7c1645e1b8d47ba28c8f3832
I20260619 06:31:02.954639 12071 raft_consensus.cc:2726] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
************************* END STACKS ***************************
I20260619 06:31:02.963667 7552 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu pid 11299
I20260619 06:31:02.973949 11423 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:31:03.233641 7552 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu with pid 11299
W20260619 06:31:03.279618 8801 connection.cc:535] server connection from 127.7.96.1:55369 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260619 06:31:03.279633 11725 connection.cc:535] server connection from 127.7.96.1:51041 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260619 06:31:03.279963 11590 connection.cc:535] server connection from 127.7.96.1:41795 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260619 06:31:03.280066 7552 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu pid 11436
I20260619 06:31:03.288159 11558 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:31:03.379793 7552 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu with pid 11436
I20260619 06:31:03.399096 7552 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu pid 11571
I20260619 06:31:03.405459 11694 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:31:03.535956 12080 raft_consensus.cc:482] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c96ab909d8164eda8f3ebd210d06fbd7)
I20260619 06:31:03.536132 12080 raft_consensus.cc:504] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } }
I20260619 06:31:03.536835 12080 leader_election.cc:288] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c96ab909d8164eda8f3ebd210d06fbd7 (127.7.96.1:38305), febe077b7c1645e1b8d47ba28c8f3832 (127.7.96.3:35437)
W20260619 06:31:03.537859 11725 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.96.1:38305: connect: Connection refused (error 111)
W20260619 06:31:03.539367 11725 leader_election.cc:334] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c96ab909d8164eda8f3ebd210d06fbd7 (127.7.96.1:38305): Network error: Client connection negotiation failed: client connection to 127.7.96.1:38305: connect: Connection refused (error 111)
I20260619 06:31:03.643020 12083 raft_consensus.cc:482] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c96ab909d8164eda8f3ebd210d06fbd7)
I20260619 06:31:03.643375 7552 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu with pid 11571
I20260619 06:31:03.643366 11655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f83defb033834a9a95a05a9e6182b3b8" candidate_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" candidate_term: 14 candidate_status { last_received { term: 13 index: 2116 } } ignore_live_leader: false dest_uuid: "febe077b7c1645e1b8d47ba28c8f3832" is_pre_election: true
I20260619 06:31:03.643275 12083 raft_consensus.cc:504] T f83defb033834a9a95a05a9e6182b3b8 P febe077b7c1645e1b8d47ba28c8f3832 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c96ab909d8164eda8f3ebd210d06fbd7" member_type: VOTER last_known_addr { host: "127.7.96.1" port: 38305 } } peers { permanent_uuid: "febe077b7c1645e1b8d47ba28c8f3832" member_type: VOTER last_known_addr { host: "127.7.96.3" port: 35437 } } peers { permanent_uuid: "b9391b0d0d0143fb8708b0fba4aec26d" member_type: VOTER last_known_addr { host: "127.7.96.4" port: 42679 } }
I20260619 06:31:03.680167 7552 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu pid 11708
W20260619 06:31:03.681360 11726 leader_election.cc:334] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer febe077b7c1645e1b8d47ba28c8f3832 (127.7.96.3:35437): Network error: Client connection negotiation failed: client connection to 127.7.96.3:35437: connect: Connection refused (error 111)
I20260619 06:31:03.681537 11726 leader_election.cc:302] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9391b0d0d0143fb8708b0fba4aec26d; no voters: c96ab909d8164eda8f3ebd210d06fbd7, febe077b7c1645e1b8d47ba28c8f3832
I20260619 06:31:03.681908 12080 raft_consensus.cc:2726] T f83defb033834a9a95a05a9e6182b3b8 P b9391b0d0d0143fb8708b0fba4aec26d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260619 06:31:03.687134 11832 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:31:03.918789 7552 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu with pid 11708
I20260619 06:31:03.959713 7552 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu pid 8786
I20260619 06:31:03.960932 8847 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:31:04.092324 7552 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFG9pG8/build/asan/bin/kudu with pid 8786
2026-06-19T06:31:04Z chronyd exiting
I20260619 06:31:04.135228 7552 test_util.cc:175] -----------------------------------------------
I20260619 06:31:04.135341 7552 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskFG9pG8/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1781850565061855-7552-0
[ FAILED ] RollingRestartArgs/RollingRestartITest.TestWorkloads/4, where GetParam() = 464-byte object <01-00 00-00 01-7F 00-00 04-00 00-00 BE-BE BE-BE 98-ED 37-76 79-7F 00-00 98-ED 37-76 79-7F 00-00 00-00 00-00 BE-BE BE-BE 98-ED 37-76 79-7F 00-00 01-00 00-00 BE-BE BE-BE 90-99 02-00 20-60 00-00 ... 00-00 80-3F FD-7F 00-00 00-00 00-00 00-00 00-00 00-00 00-00 00-00 00-00 98-ED 37-76 79-7F 00-00 98-ED 37-76 79-7F 00-00 00-01 BE-BE BE-BE BE-BE 04-00 00-00 03-00 00-00 01-BE BE-BE BE-BE BE-BE> (59139 ms)
[----------] 1 test from RollingRestartArgs/RollingRestartITest (59139 ms total)
[----------] Global test environment tear-down
[==========] 2 tests from 2 test suites ran. (99000 ms total)
[ PASSED ] 1 test.
[ FAILED ] 1 test, listed below:
[ FAILED ] RollingRestartArgs/RollingRestartITest.TestWorkloads/4, where GetParam() = 464-byte object <01-00 00-00 01-7F 00-00 04-00 00-00 BE-BE BE-BE 98-ED 37-76 79-7F 00-00 98-ED 37-76 79-7F 00-00 00-00 00-00 BE-BE BE-BE 98-ED 37-76 79-7F 00-00 01-00 00-00 BE-BE BE-BE 90-99 02-00 20-60 00-00 ... 00-00 80-3F FD-7F 00-00 00-00 00-00 00-00 00-00 00-00 00-00 00-00 00-00 98-ED 37-76 79-7F 00-00 98-ED 37-76 79-7F 00-00 00-01 BE-BE BE-BE BE-BE 04-00 00-00 03-00 00-00 01-BE BE-BE BE-BE BE-BE>
1 FAILED TEST
I20260619 06:31:04.138213 7552 logging.cc:424] LogThrottler /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/meta_cache.cc:302: suppressed but not reported on 3 messages since previous log ~16 seconds ago