Note: This is test shard 1 of 8.
[==========] Running 2 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 1 test from MaintenanceModeRF3ITest
[ RUN ] MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate
2026-02-01T02:55:34Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-02-01T02:55:34Z Disabled control of system clock
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260201 02:55:34.238514 13992 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskfoNO09/build/asan/bin/kudu
/tmp/dist-test-taskfoNO09/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.170.62:35377
--webserver_interface=127.13.170.62
--webserver_port=0
--builtin_ntp_servers=127.13.170.20:41761
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.170.62:35377 with env {}
W20260201 02:55:34.585341 14000 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260201 02:55:34.585791 14000 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260201 02:55:34.585944 14000 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260201 02:55:34.594729 14000 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260201 02:55:34.594898 14000 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260201 02:55:34.595008 14000 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260201 02:55:34.595091 14000 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260201 02:55:34.605439 14000 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.170.20:41761
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.170.62:35377
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.170.62:35377
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.170.62
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 3722ed49c19ce54c7feae2fa944e32b1d4ed8d2d
build type FASTDEBUG
built by None at 01 Feb 2026 02:43:22 UTC on 24a791456cd2
build id 10288
ASAN enabled
I20260201 02:55:34.607295 14000 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260201 02:55:34.609232 14000 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 02:55:34.618049 14005 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 02:55:34.618274 14006 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 02:55:34.619043 14008 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 02:55:34.619438 14000 server_base.cc:1060] running on GCE node
I20260201 02:55:34.620359 14000 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260201 02:55:34.621954 14000 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260201 02:55:34.623206 14000 hybrid_clock.cc:648] HybridClock initialized: now 1769914534623174 us; error 59 us; skew 500 ppm
I20260201 02:55:34.623586 14000 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 02:55:34.625960 14000 webserver.cc:492] Webserver started at http://127.13.170.62:40031/ using document root <none> and password file <none>
I20260201 02:55:34.626871 14000 fs_manager.cc:362] Metadata directory not provided
I20260201 02:55:34.627009 14000 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 02:55:34.627385 14000 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 02:55:34.629938 14000 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/master-0/data/instance:
uuid: "b8988d4ef6e54f07ab050b84d4fef220"
format_stamp: "Formatted at 2026-02-01 02:55:34 on dist-test-slave-4krj"
I20260201 02:55:34.630896 14000 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/master-0/wal/instance:
uuid: "b8988d4ef6e54f07ab050b84d4fef220"
format_stamp: "Formatted at 2026-02-01 02:55:34 on dist-test-slave-4krj"
I20260201 02:55:34.636695 14000 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260201 02:55:34.640482 14014 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 02:55:34.641927 14000 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260201 02:55:34.642143 14000 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/master-0/data,/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/master-0/wal
uuid: "b8988d4ef6e54f07ab050b84d4fef220"
format_stamp: "Formatted at 2026-02-01 02:55:34 on dist-test-slave-4krj"
I20260201 02:55:34.642395 14000 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 02:55:34.673264 14000 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 02:55:34.674281 14000 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260201 02:55:34.674602 14000 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 02:55:34.696152 14000 rpc_server.cc:307] RPC server started. Bound to: 127.13.170.62:35377
I20260201 02:55:34.696203 14065 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.170.62:35377 every 8 connection(s)
I20260201 02:55:34.697831 14000 server_base.cc:1192] Dumped server information to /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/master-0/data/info.pb
I20260201 02:55:34.698923 13992 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskfoNO09/build/asan/bin/kudu as pid 14000
I20260201 02:55:34.699268 13992 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/master-0/wal/instance
I20260201 02:55:34.702598 14066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 02:55:34.714150 14066 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b8988d4ef6e54f07ab050b84d4fef220: Bootstrap starting.
I20260201 02:55:34.717681 14066 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b8988d4ef6e54f07ab050b84d4fef220: Neither blocks nor log segments found. Creating new log.
I20260201 02:55:34.719103 14066 log.cc:826] T 00000000000000000000000000000000 P b8988d4ef6e54f07ab050b84d4fef220: Log is configured to *not* fsync() on all Append() calls
I20260201 02:55:34.722251 14066 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b8988d4ef6e54f07ab050b84d4fef220: No bootstrap required, opened a new log
I20260201 02:55:34.728739 14066 raft_consensus.cc:359] T 00000000000000000000000000000000 P b8988d4ef6e54f07ab050b84d4fef220 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8988d4ef6e54f07ab050b84d4fef220" member_type: VOTER last_known_addr { host: "127.13.170.62" port: 35377 } }
I20260201 02:55:34.729195 14066 raft_consensus.cc:385] T 00000000000000000000000000000000 P b8988d4ef6e54f07ab050b84d4fef220 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 02:55:34.729377 14066 raft_consensus.cc:740] T 00000000000000000000000000000000 P b8988d4ef6e54f07ab050b84d4fef220 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8988d4ef6e54f07ab050b84d4fef220, State: Initialized, Role: FOLLOWER
I20260201 02:55:34.729997 14066 consensus_queue.cc:260] T 00000000000000000000000000000000 P b8988d4ef6e54f07ab050b84d4fef220 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8988d4ef6e54f07ab050b84d4fef220" member_type: VOTER last_known_addr { host: "127.13.170.62" port: 35377 } }
I20260201 02:55:34.730238 14066 raft_consensus.cc:399] T 00000000000000000000000000000000 P b8988d4ef6e54f07ab050b84d4fef220 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260201 02:55:34.730384 14066 raft_consensus.cc:493] T 00000000000000000000000000000000 P b8988d4ef6e54f07ab050b84d4fef220 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260201 02:55:34.730557 14066 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b8988d4ef6e54f07ab050b84d4fef220 [term 0 FOLLOWER]: Advancing to term 1
I20260201 02:55:34.732715 14066 raft_consensus.cc:515] T 00000000000000000000000000000000 P b8988d4ef6e54f07ab050b84d4fef220 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8988d4ef6e54f07ab050b84d4fef220" member_type: VOTER last_known_addr { host: "127.13.170.62" port: 35377 } }
I20260201 02:55:34.733309 14066 leader_election.cc:304] T 00000000000000000000000000000000 P b8988d4ef6e54f07ab050b84d4fef220 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b8988d4ef6e54f07ab050b84d4fef220; no voters:
I20260201 02:55:34.734031 14066 leader_election.cc:290] T 00000000000000000000000000000000 P b8988d4ef6e54f07ab050b84d4fef220 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260201 02:55:34.734176 14071 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b8988d4ef6e54f07ab050b84d4fef220 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 02:55:34.735400 14071 raft_consensus.cc:697] T 00000000000000000000000000000000 P b8988d4ef6e54f07ab050b84d4fef220 [term 1 LEADER]: Becoming Leader. State: Replica: b8988d4ef6e54f07ab050b84d4fef220, State: Running, Role: LEADER
I20260201 02:55:34.735963 14071 consensus_queue.cc:237] T 00000000000000000000000000000000 P b8988d4ef6e54f07ab050b84d4fef220 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8988d4ef6e54f07ab050b84d4fef220" member_type: VOTER last_known_addr { host: "127.13.170.62" port: 35377 } }
I20260201 02:55:34.736704 14066 sys_catalog.cc:565] T 00000000000000000000000000000000 P b8988d4ef6e54f07ab050b84d4fef220 [sys.catalog]: configured and running, proceeding with master startup.
I20260201 02:55:34.739727 14072 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8988d4ef6e54f07ab050b84d4fef220 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b8988d4ef6e54f07ab050b84d4fef220. Latest consensus state: current_term: 1 leader_uuid: "b8988d4ef6e54f07ab050b84d4fef220" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8988d4ef6e54f07ab050b84d4fef220" member_type: VOTER last_known_addr { host: "127.13.170.62" port: 35377 } } }
I20260201 02:55:34.740702 14072 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8988d4ef6e54f07ab050b84d4fef220 [sys.catalog]: This master's current role is: LEADER
I20260201 02:55:34.739571 14073 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8988d4ef6e54f07ab050b84d4fef220 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b8988d4ef6e54f07ab050b84d4fef220" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8988d4ef6e54f07ab050b84d4fef220" member_type: VOTER last_known_addr { host: "127.13.170.62" port: 35377 } } }
I20260201 02:55:34.741163 14073 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8988d4ef6e54f07ab050b84d4fef220 [sys.catalog]: This master's current role is: LEADER
I20260201 02:55:34.743021 14077 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260201 02:55:34.750065 14077 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260201 02:55:34.750878 14088 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260201 02:55:34.760361 14077 catalog_manager.cc:1357] Generated new cluster ID: 4ca7e79164324cbd98e5b19a855b0cd8
I20260201 02:55:34.760514 14077 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260201 02:55:34.775967 14077 catalog_manager.cc:1380] Generated new certificate authority record
I20260201 02:55:34.777809 14077 catalog_manager.cc:1514] Loading token signing keys...
I20260201 02:55:34.811477 14077 catalog_manager.cc:6027] T 00000000000000000000000000000000 P b8988d4ef6e54f07ab050b84d4fef220: Generated new TSK 0
I20260201 02:55:34.812698 14077 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260201 02:55:34.823359 13992 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskfoNO09/build/asan/bin/kudu
/tmp/dist-test-taskfoNO09/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.170.1:0
--local_ip_for_outbound_sockets=127.13.170.1
--webserver_interface=127.13.170.1
--webserver_port=0
--tserver_master_addrs=127.13.170.62:35377
--builtin_ntp_servers=127.13.170.20:41761
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--follower_unavailable_considered_failed_sec=2
--enable_log_gc=false with env {}
W20260201 02:55:35.188112 14090 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260201 02:55:35.188482 14090 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260201 02:55:35.188606 14090 flags.cc:425] Enabled unsafe flag: --enable_log_gc=false
W20260201 02:55:35.188717 14090 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260201 02:55:35.197525 14090 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260201 02:55:35.197804 14090 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.170.1
I20260201 02:55:35.208221 14090 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.170.20:41761
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=2
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.170.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.170.1
--webserver_port=0
--enable_log_gc=false
--tserver_master_addrs=127.13.170.62:35377
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.170.1
--log_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3722ed49c19ce54c7feae2fa944e32b1d4ed8d2d
build type FASTDEBUG
built by None at 01 Feb 2026 02:43:22 UTC on 24a791456cd2
build id 10288
ASAN enabled
I20260201 02:55:35.209980 14090 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260201 02:55:35.212073 14090 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 02:55:35.221978 14095 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 02:55:35.221956 14096 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 02:55:35.222951 14098 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 02:55:35.223410 14090 server_base.cc:1060] running on GCE node
I20260201 02:55:35.223989 14090 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260201 02:55:35.225095 14090 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260201 02:55:35.226395 14090 hybrid_clock.cc:648] HybridClock initialized: now 1769914535226312 us; error 56 us; skew 500 ppm
I20260201 02:55:35.226847 14090 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 02:55:35.229215 14090 webserver.cc:492] Webserver started at http://127.13.170.1:34153/ using document root <none> and password file <none>
I20260201 02:55:35.230002 14090 fs_manager.cc:362] Metadata directory not provided
I20260201 02:55:35.230127 14090 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 02:55:35.230448 14090 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 02:55:35.233188 14090 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-0/data/instance:
uuid: "20beda53b20146fb90018bf4533dcd58"
format_stamp: "Formatted at 2026-02-01 02:55:35 on dist-test-slave-4krj"
I20260201 02:55:35.233973 14090 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-0/wal/instance:
uuid: "20beda53b20146fb90018bf4533dcd58"
format_stamp: "Formatted at 2026-02-01 02:55:35 on dist-test-slave-4krj"
I20260201 02:55:35.240132 14090 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260201 02:55:35.244292 14104 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 02:55:35.246068 14090 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260201 02:55:35.246300 14090 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-0/data,/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-0/wal
uuid: "20beda53b20146fb90018bf4533dcd58"
format_stamp: "Formatted at 2026-02-01 02:55:35 on dist-test-slave-4krj"
I20260201 02:55:35.246521 14090 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 02:55:35.288285 14090 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 02:55:35.289259 14090 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260201 02:55:35.289589 14090 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 02:55:35.290623 14090 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260201 02:55:35.292577 14090 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260201 02:55:35.292709 14090 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260201 02:55:35.292876 14090 ts_tablet_manager.cc:616] Registered 0 tablets
I20260201 02:55:35.292954 14090 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260201 02:55:35.330312 14090 rpc_server.cc:307] RPC server started. Bound to: 127.13.170.1:36225
I20260201 02:55:35.330353 14216 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.170.1:36225 every 8 connection(s)
I20260201 02:55:35.331962 14090 server_base.cc:1192] Dumped server information to /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-0/data/info.pb
I20260201 02:55:35.334491 13992 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskfoNO09/build/asan/bin/kudu as pid 14090
I20260201 02:55:35.334759 13992 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-0/wal/instance
I20260201 02:55:35.339056 13992 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskfoNO09/build/asan/bin/kudu
/tmp/dist-test-taskfoNO09/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.170.2:0
--local_ip_for_outbound_sockets=127.13.170.2
--webserver_interface=127.13.170.2
--webserver_port=0
--tserver_master_addrs=127.13.170.62:35377
--builtin_ntp_servers=127.13.170.20:41761
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--follower_unavailable_considered_failed_sec=2
--enable_log_gc=false with env {}
I20260201 02:55:35.351527 14217 heartbeater.cc:344] Connected to a master server at 127.13.170.62:35377
I20260201 02:55:35.351995 14217 heartbeater.cc:461] Registering TS with master...
I20260201 02:55:35.353068 14217 heartbeater.cc:507] Master 127.13.170.62:35377 requested a full tablet report, sending...
I20260201 02:55:35.355564 14031 ts_manager.cc:194] Registered new tserver with Master: 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225)
I20260201 02:55:35.357236 14031 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.13.170.1:51469
W20260201 02:55:35.699998 14221 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260201 02:55:35.700417 14221 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260201 02:55:35.700510 14221 flags.cc:425] Enabled unsafe flag: --enable_log_gc=false
W20260201 02:55:35.700604 14221 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260201 02:55:35.714280 14221 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260201 02:55:35.714593 14221 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.170.2
I20260201 02:55:35.727150 14221 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.170.20:41761
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=2
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.170.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.170.2
--webserver_port=0
--enable_log_gc=false
--tserver_master_addrs=127.13.170.62:35377
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.170.2
--log_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3722ed49c19ce54c7feae2fa944e32b1d4ed8d2d
build type FASTDEBUG
built by None at 01 Feb 2026 02:43:22 UTC on 24a791456cd2
build id 10288
ASAN enabled
I20260201 02:55:35.728809 14221 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260201 02:55:35.730619 14221 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 02:55:35.741321 14229 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 02:55:35.741390 14227 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 02:55:35.741390 14226 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 02:55:35.742528 14221 server_base.cc:1060] running on GCE node
I20260201 02:55:35.743208 14221 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260201 02:55:35.744598 14221 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260201 02:55:35.745848 14221 hybrid_clock.cc:648] HybridClock initialized: now 1769914535745758 us; error 73 us; skew 500 ppm
I20260201 02:55:35.746145 14221 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 02:55:35.748646 14221 webserver.cc:492] Webserver started at http://127.13.170.2:43189/ using document root <none> and password file <none>
I20260201 02:55:35.749426 14221 fs_manager.cc:362] Metadata directory not provided
I20260201 02:55:35.749536 14221 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 02:55:35.749923 14221 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 02:55:35.752974 14221 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-1/data/instance:
uuid: "943634a8539f44a8969b8503616b09d6"
format_stamp: "Formatted at 2026-02-01 02:55:35 on dist-test-slave-4krj"
I20260201 02:55:35.753777 14221 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-1/wal/instance:
uuid: "943634a8539f44a8969b8503616b09d6"
format_stamp: "Formatted at 2026-02-01 02:55:35 on dist-test-slave-4krj"
I20260201 02:55:35.760274 14221 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.003s sys 0.005s
I20260201 02:55:35.764592 14235 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 02:55:35.766323 14221 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260201 02:55:35.766577 14221 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-1/data,/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-1/wal
uuid: "943634a8539f44a8969b8503616b09d6"
format_stamp: "Formatted at 2026-02-01 02:55:35 on dist-test-slave-4krj"
I20260201 02:55:35.766870 14221 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 02:55:35.782943 14221 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 02:55:35.783891 14221 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260201 02:55:35.784214 14221 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 02:55:35.785220 14221 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260201 02:55:35.787101 14221 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260201 02:55:35.787182 14221 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260201 02:55:35.787338 14221 ts_tablet_manager.cc:616] Registered 0 tablets
I20260201 02:55:35.787405 14221 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260201 02:55:35.823563 14221 rpc_server.cc:307] RPC server started. Bound to: 127.13.170.2:41045
I20260201 02:55:35.823601 14347 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.170.2:41045 every 8 connection(s)
I20260201 02:55:35.825057 14221 server_base.cc:1192] Dumped server information to /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-1/data/info.pb
I20260201 02:55:35.830852 13992 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskfoNO09/build/asan/bin/kudu as pid 14221
I20260201 02:55:35.831058 13992 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-1/wal/instance
I20260201 02:55:35.834513 13992 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskfoNO09/build/asan/bin/kudu
/tmp/dist-test-taskfoNO09/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.170.3:0
--local_ip_for_outbound_sockets=127.13.170.3
--webserver_interface=127.13.170.3
--webserver_port=0
--tserver_master_addrs=127.13.170.62:35377
--builtin_ntp_servers=127.13.170.20:41761
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--follower_unavailable_considered_failed_sec=2
--enable_log_gc=false with env {}
I20260201 02:55:35.840178 14348 heartbeater.cc:344] Connected to a master server at 127.13.170.62:35377
I20260201 02:55:35.840631 14348 heartbeater.cc:461] Registering TS with master...
I20260201 02:55:35.841797 14348 heartbeater.cc:507] Master 127.13.170.62:35377 requested a full tablet report, sending...
I20260201 02:55:35.844096 14031 ts_manager.cc:194] Registered new tserver with Master: 943634a8539f44a8969b8503616b09d6 (127.13.170.2:41045)
I20260201 02:55:35.844981 14031 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.13.170.2:60737
W20260201 02:55:36.190192 14351 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260201 02:55:36.190524 14351 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260201 02:55:36.190649 14351 flags.cc:425] Enabled unsafe flag: --enable_log_gc=false
W20260201 02:55:36.190805 14351 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260201 02:55:36.199712 14351 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260201 02:55:36.199999 14351 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.170.3
I20260201 02:55:36.210391 14351 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.170.20:41761
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=2
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.170.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.170.3
--webserver_port=0
--enable_log_gc=false
--tserver_master_addrs=127.13.170.62:35377
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.170.3
--log_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3722ed49c19ce54c7feae2fa944e32b1d4ed8d2d
build type FASTDEBUG
built by None at 01 Feb 2026 02:43:22 UTC on 24a791456cd2
build id 10288
ASAN enabled
I20260201 02:55:36.212177 14351 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260201 02:55:36.214157 14351 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 02:55:36.225211 14357 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 02:55:36.225344 14356 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 02:55:36.225986 14359 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 02:55:36.226197 14351 server_base.cc:1060] running on GCE node
I20260201 02:55:36.226953 14351 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260201 02:55:36.227941 14351 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260201 02:55:36.229224 14351 hybrid_clock.cc:648] HybridClock initialized: now 1769914536229159 us; error 38 us; skew 500 ppm
I20260201 02:55:36.229552 14351 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 02:55:36.231928 14351 webserver.cc:492] Webserver started at http://127.13.170.3:45155/ using document root <none> and password file <none>
I20260201 02:55:36.232757 14351 fs_manager.cc:362] Metadata directory not provided
I20260201 02:55:36.232918 14351 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 02:55:36.233294 14351 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 02:55:36.236934 14351 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-2/data/instance:
uuid: "74bc17a87c2342958617c01904a29dac"
format_stamp: "Formatted at 2026-02-01 02:55:36 on dist-test-slave-4krj"
I20260201 02:55:36.239946 14351 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-2/wal/instance:
uuid: "74bc17a87c2342958617c01904a29dac"
format_stamp: "Formatted at 2026-02-01 02:55:36 on dist-test-slave-4krj"
I20260201 02:55:36.246438 14351 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260201 02:55:36.250715 14365 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 02:55:36.252562 14351 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260201 02:55:36.252805 14351 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-2/data,/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-2/wal
uuid: "74bc17a87c2342958617c01904a29dac"
format_stamp: "Formatted at 2026-02-01 02:55:36 on dist-test-slave-4krj"
I20260201 02:55:36.253036 14351 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 02:55:36.285646 14351 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 02:55:36.286790 14351 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260201 02:55:36.287163 14351 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 02:55:36.288316 14351 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260201 02:55:36.290352 14351 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260201 02:55:36.290437 14351 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260201 02:55:36.290591 14351 ts_tablet_manager.cc:616] Registered 0 tablets
I20260201 02:55:36.290693 14351 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260201 02:55:36.327572 14351 rpc_server.cc:307] RPC server started. Bound to: 127.13.170.3:45403
I20260201 02:55:36.327615 14477 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.170.3:45403 every 8 connection(s)
I20260201 02:55:36.329150 14351 server_base.cc:1192] Dumped server information to /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-2/data/info.pb
I20260201 02:55:36.336570 13992 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskfoNO09/build/asan/bin/kudu as pid 14351
I20260201 02:55:36.336853 13992 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-2/wal/instance
I20260201 02:55:36.344229 14478 heartbeater.cc:344] Connected to a master server at 127.13.170.62:35377
I20260201 02:55:36.344664 14478 heartbeater.cc:461] Registering TS with master...
I20260201 02:55:36.345575 14478 heartbeater.cc:507] Master 127.13.170.62:35377 requested a full tablet report, sending...
I20260201 02:55:36.347272 14031 ts_manager.cc:194] Registered new tserver with Master: 74bc17a87c2342958617c01904a29dac (127.13.170.3:45403)
I20260201 02:55:36.348258 14031 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.13.170.3:37515
I20260201 02:55:36.354697 13992 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
I20260201 02:55:36.360908 14217 heartbeater.cc:499] Master 127.13.170.62:35377 was elected leader, sending a full tablet report...
I20260201 02:55:36.400504 14031 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50036:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\004\001\000UUU\025\004\001\000\252\252\252*\004\001\000\377\377\377?\004\001\000TUUU\004\001\000\251\252\252j"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260201 02:55:36.402624 14031 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260201 02:55:36.438422 14147 tablet_service.cc:1505] Processing CreateTablet for tablet 535b6fc9826f436089318f329dad0f4d (DEFAULT_TABLE table=test-workload [id=d9382ed8fdae41879cc8eb40b1463720]), partition=RANGE (key) PARTITION 1789569705 <= VALUES
I20260201 02:55:36.439989 14148 tablet_service.cc:1505] Processing CreateTablet for tablet 7b2f386887ef4ab0a692195c4f968c12 (DEFAULT_TABLE table=test-workload [id=d9382ed8fdae41879cc8eb40b1463720]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1789569705
I20260201 02:55:36.439427 14413 tablet_service.cc:1505] Processing CreateTablet for tablet af28911fb32b478b88b6779c6f0dc08f (DEFAULT_TABLE table=test-workload [id=d9382ed8fdae41879cc8eb40b1463720]), partition=RANGE (key) PARTITION VALUES < 357913941
I20260201 02:55:36.440697 14147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 535b6fc9826f436089318f329dad0f4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 02:55:36.440851 14151 tablet_service.cc:1505] Processing CreateTablet for tablet 9434d106c0374b5d928cc00f109846ce (DEFAULT_TABLE table=test-workload [id=d9382ed8fdae41879cc8eb40b1463720]), partition=RANGE (key) PARTITION 357913941 <= VALUES < 715827882
I20260201 02:55:36.441213 14413 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af28911fb32b478b88b6779c6f0dc08f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 02:55:36.441310 14151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9434d106c0374b5d928cc00f109846ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 02:55:36.443123 14148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b2f386887ef4ab0a692195c4f968c12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 02:55:36.443487 14152 tablet_service.cc:1505] Processing CreateTablet for tablet af28911fb32b478b88b6779c6f0dc08f (DEFAULT_TABLE table=test-workload [id=d9382ed8fdae41879cc8eb40b1463720]), partition=RANGE (key) PARTITION VALUES < 357913941
I20260201 02:55:36.444046 14152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af28911fb32b478b88b6779c6f0dc08f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 02:55:36.444206 14149 tablet_service.cc:1505] Processing CreateTablet for tablet 7519edb327894747a21ff97e8a90f2f9 (DEFAULT_TABLE table=test-workload [id=d9382ed8fdae41879cc8eb40b1463720]), partition=RANGE (key) PARTITION 1073741823 <= VALUES < 1431655764
I20260201 02:55:36.444690 14149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7519edb327894747a21ff97e8a90f2f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 02:55:36.443127 14150 tablet_service.cc:1505] Processing CreateTablet for tablet 1abdef8b45334d908fa08ec613374a3b (DEFAULT_TABLE table=test-workload [id=d9382ed8fdae41879cc8eb40b1463720]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 1073741823
I20260201 02:55:36.445364 14150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1abdef8b45334d908fa08ec613374a3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 02:55:36.448220 14412 tablet_service.cc:1505] Processing CreateTablet for tablet 9434d106c0374b5d928cc00f109846ce (DEFAULT_TABLE table=test-workload [id=d9382ed8fdae41879cc8eb40b1463720]), partition=RANGE (key) PARTITION 357913941 <= VALUES < 715827882
I20260201 02:55:36.448369 14411 tablet_service.cc:1505] Processing CreateTablet for tablet 1abdef8b45334d908fa08ec613374a3b (DEFAULT_TABLE table=test-workload [id=d9382ed8fdae41879cc8eb40b1463720]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 1073741823
I20260201 02:55:36.448879 14412 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9434d106c0374b5d928cc00f109846ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 02:55:36.449150 14411 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1abdef8b45334d908fa08ec613374a3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 02:55:36.454277 14410 tablet_service.cc:1505] Processing CreateTablet for tablet 7519edb327894747a21ff97e8a90f2f9 (DEFAULT_TABLE table=test-workload [id=d9382ed8fdae41879cc8eb40b1463720]), partition=RANGE (key) PARTITION 1073741823 <= VALUES < 1431655764
I20260201 02:55:36.454560 14409 tablet_service.cc:1505] Processing CreateTablet for tablet 7b2f386887ef4ab0a692195c4f968c12 (DEFAULT_TABLE table=test-workload [id=d9382ed8fdae41879cc8eb40b1463720]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1789569705
I20260201 02:55:36.454927 14410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7519edb327894747a21ff97e8a90f2f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 02:55:36.455214 14409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b2f386887ef4ab0a692195c4f968c12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 02:55:36.464635 14409 tablet_service.cc:1505] Processing CreateTablet for tablet 535b6fc9826f436089318f329dad0f4d (DEFAULT_TABLE table=test-workload [id=d9382ed8fdae41879cc8eb40b1463720]), partition=RANGE (key) PARTITION 1789569705 <= VALUES
I20260201 02:55:36.465178 14409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 535b6fc9826f436089318f329dad0f4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 02:55:36.471549 14283 tablet_service.cc:1505] Processing CreateTablet for tablet af28911fb32b478b88b6779c6f0dc08f (DEFAULT_TABLE table=test-workload [id=d9382ed8fdae41879cc8eb40b1463720]), partition=RANGE (key) PARTITION VALUES < 357913941
I20260201 02:55:36.473172 14502 tablet_bootstrap.cc:492] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58: Bootstrap starting.
I20260201 02:55:36.473963 14283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af28911fb32b478b88b6779c6f0dc08f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 02:55:36.480595 14502 tablet_bootstrap.cc:654] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58: Neither blocks nor log segments found. Creating new log.
I20260201 02:55:36.482167 14502 log.cc:826] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58: Log is configured to *not* fsync() on all Append() calls
I20260201 02:55:36.482375 14280 tablet_service.cc:1505] Processing CreateTablet for tablet 7519edb327894747a21ff97e8a90f2f9 (DEFAULT_TABLE table=test-workload [id=d9382ed8fdae41879cc8eb40b1463720]), partition=RANGE (key) PARTITION 1073741823 <= VALUES < 1431655764
I20260201 02:55:36.478819 14281 tablet_service.cc:1505] Processing CreateTablet for tablet 1abdef8b45334d908fa08ec613374a3b (DEFAULT_TABLE table=test-workload [id=d9382ed8fdae41879cc8eb40b1463720]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 1073741823
I20260201 02:55:36.479570 14282 tablet_service.cc:1505] Processing CreateTablet for tablet 9434d106c0374b5d928cc00f109846ce (DEFAULT_TABLE table=test-workload [id=d9382ed8fdae41879cc8eb40b1463720]), partition=RANGE (key) PARTITION 357913941 <= VALUES < 715827882
I20260201 02:55:36.483989 14501 tablet_bootstrap.cc:492] T 1abdef8b45334d908fa08ec613374a3b P 74bc17a87c2342958617c01904a29dac: Bootstrap starting.
I20260201 02:55:36.484424 14278 tablet_service.cc:1505] Processing CreateTablet for tablet 535b6fc9826f436089318f329dad0f4d (DEFAULT_TABLE table=test-workload [id=d9382ed8fdae41879cc8eb40b1463720]), partition=RANGE (key) PARTITION 1789569705 <= VALUES
I20260201 02:55:36.484674 14279 tablet_service.cc:1505] Processing CreateTablet for tablet 7b2f386887ef4ab0a692195c4f968c12 (DEFAULT_TABLE table=test-workload [id=d9382ed8fdae41879cc8eb40b1463720]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1789569705
I20260201 02:55:36.485126 14280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7519edb327894747a21ff97e8a90f2f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 02:55:36.485540 14281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1abdef8b45334d908fa08ec613374a3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 02:55:36.485953 14279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b2f386887ef4ab0a692195c4f968c12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 02:55:36.486186 14502 tablet_bootstrap.cc:492] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58: No bootstrap required, opened a new log
I20260201 02:55:36.486312 14278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 535b6fc9826f436089318f329dad0f4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 02:55:36.486528 14502 ts_tablet_manager.cc:1403] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.005s
I20260201 02:55:36.486619 14282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9434d106c0374b5d928cc00f109846ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 02:55:36.487608 14501 tablet_bootstrap.cc:654] T 1abdef8b45334d908fa08ec613374a3b P 74bc17a87c2342958617c01904a29dac: Neither blocks nor log segments found. Creating new log.
I20260201 02:55:36.488785 14501 log.cc:826] T 1abdef8b45334d908fa08ec613374a3b P 74bc17a87c2342958617c01904a29dac: Log is configured to *not* fsync() on all Append() calls
I20260201 02:55:36.494297 14502 raft_consensus.cc:359] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:55:36.494869 14502 raft_consensus.cc:385] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 02:55:36.495030 14502 raft_consensus.cc:740] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20beda53b20146fb90018bf4533dcd58, State: Initialized, Role: FOLLOWER
I20260201 02:55:36.495949 14502 consensus_queue.cc:260] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:55:36.496924 14501 tablet_bootstrap.cc:492] T 1abdef8b45334d908fa08ec613374a3b P 74bc17a87c2342958617c01904a29dac: No bootstrap required, opened a new log
I20260201 02:55:36.497291 14501 ts_tablet_manager.cc:1403] T 1abdef8b45334d908fa08ec613374a3b P 74bc17a87c2342958617c01904a29dac: Time spent bootstrapping tablet: real 0.014s user 0.008s sys 0.000s
I20260201 02:55:36.504703 14506 tablet_bootstrap.cc:492] T 7519edb327894747a21ff97e8a90f2f9 P 943634a8539f44a8969b8503616b09d6: Bootstrap starting.
I20260201 02:55:36.505306 14501 raft_consensus.cc:359] T 1abdef8b45334d908fa08ec613374a3b P 74bc17a87c2342958617c01904a29dac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:55:36.507494 14501 raft_consensus.cc:385] T 1abdef8b45334d908fa08ec613374a3b P 74bc17a87c2342958617c01904a29dac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 02:55:36.507663 14501 raft_consensus.cc:740] T 1abdef8b45334d908fa08ec613374a3b P 74bc17a87c2342958617c01904a29dac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74bc17a87c2342958617c01904a29dac, State: Initialized, Role: FOLLOWER
I20260201 02:55:36.508639 14501 consensus_queue.cc:260] T 1abdef8b45334d908fa08ec613374a3b P 74bc17a87c2342958617c01904a29dac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:55:36.509903 14478 heartbeater.cc:499] Master 127.13.170.62:35377 was elected leader, sending a full tablet report...
I20260201 02:55:36.511324 14502 ts_tablet_manager.cc:1434] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58: Time spent starting tablet: real 0.025s user 0.017s sys 0.007s
I20260201 02:55:36.511890 14502 tablet_bootstrap.cc:492] T 535b6fc9826f436089318f329dad0f4d P 20beda53b20146fb90018bf4533dcd58: Bootstrap starting.
I20260201 02:55:36.513082 14501 ts_tablet_manager.cc:1434] T 1abdef8b45334d908fa08ec613374a3b P 74bc17a87c2342958617c01904a29dac: Time spent starting tablet: real 0.016s user 0.012s sys 0.000s
I20260201 02:55:36.513607 14501 tablet_bootstrap.cc:492] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac: Bootstrap starting.
I20260201 02:55:36.514267 14502 tablet_bootstrap.cc:654] T 535b6fc9826f436089318f329dad0f4d P 20beda53b20146fb90018bf4533dcd58: Neither blocks nor log segments found. Creating new log.
I20260201 02:55:36.515602 14501 tablet_bootstrap.cc:654] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac: Neither blocks nor log segments found. Creating new log.
I20260201 02:55:36.520845 14501 tablet_bootstrap.cc:492] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac: No bootstrap required, opened a new log
I20260201 02:55:36.521036 14501 ts_tablet_manager.cc:1403] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.006s
I20260201 02:55:36.522111 14501 raft_consensus.cc:359] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:55:36.522333 14501 raft_consensus.cc:385] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 02:55:36.522425 14501 raft_consensus.cc:740] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74bc17a87c2342958617c01904a29dac, State: Initialized, Role: FOLLOWER
I20260201 02:55:36.522758 14501 consensus_queue.cc:260] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:55:36.522879 14506 tablet_bootstrap.cc:654] T 7519edb327894747a21ff97e8a90f2f9 P 943634a8539f44a8969b8503616b09d6: Neither blocks nor log segments found. Creating new log.
I20260201 02:55:36.523306 14501 ts_tablet_manager.cc:1434] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260201 02:55:36.523613 14501 tablet_bootstrap.cc:492] T af28911fb32b478b88b6779c6f0dc08f P 74bc17a87c2342958617c01904a29dac: Bootstrap starting.
I20260201 02:55:36.525285 14501 tablet_bootstrap.cc:654] T af28911fb32b478b88b6779c6f0dc08f P 74bc17a87c2342958617c01904a29dac: Neither blocks nor log segments found. Creating new log.
I20260201 02:55:36.525373 14502 tablet_bootstrap.cc:492] T 535b6fc9826f436089318f329dad0f4d P 20beda53b20146fb90018bf4533dcd58: No bootstrap required, opened a new log
I20260201 02:55:36.525550 14502 ts_tablet_manager.cc:1403] T 535b6fc9826f436089318f329dad0f4d P 20beda53b20146fb90018bf4533dcd58: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.003s
I20260201 02:55:36.525650 14506 log.cc:826] T 7519edb327894747a21ff97e8a90f2f9 P 943634a8539f44a8969b8503616b09d6: Log is configured to *not* fsync() on all Append() calls
I20260201 02:55:36.526798 14502 raft_consensus.cc:359] T 535b6fc9826f436089318f329dad0f4d P 20beda53b20146fb90018bf4533dcd58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:55:36.527083 14502 raft_consensus.cc:385] T 535b6fc9826f436089318f329dad0f4d P 20beda53b20146fb90018bf4533dcd58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 02:55:36.527226 14502 raft_consensus.cc:740] T 535b6fc9826f436089318f329dad0f4d P 20beda53b20146fb90018bf4533dcd58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20beda53b20146fb90018bf4533dcd58, State: Initialized, Role: FOLLOWER
I20260201 02:55:36.527577 14502 consensus_queue.cc:260] T 535b6fc9826f436089318f329dad0f4d P 20beda53b20146fb90018bf4533dcd58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:55:36.528949 14505 raft_consensus.cc:493] T 535b6fc9826f436089318f329dad0f4d P 20beda53b20146fb90018bf4533dcd58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 02:55:36.529183 14505 raft_consensus.cc:515] T 535b6fc9826f436089318f329dad0f4d P 20beda53b20146fb90018bf4533dcd58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:55:36.531205 14502 ts_tablet_manager.cc:1434] T 535b6fc9826f436089318f329dad0f4d P 20beda53b20146fb90018bf4533dcd58: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260201 02:55:36.533629 14505 leader_election.cc:290] T 535b6fc9826f436089318f329dad0f4d P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 943634a8539f44a8969b8503616b09d6 (127.13.170.2:41045), 74bc17a87c2342958617c01904a29dac (127.13.170.3:45403)
I20260201 02:55:36.534237 14502 tablet_bootstrap.cc:492] T 7b2f386887ef4ab0a692195c4f968c12 P 20beda53b20146fb90018bf4533dcd58: Bootstrap starting.
I20260201 02:55:36.536823 14501 tablet_bootstrap.cc:492] T af28911fb32b478b88b6779c6f0dc08f P 74bc17a87c2342958617c01904a29dac: No bootstrap required, opened a new log
I20260201 02:55:36.537034 14501 ts_tablet_manager.cc:1403] T af28911fb32b478b88b6779c6f0dc08f P 74bc17a87c2342958617c01904a29dac: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.008s
I20260201 02:55:36.537133 14502 tablet_bootstrap.cc:654] T 7b2f386887ef4ab0a692195c4f968c12 P 20beda53b20146fb90018bf4533dcd58: Neither blocks nor log segments found. Creating new log.
I20260201 02:55:36.537496 14506 tablet_bootstrap.cc:492] T 7519edb327894747a21ff97e8a90f2f9 P 943634a8539f44a8969b8503616b09d6: No bootstrap required, opened a new log
I20260201 02:55:36.537820 14506 ts_tablet_manager.cc:1403] T 7519edb327894747a21ff97e8a90f2f9 P 943634a8539f44a8969b8503616b09d6: Time spent bootstrapping tablet: real 0.034s user 0.007s sys 0.007s
I20260201 02:55:36.538017 14501 raft_consensus.cc:359] T af28911fb32b478b88b6779c6f0dc08f P 74bc17a87c2342958617c01904a29dac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } }
I20260201 02:55:36.538276 14501 raft_consensus.cc:385] T af28911fb32b478b88b6779c6f0dc08f P 74bc17a87c2342958617c01904a29dac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 02:55:36.538365 14501 raft_consensus.cc:740] T af28911fb32b478b88b6779c6f0dc08f P 74bc17a87c2342958617c01904a29dac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74bc17a87c2342958617c01904a29dac, State: Initialized, Role: FOLLOWER
I20260201 02:55:36.538729 14501 consensus_queue.cc:260] T af28911fb32b478b88b6779c6f0dc08f P 74bc17a87c2342958617c01904a29dac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } }
I20260201 02:55:36.542220 14501 ts_tablet_manager.cc:1434] T af28911fb32b478b88b6779c6f0dc08f P 74bc17a87c2342958617c01904a29dac: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260201 02:55:36.542608 14505 raft_consensus.cc:493] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 02:55:36.543491 14505 raft_consensus.cc:515] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:55:36.544824 14505 leader_election.cc:290] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 943634a8539f44a8969b8503616b09d6 (127.13.170.2:41045), 74bc17a87c2342958617c01904a29dac (127.13.170.3:45403)
I20260201 02:55:36.544930 14501 tablet_bootstrap.cc:492] T 7519edb327894747a21ff97e8a90f2f9 P 74bc17a87c2342958617c01904a29dac: Bootstrap starting.
I20260201 02:55:36.546873 14501 tablet_bootstrap.cc:654] T 7519edb327894747a21ff97e8a90f2f9 P 74bc17a87c2342958617c01904a29dac: Neither blocks nor log segments found. Creating new log.
I20260201 02:55:36.548511 14432 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1abdef8b45334d908fa08ec613374a3b" candidate_uuid: "20beda53b20146fb90018bf4533dcd58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74bc17a87c2342958617c01904a29dac" is_pre_election: true
I20260201 02:55:36.549111 14432 raft_consensus.cc:2468] T 1abdef8b45334d908fa08ec613374a3b P 74bc17a87c2342958617c01904a29dac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20beda53b20146fb90018bf4533dcd58 in term 0.
I20260201 02:55:36.549854 14501 tablet_bootstrap.cc:492] T 7519edb327894747a21ff97e8a90f2f9 P 74bc17a87c2342958617c01904a29dac: No bootstrap required, opened a new log
I20260201 02:55:36.549687 14433 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "535b6fc9826f436089318f329dad0f4d" candidate_uuid: "20beda53b20146fb90018bf4533dcd58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74bc17a87c2342958617c01904a29dac" is_pre_election: true
I20260201 02:55:36.550074 14501 ts_tablet_manager.cc:1403] T 7519edb327894747a21ff97e8a90f2f9 P 74bc17a87c2342958617c01904a29dac: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s
I20260201 02:55:36.551191 14502 tablet_bootstrap.cc:492] T 7b2f386887ef4ab0a692195c4f968c12 P 20beda53b20146fb90018bf4533dcd58: No bootstrap required, opened a new log
I20260201 02:55:36.551111 14501 raft_consensus.cc:359] T 7519edb327894747a21ff97e8a90f2f9 P 74bc17a87c2342958617c01904a29dac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:55:36.551311 14501 raft_consensus.cc:385] T 7519edb327894747a21ff97e8a90f2f9 P 74bc17a87c2342958617c01904a29dac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 02:55:36.551409 14501 raft_consensus.cc:740] T 7519edb327894747a21ff97e8a90f2f9 P 74bc17a87c2342958617c01904a29dac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74bc17a87c2342958617c01904a29dac, State: Initialized, Role: FOLLOWER
I20260201 02:55:36.551568 14502 ts_tablet_manager.cc:1403] T 7b2f386887ef4ab0a692195c4f968c12 P 20beda53b20146fb90018bf4533dcd58: Time spent bootstrapping tablet: real 0.017s user 0.004s sys 0.006s
I20260201 02:55:36.551680 14501 consensus_queue.cc:260] T 7519edb327894747a21ff97e8a90f2f9 P 74bc17a87c2342958617c01904a29dac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:55:36.552265 14501 ts_tablet_manager.cc:1434] T 7519edb327894747a21ff97e8a90f2f9 P 74bc17a87c2342958617c01904a29dac: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260201 02:55:36.552402 14108 leader_election.cc:304] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20beda53b20146fb90018bf4533dcd58, 74bc17a87c2342958617c01904a29dac; no voters:
I20260201 02:55:36.552587 14501 tablet_bootstrap.cc:492] T 9434d106c0374b5d928cc00f109846ce P 74bc17a87c2342958617c01904a29dac: Bootstrap starting.
I20260201 02:55:36.552765 14502 raft_consensus.cc:359] T 7b2f386887ef4ab0a692195c4f968c12 P 20beda53b20146fb90018bf4533dcd58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:55:36.552989 14515 raft_consensus.cc:2804] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 02:55:36.553157 14515 raft_consensus.cc:493] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 02:55:36.553299 14515 raft_consensus.cc:3060] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58 [term 0 FOLLOWER]: Advancing to term 1
I20260201 02:55:36.554392 14501 tablet_bootstrap.cc:654] T 9434d106c0374b5d928cc00f109846ce P 74bc17a87c2342958617c01904a29dac: Neither blocks nor log segments found. Creating new log.
W20260201 02:55:36.555567 14108 leader_election.cc:343] T 535b6fc9826f436089318f329dad0f4d P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74bc17a87c2342958617c01904a29dac (127.13.170.3:45403): Illegal state: must be running to vote when last-logged opid is not known
I20260201 02:55:36.555395 14506 raft_consensus.cc:359] T 7519edb327894747a21ff97e8a90f2f9 P 943634a8539f44a8969b8503616b09d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:55:36.556059 14502 raft_consensus.cc:385] T 7b2f386887ef4ab0a692195c4f968c12 P 20beda53b20146fb90018bf4533dcd58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 02:55:36.556185 14502 raft_consensus.cc:740] T 7b2f386887ef4ab0a692195c4f968c12 P 20beda53b20146fb90018bf4533dcd58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20beda53b20146fb90018bf4533dcd58, State: Initialized, Role: FOLLOWER
I20260201 02:55:36.556491 14515 raft_consensus.cc:515] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:55:36.557147 14506 raft_consensus.cc:385] T 7519edb327894747a21ff97e8a90f2f9 P 943634a8539f44a8969b8503616b09d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 02:55:36.557329 14506 raft_consensus.cc:740] T 7519edb327894747a21ff97e8a90f2f9 P 943634a8539f44a8969b8503616b09d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 943634a8539f44a8969b8503616b09d6, State: Initialized, Role: FOLLOWER
I20260201 02:55:36.557219 14303 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "535b6fc9826f436089318f329dad0f4d" candidate_uuid: "20beda53b20146fb90018bf4533dcd58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "943634a8539f44a8969b8503616b09d6" is_pre_election: true
I20260201 02:55:36.557677 14515 leader_election.cc:290] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 1 election: Requested vote from peers 943634a8539f44a8969b8503616b09d6 (127.13.170.2:41045), 74bc17a87c2342958617c01904a29dac (127.13.170.3:45403)
I20260201 02:55:36.558204 14506 consensus_queue.cc:260] T 7519edb327894747a21ff97e8a90f2f9 P 943634a8539f44a8969b8503616b09d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:55:36.558586 14433 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1abdef8b45334d908fa08ec613374a3b" candidate_uuid: "20beda53b20146fb90018bf4533dcd58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74bc17a87c2342958617c01904a29dac"
I20260201 02:55:36.558864 14433 raft_consensus.cc:3060] T 1abdef8b45334d908fa08ec613374a3b P 74bc17a87c2342958617c01904a29dac [term 0 FOLLOWER]: Advancing to term 1
I20260201 02:55:36.559382 14303 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1abdef8b45334d908fa08ec613374a3b" candidate_uuid: "20beda53b20146fb90018bf4533dcd58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "943634a8539f44a8969b8503616b09d6"
W20260201 02:55:36.559731 14108 leader_election.cc:343] T 535b6fc9826f436089318f329dad0f4d P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 943634a8539f44a8969b8503616b09d6 (127.13.170.2:41045): Illegal state: must be running to vote when last-logged opid is not known
I20260201 02:55:36.559863 14108 leader_election.cc:304] T 535b6fc9826f436089318f329dad0f4d P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20beda53b20146fb90018bf4533dcd58; no voters: 74bc17a87c2342958617c01904a29dac, 943634a8539f44a8969b8503616b09d6
W20260201 02:55:36.560534 14108 leader_election.cc:343] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 943634a8539f44a8969b8503616b09d6 (127.13.170.2:41045): Illegal state: must be running to vote when last-logged opid is not known
I20260201 02:55:36.556574 14502 consensus_queue.cc:260] T 7b2f386887ef4ab0a692195c4f968c12 P 20beda53b20146fb90018bf4533dcd58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:55:36.559139 14302 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1abdef8b45334d908fa08ec613374a3b" candidate_uuid: "20beda53b20146fb90018bf4533dcd58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "943634a8539f44a8969b8503616b09d6" is_pre_election: true
I20260201 02:55:36.560882 14505 raft_consensus.cc:2749] T 535b6fc9826f436089318f329dad0f4d P 20beda53b20146fb90018bf4533dcd58 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 02:55:36.561064 14502 ts_tablet_manager.cc:1434] T 7b2f386887ef4ab0a692195c4f968c12 P 20beda53b20146fb90018bf4533dcd58: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260201 02:55:36.561429 14502 tablet_bootstrap.cc:492] T 9434d106c0374b5d928cc00f109846ce P 20beda53b20146fb90018bf4533dcd58: Bootstrap starting.
I20260201 02:55:36.562104 14433 raft_consensus.cc:2468] T 1abdef8b45334d908fa08ec613374a3b P 74bc17a87c2342958617c01904a29dac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20beda53b20146fb90018bf4533dcd58 in term 1.
I20260201 02:55:36.563361 14501 tablet_bootstrap.cc:492] T 9434d106c0374b5d928cc00f109846ce P 74bc17a87c2342958617c01904a29dac: No bootstrap required, opened a new log
I20260201 02:55:36.563370 14502 tablet_bootstrap.cc:654] T 9434d106c0374b5d928cc00f109846ce P 20beda53b20146fb90018bf4533dcd58: Neither blocks nor log segments found. Creating new log.
I20260201 02:55:36.563557 14501 ts_tablet_manager.cc:1403] T 9434d106c0374b5d928cc00f109846ce P 74bc17a87c2342958617c01904a29dac: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.003s
I20260201 02:55:36.564003 14108 leader_election.cc:304] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20beda53b20146fb90018bf4533dcd58, 74bc17a87c2342958617c01904a29dac; no voters: 943634a8539f44a8969b8503616b09d6
I20260201 02:55:36.564536 14501 raft_consensus.cc:359] T 9434d106c0374b5d928cc00f109846ce P 74bc17a87c2342958617c01904a29dac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:55:36.564810 14515 raft_consensus.cc:2804] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 02:55:36.564846 14501 raft_consensus.cc:385] T 9434d106c0374b5d928cc00f109846ce P 74bc17a87c2342958617c01904a29dac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 02:55:36.564939 14501 raft_consensus.cc:740] T 9434d106c0374b5d928cc00f109846ce P 74bc17a87c2342958617c01904a29dac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74bc17a87c2342958617c01904a29dac, State: Initialized, Role: FOLLOWER
I20260201 02:55:36.565068 14515 raft_consensus.cc:697] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58 [term 1 LEADER]: Becoming Leader. State: Replica: 20beda53b20146fb90018bf4533dcd58, State: Running, Role: LEADER
W20260201 02:55:36.565276 14108 leader_election.cc:343] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 943634a8539f44a8969b8503616b09d6 (127.13.170.2:41045): Illegal state: must be running to vote when last-logged opid is not known
I20260201 02:55:36.565613 14515 consensus_queue.cc:237] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:55:36.565733 14501 consensus_queue.cc:260] T 9434d106c0374b5d928cc00f109846ce P 74bc17a87c2342958617c01904a29dac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:55:36.566022 14507 raft_consensus.cc:493] T 9434d106c0374b5d928cc00f109846ce P 74bc17a87c2342958617c01904a29dac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 02:55:36.566180 14507 raft_consensus.cc:515] T 9434d106c0374b5d928cc00f109846ce P 74bc17a87c2342958617c01904a29dac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:55:36.568845 14507 leader_election.cc:290] T 9434d106c0374b5d928cc00f109846ce P 74bc17a87c2342958617c01904a29dac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225), 943634a8539f44a8969b8503616b09d6 (127.13.170.2:41045)
W20260201 02:55:36.581548 14479 tablet.cc:2378] T 1abdef8b45334d908fa08ec613374a3b P 74bc17a87c2342958617c01904a29dac: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260201 02:55:36.581782 14172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9434d106c0374b5d928cc00f109846ce" candidate_uuid: "74bc17a87c2342958617c01904a29dac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20beda53b20146fb90018bf4533dcd58" is_pre_election: true
W20260201 02:55:36.583588 14368 leader_election.cc:343] T 9434d106c0374b5d928cc00f109846ce P 74bc17a87c2342958617c01904a29dac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Illegal state: must be running to vote when last-logged opid is not known
W20260201 02:55:36.584823 14218 tablet.cc:2378] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260201 02:55:36.585459 14501 ts_tablet_manager.cc:1434] T 9434d106c0374b5d928cc00f109846ce P 74bc17a87c2342958617c01904a29dac: Time spent starting tablet: real 0.022s user 0.000s sys 0.003s
I20260201 02:55:36.590358 14501 tablet_bootstrap.cc:492] T 535b6fc9826f436089318f329dad0f4d P 74bc17a87c2342958617c01904a29dac: Bootstrap starting.
I20260201 02:55:36.594012 14501 tablet_bootstrap.cc:654] T 535b6fc9826f436089318f329dad0f4d P 74bc17a87c2342958617c01904a29dac: Neither blocks nor log segments found. Creating new log.
I20260201 02:55:36.597419 14302 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9434d106c0374b5d928cc00f109846ce" candidate_uuid: "74bc17a87c2342958617c01904a29dac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "943634a8539f44a8969b8503616b09d6" is_pre_election: true
W20260201 02:55:36.598356 14369 leader_election.cc:343] T 9434d106c0374b5d928cc00f109846ce P 74bc17a87c2342958617c01904a29dac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 943634a8539f44a8969b8503616b09d6 (127.13.170.2:41045): Illegal state: must be running to vote when last-logged opid is not known
I20260201 02:55:36.598811 14506 ts_tablet_manager.cc:1434] T 7519edb327894747a21ff97e8a90f2f9 P 943634a8539f44a8969b8503616b09d6: Time spent starting tablet: real 0.061s user 0.016s sys 0.008s
I20260201 02:55:36.598640 14369 leader_election.cc:304] T 9434d106c0374b5d928cc00f109846ce P 74bc17a87c2342958617c01904a29dac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74bc17a87c2342958617c01904a29dac; no voters: 20beda53b20146fb90018bf4533dcd58, 943634a8539f44a8969b8503616b09d6
I20260201 02:55:36.599150 14502 tablet_bootstrap.cc:492] T 9434d106c0374b5d928cc00f109846ce P 20beda53b20146fb90018bf4533dcd58: No bootstrap required, opened a new log
I20260201 02:55:36.599350 14502 ts_tablet_manager.cc:1403] T 9434d106c0374b5d928cc00f109846ce P 20beda53b20146fb90018bf4533dcd58: Time spent bootstrapping tablet: real 0.038s user 0.009s sys 0.028s
I20260201 02:55:36.599390 14507 raft_consensus.cc:2749] T 9434d106c0374b5d928cc00f109846ce P 74bc17a87c2342958617c01904a29dac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 02:55:36.599818 14522 raft_consensus.cc:493] T 7519edb327894747a21ff97e8a90f2f9 P 943634a8539f44a8969b8503616b09d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 02:55:36.600098 14522 raft_consensus.cc:515] T 7519edb327894747a21ff97e8a90f2f9 P 943634a8539f44a8969b8503616b09d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:55:36.600364 14502 raft_consensus.cc:359] T 9434d106c0374b5d928cc00f109846ce P 20beda53b20146fb90018bf4533dcd58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:55:36.600553 14502 raft_consensus.cc:385] T 9434d106c0374b5d928cc00f109846ce P 20beda53b20146fb90018bf4533dcd58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 02:55:36.600662 14502 raft_consensus.cc:740] T 9434d106c0374b5d928cc00f109846ce P 20beda53b20146fb90018bf4533dcd58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20beda53b20146fb90018bf4533dcd58, State: Initialized, Role: FOLLOWER
I20260201 02:55:36.601037 14502 consensus_queue.cc:260] T 9434d106c0374b5d928cc00f109846ce P 20beda53b20146fb90018bf4533dcd58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:55:36.601583 14501 tablet_bootstrap.cc:492] T 535b6fc9826f436089318f329dad0f4d P 74bc17a87c2342958617c01904a29dac: No bootstrap required, opened a new log
I20260201 02:55:36.601701 14502 ts_tablet_manager.cc:1434] T 9434d106c0374b5d928cc00f109846ce P 20beda53b20146fb90018bf4533dcd58: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260201 02:55:36.601895 14501 ts_tablet_manager.cc:1403] T 535b6fc9826f436089318f329dad0f4d P 74bc17a87c2342958617c01904a29dac: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.000s
I20260201 02:55:36.602075 14502 tablet_bootstrap.cc:492] T af28911fb32b478b88b6779c6f0dc08f P 20beda53b20146fb90018bf4533dcd58: Bootstrap starting.
I20260201 02:55:36.603154 14501 raft_consensus.cc:359] T 535b6fc9826f436089318f329dad0f4d P 74bc17a87c2342958617c01904a29dac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:55:36.603528 14501 raft_consensus.cc:385] T 535b6fc9826f436089318f329dad0f4d P 74bc17a87c2342958617c01904a29dac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 02:55:36.603711 14501 raft_consensus.cc:740] T 535b6fc9826f436089318f329dad0f4d P 74bc17a87c2342958617c01904a29dac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74bc17a87c2342958617c01904a29dac, State: Initialized, Role: FOLLOWER
I20260201 02:55:36.604161 14501 consensus_queue.cc:260] T 535b6fc9826f436089318f329dad0f4d P 74bc17a87c2342958617c01904a29dac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:55:36.604449 14502 tablet_bootstrap.cc:654] T af28911fb32b478b88b6779c6f0dc08f P 20beda53b20146fb90018bf4533dcd58: Neither blocks nor log segments found. Creating new log.
I20260201 02:55:36.605301 14505 raft_consensus.cc:493] T 7b2f386887ef4ab0a692195c4f968c12 P 20beda53b20146fb90018bf4533dcd58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 02:55:36.605506 14505 raft_consensus.cc:515] T 7b2f386887ef4ab0a692195c4f968c12 P 20beda53b20146fb90018bf4533dcd58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:55:36.605996 14501 ts_tablet_manager.cc:1434] T 535b6fc9826f436089318f329dad0f4d P 74bc17a87c2342958617c01904a29dac: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260201 02:55:36.606217 14505 leader_election.cc:290] T 7b2f386887ef4ab0a692195c4f968c12 P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 943634a8539f44a8969b8503616b09d6 (127.13.170.2:41045), 74bc17a87c2342958617c01904a29dac (127.13.170.3:45403)
I20260201 02:55:36.607177 14507 raft_consensus.cc:493] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 02:55:36.607197 14302 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b2f386887ef4ab0a692195c4f968c12" candidate_uuid: "20beda53b20146fb90018bf4533dcd58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "943634a8539f44a8969b8503616b09d6" is_pre_election: true
I20260201 02:55:36.607368 14507 raft_consensus.cc:515] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
W20260201 02:55:36.607895 14108 leader_election.cc:343] T 7b2f386887ef4ab0a692195c4f968c12 P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 943634a8539f44a8969b8503616b09d6 (127.13.170.2:41045): Illegal state: must be running to vote when last-logged opid is not known
I20260201 02:55:36.608070 14433 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b2f386887ef4ab0a692195c4f968c12" candidate_uuid: "20beda53b20146fb90018bf4533dcd58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74bc17a87c2342958617c01904a29dac" is_pre_election: true
I20260201 02:55:36.608242 14507 leader_election.cc:290] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225), 943634a8539f44a8969b8503616b09d6 (127.13.170.2:41045)
I20260201 02:55:36.608290 14433 raft_consensus.cc:2468] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20beda53b20146fb90018bf4533dcd58 in term 0.
I20260201 02:55:36.608796 14108 leader_election.cc:304] T 7b2f386887ef4ab0a692195c4f968c12 P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20beda53b20146fb90018bf4533dcd58, 74bc17a87c2342958617c01904a29dac; no voters: 943634a8539f44a8969b8503616b09d6
I20260201 02:55:36.609316 14505 raft_consensus.cc:2804] T 7b2f386887ef4ab0a692195c4f968c12 P 20beda53b20146fb90018bf4533dcd58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 02:55:36.609440 14505 raft_consensus.cc:493] T 7b2f386887ef4ab0a692195c4f968c12 P 20beda53b20146fb90018bf4533dcd58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 02:55:36.609576 14505 raft_consensus.cc:3060] T 7b2f386887ef4ab0a692195c4f968c12 P 20beda53b20146fb90018bf4533dcd58 [term 0 FOLLOWER]: Advancing to term 1
I20260201 02:55:36.609789 14172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b2f386887ef4ab0a692195c4f968c12" candidate_uuid: "74bc17a87c2342958617c01904a29dac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20beda53b20146fb90018bf4533dcd58" is_pre_election: true
I20260201 02:55:36.610221 14302 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b2f386887ef4ab0a692195c4f968c12" candidate_uuid: "74bc17a87c2342958617c01904a29dac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "943634a8539f44a8969b8503616b09d6" is_pre_election: true
I20260201 02:55:36.610412 14348 heartbeater.cc:499] Master 127.13.170.62:35377 was elected leader, sending a full tablet report...
W20260201 02:55:36.610859 14369 leader_election.cc:343] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 943634a8539f44a8969b8503616b09d6 (127.13.170.2:41045): Illegal state: must be running to vote when last-logged opid is not known
I20260201 02:55:36.612835 14505 raft_consensus.cc:515] T 7b2f386887ef4ab0a692195c4f968c12 P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:55:36.613476 14172 raft_consensus.cc:2393] T 7b2f386887ef4ab0a692195c4f968c12 P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74bc17a87c2342958617c01904a29dac in current term 1: Already voted for candidate 20beda53b20146fb90018bf4533dcd58 in this term.
I20260201 02:55:36.613592 14522 leader_election.cc:290] T 7519edb327894747a21ff97e8a90f2f9 P 943634a8539f44a8969b8503616b09d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225), 74bc17a87c2342958617c01904a29dac (127.13.170.3:45403)
I20260201 02:55:36.615342 14368 leader_election.cc:304] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74bc17a87c2342958617c01904a29dac; no voters: 20beda53b20146fb90018bf4533dcd58, 943634a8539f44a8969b8503616b09d6
I20260201 02:55:36.615893 14507 raft_consensus.cc:3060] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac [term 0 FOLLOWER]: Advancing to term 1
I20260201 02:55:36.622593 14507 raft_consensus.cc:2749] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 02:55:36.622866 14502 tablet_bootstrap.cc:492] T af28911fb32b478b88b6779c6f0dc08f P 20beda53b20146fb90018bf4533dcd58: No bootstrap required, opened a new log
I20260201 02:55:36.623075 14502 ts_tablet_manager.cc:1403] T af28911fb32b478b88b6779c6f0dc08f P 20beda53b20146fb90018bf4533dcd58: Time spent bootstrapping tablet: real 0.021s user 0.004s sys 0.003s
I20260201 02:55:36.623826 14172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7519edb327894747a21ff97e8a90f2f9" candidate_uuid: "943634a8539f44a8969b8503616b09d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20beda53b20146fb90018bf4533dcd58" is_pre_election: true
I20260201 02:55:36.624104 14502 raft_consensus.cc:359] T af28911fb32b478b88b6779c6f0dc08f P 20beda53b20146fb90018bf4533dcd58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } }
I20260201 02:55:36.624224 14302 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b2f386887ef4ab0a692195c4f968c12" candidate_uuid: "20beda53b20146fb90018bf4533dcd58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "943634a8539f44a8969b8503616b09d6"
I20260201 02:55:36.624329 14502 raft_consensus.cc:385] T af28911fb32b478b88b6779c6f0dc08f P 20beda53b20146fb90018bf4533dcd58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 02:55:36.624397 14502 raft_consensus.cc:740] T af28911fb32b478b88b6779c6f0dc08f P 20beda53b20146fb90018bf4533dcd58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20beda53b20146fb90018bf4533dcd58, State: Initialized, Role: FOLLOWER
I20260201 02:55:36.624655 14502 consensus_queue.cc:260] T af28911fb32b478b88b6779c6f0dc08f P 20beda53b20146fb90018bf4533dcd58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } }
W20260201 02:55:36.624881 14108 leader_election.cc:343] T 7b2f386887ef4ab0a692195c4f968c12 P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 943634a8539f44a8969b8503616b09d6 (127.13.170.2:41045): Illegal state: must be running to vote when last-logged opid is not known
W20260201 02:55:36.624974 14238 leader_election.cc:343] T 7519edb327894747a21ff97e8a90f2f9 P 943634a8539f44a8969b8503616b09d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Illegal state: must be running to vote when last-logged opid is not known
I20260201 02:55:36.625182 14502 ts_tablet_manager.cc:1434] T af28911fb32b478b88b6779c6f0dc08f P 20beda53b20146fb90018bf4533dcd58: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260201 02:55:36.625537 14502 tablet_bootstrap.cc:492] T 7519edb327894747a21ff97e8a90f2f9 P 20beda53b20146fb90018bf4533dcd58: Bootstrap starting.
I20260201 02:55:36.625749 14433 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b2f386887ef4ab0a692195c4f968c12" candidate_uuid: "20beda53b20146fb90018bf4533dcd58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74bc17a87c2342958617c01904a29dac"
I20260201 02:55:36.627488 14502 tablet_bootstrap.cc:654] T 7519edb327894747a21ff97e8a90f2f9 P 20beda53b20146fb90018bf4533dcd58: Neither blocks nor log segments found. Creating new log.
I20260201 02:55:36.626996 14031 catalog_manager.cc:5654] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58 reported cstate change: term changed from 0 to 1, leader changed from <none> to 20beda53b20146fb90018bf4533dcd58 (127.13.170.1). New cstate: current_term: 1 leader_uuid: "20beda53b20146fb90018bf4533dcd58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } health_report { overall_health: UNKNOWN } } }
I20260201 02:55:36.628937 14433 raft_consensus.cc:2468] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20beda53b20146fb90018bf4533dcd58 in term 1.
I20260201 02:55:36.629616 14108 leader_election.cc:304] T 7b2f386887ef4ab0a692195c4f968c12 P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20beda53b20146fb90018bf4533dcd58, 74bc17a87c2342958617c01904a29dac; no voters: 943634a8539f44a8969b8503616b09d6
I20260201 02:55:36.629987 14507 raft_consensus.cc:493] T af28911fb32b478b88b6779c6f0dc08f P 74bc17a87c2342958617c01904a29dac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 02:55:36.630154 14507 raft_consensus.cc:515] T af28911fb32b478b88b6779c6f0dc08f P 74bc17a87c2342958617c01904a29dac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } }
I20260201 02:55:36.631415 14507 leader_election.cc:290] T af28911fb32b478b88b6779c6f0dc08f P 74bc17a87c2342958617c01904a29dac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 943634a8539f44a8969b8503616b09d6 (127.13.170.2:41045), 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225)
I20260201 02:55:36.631628 14172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "af28911fb32b478b88b6779c6f0dc08f" candidate_uuid: "74bc17a87c2342958617c01904a29dac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20beda53b20146fb90018bf4533dcd58" is_pre_election: true
I20260201 02:55:36.631778 14515 raft_consensus.cc:2804] T 7b2f386887ef4ab0a692195c4f968c12 P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 02:55:36.631723 14302 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "af28911fb32b478b88b6779c6f0dc08f" candidate_uuid: "74bc17a87c2342958617c01904a29dac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "943634a8539f44a8969b8503616b09d6" is_pre_election: true
I20260201 02:55:36.631968 14172 raft_consensus.cc:2468] T af28911fb32b478b88b6779c6f0dc08f P 20beda53b20146fb90018bf4533dcd58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74bc17a87c2342958617c01904a29dac in term 0.
W20260201 02:55:36.632359 14369 leader_election.cc:343] T af28911fb32b478b88b6779c6f0dc08f P 74bc17a87c2342958617c01904a29dac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 943634a8539f44a8969b8503616b09d6 (127.13.170.2:41045): Illegal state: must be running to vote when last-logged opid is not known
I20260201 02:55:36.632457 14506 tablet_bootstrap.cc:492] T 7b2f386887ef4ab0a692195c4f968c12 P 943634a8539f44a8969b8503616b09d6: Bootstrap starting.
I20260201 02:55:36.634071 14368 leader_election.cc:304] T af28911fb32b478b88b6779c6f0dc08f P 74bc17a87c2342958617c01904a29dac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20beda53b20146fb90018bf4533dcd58, 74bc17a87c2342958617c01904a29dac; no voters: 943634a8539f44a8969b8503616b09d6
I20260201 02:55:36.634625 14506 tablet_bootstrap.cc:654] T 7b2f386887ef4ab0a692195c4f968c12 P 943634a8539f44a8969b8503616b09d6: Neither blocks nor log segments found. Creating new log.
I20260201 02:55:36.636433 14507 raft_consensus.cc:2804] T af28911fb32b478b88b6779c6f0dc08f P 74bc17a87c2342958617c01904a29dac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 02:55:36.636696 14507 raft_consensus.cc:493] T af28911fb32b478b88b6779c6f0dc08f P 74bc17a87c2342958617c01904a29dac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 02:55:36.631644 14505 leader_election.cc:290] T 7b2f386887ef4ab0a692195c4f968c12 P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 1 election: Requested vote from peers 943634a8539f44a8969b8503616b09d6 (127.13.170.2:41045), 74bc17a87c2342958617c01904a29dac (127.13.170.3:45403)
I20260201 02:55:36.637125 14507 raft_consensus.cc:3060] T af28911fb32b478b88b6779c6f0dc08f P 74bc17a87c2342958617c01904a29dac [term 0 FOLLOWER]: Advancing to term 1
I20260201 02:55:36.637706 14515 raft_consensus.cc:697] T 7b2f386887ef4ab0a692195c4f968c12 P 20beda53b20146fb90018bf4533dcd58 [term 1 LEADER]: Becoming Leader. State: Replica: 20beda53b20146fb90018bf4533dcd58, State: Running, Role: LEADER
I20260201 02:55:36.638106 14515 consensus_queue.cc:237] T 7b2f386887ef4ab0a692195c4f968c12 P 20beda53b20146fb90018bf4533dcd58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:55:36.640887 14506 tablet_bootstrap.cc:492] T 7b2f386887ef4ab0a692195c4f968c12 P 943634a8539f44a8969b8503616b09d6: No bootstrap required, opened a new log
I20260201 02:55:36.641088 14506 ts_tablet_manager.cc:1403] T 7b2f386887ef4ab0a692195c4f968c12 P 943634a8539f44a8969b8503616b09d6: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.003s
I20260201 02:55:36.642057 14507 raft_consensus.cc:515] T af28911fb32b478b88b6779c6f0dc08f P 74bc17a87c2342958617c01904a29dac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } }
I20260201 02:55:36.642477 14502 tablet_bootstrap.cc:492] T 7519edb327894747a21ff97e8a90f2f9 P 20beda53b20146fb90018bf4533dcd58: No bootstrap required, opened a new log
I20260201 02:55:36.642525 14433 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7519edb327894747a21ff97e8a90f2f9" candidate_uuid: "943634a8539f44a8969b8503616b09d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74bc17a87c2342958617c01904a29dac" is_pre_election: true
I20260201 02:55:36.642692 14502 ts_tablet_manager.cc:1403] T 7519edb327894747a21ff97e8a90f2f9 P 20beda53b20146fb90018bf4533dcd58: Time spent bootstrapping tablet: real 0.017s user 0.005s sys 0.000s
I20260201 02:55:36.642773 14433 raft_consensus.cc:2468] T 7519edb327894747a21ff97e8a90f2f9 P 74bc17a87c2342958617c01904a29dac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 943634a8539f44a8969b8503616b09d6 in term 0.
I20260201 02:55:36.643388 14239 leader_election.cc:304] T 7519edb327894747a21ff97e8a90f2f9 P 943634a8539f44a8969b8503616b09d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74bc17a87c2342958617c01904a29dac, 943634a8539f44a8969b8503616b09d6; no voters: 20beda53b20146fb90018bf4533dcd58
I20260201 02:55:36.643565 14502 raft_consensus.cc:359] T 7519edb327894747a21ff97e8a90f2f9 P 20beda53b20146fb90018bf4533dcd58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:55:36.643747 14502 raft_consensus.cc:385] T 7519edb327894747a21ff97e8a90f2f9 P 20beda53b20146fb90018bf4533dcd58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 02:55:36.643846 14502 raft_consensus.cc:740] T 7519edb327894747a21ff97e8a90f2f9 P 20beda53b20146fb90018bf4533dcd58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20beda53b20146fb90018bf4533dcd58, State: Initialized, Role: FOLLOWER
I20260201 02:55:36.643898 14522 raft_consensus.cc:2804] T 7519edb327894747a21ff97e8a90f2f9 P 943634a8539f44a8969b8503616b09d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 02:55:36.643952 14506 raft_consensus.cc:359] T 7b2f386887ef4ab0a692195c4f968c12 P 943634a8539f44a8969b8503616b09d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:55:36.644073 14522 raft_consensus.cc:493] T 7519edb327894747a21ff97e8a90f2f9 P 943634a8539f44a8969b8503616b09d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 02:55:36.644192 14506 raft_consensus.cc:385] T 7b2f386887ef4ab0a692195c4f968c12 P 943634a8539f44a8969b8503616b09d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 02:55:36.644120 14502 consensus_queue.cc:260] T 7519edb327894747a21ff97e8a90f2f9 P 20beda53b20146fb90018bf4533dcd58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:55:36.644241 14522 raft_consensus.cc:3060] T 7519edb327894747a21ff97e8a90f2f9 P 943634a8539f44a8969b8503616b09d6 [term 0 FOLLOWER]: Advancing to term 1
I20260201 02:55:36.644310 14506 raft_consensus.cc:740] T 7b2f386887ef4ab0a692195c4f968c12 P 943634a8539f44a8969b8503616b09d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 943634a8539f44a8969b8503616b09d6, State: Initialized, Role: FOLLOWER
I20260201 02:55:36.644577 14506 consensus_queue.cc:260] T 7b2f386887ef4ab0a692195c4f968c12 P 943634a8539f44a8969b8503616b09d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:55:36.644884 14502 ts_tablet_manager.cc:1434] T 7519edb327894747a21ff97e8a90f2f9 P 20beda53b20146fb90018bf4533dcd58: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260201 02:55:36.645212 14506 ts_tablet_manager.cc:1434] T 7b2f386887ef4ab0a692195c4f968c12 P 943634a8539f44a8969b8503616b09d6: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260201 02:55:36.645529 14506 tablet_bootstrap.cc:492] T 1abdef8b45334d908fa08ec613374a3b P 943634a8539f44a8969b8503616b09d6: Bootstrap starting.
I20260201 02:55:36.647553 14506 tablet_bootstrap.cc:654] T 1abdef8b45334d908fa08ec613374a3b P 943634a8539f44a8969b8503616b09d6: Neither blocks nor log segments found. Creating new log.
I20260201 02:55:36.651777 14522 raft_consensus.cc:515] T 7519edb327894747a21ff97e8a90f2f9 P 943634a8539f44a8969b8503616b09d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:55:36.652567 14507 leader_election.cc:290] T af28911fb32b478b88b6779c6f0dc08f P 74bc17a87c2342958617c01904a29dac [CANDIDATE]: Term 1 election: Requested vote from peers 943634a8539f44a8969b8503616b09d6 (127.13.170.2:41045), 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225)
I20260201 02:55:36.652155 14030 catalog_manager.cc:5654] T 7b2f386887ef4ab0a692195c4f968c12 P 20beda53b20146fb90018bf4533dcd58 reported cstate change: term changed from 0 to 1, leader changed from <none> to 20beda53b20146fb90018bf4533dcd58 (127.13.170.1). New cstate: current_term: 1 leader_uuid: "20beda53b20146fb90018bf4533dcd58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } health_report { overall_health: UNKNOWN } } }
I20260201 02:55:36.653168 14507 raft_consensus.cc:493] T 535b6fc9826f436089318f329dad0f4d P 74bc17a87c2342958617c01904a29dac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 02:55:36.653364 14507 raft_consensus.cc:515] T 535b6fc9826f436089318f329dad0f4d P 74bc17a87c2342958617c01904a29dac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:55:36.653604 14171 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7519edb327894747a21ff97e8a90f2f9" candidate_uuid: "943634a8539f44a8969b8503616b09d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20beda53b20146fb90018bf4533dcd58"
I20260201 02:55:36.653952 14171 raft_consensus.cc:3060] T 7519edb327894747a21ff97e8a90f2f9 P 20beda53b20146fb90018bf4533dcd58 [term 0 FOLLOWER]: Advancing to term 1
I20260201 02:55:36.654080 14507 leader_election.cc:290] T 535b6fc9826f436089318f329dad0f4d P 74bc17a87c2342958617c01904a29dac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225), 943634a8539f44a8969b8503616b09d6 (127.13.170.2:41045)
I20260201 02:55:36.654325 14515 raft_consensus.cc:493] T 9434d106c0374b5d928cc00f109846ce P 20beda53b20146fb90018bf4533dcd58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 02:55:36.654557 14515 raft_consensus.cc:515] T 9434d106c0374b5d928cc00f109846ce P 20beda53b20146fb90018bf4533dcd58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:55:36.655436 14515 leader_election.cc:290] T 9434d106c0374b5d928cc00f109846ce P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 943634a8539f44a8969b8503616b09d6 (127.13.170.2:41045), 74bc17a87c2342958617c01904a29dac (127.13.170.3:45403)
I20260201 02:55:36.656623 14302 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "af28911fb32b478b88b6779c6f0dc08f" candidate_uuid: "74bc17a87c2342958617c01904a29dac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "943634a8539f44a8969b8503616b09d6"
I20260201 02:55:36.657037 14170 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "535b6fc9826f436089318f329dad0f4d" candidate_uuid: "74bc17a87c2342958617c01904a29dac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20beda53b20146fb90018bf4533dcd58" is_pre_election: true
I20260201 02:55:36.657315 14170 raft_consensus.cc:2468] T 535b6fc9826f436089318f329dad0f4d P 20beda53b20146fb90018bf4533dcd58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74bc17a87c2342958617c01904a29dac in term 0.
W20260201 02:55:36.657348 14369 leader_election.cc:343] T af28911fb32b478b88b6779c6f0dc08f P 74bc17a87c2342958617c01904a29dac [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 943634a8539f44a8969b8503616b09d6 (127.13.170.2:41045): Illegal state: must be running to vote when last-logged opid is not known
I20260201 02:55:36.657436 14302 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "535b6fc9826f436089318f329dad0f4d" candidate_uuid: "74bc17a87c2342958617c01904a29dac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "943634a8539f44a8969b8503616b09d6" is_pre_election: true
I20260201 02:55:36.657693 14172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "af28911fb32b478b88b6779c6f0dc08f" candidate_uuid: "74bc17a87c2342958617c01904a29dac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20beda53b20146fb90018bf4533dcd58"
I20260201 02:55:36.657866 14172 raft_consensus.cc:3060] T af28911fb32b478b88b6779c6f0dc08f P 20beda53b20146fb90018bf4533dcd58 [term 0 FOLLOWER]: Advancing to term 1
W20260201 02:55:36.658032 14369 leader_election.cc:343] T 535b6fc9826f436089318f329dad0f4d P 74bc17a87c2342958617c01904a29dac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 943634a8539f44a8969b8503616b09d6 (127.13.170.2:41045): Illegal state: must be running to vote when last-logged opid is not known
I20260201 02:55:36.658463 14433 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9434d106c0374b5d928cc00f109846ce" candidate_uuid: "20beda53b20146fb90018bf4533dcd58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74bc17a87c2342958617c01904a29dac" is_pre_election: true
I20260201 02:55:36.658543 14522 leader_election.cc:290] T 7519edb327894747a21ff97e8a90f2f9 P 943634a8539f44a8969b8503616b09d6 [CANDIDATE]: Term 1 election: Requested vote from peers 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225), 74bc17a87c2342958617c01904a29dac (127.13.170.3:45403)
I20260201 02:55:36.658535 14368 leader_election.cc:304] T 535b6fc9826f436089318f329dad0f4d P 74bc17a87c2342958617c01904a29dac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20beda53b20146fb90018bf4533dcd58, 74bc17a87c2342958617c01904a29dac; no voters: 943634a8539f44a8969b8503616b09d6
I20260201 02:55:36.658757 14433 raft_consensus.cc:2468] T 9434d106c0374b5d928cc00f109846ce P 74bc17a87c2342958617c01904a29dac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20beda53b20146fb90018bf4533dcd58 in term 0.
I20260201 02:55:36.659279 14108 leader_election.cc:304] T 9434d106c0374b5d928cc00f109846ce P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20beda53b20146fb90018bf4533dcd58, 74bc17a87c2342958617c01904a29dac; no voters:
I20260201 02:55:36.659472 14506 tablet_bootstrap.cc:492] T 1abdef8b45334d908fa08ec613374a3b P 943634a8539f44a8969b8503616b09d6: No bootstrap required, opened a new log
I20260201 02:55:36.659583 14515 raft_consensus.cc:2804] T 9434d106c0374b5d928cc00f109846ce P 20beda53b20146fb90018bf4533dcd58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 02:55:36.659672 14506 ts_tablet_manager.cc:1403] T 1abdef8b45334d908fa08ec613374a3b P 943634a8539f44a8969b8503616b09d6: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.007s
I20260201 02:55:36.659677 14515 raft_consensus.cc:493] T 9434d106c0374b5d928cc00f109846ce P 20beda53b20146fb90018bf4533dcd58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 02:55:36.659785 14515 raft_consensus.cc:3060] T 9434d106c0374b5d928cc00f109846ce P 20beda53b20146fb90018bf4533dcd58 [term 0 FOLLOWER]: Advancing to term 1
I20260201 02:55:36.660167 14302 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9434d106c0374b5d928cc00f109846ce" candidate_uuid: "20beda53b20146fb90018bf4533dcd58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "943634a8539f44a8969b8503616b09d6" is_pre_election: true
I20260201 02:55:36.660708 14506 raft_consensus.cc:359] T 1abdef8b45334d908fa08ec613374a3b P 943634a8539f44a8969b8503616b09d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:55:36.660926 14506 raft_consensus.cc:385] T 1abdef8b45334d908fa08ec613374a3b P 943634a8539f44a8969b8503616b09d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 02:55:36.660998 14506 raft_consensus.cc:740] T 1abdef8b45334d908fa08ec613374a3b P 943634a8539f44a8969b8503616b09d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 943634a8539f44a8969b8503616b09d6, State: Initialized, Role: FOLLOWER
I20260201 02:55:36.661264 14506 consensus_queue.cc:260] T 1abdef8b45334d908fa08ec613374a3b P 943634a8539f44a8969b8503616b09d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
W20260201 02:55:36.662045 14108 leader_election.cc:343] T 9434d106c0374b5d928cc00f109846ce P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 943634a8539f44a8969b8503616b09d6 (127.13.170.2:41045): Illegal state: must be running to vote when last-logged opid is not known
I20260201 02:55:36.662441 14506 ts_tablet_manager.cc:1434] T 1abdef8b45334d908fa08ec613374a3b P 943634a8539f44a8969b8503616b09d6: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260201 02:55:36.662499 14531 raft_consensus.cc:2804] T 535b6fc9826f436089318f329dad0f4d P 74bc17a87c2342958617c01904a29dac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 02:55:36.662693 14531 raft_consensus.cc:493] T 535b6fc9826f436089318f329dad0f4d P 74bc17a87c2342958617c01904a29dac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 02:55:36.662853 14506 tablet_bootstrap.cc:492] T 535b6fc9826f436089318f329dad0f4d P 943634a8539f44a8969b8503616b09d6: Bootstrap starting.
I20260201 02:55:36.662850 14531 raft_consensus.cc:3060] T 535b6fc9826f436089318f329dad0f4d P 74bc17a87c2342958617c01904a29dac [term 0 FOLLOWER]: Advancing to term 1
I20260201 02:55:36.663065 14515 raft_consensus.cc:515] T 9434d106c0374b5d928cc00f109846ce P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:55:36.663781 14515 leader_election.cc:290] T 9434d106c0374b5d928cc00f109846ce P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 1 election: Requested vote from peers 943634a8539f44a8969b8503616b09d6 (127.13.170.2:41045), 74bc17a87c2342958617c01904a29dac (127.13.170.3:45403)
I20260201 02:55:36.664435 14433 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7519edb327894747a21ff97e8a90f2f9" candidate_uuid: "943634a8539f44a8969b8503616b09d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74bc17a87c2342958617c01904a29dac"
I20260201 02:55:36.664510 14171 raft_consensus.cc:2468] T 7519edb327894747a21ff97e8a90f2f9 P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 943634a8539f44a8969b8503616b09d6 in term 1.
I20260201 02:55:36.664666 14433 raft_consensus.cc:3060] T 7519edb327894747a21ff97e8a90f2f9 P 74bc17a87c2342958617c01904a29dac [term 0 FOLLOWER]: Advancing to term 1
I20260201 02:55:36.665252 14238 leader_election.cc:304] T 7519edb327894747a21ff97e8a90f2f9 P 943634a8539f44a8969b8503616b09d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20beda53b20146fb90018bf4533dcd58, 943634a8539f44a8969b8503616b09d6; no voters:
I20260201 02:55:36.666195 14432 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9434d106c0374b5d928cc00f109846ce" candidate_uuid: "20beda53b20146fb90018bf4533dcd58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74bc17a87c2342958617c01904a29dac"
I20260201 02:55:36.666441 14432 raft_consensus.cc:3060] T 9434d106c0374b5d928cc00f109846ce P 74bc17a87c2342958617c01904a29dac [term 0 FOLLOWER]: Advancing to term 1
I20260201 02:55:36.667375 14522 raft_consensus.cc:2804] T 7519edb327894747a21ff97e8a90f2f9 P 943634a8539f44a8969b8503616b09d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 02:55:36.667546 14522 raft_consensus.cc:697] T 7519edb327894747a21ff97e8a90f2f9 P 943634a8539f44a8969b8503616b09d6 [term 1 LEADER]: Becoming Leader. State: Replica: 943634a8539f44a8969b8503616b09d6, State: Running, Role: LEADER
I20260201 02:55:36.668082 14522 consensus_queue.cc:237] T 7519edb327894747a21ff97e8a90f2f9 P 943634a8539f44a8969b8503616b09d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:55:36.668627 14172 raft_consensus.cc:2468] T af28911fb32b478b88b6779c6f0dc08f P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74bc17a87c2342958617c01904a29dac in term 1.
I20260201 02:55:36.669149 14303 raft_consensus.cc:3060] T 1abdef8b45334d908fa08ec613374a3b P 943634a8539f44a8969b8503616b09d6 [term 0 FOLLOWER]: Advancing to term 1
I20260201 02:55:36.670835 14432 raft_consensus.cc:2468] T 9434d106c0374b5d928cc00f109846ce P 74bc17a87c2342958617c01904a29dac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20beda53b20146fb90018bf4533dcd58 in term 1.
I20260201 02:55:36.671284 14302 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9434d106c0374b5d928cc00f109846ce" candidate_uuid: "20beda53b20146fb90018bf4533dcd58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "943634a8539f44a8969b8503616b09d6"
I20260201 02:55:36.671725 14368 leader_election.cc:304] T af28911fb32b478b88b6779c6f0dc08f P 74bc17a87c2342958617c01904a29dac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20beda53b20146fb90018bf4533dcd58, 74bc17a87c2342958617c01904a29dac; no voters: 943634a8539f44a8969b8503616b09d6
I20260201 02:55:36.671988 14518 raft_consensus.cc:493] T 1abdef8b45334d908fa08ec613374a3b P 943634a8539f44a8969b8503616b09d6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 02:55:36.672128 14518 raft_consensus.cc:515] T 1abdef8b45334d908fa08ec613374a3b P 943634a8539f44a8969b8503616b09d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:55:36.672536 14506 tablet_bootstrap.cc:654] T 535b6fc9826f436089318f329dad0f4d P 943634a8539f44a8969b8503616b09d6: Neither blocks nor log segments found. Creating new log.
W20260201 02:55:36.672693 14108 leader_election.cc:343] T 9434d106c0374b5d928cc00f109846ce P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 943634a8539f44a8969b8503616b09d6 (127.13.170.2:41045): Illegal state: must be running to vote when last-logged opid is not known
I20260201 02:55:36.673002 14108 leader_election.cc:304] T 9434d106c0374b5d928cc00f109846ce P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20beda53b20146fb90018bf4533dcd58, 74bc17a87c2342958617c01904a29dac; no voters: 943634a8539f44a8969b8503616b09d6
I20260201 02:55:36.673070 14518 leader_election.cc:290] T 1abdef8b45334d908fa08ec613374a3b P 943634a8539f44a8969b8503616b09d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225), 74bc17a87c2342958617c01904a29dac (127.13.170.3:45403)
I20260201 02:55:36.674062 14505 raft_consensus.cc:2804] T 9434d106c0374b5d928cc00f109846ce P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 02:55:36.674125 14432 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1abdef8b45334d908fa08ec613374a3b" candidate_uuid: "943634a8539f44a8969b8503616b09d6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74bc17a87c2342958617c01904a29dac" is_pre_election: true
I20260201 02:55:36.674248 14505 raft_consensus.cc:697] T 9434d106c0374b5d928cc00f109846ce P 20beda53b20146fb90018bf4533dcd58 [term 1 LEADER]: Becoming Leader. State: Replica: 20beda53b20146fb90018bf4533dcd58, State: Running, Role: LEADER
I20260201 02:55:36.674367 14432 raft_consensus.cc:2468] T 1abdef8b45334d908fa08ec613374a3b P 74bc17a87c2342958617c01904a29dac [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 943634a8539f44a8969b8503616b09d6 in term 1.
I20260201 02:55:36.674329 14515 consensus_queue.cc:1048] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 02:55:36.674587 14505 consensus_queue.cc:237] T 9434d106c0374b5d928cc00f109846ce P 20beda53b20146fb90018bf4533dcd58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:55:36.676204 14239 leader_election.cc:304] T 1abdef8b45334d908fa08ec613374a3b P 943634a8539f44a8969b8503616b09d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74bc17a87c2342958617c01904a29dac, 943634a8539f44a8969b8503616b09d6; no voters:
I20260201 02:55:36.676530 14518 raft_consensus.cc:2804] T 1abdef8b45334d908fa08ec613374a3b P 943634a8539f44a8969b8503616b09d6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 02:55:36.676671 14518 raft_consensus.cc:493] T 1abdef8b45334d908fa08ec613374a3b P 943634a8539f44a8969b8503616b09d6 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 02:55:36.676766 14518 raft_consensus.cc:3060] T 1abdef8b45334d908fa08ec613374a3b P 943634a8539f44a8969b8503616b09d6 [term 1 FOLLOWER]: Advancing to term 2
I20260201 02:55:36.678154 14030 catalog_manager.cc:5654] T 9434d106c0374b5d928cc00f109846ce P 20beda53b20146fb90018bf4533dcd58 reported cstate change: term changed from 0 to 1, leader changed from <none> to 20beda53b20146fb90018bf4533dcd58 (127.13.170.1). New cstate: current_term: 1 leader_uuid: "20beda53b20146fb90018bf4533dcd58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } health_report { overall_health: UNKNOWN } } }
I20260201 02:55:36.679559 14172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1abdef8b45334d908fa08ec613374a3b" candidate_uuid: "943634a8539f44a8969b8503616b09d6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20beda53b20146fb90018bf4533dcd58" is_pre_election: true
I20260201 02:55:36.679915 14518 raft_consensus.cc:515] T 1abdef8b45334d908fa08ec613374a3b P 943634a8539f44a8969b8503616b09d6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:55:36.680681 14518 leader_election.cc:290] T 1abdef8b45334d908fa08ec613374a3b P 943634a8539f44a8969b8503616b09d6 [CANDIDATE]: Term 2 election: Requested vote from peers 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225), 74bc17a87c2342958617c01904a29dac (127.13.170.3:45403)
I20260201 02:55:36.681038 14303 raft_consensus.cc:1240] T 1abdef8b45334d908fa08ec613374a3b P 943634a8539f44a8969b8503616b09d6 [term 2 FOLLOWER]: Rejecting Update request from peer 20beda53b20146fb90018bf4533dcd58 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260201 02:55:36.681609 14171 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1abdef8b45334d908fa08ec613374a3b" candidate_uuid: "943634a8539f44a8969b8503616b09d6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20beda53b20146fb90018bf4533dcd58"
I20260201 02:55:36.682497 14433 raft_consensus.cc:2468] T 7519edb327894747a21ff97e8a90f2f9 P 74bc17a87c2342958617c01904a29dac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 943634a8539f44a8969b8503616b09d6 in term 1.
I20260201 02:55:36.682883 14515 consensus_queue.cc:1059] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 02:55:36.683579 14505 raft_consensus.cc:3055] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58 [term 1 LEADER]: Stepping down as leader of term 1
I20260201 02:55:36.683709 14505 raft_consensus.cc:740] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 20beda53b20146fb90018bf4533dcd58, State: Running, Role: LEADER
I20260201 02:55:36.684134 14505 consensus_queue.cc:260] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:55:36.684744 14505 raft_consensus.cc:3060] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Advancing to term 2
I20260201 02:55:36.683676 14432 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1abdef8b45334d908fa08ec613374a3b" candidate_uuid: "943634a8539f44a8969b8503616b09d6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74bc17a87c2342958617c01904a29dac"
I20260201 02:55:36.666172 14531 raft_consensus.cc:515] T 535b6fc9826f436089318f329dad0f4d P 74bc17a87c2342958617c01904a29dac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:55:36.687422 14432 raft_consensus.cc:3060] T 1abdef8b45334d908fa08ec613374a3b P 74bc17a87c2342958617c01904a29dac [term 1 FOLLOWER]: Advancing to term 2
I20260201 02:55:36.687805 14522 raft_consensus.cc:493] T 7b2f386887ef4ab0a692195c4f968c12 P 943634a8539f44a8969b8503616b09d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 02:55:36.688030 14507 raft_consensus.cc:2804] T af28911fb32b478b88b6779c6f0dc08f P 74bc17a87c2342958617c01904a29dac [term 1 FOLLOWER]: Leader election won for term 1
I20260201 02:55:36.688222 14522 raft_consensus.cc:515] T 7b2f386887ef4ab0a692195c4f968c12 P 943634a8539f44a8969b8503616b09d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:55:36.688236 14030 catalog_manager.cc:5654] T 7519edb327894747a21ff97e8a90f2f9 P 943634a8539f44a8969b8503616b09d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 943634a8539f44a8969b8503616b09d6 (127.13.170.2). New cstate: current_term: 1 leader_uuid: "943634a8539f44a8969b8503616b09d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } health_report { overall_health: UNKNOWN } } }
I20260201 02:55:36.688860 14531 leader_election.cc:290] T 535b6fc9826f436089318f329dad0f4d P 74bc17a87c2342958617c01904a29dac [CANDIDATE]: Term 1 election: Requested vote from peers 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225), 943634a8539f44a8969b8503616b09d6 (127.13.170.2:41045)
I20260201 02:55:36.690115 14522 leader_election.cc:290] T 7b2f386887ef4ab0a692195c4f968c12 P 943634a8539f44a8969b8503616b09d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225), 74bc17a87c2342958617c01904a29dac (127.13.170.3:45403)
I20260201 02:55:36.690532 14432 raft_consensus.cc:2468] T 1abdef8b45334d908fa08ec613374a3b P 74bc17a87c2342958617c01904a29dac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 943634a8539f44a8969b8503616b09d6 in term 2.
I20260201 02:55:36.690878 14172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b2f386887ef4ab0a692195c4f968c12" candidate_uuid: "943634a8539f44a8969b8503616b09d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20beda53b20146fb90018bf4533dcd58" is_pre_election: true
I20260201 02:55:36.691375 14239 leader_election.cc:304] T 1abdef8b45334d908fa08ec613374a3b P 943634a8539f44a8969b8503616b09d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74bc17a87c2342958617c01904a29dac, 943634a8539f44a8969b8503616b09d6; no voters: 20beda53b20146fb90018bf4533dcd58
I20260201 02:55:36.691917 14507 raft_consensus.cc:697] T af28911fb32b478b88b6779c6f0dc08f P 74bc17a87c2342958617c01904a29dac [term 1 LEADER]: Becoming Leader. State: Replica: 74bc17a87c2342958617c01904a29dac, State: Running, Role: LEADER
I20260201 02:55:36.692142 14506 tablet_bootstrap.cc:492] T 535b6fc9826f436089318f329dad0f4d P 943634a8539f44a8969b8503616b09d6: No bootstrap required, opened a new log
I20260201 02:55:36.692167 14522 raft_consensus.cc:2804] T 1abdef8b45334d908fa08ec613374a3b P 943634a8539f44a8969b8503616b09d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260201 02:55:36.692309 14506 ts_tablet_manager.cc:1403] T 535b6fc9826f436089318f329dad0f4d P 943634a8539f44a8969b8503616b09d6: Time spent bootstrapping tablet: real 0.030s user 0.005s sys 0.001s
I20260201 02:55:36.692443 14522 raft_consensus.cc:697] T 1abdef8b45334d908fa08ec613374a3b P 943634a8539f44a8969b8503616b09d6 [term 2 LEADER]: Becoming Leader. State: Replica: 943634a8539f44a8969b8503616b09d6, State: Running, Role: LEADER
I20260201 02:55:36.692800 14522 consensus_queue.cc:237] T 1abdef8b45334d908fa08ec613374a3b P 943634a8539f44a8969b8503616b09d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:55:36.692780 14507 consensus_queue.cc:237] T af28911fb32b478b88b6779c6f0dc08f P 74bc17a87c2342958617c01904a29dac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } }
I20260201 02:55:36.693236 14303 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "535b6fc9826f436089318f329dad0f4d" candidate_uuid: "74bc17a87c2342958617c01904a29dac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "943634a8539f44a8969b8503616b09d6"
I20260201 02:55:36.693269 14506 raft_consensus.cc:359] T 535b6fc9826f436089318f329dad0f4d P 943634a8539f44a8969b8503616b09d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:55:36.693457 14506 raft_consensus.cc:385] T 535b6fc9826f436089318f329dad0f4d P 943634a8539f44a8969b8503616b09d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 02:55:36.693550 14506 raft_consensus.cc:740] T 535b6fc9826f436089318f329dad0f4d P 943634a8539f44a8969b8503616b09d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 943634a8539f44a8969b8503616b09d6, State: Initialized, Role: FOLLOWER
I20260201 02:55:36.694111 14432 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b2f386887ef4ab0a692195c4f968c12" candidate_uuid: "943634a8539f44a8969b8503616b09d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74bc17a87c2342958617c01904a29dac" is_pre_election: true
I20260201 02:55:36.694131 14506 consensus_queue.cc:260] T 535b6fc9826f436089318f329dad0f4d P 943634a8539f44a8969b8503616b09d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:55:36.694410 14432 raft_consensus.cc:2393] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 943634a8539f44a8969b8503616b09d6 in current term 1: Already voted for candidate 20beda53b20146fb90018bf4533dcd58 in this term.
I20260201 02:55:36.694509 14303 raft_consensus.cc:3060] T 535b6fc9826f436089318f329dad0f4d P 943634a8539f44a8969b8503616b09d6 [term 0 FOLLOWER]: Advancing to term 1
I20260201 02:55:36.694924 14239 leader_election.cc:304] T 7b2f386887ef4ab0a692195c4f968c12 P 943634a8539f44a8969b8503616b09d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 943634a8539f44a8969b8503616b09d6; no voters: 20beda53b20146fb90018bf4533dcd58, 74bc17a87c2342958617c01904a29dac
I20260201 02:55:36.694994 14171 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "535b6fc9826f436089318f329dad0f4d" candidate_uuid: "74bc17a87c2342958617c01904a29dac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20beda53b20146fb90018bf4533dcd58"
I20260201 02:55:36.695202 14171 raft_consensus.cc:3060] T 535b6fc9826f436089318f329dad0f4d P 20beda53b20146fb90018bf4533dcd58 [term 0 FOLLOWER]: Advancing to term 1
I20260201 02:55:36.695372 14518 raft_consensus.cc:3060] T 7b2f386887ef4ab0a692195c4f968c12 P 943634a8539f44a8969b8503616b09d6 [term 0 FOLLOWER]: Advancing to term 1
I20260201 02:55:36.697791 14303 raft_consensus.cc:2468] T 535b6fc9826f436089318f329dad0f4d P 943634a8539f44a8969b8503616b09d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74bc17a87c2342958617c01904a29dac in term 1.
I20260201 02:55:36.698298 14518 raft_consensus.cc:2749] T 7b2f386887ef4ab0a692195c4f968c12 P 943634a8539f44a8969b8503616b09d6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 02:55:36.698607 14369 leader_election.cc:304] T 535b6fc9826f436089318f329dad0f4d P 74bc17a87c2342958617c01904a29dac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74bc17a87c2342958617c01904a29dac, 943634a8539f44a8969b8503616b09d6; no voters:
I20260201 02:55:36.699026 14171 raft_consensus.cc:2468] T 535b6fc9826f436089318f329dad0f4d P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74bc17a87c2342958617c01904a29dac in term 1.
I20260201 02:55:36.699103 14536 raft_consensus.cc:2804] T 535b6fc9826f436089318f329dad0f4d P 74bc17a87c2342958617c01904a29dac [term 1 FOLLOWER]: Leader election won for term 1
I20260201 02:55:36.699254 14536 raft_consensus.cc:697] T 535b6fc9826f436089318f329dad0f4d P 74bc17a87c2342958617c01904a29dac [term 1 LEADER]: Becoming Leader. State: Replica: 74bc17a87c2342958617c01904a29dac, State: Running, Role: LEADER
I20260201 02:55:36.699720 14506 ts_tablet_manager.cc:1434] T 535b6fc9826f436089318f329dad0f4d P 943634a8539f44a8969b8503616b09d6: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260201 02:55:36.700207 14506 tablet_bootstrap.cc:492] T 9434d106c0374b5d928cc00f109846ce P 943634a8539f44a8969b8503616b09d6: Bootstrap starting.
I20260201 02:55:36.700047 14536 consensus_queue.cc:237] T 535b6fc9826f436089318f329dad0f4d P 74bc17a87c2342958617c01904a29dac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:55:36.702809 14506 tablet_bootstrap.cc:654] T 9434d106c0374b5d928cc00f109846ce P 943634a8539f44a8969b8503616b09d6: Neither blocks nor log segments found. Creating new log.
I20260201 02:55:36.710278 14506 tablet_bootstrap.cc:492] T 9434d106c0374b5d928cc00f109846ce P 943634a8539f44a8969b8503616b09d6: No bootstrap required, opened a new log
I20260201 02:55:36.710239 14030 catalog_manager.cc:5654] T 1abdef8b45334d908fa08ec613374a3b P 943634a8539f44a8969b8503616b09d6 reported cstate change: term changed from 1 to 2, leader changed from 20beda53b20146fb90018bf4533dcd58 (127.13.170.1) to 943634a8539f44a8969b8503616b09d6 (127.13.170.2). New cstate: current_term: 2 leader_uuid: "943634a8539f44a8969b8503616b09d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } health_report { overall_health: UNKNOWN } } }
I20260201 02:55:36.710532 14506 ts_tablet_manager.cc:1403] T 9434d106c0374b5d928cc00f109846ce P 943634a8539f44a8969b8503616b09d6: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260201 02:55:36.711546 14506 raft_consensus.cc:359] T 9434d106c0374b5d928cc00f109846ce P 943634a8539f44a8969b8503616b09d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:55:36.711833 14506 raft_consensus.cc:385] T 9434d106c0374b5d928cc00f109846ce P 943634a8539f44a8969b8503616b09d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 02:55:36.711963 14506 raft_consensus.cc:740] T 9434d106c0374b5d928cc00f109846ce P 943634a8539f44a8969b8503616b09d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 943634a8539f44a8969b8503616b09d6, State: Initialized, Role: FOLLOWER
I20260201 02:55:36.711946 14031 catalog_manager.cc:5654] T af28911fb32b478b88b6779c6f0dc08f P 74bc17a87c2342958617c01904a29dac reported cstate change: term changed from 0 to 1, leader changed from <none> to 74bc17a87c2342958617c01904a29dac (127.13.170.3). New cstate: current_term: 1 leader_uuid: "74bc17a87c2342958617c01904a29dac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } health_report { overall_health: UNKNOWN } } }
I20260201 02:55:36.712301 14506 consensus_queue.cc:260] T 9434d106c0374b5d928cc00f109846ce P 943634a8539f44a8969b8503616b09d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:55:36.712930 14506 ts_tablet_manager.cc:1434] T 9434d106c0374b5d928cc00f109846ce P 943634a8539f44a8969b8503616b09d6: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260201 02:55:36.713292 14506 tablet_bootstrap.cc:492] T af28911fb32b478b88b6779c6f0dc08f P 943634a8539f44a8969b8503616b09d6: Bootstrap starting.
I20260201 02:55:36.715240 14506 tablet_bootstrap.cc:654] T af28911fb32b478b88b6779c6f0dc08f P 943634a8539f44a8969b8503616b09d6: Neither blocks nor log segments found. Creating new log.
I20260201 02:55:36.718276 14506 tablet_bootstrap.cc:492] T af28911fb32b478b88b6779c6f0dc08f P 943634a8539f44a8969b8503616b09d6: No bootstrap required, opened a new log
I20260201 02:55:36.718447 14506 ts_tablet_manager.cc:1403] T af28911fb32b478b88b6779c6f0dc08f P 943634a8539f44a8969b8503616b09d6: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260201 02:55:36.718611 14030 catalog_manager.cc:5654] T 535b6fc9826f436089318f329dad0f4d P 74bc17a87c2342958617c01904a29dac reported cstate change: term changed from 0 to 1, leader changed from <none> to 74bc17a87c2342958617c01904a29dac (127.13.170.3). New cstate: current_term: 1 leader_uuid: "74bc17a87c2342958617c01904a29dac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } health_report { overall_health: HEALTHY } } }
I20260201 02:55:36.719307 14506 raft_consensus.cc:359] T af28911fb32b478b88b6779c6f0dc08f P 943634a8539f44a8969b8503616b09d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } }
I20260201 02:55:36.719491 14506 raft_consensus.cc:385] T af28911fb32b478b88b6779c6f0dc08f P 943634a8539f44a8969b8503616b09d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 02:55:36.719570 14506 raft_consensus.cc:740] T af28911fb32b478b88b6779c6f0dc08f P 943634a8539f44a8969b8503616b09d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 943634a8539f44a8969b8503616b09d6, State: Initialized, Role: FOLLOWER
I20260201 02:55:36.719797 14506 consensus_queue.cc:260] T af28911fb32b478b88b6779c6f0dc08f P 943634a8539f44a8969b8503616b09d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } }
I20260201 02:55:36.720983 14506 ts_tablet_manager.cc:1434] T af28911fb32b478b88b6779c6f0dc08f P 943634a8539f44a8969b8503616b09d6: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260201 02:55:36.730739 13992 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskfoNO09/build/asan/bin/kudu
/tmp/dist-test-taskfoNO09/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.170.4:0
--local_ip_for_outbound_sockets=127.13.170.4
--webserver_interface=127.13.170.4
--webserver_port=0
--tserver_master_addrs=127.13.170.62:35377
--builtin_ntp_servers=127.13.170.20:41761
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--follower_unavailable_considered_failed_sec=2
--enable_log_gc=false with env {}
I20260201 02:55:36.739041 14522 raft_consensus.cc:493] T af28911fb32b478b88b6779c6f0dc08f P 943634a8539f44a8969b8503616b09d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 02:55:36.739282 14522 raft_consensus.cc:515] T af28911fb32b478b88b6779c6f0dc08f P 943634a8539f44a8969b8503616b09d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } }
I20260201 02:55:36.740111 14522 leader_election.cc:290] T af28911fb32b478b88b6779c6f0dc08f P 943634a8539f44a8969b8503616b09d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74bc17a87c2342958617c01904a29dac (127.13.170.3:45403), 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225)
I20260201 02:55:36.740727 14432 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "af28911fb32b478b88b6779c6f0dc08f" candidate_uuid: "943634a8539f44a8969b8503616b09d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74bc17a87c2342958617c01904a29dac" is_pre_election: true
I20260201 02:55:36.741139 14171 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "af28911fb32b478b88b6779c6f0dc08f" candidate_uuid: "943634a8539f44a8969b8503616b09d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20beda53b20146fb90018bf4533dcd58" is_pre_election: true
I20260201 02:55:36.741421 14171 raft_consensus.cc:2393] T af28911fb32b478b88b6779c6f0dc08f P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 943634a8539f44a8969b8503616b09d6 in current term 1: Already voted for candidate 74bc17a87c2342958617c01904a29dac in this term.
I20260201 02:55:36.742046 14238 leader_election.cc:304] T af28911fb32b478b88b6779c6f0dc08f P 943634a8539f44a8969b8503616b09d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 943634a8539f44a8969b8503616b09d6; no voters: 20beda53b20146fb90018bf4533dcd58, 74bc17a87c2342958617c01904a29dac
I20260201 02:55:36.742631 14522 raft_consensus.cc:3060] T af28911fb32b478b88b6779c6f0dc08f P 943634a8539f44a8969b8503616b09d6 [term 0 FOLLOWER]: Advancing to term 1
I20260201 02:55:36.748373 14522 raft_consensus.cc:2749] T af28911fb32b478b88b6779c6f0dc08f P 943634a8539f44a8969b8503616b09d6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 02:55:36.757045 14505 consensus_queue.cc:1048] T 7b2f386887ef4ab0a692195c4f968c12 P 20beda53b20146fb90018bf4533dcd58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 02:55:36.764248 14505 consensus_queue.cc:1048] T 7b2f386887ef4ab0a692195c4f968c12 P 20beda53b20146fb90018bf4533dcd58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 02:55:36.770011 14522 consensus_queue.cc:1048] T 7519edb327894747a21ff97e8a90f2f9 P 943634a8539f44a8969b8503616b09d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 02:55:36.772396 14507 consensus_queue.cc:1048] T af28911fb32b478b88b6779c6f0dc08f P 74bc17a87c2342958617c01904a29dac [LEADER]: Connected to new peer: Peer: permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 02:55:36.778477 14522 raft_consensus.cc:493] T 9434d106c0374b5d928cc00f109846ce P 943634a8539f44a8969b8503616b09d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 02:55:36.778751 14522 raft_consensus.cc:515] T 9434d106c0374b5d928cc00f109846ce P 943634a8539f44a8969b8503616b09d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:55:36.779549 14522 leader_election.cc:290] T 9434d106c0374b5d928cc00f109846ce P 943634a8539f44a8969b8503616b09d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225), 74bc17a87c2342958617c01904a29dac (127.13.170.3:45403)
I20260201 02:55:36.780390 14172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9434d106c0374b5d928cc00f109846ce" candidate_uuid: "943634a8539f44a8969b8503616b09d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20beda53b20146fb90018bf4533dcd58" is_pre_election: true
I20260201 02:55:36.781263 14507 consensus_queue.cc:1048] T 535b6fc9826f436089318f329dad0f4d P 74bc17a87c2342958617c01904a29dac [LEADER]: Connected to new peer: Peer: permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 02:55:36.781814 14431 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9434d106c0374b5d928cc00f109846ce" candidate_uuid: "943634a8539f44a8969b8503616b09d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74bc17a87c2342958617c01904a29dac" is_pre_election: true
I20260201 02:55:36.782243 14431 raft_consensus.cc:2393] T 9434d106c0374b5d928cc00f109846ce P 74bc17a87c2342958617c01904a29dac [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 943634a8539f44a8969b8503616b09d6 in current term 1: Already voted for candidate 20beda53b20146fb90018bf4533dcd58 in this term.
I20260201 02:55:36.782918 14239 leader_election.cc:304] T 9434d106c0374b5d928cc00f109846ce P 943634a8539f44a8969b8503616b09d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 943634a8539f44a8969b8503616b09d6; no voters: 20beda53b20146fb90018bf4533dcd58, 74bc17a87c2342958617c01904a29dac
I20260201 02:55:36.783614 14518 raft_consensus.cc:3060] T 9434d106c0374b5d928cc00f109846ce P 943634a8539f44a8969b8503616b09d6 [term 0 FOLLOWER]: Advancing to term 1
I20260201 02:55:36.792852 14531 consensus_queue.cc:1048] T 535b6fc9826f436089318f329dad0f4d P 74bc17a87c2342958617c01904a29dac [LEADER]: Connected to new peer: Peer: permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 02:55:36.796162 14518 raft_consensus.cc:2749] T 9434d106c0374b5d928cc00f109846ce P 943634a8539f44a8969b8503616b09d6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 02:55:36.797549 14505 consensus_queue.cc:1048] T 9434d106c0374b5d928cc00f109846ce P 20beda53b20146fb90018bf4533dcd58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 02:55:36.798249 14431 raft_consensus.cc:1275] T 1abdef8b45334d908fa08ec613374a3b P 74bc17a87c2342958617c01904a29dac [term 2 FOLLOWER]: Refusing update from remote peer 943634a8539f44a8969b8503616b09d6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260201 02:55:36.799481 14505 consensus_queue.cc:1048] T 9434d106c0374b5d928cc00f109846ce P 20beda53b20146fb90018bf4533dcd58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 02:55:36.800545 14522 consensus_queue.cc:1048] T 1abdef8b45334d908fa08ec613374a3b P 943634a8539f44a8969b8503616b09d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 02:55:36.813872 14531 consensus_queue.cc:1048] T af28911fb32b478b88b6779c6f0dc08f P 74bc17a87c2342958617c01904a29dac [LEADER]: Connected to new peer: Peer: permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260201 02:55:36.827433 14349 tablet.cc:2378] T 1abdef8b45334d908fa08ec613374a3b P 943634a8539f44a8969b8503616b09d6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260201 02:55:36.846515 14170 raft_consensus.cc:1275] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58 [term 2 FOLLOWER]: Refusing update from remote peer 943634a8539f44a8969b8503616b09d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260201 02:55:36.846730 14170 pending_rounds.cc:85] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58: Aborting all ops after (but not including) 0
I20260201 02:55:36.846918 14170 pending_rounds.cc:107] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260201 02:55:36.847031 14170 raft_consensus.cc:2889] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 02:55:36.848255 14522 consensus_queue.cc:1048] T 7519edb327894747a21ff97e8a90f2f9 P 943634a8539f44a8969b8503616b09d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 02:55:36.849033 14522 consensus_queue.cc:1048] T 1abdef8b45334d908fa08ec613374a3b P 943634a8539f44a8969b8503616b09d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260201 02:55:37.779239 14546 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260201 02:55:37.779737 14546 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260201 02:55:37.779857 14546 flags.cc:425] Enabled unsafe flag: --enable_log_gc=false
W20260201 02:55:37.779963 14546 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260201 02:55:37.796772 14546 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260201 02:55:37.797078 14546 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.170.4
I20260201 02:55:37.820928 14546 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.170.20:41761
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=2
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.170.4:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-3/data/info.pb
--webserver_interface=127.13.170.4
--webserver_port=0
--enable_log_gc=false
--tserver_master_addrs=127.13.170.62:35377
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.170.4
--log_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-3/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3722ed49c19ce54c7feae2fa944e32b1d4ed8d2d
build type FASTDEBUG
built by None at 01 Feb 2026 02:43:22 UTC on 24a791456cd2
build id 10288
ASAN enabled
I20260201 02:55:37.823709 14546 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260201 02:55:37.828382 14546 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 02:55:38.056354 14600 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 02:55:38.112355 14546 server_base.cc:1060] running on GCE node
W20260201 02:55:38.132849 14601 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 02:55:38.184384 14603 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 02:55:38.204094 14546 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260201 02:55:38.321153 14546 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260201 02:55:38.407238 14546 hybrid_clock.cc:648] HybridClock initialized: now 1769914538407047 us; error 156 us; skew 500 ppm
I20260201 02:55:38.410125 14546 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 02:55:38.437924 14546 webserver.cc:492] Webserver started at http://127.13.170.4:46681/ using document root <none> and password file <none>
I20260201 02:55:38.439239 14546 fs_manager.cc:362] Metadata directory not provided
I20260201 02:55:38.439486 14546 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 02:55:38.440097 14546 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 02:55:38.443593 14546 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-3/data/instance:
uuid: "e5c7c83542c74b66b44ee29fdcc2a847"
format_stamp: "Formatted at 2026-02-01 02:55:38 on dist-test-slave-4krj"
I20260201 02:55:38.444903 14546 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-3/wal/instance:
uuid: "e5c7c83542c74b66b44ee29fdcc2a847"
format_stamp: "Formatted at 2026-02-01 02:55:38 on dist-test-slave-4krj"
I20260201 02:55:38.473531 14546 fs_manager.cc:696] Time spent creating directory manager: real 0.027s user 0.008s sys 0.004s
I20260201 02:55:38.707635 14611 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 02:55:38.732216 14546 fs_manager.cc:730] Time spent opening block manager: real 0.255s user 0.070s sys 0.112s
I20260201 02:55:38.732484 14546 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-3/data,/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-3/wal
uuid: "e5c7c83542c74b66b44ee29fdcc2a847"
format_stamp: "Formatted at 2026-02-01 02:55:38 on dist-test-slave-4krj"
I20260201 02:55:38.732771 14546 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-3/wal
metadata directory: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-3/wal
1 data directories: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 02:55:38.824193 14546 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 02:55:38.825232 14546 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260201 02:55:38.826092 14546 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 02:55:38.833612 14546 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260201 02:55:38.839629 14546 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260201 02:55:38.839728 14546 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260201 02:55:38.839864 14546 ts_tablet_manager.cc:616] Registered 0 tablets
I20260201 02:55:38.839927 14546 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260201 02:55:40.778594 14546 rpc_server.cc:307] RPC server started. Bound to: 127.13.170.4:41583
I20260201 02:55:40.780869 14546 server_base.cc:1192] Dumped server information to /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-3/data/info.pb
I20260201 02:55:40.778621 14730 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.170.4:41583 every 8 connection(s)
I20260201 02:55:40.790535 13992 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskfoNO09/build/asan/bin/kudu as pid 14546
I20260201 02:55:40.790784 13992 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-3/wal/instance
I20260201 02:55:40.842875 14731 heartbeater.cc:344] Connected to a master server at 127.13.170.62:35377
I20260201 02:55:40.843348 14731 heartbeater.cc:461] Registering TS with master...
I20260201 02:55:40.844650 14731 heartbeater.cc:507] Master 127.13.170.62:35377 requested a full tablet report, sending...
I20260201 02:55:40.867173 14027 ts_manager.cc:194] Registered new tserver with Master: e5c7c83542c74b66b44ee29fdcc2a847 (127.13.170.4:41583)
I20260201 02:55:40.868443 14027 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.13.170.4:48867
I20260201 02:55:41.664093 14027 ts_manager.cc:295] Set tserver state for 20beda53b20146fb90018bf4533dcd58 to MAINTENANCE_MODE
I20260201 02:55:41.665372 13992 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-taskfoNO09/build/asan/bin/kudu pid 14090
I20260201 02:55:41.667608 14212 generic_service.cc:196] Checking for leaks (request via RPC)
I20260201 02:55:41.878782 14731 heartbeater.cc:499] Master 127.13.170.62:35377 was elected leader, sending a full tablet report...
I20260201 02:55:41.883351 13992 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskfoNO09/build/asan/bin/kudu with pid 14090
W20260201 02:55:41.909654 14488 connection.cc:537] client connection to 127.13.170.1:36225 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260201 02:55:41.909762 14238 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.13.170.1:36225 (error 108)
W20260201 02:55:41.909986 14488 meta_cache.cc:302] tablet 9434d106c0374b5d928cc00f109846ce: replica 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225) has failed: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260201 02:55:41.910864 14368 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.13.170.1:36225 (error 108)
W20260201 02:55:41.912387 14238 consensus_peers.cc:597] T 7519edb327894747a21ff97e8a90f2f9 P 943634a8539f44a8969b8503616b09d6 -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260201 02:55:41.912511 14238 consensus_peers.cc:597] T 1abdef8b45334d908fa08ec613374a3b P 943634a8539f44a8969b8503616b09d6 -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260201 02:55:41.912770 14368 consensus_peers.cc:597] T af28911fb32b478b88b6779c6f0dc08f P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260201 02:55:41.912925 14368 consensus_peers.cc:597] T 535b6fc9826f436089318f329dad0f4d P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260201 02:55:41.914039 14257 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60558: Illegal state: replica 943634a8539f44a8969b8503616b09d6 is not leader of this config: current role FOLLOWER
W20260201 02:55:41.916294 14257 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60558: Illegal state: replica 943634a8539f44a8969b8503616b09d6 is not leader of this config: current role FOLLOWER
W20260201 02:55:41.916409 14258 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60558: Illegal state: replica 943634a8539f44a8969b8503616b09d6 is not leader of this config: current role FOLLOWER
W20260201 02:55:41.917711 14258 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60558: Illegal state: replica 943634a8539f44a8969b8503616b09d6 is not leader of this config: current role FOLLOWER
W20260201 02:55:41.917795 14257 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60558: Illegal state: replica 943634a8539f44a8969b8503616b09d6 is not leader of this config: current role FOLLOWER
W20260201 02:55:41.917994 14262 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60558: Illegal state: replica 943634a8539f44a8969b8503616b09d6 is not leader of this config: current role FOLLOWER
W20260201 02:55:41.922286 14390 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59330: Illegal state: replica 74bc17a87c2342958617c01904a29dac is not leader of this config: current role FOLLOWER
W20260201 02:55:41.922339 14388 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59330: Illegal state: replica 74bc17a87c2342958617c01904a29dac is not leader of this config: current role FOLLOWER
W20260201 02:55:41.922384 14391 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59330: Illegal state: replica 74bc17a87c2342958617c01904a29dac is not leader of this config: current role FOLLOWER
W20260201 02:55:41.922463 14389 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59330: Illegal state: replica 74bc17a87c2342958617c01904a29dac is not leader of this config: current role FOLLOWER
W20260201 02:55:41.924088 14390 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59330: Illegal state: replica 74bc17a87c2342958617c01904a29dac is not leader of this config: current role FOLLOWER
W20260201 02:55:41.937796 14262 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60558: Illegal state: replica 943634a8539f44a8969b8503616b09d6 is not leader of this config: current role FOLLOWER
W20260201 02:55:41.939373 14262 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60558: Illegal state: replica 943634a8539f44a8969b8503616b09d6 is not leader of this config: current role FOLLOWER
W20260201 02:55:41.939463 14257 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60558: Illegal state: replica 943634a8539f44a8969b8503616b09d6 is not leader of this config: current role FOLLOWER
W20260201 02:55:41.941006 14262 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60558: Illegal state: replica 943634a8539f44a8969b8503616b09d6 is not leader of this config: current role FOLLOWER
W20260201 02:55:41.946884 14262 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60558: Illegal state: replica 943634a8539f44a8969b8503616b09d6 is not leader of this config: current role FOLLOWER
W20260201 02:55:41.947101 14390 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59330: Illegal state: replica 74bc17a87c2342958617c01904a29dac is not leader of this config: current role FOLLOWER
W20260201 02:55:41.948742 14390 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59330: Illegal state: replica 74bc17a87c2342958617c01904a29dac is not leader of this config: current role FOLLOWER
W20260201 02:55:41.948972 14391 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59330: Illegal state: replica 74bc17a87c2342958617c01904a29dac is not leader of this config: current role FOLLOWER
W20260201 02:55:41.949199 14388 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59330: Illegal state: replica 74bc17a87c2342958617c01904a29dac is not leader of this config: current role FOLLOWER
W20260201 02:55:41.958729 14388 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59330: Illegal state: replica 74bc17a87c2342958617c01904a29dac is not leader of this config: current role FOLLOWER
W20260201 02:55:41.960276 14262 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60558: Illegal state: replica 943634a8539f44a8969b8503616b09d6 is not leader of this config: current role FOLLOWER
W20260201 02:55:41.968592 14262 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60558: Illegal state: replica 943634a8539f44a8969b8503616b09d6 is not leader of this config: current role FOLLOWER
W20260201 02:55:41.969651 14257 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60558: Illegal state: replica 943634a8539f44a8969b8503616b09d6 is not leader of this config: current role FOLLOWER
W20260201 02:55:41.970919 14257 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60558: Illegal state: replica 943634a8539f44a8969b8503616b09d6 is not leader of this config: current role FOLLOWER
W20260201 02:55:41.972543 14388 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59330: Illegal state: replica 74bc17a87c2342958617c01904a29dac is not leader of this config: current role FOLLOWER
I20260201 02:55:41.976827 14719 raft_consensus.cc:493] T 7b2f386887ef4ab0a692195c4f968c12 P 943634a8539f44a8969b8503616b09d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20beda53b20146fb90018bf4533dcd58)
I20260201 02:55:41.977030 14719 raft_consensus.cc:515] T 7b2f386887ef4ab0a692195c4f968c12 P 943634a8539f44a8969b8503616b09d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:55:41.977825 14719 leader_election.cc:290] T 7b2f386887ef4ab0a692195c4f968c12 P 943634a8539f44a8969b8503616b09d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225), 74bc17a87c2342958617c01904a29dac (127.13.170.3:45403)
I20260201 02:55:41.978998 14433 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b2f386887ef4ab0a692195c4f968c12" candidate_uuid: "943634a8539f44a8969b8503616b09d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 168 } } ignore_live_leader: false dest_uuid: "74bc17a87c2342958617c01904a29dac" is_pre_election: true
W20260201 02:55:41.979804 14388 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59330: Illegal state: replica 74bc17a87c2342958617c01904a29dac is not leader of this config: current role FOLLOWER
W20260201 02:55:41.979725 14238 leader_election.cc:336] T 7b2f386887ef4ab0a692195c4f968c12 P 943634a8539f44a8969b8503616b09d6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111)
I20260201 02:55:41.980281 14239 leader_election.cc:304] T 7b2f386887ef4ab0a692195c4f968c12 P 943634a8539f44a8969b8503616b09d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 943634a8539f44a8969b8503616b09d6; no voters: 20beda53b20146fb90018bf4533dcd58, 74bc17a87c2342958617c01904a29dac
I20260201 02:55:41.980602 14719 raft_consensus.cc:2749] T 7b2f386887ef4ab0a692195c4f968c12 P 943634a8539f44a8969b8503616b09d6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 02:55:41.984781 14592 raft_consensus.cc:493] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20beda53b20146fb90018bf4533dcd58)
W20260201 02:55:41.984737 14388 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59330: Illegal state: replica 74bc17a87c2342958617c01904a29dac is not leader of this config: current role FOLLOWER
W20260201 02:55:41.984740 14391 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59330: Illegal state: replica 74bc17a87c2342958617c01904a29dac is not leader of this config: current role FOLLOWER
I20260201 02:55:41.985018 14592 raft_consensus.cc:515] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:55:41.985808 14592 leader_election.cc:290] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225), 943634a8539f44a8969b8503616b09d6 (127.13.170.2:41045)
W20260201 02:55:41.986464 14390 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59330: Illegal state: replica 74bc17a87c2342958617c01904a29dac is not leader of this config: current role FOLLOWER
I20260201 02:55:41.987488 14302 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b2f386887ef4ab0a692195c4f968c12" candidate_uuid: "74bc17a87c2342958617c01904a29dac" candidate_term: 2 candidate_status { last_received { term: 1 index: 169 } } ignore_live_leader: false dest_uuid: "943634a8539f44a8969b8503616b09d6" is_pre_election: true
I20260201 02:55:41.987751 14302 raft_consensus.cc:2468] T 7b2f386887ef4ab0a692195c4f968c12 P 943634a8539f44a8969b8503616b09d6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74bc17a87c2342958617c01904a29dac in term 1.
I20260201 02:55:41.988183 14369 leader_election.cc:304] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74bc17a87c2342958617c01904a29dac, 943634a8539f44a8969b8503616b09d6; no voters:
I20260201 02:55:41.988476 14589 raft_consensus.cc:2804] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 02:55:41.988583 14589 raft_consensus.cc:493] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac [term 1 FOLLOWER]: Starting leader election (detected failure of leader 20beda53b20146fb90018bf4533dcd58)
I20260201 02:55:41.988719 14589 raft_consensus.cc:3060] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac [term 1 FOLLOWER]: Advancing to term 2
W20260201 02:55:41.988853 14368 leader_election.cc:336] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111)
I20260201 02:55:41.991182 14719 raft_consensus.cc:493] T 9434d106c0374b5d928cc00f109846ce P 943634a8539f44a8969b8503616b09d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20beda53b20146fb90018bf4533dcd58)
I20260201 02:55:41.991339 14589 raft_consensus.cc:515] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:55:41.991379 14719 raft_consensus.cc:515] T 9434d106c0374b5d928cc00f109846ce P 943634a8539f44a8969b8503616b09d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:55:41.992075 14589 leader_election.cc:290] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac [CANDIDATE]: Term 2 election: Requested vote from peers 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225), 943634a8539f44a8969b8503616b09d6 (127.13.170.2:41045)
I20260201 02:55:41.992100 14719 leader_election.cc:290] T 9434d106c0374b5d928cc00f109846ce P 943634a8539f44a8969b8503616b09d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225), 74bc17a87c2342958617c01904a29dac (127.13.170.3:45403)
I20260201 02:55:41.992899 14303 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b2f386887ef4ab0a692195c4f968c12" candidate_uuid: "74bc17a87c2342958617c01904a29dac" candidate_term: 2 candidate_status { last_received { term: 1 index: 169 } } ignore_live_leader: false dest_uuid: "943634a8539f44a8969b8503616b09d6"
I20260201 02:55:41.993160 14303 raft_consensus.cc:3060] T 7b2f386887ef4ab0a692195c4f968c12 P 943634a8539f44a8969b8503616b09d6 [term 1 FOLLOWER]: Advancing to term 2
I20260201 02:55:41.993530 14433 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9434d106c0374b5d928cc00f109846ce" candidate_uuid: "943634a8539f44a8969b8503616b09d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 169 } } ignore_live_leader: false dest_uuid: "74bc17a87c2342958617c01904a29dac" is_pre_election: true
W20260201 02:55:41.993757 14238 leader_election.cc:336] T 9434d106c0374b5d928cc00f109846ce P 943634a8539f44a8969b8503616b09d6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111)
I20260201 02:55:41.994177 14239 leader_election.cc:304] T 9434d106c0374b5d928cc00f109846ce P 943634a8539f44a8969b8503616b09d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 943634a8539f44a8969b8503616b09d6; no voters: 20beda53b20146fb90018bf4533dcd58, 74bc17a87c2342958617c01904a29dac
I20260201 02:55:41.994488 14719 raft_consensus.cc:2749] T 9434d106c0374b5d928cc00f109846ce P 943634a8539f44a8969b8503616b09d6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260201 02:55:41.994731 14368 leader_election.cc:336] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111)
I20260201 02:55:41.995939 14303 raft_consensus.cc:2468] T 7b2f386887ef4ab0a692195c4f968c12 P 943634a8539f44a8969b8503616b09d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74bc17a87c2342958617c01904a29dac in term 2.
I20260201 02:55:41.996762 14369 leader_election.cc:304] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74bc17a87c2342958617c01904a29dac, 943634a8539f44a8969b8503616b09d6; no voters: 20beda53b20146fb90018bf4533dcd58
I20260201 02:55:41.997376 14589 raft_consensus.cc:2804] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac [term 2 FOLLOWER]: Leader election won for term 2
I20260201 02:55:41.997663 14589 raft_consensus.cc:697] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac [term 2 LEADER]: Becoming Leader. State: Replica: 74bc17a87c2342958617c01904a29dac, State: Running, Role: LEADER
I20260201 02:55:41.997973 14589 consensus_queue.cc:237] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 169, Committed index: 169, Last appended: 1.169, Last appended by leader: 169, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:55:42.000476 14027 catalog_manager.cc:5654] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac reported cstate change: term changed from 1 to 2, leader changed from 20beda53b20146fb90018bf4533dcd58 (127.13.170.1) to 74bc17a87c2342958617c01904a29dac (127.13.170.3). New cstate: current_term: 2 leader_uuid: "74bc17a87c2342958617c01904a29dac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } health_report { overall_health: HEALTHY } } }
I20260201 02:55:42.002023 14589 raft_consensus.cc:493] T 9434d106c0374b5d928cc00f109846ce P 74bc17a87c2342958617c01904a29dac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20beda53b20146fb90018bf4533dcd58)
I20260201 02:55:42.002257 14589 raft_consensus.cc:515] T 9434d106c0374b5d928cc00f109846ce P 74bc17a87c2342958617c01904a29dac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:55:42.003067 14589 leader_election.cc:290] T 9434d106c0374b5d928cc00f109846ce P 74bc17a87c2342958617c01904a29dac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225), 943634a8539f44a8969b8503616b09d6 (127.13.170.2:41045)
W20260201 02:55:42.003903 14257 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60558: Illegal state: replica 943634a8539f44a8969b8503616b09d6 is not leader of this config: current role FOLLOWER
I20260201 02:55:42.004027 14303 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9434d106c0374b5d928cc00f109846ce" candidate_uuid: "74bc17a87c2342958617c01904a29dac" candidate_term: 2 candidate_status { last_received { term: 1 index: 170 } } ignore_live_leader: false dest_uuid: "943634a8539f44a8969b8503616b09d6" is_pre_election: true
I20260201 02:55:42.004249 14303 raft_consensus.cc:2468] T 9434d106c0374b5d928cc00f109846ce P 943634a8539f44a8969b8503616b09d6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74bc17a87c2342958617c01904a29dac in term 1.
I20260201 02:55:42.005695 14369 leader_election.cc:304] T 9434d106c0374b5d928cc00f109846ce P 74bc17a87c2342958617c01904a29dac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74bc17a87c2342958617c01904a29dac, 943634a8539f44a8969b8503616b09d6; no voters:
W20260201 02:55:42.006042 14368 leader_election.cc:336] T 9434d106c0374b5d928cc00f109846ce P 74bc17a87c2342958617c01904a29dac [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111)
I20260201 02:55:42.006078 14589 raft_consensus.cc:2804] T 9434d106c0374b5d928cc00f109846ce P 74bc17a87c2342958617c01904a29dac [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 02:55:42.006222 14589 raft_consensus.cc:493] T 9434d106c0374b5d928cc00f109846ce P 74bc17a87c2342958617c01904a29dac [term 1 FOLLOWER]: Starting leader election (detected failure of leader 20beda53b20146fb90018bf4533dcd58)
I20260201 02:55:42.006356 14589 raft_consensus.cc:3060] T 9434d106c0374b5d928cc00f109846ce P 74bc17a87c2342958617c01904a29dac [term 1 FOLLOWER]: Advancing to term 2
I20260201 02:55:42.008605 14589 raft_consensus.cc:515] T 9434d106c0374b5d928cc00f109846ce P 74bc17a87c2342958617c01904a29dac [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:55:42.009405 14589 leader_election.cc:290] T 9434d106c0374b5d928cc00f109846ce P 74bc17a87c2342958617c01904a29dac [CANDIDATE]: Term 2 election: Requested vote from peers 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225), 943634a8539f44a8969b8503616b09d6 (127.13.170.2:41045)
I20260201 02:55:42.010095 14303 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9434d106c0374b5d928cc00f109846ce" candidate_uuid: "74bc17a87c2342958617c01904a29dac" candidate_term: 2 candidate_status { last_received { term: 1 index: 170 } } ignore_live_leader: false dest_uuid: "943634a8539f44a8969b8503616b09d6"
I20260201 02:55:42.010434 14303 raft_consensus.cc:3060] T 9434d106c0374b5d928cc00f109846ce P 943634a8539f44a8969b8503616b09d6 [term 1 FOLLOWER]: Advancing to term 2
W20260201 02:55:42.011054 14368 leader_election.cc:336] T 9434d106c0374b5d928cc00f109846ce P 74bc17a87c2342958617c01904a29dac [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111)
I20260201 02:55:42.012993 14303 raft_consensus.cc:2468] T 9434d106c0374b5d928cc00f109846ce P 943634a8539f44a8969b8503616b09d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74bc17a87c2342958617c01904a29dac in term 2.
W20260201 02:55:42.013238 14257 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60558: Illegal state: replica 943634a8539f44a8969b8503616b09d6 is not leader of this config: current role FOLLOWER
I20260201 02:55:42.013621 14369 leader_election.cc:304] T 9434d106c0374b5d928cc00f109846ce P 74bc17a87c2342958617c01904a29dac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74bc17a87c2342958617c01904a29dac, 943634a8539f44a8969b8503616b09d6; no voters: 20beda53b20146fb90018bf4533dcd58
I20260201 02:55:42.014014 14589 raft_consensus.cc:2804] T 9434d106c0374b5d928cc00f109846ce P 74bc17a87c2342958617c01904a29dac [term 2 FOLLOWER]: Leader election won for term 2
W20260201 02:55:42.014875 14257 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60558: Illegal state: replica 943634a8539f44a8969b8503616b09d6 is not leader of this config: current role FOLLOWER
I20260201 02:55:42.015290 14589 raft_consensus.cc:697] T 9434d106c0374b5d928cc00f109846ce P 74bc17a87c2342958617c01904a29dac [term 2 LEADER]: Becoming Leader. State: Replica: 74bc17a87c2342958617c01904a29dac, State: Running, Role: LEADER
I20260201 02:55:42.015628 14589 consensus_queue.cc:237] T 9434d106c0374b5d928cc00f109846ce P 74bc17a87c2342958617c01904a29dac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 169, Committed index: 169, Last appended: 1.170, Last appended by leader: 170, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
W20260201 02:55:42.016518 14257 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60558: Illegal state: replica 943634a8539f44a8969b8503616b09d6 is not leader of this config: current role FOLLOWER
I20260201 02:55:42.018589 14303 raft_consensus.cc:1275] T 7b2f386887ef4ab0a692195c4f968c12 P 943634a8539f44a8969b8503616b09d6 [term 2 FOLLOWER]: Refusing update from remote peer 74bc17a87c2342958617c01904a29dac: Log matching property violated. Preceding OpId in replica: term: 1 index: 168. Preceding OpId from leader: term: 2 index: 171. (index mismatch)
I20260201 02:55:42.019171 14592 consensus_queue.cc:1048] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac [LEADER]: Connected to new peer: Peer: permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 170, Last known committed idx: 167, Time since last communication: 0.000s
I20260201 02:55:42.019958 14027 catalog_manager.cc:5654] T 9434d106c0374b5d928cc00f109846ce P 74bc17a87c2342958617c01904a29dac reported cstate change: term changed from 1 to 2, leader changed from 20beda53b20146fb90018bf4533dcd58 (127.13.170.1) to 74bc17a87c2342958617c01904a29dac (127.13.170.3). New cstate: current_term: 2 leader_uuid: "74bc17a87c2342958617c01904a29dac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } health_report { overall_health: HEALTHY } } }
W20260201 02:55:42.023947 14368 consensus_peers.cc:597] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260201 02:55:42.030123 14303 raft_consensus.cc:1275] T 9434d106c0374b5d928cc00f109846ce P 943634a8539f44a8969b8503616b09d6 [term 2 FOLLOWER]: Refusing update from remote peer 74bc17a87c2342958617c01904a29dac: Log matching property violated. Preceding OpId in replica: term: 1 index: 169. Preceding OpId from leader: term: 2 index: 172. (index mismatch)
I20260201 02:55:42.030789 14743 consensus_queue.cc:1048] T 9434d106c0374b5d928cc00f109846ce P 74bc17a87c2342958617c01904a29dac [LEADER]: Connected to new peer: Peer: permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 171, Last known committed idx: 169, Time since last communication: 0.000s
W20260201 02:55:42.032631 14368 consensus_peers.cc:597] T 9434d106c0374b5d928cc00f109846ce P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260201 02:55:42.037855 14551 mvcc.cc:204] Tried to move back new op lower bound from 7249569964150480896 to 7249569964103344128. Current Snapshot: MvccSnapshot[applied={T|T < 7249569962802659328}]
I20260201 02:55:42.040429 14560 mvcc.cc:204] Tried to move back new op lower bound from 7249569964150480896 to 7249569964103344128. Current Snapshot: MvccSnapshot[applied={T|T < 7249569964150480896 or (T in {7249569964150480896})}]
W20260201 02:55:42.364984 14238 consensus_peers.cc:597] T 7519edb327894747a21ff97e8a90f2f9 P 943634a8539f44a8969b8503616b09d6 -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260201 02:55:42.410408 14368 consensus_peers.cc:597] T af28911fb32b478b88b6779c6f0dc08f P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260201 02:55:42.412607 14238 consensus_peers.cc:597] T 1abdef8b45334d908fa08ec613374a3b P 943634a8539f44a8969b8503616b09d6 -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260201 02:55:42.449082 14368 consensus_peers.cc:597] T 535b6fc9826f436089318f329dad0f4d P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260201 02:55:42.546070 14368 consensus_peers.cc:597] T 9434d106c0374b5d928cc00f109846ce P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260201 02:55:42.558833 14368 consensus_peers.cc:597] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260201 02:55:42.868461 14238 consensus_peers.cc:597] T 7519edb327894747a21ff97e8a90f2f9 P 943634a8539f44a8969b8503616b09d6 -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260201 02:55:42.921125 14238 consensus_peers.cc:597] T 1abdef8b45334d908fa08ec613374a3b P 943634a8539f44a8969b8503616b09d6 -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260201 02:55:42.926235 14368 consensus_peers.cc:597] T af28911fb32b478b88b6779c6f0dc08f P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260201 02:55:42.943112 14368 consensus_peers.cc:597] T 535b6fc9826f436089318f329dad0f4d P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260201 02:55:42.988111 14368 consensus_peers.cc:597] T 9434d106c0374b5d928cc00f109846ce P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260201 02:55:43.071118 14368 consensus_peers.cc:597] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260201 02:55:43.407335 14238 consensus_peers.cc:597] T 7519edb327894747a21ff97e8a90f2f9 P 943634a8539f44a8969b8503616b09d6 -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260201 02:55:43.421837 14368 consensus_peers.cc:597] T af28911fb32b478b88b6779c6f0dc08f P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260201 02:55:43.463469 14238 consensus_peers.cc:597] T 1abdef8b45334d908fa08ec613374a3b P 943634a8539f44a8969b8503616b09d6 -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260201 02:55:43.497684 14368 consensus_peers.cc:597] T 535b6fc9826f436089318f329dad0f4d P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260201 02:55:43.555372 14368 consensus_peers.cc:597] T 9434d106c0374b5d928cc00f109846ce P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260201 02:55:43.639168 14368 consensus_peers.cc:597] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260201 02:55:43.710817 14764 consensus_queue.cc:579] T 7519edb327894747a21ff97e8a90f2f9 P 943634a8539f44a8969b8503616b09d6 [LEADER]: Leader has been unable to successfully communicate with peer 20beda53b20146fb90018bf4533dcd58 for more than 2 seconds (2.063s)
I20260201 02:55:43.713084 14766 consensus_queue.cc:579] T 535b6fc9826f436089318f329dad0f4d P 74bc17a87c2342958617c01904a29dac [LEADER]: Leader has been unable to successfully communicate with peer 20beda53b20146fb90018bf4533dcd58 for more than 2 seconds (2.066s)
I20260201 02:55:43.720183 14762 consensus_queue.cc:579] T af28911fb32b478b88b6779c6f0dc08f P 74bc17a87c2342958617c01904a29dac [LEADER]: Leader has been unable to successfully communicate with peer 20beda53b20146fb90018bf4533dcd58 for more than 2 seconds (2.067s)
I20260201 02:55:43.886353 14555 consensus_queue.cc:579] T 1abdef8b45334d908fa08ec613374a3b P 943634a8539f44a8969b8503616b09d6 [LEADER]: Leader has been unable to successfully communicate with peer 20beda53b20146fb90018bf4533dcd58 for more than 2 seconds (2.006s)
W20260201 02:55:43.931699 14238 consensus_peers.cc:597] T 7519edb327894747a21ff97e8a90f2f9 P 943634a8539f44a8969b8503616b09d6 -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260201 02:55:43.948378 14368 consensus_peers.cc:597] T af28911fb32b478b88b6779c6f0dc08f P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260201 02:55:44.000883 14238 consensus_peers.cc:597] T 1abdef8b45334d908fa08ec613374a3b P 943634a8539f44a8969b8503616b09d6 -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260201 02:55:44.011237 14368 consensus_peers.cc:597] T 535b6fc9826f436089318f329dad0f4d P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260201 02:55:44.048069 14758 consensus_queue.cc:579] T 9434d106c0374b5d928cc00f109846ce P 74bc17a87c2342958617c01904a29dac [LEADER]: Leader has been unable to successfully communicate with peer 20beda53b20146fb90018bf4533dcd58 for more than 2 seconds (2.031s)
I20260201 02:55:44.112314 14766 consensus_queue.cc:579] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac [LEADER]: Leader has been unable to successfully communicate with peer 20beda53b20146fb90018bf4533dcd58 for more than 2 seconds (2.114s)
W20260201 02:55:44.148099 14368 consensus_peers.cc:597] T 9434d106c0374b5d928cc00f109846ce P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260201 02:55:44.227027 14368 consensus_peers.cc:597] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260201 02:55:44.408674 14368 consensus_peers.cc:597] T af28911fb32b478b88b6779c6f0dc08f P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260201 02:55:44.458931 14238 consensus_peers.cc:597] T 7519edb327894747a21ff97e8a90f2f9 P 943634a8539f44a8969b8503616b09d6 -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260201 02:55:44.467038 14368 consensus_peers.cc:597] T 535b6fc9826f436089318f329dad0f4d P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260201 02:55:44.476920 14238 consensus_peers.cc:597] T 1abdef8b45334d908fa08ec613374a3b P 943634a8539f44a8969b8503616b09d6 -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260201 02:55:44.736351 14368 consensus_peers.cc:597] T 9434d106c0374b5d928cc00f109846ce P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260201 02:55:44.816555 14368 consensus_peers.cc:597] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260201 02:55:44.838770 14368 consensus_peers.cc:597] T af28911fb32b478b88b6779c6f0dc08f P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260201 02:55:44.953531 14238 consensus_peers.cc:597] T 1abdef8b45334d908fa08ec613374a3b P 943634a8539f44a8969b8503616b09d6 -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260201 02:55:44.963653 14238 consensus_peers.cc:597] T 7519edb327894747a21ff97e8a90f2f9 P 943634a8539f44a8969b8503616b09d6 -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260201 02:55:44.967644 14368 consensus_peers.cc:597] T 535b6fc9826f436089318f329dad0f4d P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260201 02:55:45.070314 13992 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-taskfoNO09/build/asan/bin/kudu pid 14000
I20260201 02:55:45.071650 14061 generic_service.cc:196] Checking for leaks (request via RPC)
I20260201 02:55:45.330693 13992 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskfoNO09/build/asan/bin/kudu with pid 14000
W20260201 02:55:45.376646 14368 consensus_peers.cc:597] T 9434d106c0374b5d928cc00f109846ce P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260201 02:55:45.389142 14368 consensus_peers.cc:597] T af28911fb32b478b88b6779c6f0dc08f P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260201 02:55:45.401840 14368 consensus_peers.cc:597] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260201 02:55:45.452625 14478 heartbeater.cc:646] Failed to heartbeat to 127.13.170.62:35377 (0 consecutive failures): Network error: Failed to send heartbeat to master: recv got EOF from 127.13.170.62:35377 (error 108)
I20260201 02:55:45.457778 13992 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskfoNO09/build/asan/bin/kudu
/tmp/dist-test-taskfoNO09/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.170.62:35377
--webserver_interface=127.13.170.62
--webserver_port=40031
--builtin_ntp_servers=127.13.170.20:41761
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.170.62:35377 with env {}
W20260201 02:55:45.469412 14368 consensus_peers.cc:597] T 535b6fc9826f436089318f329dad0f4d P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260201 02:55:45.524766 14238 consensus_peers.cc:597] T 7519edb327894747a21ff97e8a90f2f9 P 943634a8539f44a8969b8503616b09d6 -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260201 02:55:45.528177 14238 consensus_peers.cc:597] T 1abdef8b45334d908fa08ec613374a3b P 943634a8539f44a8969b8503616b09d6 -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260201 02:55:45.898937 14348 heartbeater.cc:646] Failed to heartbeat to 127.13.170.62:35377 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.13.170.62:35377: connect: Connection refused (error 111)
W20260201 02:55:45.908093 14731 heartbeater.cc:646] Failed to heartbeat to 127.13.170.62:35377 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.13.170.62:35377: connect: Connection refused (error 111)
W20260201 02:55:45.931439 14368 consensus_peers.cc:597] T af28911fb32b478b88b6779c6f0dc08f P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260201 02:55:45.948282 14368 consensus_peers.cc:597] T 535b6fc9826f436089318f329dad0f4d P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260201 02:55:45.999915 14368 consensus_peers.cc:597] T 9434d106c0374b5d928cc00f109846ce P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260201 02:55:46.000182 14368 consensus_peers.cc:597] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260201 02:55:46.047461 14238 consensus_peers.cc:597] T 1abdef8b45334d908fa08ec613374a3b P 943634a8539f44a8969b8503616b09d6 -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260201 02:55:46.077461 14238 consensus_peers.cc:597] T 7519edb327894747a21ff97e8a90f2f9 P 943634a8539f44a8969b8503616b09d6 -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260201 02:55:46.129935 14774 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260201 02:55:46.130481 14774 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260201 02:55:46.130699 14774 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260201 02:55:46.144250 14774 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260201 02:55:46.144506 14774 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260201 02:55:46.144659 14774 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260201 02:55:46.144799 14774 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260201 02:55:46.162009 14774 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.170.20:41761
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.170.62:35377
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.170.62:35377
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.170.62
--webserver_port=40031
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 3722ed49c19ce54c7feae2fa944e32b1d4ed8d2d
build type FASTDEBUG
built by None at 01 Feb 2026 02:43:22 UTC on 24a791456cd2
build id 10288
ASAN enabled
I20260201 02:55:46.164671 14774 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260201 02:55:46.167514 14774 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 02:55:46.192611 14780 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 02:55:46.199905 14781 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 02:55:46.241556 14783 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 02:55:46.242125 14774 server_base.cc:1060] running on GCE node
I20260201 02:55:46.243634 14774 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260201 02:55:46.284711 14774 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260201 02:55:46.288324 14774 hybrid_clock.cc:648] HybridClock initialized: now 1769914546288135 us; error 161 us; skew 500 ppm
I20260201 02:55:46.290556 14774 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 02:55:46.316761 14774 webserver.cc:492] Webserver started at http://127.13.170.62:40031/ using document root <none> and password file <none>
I20260201 02:55:46.318183 14774 fs_manager.cc:362] Metadata directory not provided
I20260201 02:55:46.318459 14774 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 02:55:46.377461 14774 fs_manager.cc:714] Time spent opening directory manager: real 0.056s user 0.032s sys 0.016s
I20260201 02:55:46.387526 14789 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 02:55:46.394794 14774 fs_manager.cc:730] Time spent opening block manager: real 0.014s user 0.001s sys 0.003s
I20260201 02:55:46.395181 14774 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/master-0/data,/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/master-0/wal
uuid: "b8988d4ef6e54f07ab050b84d4fef220"
format_stamp: "Formatted at 2026-02-01 02:55:34 on dist-test-slave-4krj"
I20260201 02:55:46.397074 14774 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260201 02:55:46.407501 14368 consensus_peers.cc:597] T af28911fb32b478b88b6779c6f0dc08f P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260201 02:55:46.461977 14774 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
W20260201 02:55:46.463011 14368 consensus_peers.cc:597] T 535b6fc9826f436089318f329dad0f4d P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260201 02:55:46.464429 14774 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260201 02:55:46.464854 14774 kserver.cc:163] Server-wide thread pool size limit: 3276
W20260201 02:55:46.539078 14238 consensus_peers.cc:597] T 7519edb327894747a21ff97e8a90f2f9 P 943634a8539f44a8969b8503616b09d6 -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260201 02:55:46.586160 14368 consensus_peers.cc:597] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260201 02:55:46.638806 14238 consensus_peers.cc:597] T 1abdef8b45334d908fa08ec613374a3b P 943634a8539f44a8969b8503616b09d6 -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260201 02:55:46.670959 14368 consensus_peers.cc:597] T 9434d106c0374b5d928cc00f109846ce P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260201 02:55:46.846001 14840 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.170.62:35377 every 8 connection(s)
I20260201 02:55:46.846434 14774 rpc_server.cc:307] RPC server started. Bound to: 127.13.170.62:35377
I20260201 02:55:46.849025 14774 server_base.cc:1192] Dumped server information to /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/master-0/data/info.pb
I20260201 02:55:46.855474 13992 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskfoNO09/build/asan/bin/kudu as pid 14774
I20260201 02:55:46.862638 14841 sys_catalog.cc:263] Verifying existing consensus state
I20260201 02:55:46.867583 14841 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b8988d4ef6e54f07ab050b84d4fef220: Bootstrap starting.
I20260201 02:55:46.899556 14841 log.cc:826] T 00000000000000000000000000000000 P b8988d4ef6e54f07ab050b84d4fef220: Log is configured to *not* fsync() on all Append() calls
W20260201 02:55:46.927451 14368 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111) [suppressed 189 similar messages]
W20260201 02:55:46.928907 14368 consensus_peers.cc:597] T 535b6fc9826f436089318f329dad0f4d P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260201 02:55:46.940853 14368 consensus_peers.cc:597] T af28911fb32b478b88b6779c6f0dc08f P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260201 02:55:46.948679 14841 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b8988d4ef6e54f07ab050b84d4fef220: Bootstrap replayed 1/1 log segments. Stats: ops{read=16 overwritten=0 applied=16 ignored=0} inserts{seen=11 ignored=0} mutations{seen=15 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 02:55:46.949574 14841 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b8988d4ef6e54f07ab050b84d4fef220: Bootstrap complete.
W20260201 02:55:46.957585 14238 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111) [suppressed 99 similar messages]
I20260201 02:55:46.958930 14731 heartbeater.cc:344] Connected to a master server at 127.13.170.62:35377
I20260201 02:55:46.959393 14348 heartbeater.cc:344] Connected to a master server at 127.13.170.62:35377
I20260201 02:55:46.961081 14841 raft_consensus.cc:359] T 00000000000000000000000000000000 P b8988d4ef6e54f07ab050b84d4fef220 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8988d4ef6e54f07ab050b84d4fef220" member_type: VOTER last_known_addr { host: "127.13.170.62" port: 35377 } }
I20260201 02:55:46.962137 14841 raft_consensus.cc:740] T 00000000000000000000000000000000 P b8988d4ef6e54f07ab050b84d4fef220 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8988d4ef6e54f07ab050b84d4fef220, State: Initialized, Role: FOLLOWER
I20260201 02:55:46.962932 14841 consensus_queue.cc:260] T 00000000000000000000000000000000 P b8988d4ef6e54f07ab050b84d4fef220 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 16, Last appended: 1.16, Last appended by leader: 16, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8988d4ef6e54f07ab050b84d4fef220" member_type: VOTER last_known_addr { host: "127.13.170.62" port: 35377 } }
I20260201 02:55:46.963229 14841 raft_consensus.cc:399] T 00000000000000000000000000000000 P b8988d4ef6e54f07ab050b84d4fef220 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260201 02:55:46.963389 14841 raft_consensus.cc:493] T 00000000000000000000000000000000 P b8988d4ef6e54f07ab050b84d4fef220 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260201 02:55:46.963608 14841 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b8988d4ef6e54f07ab050b84d4fef220 [term 1 FOLLOWER]: Advancing to term 2
I20260201 02:55:46.968770 14841 raft_consensus.cc:515] T 00000000000000000000000000000000 P b8988d4ef6e54f07ab050b84d4fef220 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8988d4ef6e54f07ab050b84d4fef220" member_type: VOTER last_known_addr { host: "127.13.170.62" port: 35377 } }
I20260201 02:55:46.969571 14841 leader_election.cc:304] T 00000000000000000000000000000000 P b8988d4ef6e54f07ab050b84d4fef220 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b8988d4ef6e54f07ab050b84d4fef220; no voters:
W20260201 02:55:47.009138 14238 consensus_peers.cc:597] T 7519edb327894747a21ff97e8a90f2f9 P 943634a8539f44a8969b8503616b09d6 -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260201 02:55:47.028890 14841 leader_election.cc:290] T 00000000000000000000000000000000 P b8988d4ef6e54f07ab050b84d4fef220 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260201 02:55:47.029284 14848 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b8988d4ef6e54f07ab050b84d4fef220 [term 2 FOLLOWER]: Leader election won for term 2
I20260201 02:55:47.038607 14841 sys_catalog.cc:565] T 00000000000000000000000000000000 P b8988d4ef6e54f07ab050b84d4fef220 [sys.catalog]: configured and running, proceeding with master startup.
I20260201 02:55:47.050881 14848 raft_consensus.cc:697] T 00000000000000000000000000000000 P b8988d4ef6e54f07ab050b84d4fef220 [term 2 LEADER]: Becoming Leader. State: Replica: b8988d4ef6e54f07ab050b84d4fef220, State: Running, Role: LEADER
I20260201 02:55:47.051817 14848 consensus_queue.cc:237] T 00000000000000000000000000000000 P b8988d4ef6e54f07ab050b84d4fef220 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 1.16, Last appended by leader: 16, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8988d4ef6e54f07ab050b84d4fef220" member_type: VOTER last_known_addr { host: "127.13.170.62" port: 35377 } }
I20260201 02:55:47.066344 14849 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8988d4ef6e54f07ab050b84d4fef220 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "b8988d4ef6e54f07ab050b84d4fef220" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8988d4ef6e54f07ab050b84d4fef220" member_type: VOTER last_known_addr { host: "127.13.170.62" port: 35377 } } }
I20260201 02:55:47.066375 14850 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8988d4ef6e54f07ab050b84d4fef220 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b8988d4ef6e54f07ab050b84d4fef220. Latest consensus state: current_term: 2 leader_uuid: "b8988d4ef6e54f07ab050b84d4fef220" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8988d4ef6e54f07ab050b84d4fef220" member_type: VOTER last_known_addr { host: "127.13.170.62" port: 35377 } } }
I20260201 02:55:47.066815 14849 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8988d4ef6e54f07ab050b84d4fef220 [sys.catalog]: This master's current role is: LEADER
I20260201 02:55:47.066860 14850 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8988d4ef6e54f07ab050b84d4fef220 [sys.catalog]: This master's current role is: LEADER
I20260201 02:55:47.088109 14857 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260201 02:55:47.097613 14857 catalog_manager.cc:679] Loaded metadata for table test-workload [id=d9382ed8fdae41879cc8eb40b1463720]
I20260201 02:55:47.100766 14857 tablet_loader.cc:96] loaded metadata for tablet 1abdef8b45334d908fa08ec613374a3b (table test-workload [id=d9382ed8fdae41879cc8eb40b1463720])
I20260201 02:55:47.101543 14857 tablet_loader.cc:96] loaded metadata for tablet 535b6fc9826f436089318f329dad0f4d (table test-workload [id=d9382ed8fdae41879cc8eb40b1463720])
I20260201 02:55:47.102136 14857 tablet_loader.cc:96] loaded metadata for tablet 7519edb327894747a21ff97e8a90f2f9 (table test-workload [id=d9382ed8fdae41879cc8eb40b1463720])
I20260201 02:55:47.102602 14857 tablet_loader.cc:96] loaded metadata for tablet 7b2f386887ef4ab0a692195c4f968c12 (table test-workload [id=d9382ed8fdae41879cc8eb40b1463720])
I20260201 02:55:47.103196 14857 tablet_loader.cc:96] loaded metadata for tablet 9434d106c0374b5d928cc00f109846ce (table test-workload [id=d9382ed8fdae41879cc8eb40b1463720])
I20260201 02:55:47.103664 14857 tablet_loader.cc:96] loaded metadata for tablet af28911fb32b478b88b6779c6f0dc08f (table test-workload [id=d9382ed8fdae41879cc8eb40b1463720])
I20260201 02:55:47.104100 14857 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260201 02:55:47.105931 14857 catalog_manager.cc:1269] Loaded cluster ID: 4ca7e79164324cbd98e5b19a855b0cd8
I20260201 02:55:47.106118 14857 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
W20260201 02:55:47.123981 14238 consensus_peers.cc:597] T 1abdef8b45334d908fa08ec613374a3b P 943634a8539f44a8969b8503616b09d6 -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260201 02:55:47.124046 14857 catalog_manager.cc:1514] Loading token signing keys...
I20260201 02:55:47.126080 14857 catalog_manager.cc:6038] T 00000000000000000000000000000000 P b8988d4ef6e54f07ab050b84d4fef220: Loaded TSK: 0
I20260201 02:55:47.132761 14857 catalog_manager.cc:1524] Initializing in-progress tserver states...
W20260201 02:55:47.248577 14368 consensus_peers.cc:597] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260201 02:55:47.258306 14368 consensus_peers.cc:597] T 9434d106c0374b5d928cc00f109846ce P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260201 02:55:47.477662 14478 heartbeater.cc:344] Connected to a master server at 127.13.170.62:35377
I20260201 02:55:47.480695 14805 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "74bc17a87c2342958617c01904a29dac" instance_seqno: 1769914536319009) as {username='slave'} at 127.13.170.3:39055; Asking this server to re-register.
I20260201 02:55:47.482211 14478 heartbeater.cc:461] Registering TS with master...
I20260201 02:55:47.482537 14478 heartbeater.cc:507] Master 127.13.170.62:35377 requested a full tablet report, sending...
I20260201 02:55:47.487052 14805 ts_manager.cc:194] Registered new tserver with Master: 74bc17a87c2342958617c01904a29dac (127.13.170.3:45403)
W20260201 02:55:47.515244 14368 consensus_peers.cc:597] T 535b6fc9826f436089318f329dad0f4d P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260201 02:55:47.519853 14368 consensus_peers.cc:597] T af28911fb32b478b88b6779c6f0dc08f P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260201 02:55:47.561403 14238 consensus_peers.cc:597] T 7519edb327894747a21ff97e8a90f2f9 P 943634a8539f44a8969b8503616b09d6 -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260201 02:55:47.712224 14238 consensus_peers.cc:597] T 1abdef8b45334d908fa08ec613374a3b P 943634a8539f44a8969b8503616b09d6 -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260201 02:55:47.882572 14368 consensus_peers.cc:597] T 9434d106c0374b5d928cc00f109846ce P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260201 02:55:47.882990 14368 consensus_peers.cc:597] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260201 02:55:47.963975 14805 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "e5c7c83542c74b66b44ee29fdcc2a847" instance_seqno: 1769914540249287) as {username='slave'} at 127.13.170.4:42923; Asking this server to re-register.
I20260201 02:55:47.964772 14731 heartbeater.cc:461] Registering TS with master...
I20260201 02:55:47.965080 14731 heartbeater.cc:507] Master 127.13.170.62:35377 requested a full tablet report, sending...
I20260201 02:55:47.966022 14805 ts_manager.cc:194] Registered new tserver with Master: e5c7c83542c74b66b44ee29fdcc2a847 (127.13.170.4:41583)
I20260201 02:55:47.968225 14805 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "943634a8539f44a8969b8503616b09d6" instance_seqno: 1769914535814898) as {username='slave'} at 127.13.170.2:37325; Asking this server to re-register.
I20260201 02:55:47.969475 14348 heartbeater.cc:461] Registering TS with master...
I20260201 02:55:47.969761 14348 heartbeater.cc:507] Master 127.13.170.62:35377 requested a full tablet report, sending...
I20260201 02:55:47.974009 14805 ts_manager.cc:194] Registered new tserver with Master: 943634a8539f44a8969b8503616b09d6 (127.13.170.2:41045)
W20260201 02:55:47.989717 14368 consensus_peers.cc:597] T 535b6fc9826f436089318f329dad0f4d P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260201 02:55:48.076685 14238 consensus_peers.cc:597] T 7519edb327894747a21ff97e8a90f2f9 P 943634a8539f44a8969b8503616b09d6 -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260201 02:55:48.094916 14368 consensus_peers.cc:597] T af28911fb32b478b88b6779c6f0dc08f P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260201 02:55:48.232936 14238 consensus_peers.cc:597] T 1abdef8b45334d908fa08ec613374a3b P 943634a8539f44a8969b8503616b09d6 -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260201 02:55:48.397939 14368 consensus_peers.cc:597] T 9434d106c0374b5d928cc00f109846ce P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260201 02:55:48.398730 14368 consensus_peers.cc:597] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260201 02:55:48.445920 14368 consensus_peers.cc:597] T 535b6fc9826f436089318f329dad0f4d P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260201 02:55:48.553736 14238 consensus_peers.cc:597] T 7519edb327894747a21ff97e8a90f2f9 P 943634a8539f44a8969b8503616b09d6 -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260201 02:55:48.614176 14368 consensus_peers.cc:597] T af28911fb32b478b88b6779c6f0dc08f P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260201 02:55:48.801717 14238 consensus_peers.cc:597] T 1abdef8b45334d908fa08ec613374a3b P 943634a8539f44a8969b8503616b09d6 -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260201 02:55:48.938059 14368 consensus_peers.cc:597] T 535b6fc9826f436089318f329dad0f4d P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260201 02:55:48.985822 14368 consensus_peers.cc:597] T 9434d106c0374b5d928cc00f109846ce P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260201 02:55:48.986183 14368 consensus_peers.cc:597] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260201 02:55:49.068275 14238 consensus_peers.cc:597] T 7519edb327894747a21ff97e8a90f2f9 P 943634a8539f44a8969b8503616b09d6 -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260201 02:55:49.115239 14368 consensus_peers.cc:597] T af28911fb32b478b88b6779c6f0dc08f P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260201 02:55:49.357062 14238 consensus_peers.cc:597] T 1abdef8b45334d908fa08ec613374a3b P 943634a8539f44a8969b8503616b09d6 -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260201 02:55:49.499491 14368 consensus_peers.cc:597] T 535b6fc9826f436089318f329dad0f4d P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260201 02:55:49.568781 14368 consensus_peers.cc:597] T 9434d106c0374b5d928cc00f109846ce P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260201 02:55:49.570771 14368 consensus_peers.cc:597] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260201 02:55:49.605609 14238 consensus_peers.cc:597] T 7519edb327894747a21ff97e8a90f2f9 P 943634a8539f44a8969b8503616b09d6 -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260201 02:55:49.679979 14368 consensus_peers.cc:597] T af28911fb32b478b88b6779c6f0dc08f P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260201 02:55:49.842402 14238 consensus_peers.cc:597] T 1abdef8b45334d908fa08ec613374a3b P 943634a8539f44a8969b8503616b09d6 -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
I20260201 02:55:49.967836 13992 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskfoNO09/build/asan/bin/kudu
/tmp/dist-test-taskfoNO09/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.170.1:36225
--local_ip_for_outbound_sockets=127.13.170.1
--tserver_master_addrs=127.13.170.62:35377
--webserver_port=34153
--webserver_interface=127.13.170.1
--builtin_ntp_servers=127.13.170.20:41761
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--follower_unavailable_considered_failed_sec=2
--enable_log_gc=false with env {}
W20260201 02:55:50.005787 14368 consensus_peers.cc:597] T 535b6fc9826f436089318f329dad0f4d P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 81: this message will repeat every 5th retry.
W20260201 02:55:50.137830 14368 consensus_peers.cc:597] T 9434d106c0374b5d928cc00f109846ce P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260201 02:55:50.141288 14238 consensus_peers.cc:597] T 7519edb327894747a21ff97e8a90f2f9 P 943634a8539f44a8969b8503616b09d6 -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 81: this message will repeat every 5th retry.
W20260201 02:55:50.252158 14368 consensus_peers.cc:597] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260201 02:55:50.261227 14368 consensus_peers.cc:597] T af28911fb32b478b88b6779c6f0dc08f P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 81: this message will repeat every 5th retry.
W20260201 02:55:50.371562 14238 consensus_peers.cc:597] T 1abdef8b45334d908fa08ec613374a3b P 943634a8539f44a8969b8503616b09d6 -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 81: this message will repeat every 5th retry.
W20260201 02:55:50.566967 14368 consensus_peers.cc:597] T 535b6fc9826f436089318f329dad0f4d P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 86: this message will repeat every 5th retry.
W20260201 02:55:50.683126 14238 consensus_peers.cc:597] T 7519edb327894747a21ff97e8a90f2f9 P 943634a8539f44a8969b8503616b09d6 -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 86: this message will repeat every 5th retry.
W20260201 02:55:50.764084 14368 consensus_peers.cc:597] T af28911fb32b478b88b6779c6f0dc08f P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 86: this message will repeat every 5th retry.
W20260201 02:55:50.790195 14368 consensus_peers.cc:597] T 9434d106c0374b5d928cc00f109846ce P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260201 02:55:50.821283 14368 consensus_peers.cc:597] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260201 02:55:50.866161 14874 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260201 02:55:50.866768 14874 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260201 02:55:50.866940 14874 flags.cc:425] Enabled unsafe flag: --enable_log_gc=false
W20260201 02:55:50.867103 14874 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260201 02:55:50.893577 14874 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260201 02:55:50.895169 14874 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.170.1
W20260201 02:55:50.907440 14238 consensus_peers.cc:597] T 1abdef8b45334d908fa08ec613374a3b P 943634a8539f44a8969b8503616b09d6 -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 86: this message will repeat every 5th retry.
I20260201 02:55:50.948323 14874 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.170.20:41761
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=2
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.170.1:36225
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.170.1
--webserver_port=34153
--enable_log_gc=false
--tserver_master_addrs=127.13.170.62:35377
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.170.1
--log_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3722ed49c19ce54c7feae2fa944e32b1d4ed8d2d
build type FASTDEBUG
built by None at 01 Feb 2026 02:43:22 UTC on 24a791456cd2
build id 10288
ASAN enabled
I20260201 02:55:50.950841 14874 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260201 02:55:50.956838 14874 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 02:55:50.985934 14879 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 02:55:50.998157 14880 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 02:55:51.023746 14874 server_base.cc:1060] running on GCE node
W20260201 02:55:51.026101 14883 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 02:55:51.028983 14874 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260201 02:55:51.041635 14874 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260201 02:55:51.043005 14874 hybrid_clock.cc:648] HybridClock initialized: now 1769914551042889 us; error 74 us; skew 500 ppm
I20260201 02:55:51.043510 14874 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 02:55:51.068272 14874 webserver.cc:492] Webserver started at http://127.13.170.1:34153/ using document root <none> and password file <none>
I20260201 02:55:51.070835 14874 fs_manager.cc:362] Metadata directory not provided
I20260201 02:55:51.071094 14874 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 02:55:51.089640 14874 fs_manager.cc:714] Time spent opening directory manager: real 0.015s user 0.011s sys 0.001s
W20260201 02:55:51.122779 14368 consensus_peers.cc:597] T 535b6fc9826f436089318f329dad0f4d P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 91: this message will repeat every 5th retry.
I20260201 02:55:51.148860 14888 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 02:55:51.152058 14874 fs_manager.cc:730] Time spent opening block manager: real 0.058s user 0.021s sys 0.022s
I20260201 02:55:51.152402 14874 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-0/data,/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-0/wal
uuid: "20beda53b20146fb90018bf4533dcd58"
format_stamp: "Formatted at 2026-02-01 02:55:35 on dist-test-slave-4krj"
I20260201 02:55:51.153604 14874 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260201 02:55:51.277964 14238 consensus_peers.cc:597] T 7519edb327894747a21ff97e8a90f2f9 P 943634a8539f44a8969b8503616b09d6 -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 91: this message will repeat every 5th retry.
W20260201 02:55:51.282308 14368 consensus_peers.cc:597] T af28911fb32b478b88b6779c6f0dc08f P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 91: this message will repeat every 5th retry.
I20260201 02:55:51.348101 14874 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 02:55:51.351034 14874 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260201 02:55:51.351509 14874 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 02:55:51.371943 14874 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
W20260201 02:55:51.382463 14368 consensus_peers.cc:597] T 9434d106c0374b5d928cc00f109846ce P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 81: this message will repeat every 5th retry.
I20260201 02:55:51.398461 14895 ts_tablet_manager.cc:548] Loading tablet metadata (0/6 complete)
W20260201 02:55:51.427299 14238 consensus_peers.cc:597] T 1abdef8b45334d908fa08ec613374a3b P 943634a8539f44a8969b8503616b09d6 -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 91: this message will repeat every 5th retry.
I20260201 02:55:51.428164 14874 ts_tablet_manager.cc:585] Loaded tablet metadata (6 total tablets, 6 live tablets)
I20260201 02:55:51.428294 14874 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.036s user 0.002s sys 0.005s
I20260201 02:55:51.428440 14874 ts_tablet_manager.cc:600] Registering tablets (0/6 complete)
I20260201 02:55:51.441835 14895 tablet_bootstrap.cc:492] T 9434d106c0374b5d928cc00f109846ce P 20beda53b20146fb90018bf4533dcd58: Bootstrap starting.
I20260201 02:55:51.455375 14874 ts_tablet_manager.cc:616] Registered 6 tablets
I20260201 02:55:51.460482 14874 ts_tablet_manager.cc:595] Time spent register tablets: real 0.032s user 0.015s sys 0.003s
W20260201 02:55:51.473644 14368 consensus_peers.cc:597] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 81: this message will repeat every 5th retry.
W20260201 02:55:51.672237 14368 consensus_peers.cc:597] T 535b6fc9826f436089318f329dad0f4d P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 96: this message will repeat every 5th retry.
I20260201 02:55:51.754675 14895 log.cc:826] T 9434d106c0374b5d928cc00f109846ce P 20beda53b20146fb90018bf4533dcd58: Log is configured to *not* fsync() on all Append() calls
W20260201 02:55:51.869024 14368 consensus_peers.cc:597] T af28911fb32b478b88b6779c6f0dc08f P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 96: this message will repeat every 5th retry.
W20260201 02:55:51.869342 14368 consensus_peers.cc:597] T 9434d106c0374b5d928cc00f109846ce P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 86: this message will repeat every 5th retry.
W20260201 02:55:51.957746 14238 consensus_peers.cc:597] T 1abdef8b45334d908fa08ec613374a3b P 943634a8539f44a8969b8503616b09d6 -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 96: this message will repeat every 5th retry.
W20260201 02:55:51.970870 14238 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111) [suppressed 92 similar messages]
W20260201 02:55:51.972344 14238 consensus_peers.cc:597] T 7519edb327894747a21ff97e8a90f2f9 P 943634a8539f44a8969b8503616b09d6 -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 96: this message will repeat every 5th retry.
W20260201 02:55:51.983727 14368 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111) [suppressed 178 similar messages]
W20260201 02:55:52.045697 14368 consensus_peers.cc:597] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 86: this message will repeat every 5th retry.
W20260201 02:55:52.236276 14368 consensus_peers.cc:597] T 535b6fc9826f436089318f329dad0f4d P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 101: this message will repeat every 5th retry.
I20260201 02:55:52.327965 14895 tablet_bootstrap.cc:492] T 9434d106c0374b5d928cc00f109846ce P 20beda53b20146fb90018bf4533dcd58: Bootstrap replayed 1/1 log segments. Stats: ops{read=170 overwritten=0 applied=169 ignored=0} inserts{seen=1399 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260201 02:55:52.328831 14895 tablet_bootstrap.cc:492] T 9434d106c0374b5d928cc00f109846ce P 20beda53b20146fb90018bf4533dcd58: Bootstrap complete.
I20260201 02:55:52.330632 14895 ts_tablet_manager.cc:1403] T 9434d106c0374b5d928cc00f109846ce P 20beda53b20146fb90018bf4533dcd58: Time spent bootstrapping tablet: real 0.889s user 0.368s sys 0.090s
I20260201 02:55:52.338713 14895 raft_consensus.cc:359] T 9434d106c0374b5d928cc00f109846ce P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
W20260201 02:55:52.385975 14368 consensus_peers.cc:597] T af28911fb32b478b88b6779c6f0dc08f P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 101: this message will repeat every 5th retry.
I20260201 02:55:52.390839 14895 raft_consensus.cc:740] T 9434d106c0374b5d928cc00f109846ce P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20beda53b20146fb90018bf4533dcd58, State: Initialized, Role: FOLLOWER
I20260201 02:55:52.392086 14895 consensus_queue.cc:260] T 9434d106c0374b5d928cc00f109846ce P 20beda53b20146fb90018bf4533dcd58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 169, Last appended: 1.170, Last appended by leader: 170, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:55:52.413436 14895 ts_tablet_manager.cc:1434] T 9434d106c0374b5d928cc00f109846ce P 20beda53b20146fb90018bf4533dcd58: Time spent starting tablet: real 0.082s user 0.022s sys 0.020s
I20260201 02:55:52.414084 14895 tablet_bootstrap.cc:492] T af28911fb32b478b88b6779c6f0dc08f P 20beda53b20146fb90018bf4533dcd58: Bootstrap starting.
W20260201 02:55:52.485337 14238 consensus_peers.cc:597] T 7519edb327894747a21ff97e8a90f2f9 P 943634a8539f44a8969b8503616b09d6 -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 101: this message will repeat every 5th retry.
W20260201 02:55:52.490207 14368 consensus_peers.cc:597] T 9434d106c0374b5d928cc00f109846ce P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 91: this message will repeat every 5th retry.
W20260201 02:55:52.516628 14238 consensus_peers.cc:597] T 1abdef8b45334d908fa08ec613374a3b P 943634a8539f44a8969b8503616b09d6 -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 101: this message will repeat every 5th retry.
W20260201 02:55:52.704937 14368 consensus_peers.cc:597] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 91: this message will repeat every 5th retry.
I20260201 02:55:52.746681 14947 raft_consensus.cc:493] T 9434d106c0374b5d928cc00f109846ce P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 02:55:52.746996 14947 raft_consensus.cc:515] T 9434d106c0374b5d928cc00f109846ce P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:55:52.752168 14947 leader_election.cc:290] T 9434d106c0374b5d928cc00f109846ce P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 943634a8539f44a8969b8503616b09d6 (127.13.170.2:41045), 74bc17a87c2342958617c01904a29dac (127.13.170.3:45403)
W20260201 02:55:52.820329 14368 consensus_peers.cc:597] T 535b6fc9826f436089318f329dad0f4d P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 106: this message will repeat every 5th retry.
I20260201 02:55:52.853922 14303 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9434d106c0374b5d928cc00f109846ce" candidate_uuid: "20beda53b20146fb90018bf4533dcd58" candidate_term: 2 candidate_status { last_received { term: 1 index: 170 } } ignore_live_leader: false dest_uuid: "943634a8539f44a8969b8503616b09d6" is_pre_election: true
I20260201 02:55:52.872733 14433 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9434d106c0374b5d928cc00f109846ce" candidate_uuid: "20beda53b20146fb90018bf4533dcd58" candidate_term: 2 candidate_status { last_received { term: 1 index: 170 } } ignore_live_leader: false dest_uuid: "74bc17a87c2342958617c01904a29dac" is_pre_election: true
I20260201 02:55:52.873718 14892 leader_election.cc:304] T 9434d106c0374b5d928cc00f109846ce P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20beda53b20146fb90018bf4533dcd58; no voters: 74bc17a87c2342958617c01904a29dac, 943634a8539f44a8969b8503616b09d6
I20260201 02:55:52.874799 14947 raft_consensus.cc:2749] T 9434d106c0374b5d928cc00f109846ce P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260201 02:55:52.889112 14368 consensus_peers.cc:597] T af28911fb32b478b88b6779c6f0dc08f P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 106: this message will repeat every 5th retry.
W20260201 02:55:53.026686 14238 consensus_peers.cc:597] T 1abdef8b45334d908fa08ec613374a3b P 943634a8539f44a8969b8503616b09d6 -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 106: this message will repeat every 5th retry.
W20260201 02:55:53.076822 14238 consensus_peers.cc:597] T 7519edb327894747a21ff97e8a90f2f9 P 943634a8539f44a8969b8503616b09d6 -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 106: this message will repeat every 5th retry.
I20260201 02:55:53.076989 14895 tablet_bootstrap.cc:492] T af28911fb32b478b88b6779c6f0dc08f P 20beda53b20146fb90018bf4533dcd58: Bootstrap replayed 1/1 log segments. Stats: ops{read=168 overwritten=0 applied=168 ignored=0} inserts{seen=1343 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 02:55:53.077862 14895 tablet_bootstrap.cc:492] T af28911fb32b478b88b6779c6f0dc08f P 20beda53b20146fb90018bf4533dcd58: Bootstrap complete.
I20260201 02:55:53.079519 14895 ts_tablet_manager.cc:1403] T af28911fb32b478b88b6779c6f0dc08f P 20beda53b20146fb90018bf4533dcd58: Time spent bootstrapping tablet: real 0.665s user 0.360s sys 0.047s
I20260201 02:55:53.081261 14895 raft_consensus.cc:359] T af28911fb32b478b88b6779c6f0dc08f P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } }
I20260201 02:55:53.081705 14895 raft_consensus.cc:740] T af28911fb32b478b88b6779c6f0dc08f P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20beda53b20146fb90018bf4533dcd58, State: Initialized, Role: FOLLOWER
I20260201 02:55:53.082212 14895 consensus_queue.cc:260] T af28911fb32b478b88b6779c6f0dc08f P 20beda53b20146fb90018bf4533dcd58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 168, Last appended: 1.168, Last appended by leader: 168, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } }
I20260201 02:55:53.083254 14895 ts_tablet_manager.cc:1434] T af28911fb32b478b88b6779c6f0dc08f P 20beda53b20146fb90018bf4533dcd58: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260201 02:55:53.083861 14895 tablet_bootstrap.cc:492] T 7519edb327894747a21ff97e8a90f2f9 P 20beda53b20146fb90018bf4533dcd58: Bootstrap starting.
W20260201 02:55:53.104039 14369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.170.2:41045, user_credentials={real_user=slave}} blocked reactor thread for 54530.5us
I20260201 02:55:53.168677 15021 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.170.1:36225 every 8 connection(s)
I20260201 02:55:53.169193 14874 rpc_server.cc:307] RPC server started. Bound to: 127.13.170.1:36225
I20260201 02:55:53.171648 14874 server_base.cc:1192] Dumped server information to /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1769914534130798-13992-0/minicluster-data/ts-0/data/info.pb
I20260201 02:55:53.176172 13992 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskfoNO09/build/asan/bin/kudu as pid 14874
I20260201 02:55:53.241715 14947 raft_consensus.cc:493] T 9434d106c0374b5d928cc00f109846ce P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 02:55:53.241899 14947 raft_consensus.cc:515] T 9434d106c0374b5d928cc00f109846ce P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:55:53.243423 14947 leader_election.cc:290] T 9434d106c0374b5d928cc00f109846ce P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 943634a8539f44a8969b8503616b09d6 (127.13.170.2:41045), 74bc17a87c2342958617c01904a29dac (127.13.170.3:45403)
I20260201 02:55:53.245422 14300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9434d106c0374b5d928cc00f109846ce" candidate_uuid: "20beda53b20146fb90018bf4533dcd58" candidate_term: 2 candidate_status { last_received { term: 1 index: 170 } } ignore_live_leader: false dest_uuid: "943634a8539f44a8969b8503616b09d6" is_pre_election: true
I20260201 02:55:53.295588 14431 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9434d106c0374b5d928cc00f109846ce" candidate_uuid: "20beda53b20146fb90018bf4533dcd58" candidate_term: 2 candidate_status { last_received { term: 1 index: 170 } } ignore_live_leader: false dest_uuid: "74bc17a87c2342958617c01904a29dac" is_pre_election: true
I20260201 02:55:53.303534 14892 leader_election.cc:304] T 9434d106c0374b5d928cc00f109846ce P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20beda53b20146fb90018bf4533dcd58; no voters: 74bc17a87c2342958617c01904a29dac, 943634a8539f44a8969b8503616b09d6
I20260201 02:55:53.304042 14947 raft_consensus.cc:2749] T 9434d106c0374b5d928cc00f109846ce P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 02:55:53.307402 15022 heartbeater.cc:344] Connected to a master server at 127.13.170.62:35377
I20260201 02:55:53.307837 15022 heartbeater.cc:461] Registering TS with master...
I20260201 02:55:53.309381 15022 heartbeater.cc:507] Master 127.13.170.62:35377 requested a full tablet report, sending...
I20260201 02:55:53.313400 14805 ts_manager.cc:194] Registered new tserver with Master: 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225)
I20260201 02:55:53.316792 14805 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.13.170.1:33843
I20260201 02:55:53.331836 14962 raft_consensus.cc:3060] T 9434d106c0374b5d928cc00f109846ce P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Advancing to term 2
I20260201 02:55:53.374066 15022 heartbeater.cc:499] Master 127.13.170.62:35377 was elected leader, sending a full tablet report...
W20260201 02:55:53.454402 14368 consensus_peers.cc:597] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 96: this message will repeat every 5th retry.
W20260201 02:55:53.759105 14369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.170.2:41045, user_credentials={real_user=slave}} blocked reactor thread for 46380.9us
W20260201 02:55:53.855400 14368 consensus_peers.cc:597] T 535b6fc9826f436089318f329dad0f4d P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 111: this message will repeat every 5th retry.
W20260201 02:55:53.861218 14238 consensus_peers.cc:597] T 1abdef8b45334d908fa08ec613374a3b P 943634a8539f44a8969b8503616b09d6 -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 111: this message will repeat every 5th retry.
I20260201 02:55:54.341257 14963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.13.170.3:46631 (request call id 0) took 1084 ms. Trace:
I20260201 02:55:54.341357 14947 raft_consensus.cc:493] T af28911fb32b478b88b6779c6f0dc08f P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74bc17a87c2342958617c01904a29dac)
I20260201 02:55:54.341585 14947 raft_consensus.cc:515] T af28911fb32b478b88b6779c6f0dc08f P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } }
I20260201 02:55:54.342643 14947 leader_election.cc:290] T af28911fb32b478b88b6779c6f0dc08f P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74bc17a87c2342958617c01904a29dac (127.13.170.3:45403), 943634a8539f44a8969b8503616b09d6 (127.13.170.2:41045)
I20260201 02:55:54.344007 14302 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "af28911fb32b478b88b6779c6f0dc08f" candidate_uuid: "20beda53b20146fb90018bf4533dcd58" candidate_term: 2 candidate_status { last_received { term: 1 index: 725 } } ignore_live_leader: false dest_uuid: "943634a8539f44a8969b8503616b09d6" is_pre_election: true
I20260201 02:55:54.357288 14433 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "af28911fb32b478b88b6779c6f0dc08f" candidate_uuid: "20beda53b20146fb90018bf4533dcd58" candidate_term: 2 candidate_status { last_received { term: 1 index: 725 } } ignore_live_leader: false dest_uuid: "74bc17a87c2342958617c01904a29dac" is_pre_election: true
W20260201 02:55:54.386878 14238 consensus_peers.cc:597] T 7519edb327894747a21ff97e8a90f2f9 P 943634a8539f44a8969b8503616b09d6 -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 111: this message will repeat every 5th retry.
I20260201 02:55:54.365782 14892 leader_election.cc:304] T af28911fb32b478b88b6779c6f0dc08f P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20beda53b20146fb90018bf4533dcd58; no voters: 74bc17a87c2342958617c01904a29dac, 943634a8539f44a8969b8503616b09d6
I20260201 02:55:54.391319 14947 raft_consensus.cc:2749] T af28911fb32b478b88b6779c6f0dc08f P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 02:55:54.608243 14962 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.13.170.3:46631 (request call id 1) took 1351 ms. Trace:
I20260201 02:55:54.622567 15031 raft_consensus.cc:493] T 9434d106c0374b5d928cc00f109846ce P 20beda53b20146fb90018bf4533dcd58 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 74bc17a87c2342958617c01904a29dac)
I20260201 02:55:54.622805 15031 raft_consensus.cc:515] T 9434d106c0374b5d928cc00f109846ce P 20beda53b20146fb90018bf4533dcd58 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:55:54.632979 14921 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:33648 (request call id 0) took 1308 ms. Trace:
I20260201 02:55:54.655355 14303 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9434d106c0374b5d928cc00f109846ce" candidate_uuid: "20beda53b20146fb90018bf4533dcd58" candidate_term: 3 candidate_status { last_received { term: 2 index: 722 } } ignore_live_leader: false dest_uuid: "943634a8539f44a8969b8503616b09d6" is_pre_election: true
I20260201 02:55:54.646579 14921 rpcz_store.cc:276] 0201 02:55:53.317146 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 02:55:53.317221 (+ 75us) service_pool.cc:225] Handling call
0201 02:55:54.623165 (+1305944us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x616000018a54. stack: 00007f9743ab1a86 00007f9743ab1840 00007f9742a8c3ad 0000000000984f94 0000000000984f5d 000000000098492a 00007f974f96e2c0 00007f975381eb2f 00007f974dc43c36 00007f974dc43965 00007f974aa7455e 00007f974aa7343e 00007f974aa79675 00007f974aa79f9f 00007f974aa79dc8 0000000000a8970c
0201 02:55:54.625042 (+ 1877us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2965420800}
I20260201 02:55:54.670186 14433 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9434d106c0374b5d928cc00f109846ce" candidate_uuid: "20beda53b20146fb90018bf4533dcd58" candidate_term: 3 candidate_status { last_received { term: 2 index: 722 } } ignore_live_leader: false dest_uuid: "74bc17a87c2342958617c01904a29dac" is_pre_election: true
I20260201 02:55:54.662758 15031 leader_election.cc:290] T 9434d106c0374b5d928cc00f109846ce P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 943634a8539f44a8969b8503616b09d6 (127.13.170.2:41045), 74bc17a87c2342958617c01904a29dac (127.13.170.3:45403)
I20260201 02:55:54.678879 14892 leader_election.cc:304] T 9434d106c0374b5d928cc00f109846ce P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20beda53b20146fb90018bf4533dcd58; no voters: 74bc17a87c2342958617c01904a29dac, 943634a8539f44a8969b8503616b09d6
I20260201 02:55:54.685158 15031 raft_consensus.cc:2749] T 9434d106c0374b5d928cc00f109846ce P 20beda53b20146fb90018bf4533dcd58 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260201 02:55:54.725567 15033 mvcc.cc:204] Tried to move back new op lower bound from 7249570008523243520 to 7249569964103344128. Current Snapshot: MvccSnapshot[applied={T|T < 7249569964402016256}]
I20260201 02:55:54.841683 15031 raft_consensus.cc:493] T af28911fb32b478b88b6779c6f0dc08f P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74bc17a87c2342958617c01904a29dac)
I20260201 02:55:54.841892 15031 raft_consensus.cc:515] T af28911fb32b478b88b6779c6f0dc08f P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } }
I20260201 02:55:54.842614 15031 leader_election.cc:290] T af28911fb32b478b88b6779c6f0dc08f P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74bc17a87c2342958617c01904a29dac (127.13.170.3:45403), 943634a8539f44a8969b8503616b09d6 (127.13.170.2:41045)
I20260201 02:55:54.843487 14303 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "af28911fb32b478b88b6779c6f0dc08f" candidate_uuid: "20beda53b20146fb90018bf4533dcd58" candidate_term: 2 candidate_status { last_received { term: 1 index: 725 } } ignore_live_leader: false dest_uuid: "943634a8539f44a8969b8503616b09d6" is_pre_election: true
I20260201 02:55:54.849889 14431 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "af28911fb32b478b88b6779c6f0dc08f" candidate_uuid: "20beda53b20146fb90018bf4533dcd58" candidate_term: 2 candidate_status { last_received { term: 1 index: 725 } } ignore_live_leader: false dest_uuid: "74bc17a87c2342958617c01904a29dac" is_pre_election: true
I20260201 02:55:54.852043 14892 leader_election.cc:304] T af28911fb32b478b88b6779c6f0dc08f P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20beda53b20146fb90018bf4533dcd58; no voters: 74bc17a87c2342958617c01904a29dac, 943634a8539f44a8969b8503616b09d6
I20260201 02:55:54.858896 15031 raft_consensus.cc:2749] T af28911fb32b478b88b6779c6f0dc08f P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260201 02:55:54.882294 14368 consensus_peers.cc:597] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 101: this message will repeat every 5th retry.
I20260201 02:55:55.040416 15031 raft_consensus.cc:493] T 9434d106c0374b5d928cc00f109846ce P 20beda53b20146fb90018bf4533dcd58 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 74bc17a87c2342958617c01904a29dac)
I20260201 02:55:55.040637 15031 raft_consensus.cc:515] T 9434d106c0374b5d928cc00f109846ce P 20beda53b20146fb90018bf4533dcd58 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:55:55.067715 15031 leader_election.cc:290] T 9434d106c0374b5d928cc00f109846ce P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 943634a8539f44a8969b8503616b09d6 (127.13.170.2:41045), 74bc17a87c2342958617c01904a29dac (127.13.170.3:45403)
I20260201 02:55:55.079190 14430 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9434d106c0374b5d928cc00f109846ce" candidate_uuid: "20beda53b20146fb90018bf4533dcd58" candidate_term: 3 candidate_status { last_received { term: 2 index: 722 } } ignore_live_leader: false dest_uuid: "74bc17a87c2342958617c01904a29dac" is_pre_election: true
I20260201 02:55:55.079334 14302 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9434d106c0374b5d928cc00f109846ce" candidate_uuid: "20beda53b20146fb90018bf4533dcd58" candidate_term: 3 candidate_status { last_received { term: 2 index: 722 } } ignore_live_leader: false dest_uuid: "943634a8539f44a8969b8503616b09d6" is_pre_election: true
I20260201 02:55:55.087347 14892 leader_election.cc:304] T 9434d106c0374b5d928cc00f109846ce P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20beda53b20146fb90018bf4533dcd58; no voters: 74bc17a87c2342958617c01904a29dac, 943634a8539f44a8969b8503616b09d6
I20260201 02:55:55.087694 15031 raft_consensus.cc:2749] T 9434d106c0374b5d928cc00f109846ce P 20beda53b20146fb90018bf4533dcd58 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260201 02:55:55.150453 14238 consensus_peers.cc:597] T 1abdef8b45334d908fa08ec613374a3b P 943634a8539f44a8969b8503616b09d6 -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 116: this message will repeat every 5th retry.
W20260201 02:55:55.170338 14368 consensus_peers.cc:597] T 535b6fc9826f436089318f329dad0f4d P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 116: this message will repeat every 5th retry.
I20260201 02:55:55.522953 15031 raft_consensus.cc:493] T af28911fb32b478b88b6779c6f0dc08f P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74bc17a87c2342958617c01904a29dac)
I20260201 02:55:55.523152 15031 raft_consensus.cc:515] T af28911fb32b478b88b6779c6f0dc08f P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } }
I20260201 02:55:55.523762 15031 leader_election.cc:290] T af28911fb32b478b88b6779c6f0dc08f P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74bc17a87c2342958617c01904a29dac (127.13.170.3:45403), 943634a8539f44a8969b8503616b09d6 (127.13.170.2:41045)
I20260201 02:55:55.526070 14303 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "af28911fb32b478b88b6779c6f0dc08f" candidate_uuid: "20beda53b20146fb90018bf4533dcd58" candidate_term: 2 candidate_status { last_received { term: 1 index: 725 } } ignore_live_leader: false dest_uuid: "943634a8539f44a8969b8503616b09d6" is_pre_election: true
I20260201 02:55:55.562640 14430 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "af28911fb32b478b88b6779c6f0dc08f" candidate_uuid: "20beda53b20146fb90018bf4533dcd58" candidate_term: 2 candidate_status { last_received { term: 1 index: 725 } } ignore_live_leader: false dest_uuid: "74bc17a87c2342958617c01904a29dac" is_pre_election: true
I20260201 02:55:55.565474 14892 leader_election.cc:304] T af28911fb32b478b88b6779c6f0dc08f P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20beda53b20146fb90018bf4533dcd58; no voters: 74bc17a87c2342958617c01904a29dac, 943634a8539f44a8969b8503616b09d6
I20260201 02:55:55.566094 15031 raft_consensus.cc:2749] T af28911fb32b478b88b6779c6f0dc08f P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 02:55:55.714051 15031 raft_consensus.cc:493] T 9434d106c0374b5d928cc00f109846ce P 20beda53b20146fb90018bf4533dcd58 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 74bc17a87c2342958617c01904a29dac)
I20260201 02:55:55.714267 15031 raft_consensus.cc:515] T 9434d106c0374b5d928cc00f109846ce P 20beda53b20146fb90018bf4533dcd58 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:55:55.717638 15031 leader_election.cc:290] T 9434d106c0374b5d928cc00f109846ce P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 943634a8539f44a8969b8503616b09d6 (127.13.170.2:41045), 74bc17a87c2342958617c01904a29dac (127.13.170.3:45403)
I20260201 02:55:55.721413 14433 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9434d106c0374b5d928cc00f109846ce" candidate_uuid: "20beda53b20146fb90018bf4533dcd58" candidate_term: 3 candidate_status { last_received { term: 2 index: 722 } } ignore_live_leader: false dest_uuid: "74bc17a87c2342958617c01904a29dac" is_pre_election: true
I20260201 02:55:55.725823 14300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9434d106c0374b5d928cc00f109846ce" candidate_uuid: "20beda53b20146fb90018bf4533dcd58" candidate_term: 3 candidate_status { last_received { term: 2 index: 722 } } ignore_live_leader: false dest_uuid: "943634a8539f44a8969b8503616b09d6" is_pre_election: true
I20260201 02:55:55.727054 14892 leader_election.cc:304] T 9434d106c0374b5d928cc00f109846ce P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20beda53b20146fb90018bf4533dcd58; no voters: 74bc17a87c2342958617c01904a29dac, 943634a8539f44a8969b8503616b09d6
I20260201 02:55:55.727506 15031 raft_consensus.cc:2749] T 9434d106c0374b5d928cc00f109846ce P 20beda53b20146fb90018bf4533dcd58 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260201 02:55:55.763171 14895 tablet_bootstrap.cc:492] T 7519edb327894747a21ff97e8a90f2f9 P 20beda53b20146fb90018bf4533dcd58: Bootstrap replayed 1/1 log segments. Stats: ops{read=167 overwritten=0 applied=167 ignored=0} inserts{seen=1471 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 02:55:55.763828 14895 tablet_bootstrap.cc:492] T 7519edb327894747a21ff97e8a90f2f9 P 20beda53b20146fb90018bf4533dcd58: Bootstrap complete.
I20260201 02:55:55.765296 14895 ts_tablet_manager.cc:1403] T 7519edb327894747a21ff97e8a90f2f9 P 20beda53b20146fb90018bf4533dcd58: Time spent bootstrapping tablet: real 2.682s user 0.328s sys 0.063s
I20260201 02:55:54.642035 14962 rpcz_store.cc:276] 0201 02:55:53.257016 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 02:55:53.262714 (+ 5698us) service_pool.cc:225] Handling call
0201 02:55:53.313393 (+ 50679us) raft_consensus.cc:1471] Updating replica for 552 ops
0201 02:55:53.367069 (+ 53676us) raft_consensus.cc:1534] Early marking committed up to index 170
0201 02:55:53.378763 (+ 11694us) raft_consensus.cc:1539] Triggering prepare for 552 ops
0201 02:55:53.382244 (+ 3481us) spinlock_profiling.cc:243] Waited 2.49 ms on lock 0x60f0000180c8. stack: 00007f9743ab1a86 00007f9743ab1840 00007f9742a8c3ad 0000000000984f94 0000000000984f5d 000000000098492a 00007f974ca63f78 00007f974f9dbdc9 00007f974f982eb9 00007f974f9806c7 00007f97537fa21d 00007f974d993b46 00007f974d993875 00007f974aa7455e 00007f974aa7343e 00007f974aa79675
0201 02:55:53.382626 (+ 382us) write_op.cc:270] Start()
0201 02:55:53.382706 (+ 80us) write_op.cc:276] Timestamp: P: 1769914542028926 usec, L: 0
0201 02:55:53.391586 (+ 8880us) write_op.cc:270] Start()
0201 02:55:53.391629 (+ 43us) write_op.cc:276] Timestamp: P: 1769914542030730 usec, L: 0
0201 02:55:53.391893 (+ 264us) write_op.cc:270] Start()
0201 02:55:53.391918 (+ 25us) write_op.cc:276] Timestamp: P: 1769914542048635 usec, L: 0
0201 02:55:53.392134 (+ 216us) write_op.cc:270] Start()
0201 02:55:53.392177 (+ 43us) write_op.cc:276] Timestamp: P: 1769914542064670 usec, L: 0
0201 02:55:53.392336 (+ 159us) write_op.cc:270] Start()
0201 02:55:53.392359 (+ 23us) write_op.cc:276] Timestamp: P: 1769914542090336 usec, L: 0
0201 02:55:53.392536 (+ 177us) write_op.cc:270] Start()
0201 02:55:53.392563 (+ 27us) write_op.cc:276] Timestamp: P: 1769914542091875 usec, L: 0
0201 02:55:53.392732 (+ 169us) write_op.cc:270] Start()
0201 02:55:53.392752 (+ 20us) write_op.cc:276] Timestamp: P: 1769914542123496 usec, L: 0
0201 02:55:53.392915 (+ 163us) write_op.cc:270] Start()
0201 02:55:53.392935 (+ 20us) write_op.cc:276] Timestamp: P: 1769914542125776 usec, L: 0
0201 02:55:53.393076 (+ 141us) write_op.cc:270] Start()
0201 02:55:53.393100 (+ 24us) write_op.cc:276] Timestamp: P: 1769914542133648 usec, L: 0
0201 02:55:53.393286 (+ 186us) write_op.cc:270] Start()
0201 02:55:53.393308 (+ 22us) write_op.cc:276] Timestamp: P: 1769914542154561 usec, L: 0
0201 02:55:53.393463 (+ 155us) write_op.cc:270] Start()
0201 02:55:53.393484 (+ 21us) write_op.cc:276] Timestamp: P: 1769914542175775 usec, L: 0
0201 02:55:53.393639 (+ 155us) write_op.cc:270] Start()
0201 02:55:53.393659 (+ 20us) write_op.cc:276] Timestamp: P: 1769914542193970 usec, L: 0
0201 02:55:53.393814 (+ 155us) write_op.cc:270] Start()
0201 02:55:53.393833 (+ 19us) write_op.cc:276] Timestamp: P: 1769914542203917 usec, L: 0
0201 02:55:53.393957 (+ 124us) write_op.cc:270] Start()
0201 02:55:53.393973 (+ 16us) write_op.cc:276] Timestamp: P: 1769914542231961 usec, L: 0
0201 02:55:53.394195 (+ 222us) write_op.cc:270] Start()
0201 02:55:53.394218 (+ 23us) write_op.cc:276] Timestamp: P: 1769914542237816 usec, L: 0
0201 02:55:53.394388 (+ 170us) write_op.cc:270] Start()
0201 02:55:53.394416 (+ 28us) write_op.cc:276] Timestamp: P: 1769914542245161 usec, L: 0
0201 02:55:53.394588 (+ 172us) write_op.cc:270] Start()
0201 02:55:53.394608 (+ 20us) write_op.cc:276] Timestamp: P: 1769914542265458 usec, L: 0
0201 02:55:53.394803 (+ 195us) write_op.cc:270] Start()
0201 02:55:53.394824 (+ 21us) write_op.cc:276] Timestamp: P: 1769914542286361 usec, L: 0
0201 02:55:53.394970 (+ 146us) write_op.cc:270] Start()
0201 02:55:53.394989 (+ 19us) write_op.cc:276] Timestamp: P: 1769914542289787 usec, L: 0
0201 02:55:53.395157 (+ 168us) write_op.cc:270] Start()
0201 02:55:53.395191 (+ 34us) write_op.cc:276] Timestamp: P: 1769914542308946 usec, L: 0
0201 02:55:53.395359 (+ 168us) write_op.cc:270] Start()
0201 02:55:53.395417 (+ 58us) write_op.cc:276] Timestamp: P: 1769914542313991 usec, L: 0
0201 02:55:53.395553 (+ 136us) write_op.cc:270] Start()
0201 02:55:53.395572 (+ 19us) write_op.cc:276] Timestamp: P: 1769914542345614 usec, L: 0
0201 02:55:53.395708 (+ 136us) write_op.cc:270] Start()
0201 02:55:53.395731 (+ 23us) write_op.cc:276] Timestamp: P: 1769914542351866 usec, L: 0
0201 02:55:53.395860 (+ 129us) write_op.cc:270] Start()
0201 02:55:53.395877 (+ 17us) write_op.cc:276] Timestamp: P: 1769914542375012 usec, L: 0
0201 02:55:53.396007 (+ 130us) write_op.cc:270] Start()
0201 02:55:53.396023 (+ 16us) write_op.cc:276] Timestamp: P: 1769914542385202 usec, L: 0
0201 02:55:53.396209 (+ 186us) write_op.cc:270] Start()
0201 02:55:53.396228 (+ 19us) write_op.cc:276] Timestamp: P: 1769914542420968 usec, L: 0
0201 02:55:53.396353 (+ 125us) write_op.cc:270] Start()
0201 02:55:53.396370 (+ 17us) write_op.cc:276] Timestamp: P: 1769914542422382 usec, L: 0
0201 02:55:53.396499 (+ 129us) write_op.cc:270] Start()
0201 02:55:53.396517 (+ 18us) write_op.cc:276] Timestamp: P: 1769914542431100 usec, L: 0
0201 02:55:53.396633 (+ 116us) write_op.cc:270] Start()
0201 02:55:53.396649 (+ 16us) write_op.cc:276] Timestamp: P: 1769914542446884 usec, L: 0
0201 02:55:53.396776 (+ 127us) write_op.cc:270] Start()
0201 02:55:53.396795 (+ 19us) write_op.cc:276] Timestamp: P: 1769914542471725 usec, L: 0
0201 02:55:53.396943 (+ 148us) write_op.cc:270] Start()
0201 02:55:53.396962 (+ 19us) write_op.cc:276] Timestamp: P: 1769914542489795 usec, L: 0
0201 02:55:53.397113 (+ 151us) write_op.cc:270] Start()
0201 02:55:53.397131 (+ 18us) write_op.cc:276] Timestamp: P: 1769914542511239 usec, L: 0
0201 02:55:53.397335 (+ 204us) write_op.cc:270] Start()
0201 02:55:53.397357 (+ 22us) write_op.cc:276] Timestamp: P: 1769914542516980 usec, L: 0
0201 02:55:53.397509 (+ 152us) write_op.cc:270] Start()
0201 02:55:53.397531 (+ 22us) write_op.cc:276] Timestamp: P: 1769914542520069 usec, L: 0
0201 02:55:53.397657 (+ 126us) write_op.cc:270] Start()
0201 02:55:53.397675 (+ 18us) write_op.cc:276] Timestamp: P: 1769914542535593 usec, L: 0
0201 02:55:53.397816 (+ 141us) write_op.cc:270] Start()
0201 02:55:53.397886 (+ 70us) write_op.cc:276] Timestamp: P: 1769914542564831 usec, L: 0
0201 02:55:53.398063 (+ 177us) write_op.cc:270] Start()
0201 02:55:53.398081 (+ 18us) write_op.cc:276] Timestamp: P: 1769914542593518 usec, L: 0
0201 02:55:53.398239 (+ 158us) write_op.cc:270] Start()
0201 02:55:53.398256 (+ 17us) write_op.cc:276] Timestamp: P: 1769914542594338 usec, L: 0
0201 02:55:53.398385 (+ 129us) write_op.cc:270] Start()
0201 02:55:53.398404 (+ 19us) write_op.cc:276] Timestamp: P: 1769914542603489 usec, L: 0
0201 02:55:53.398529 (+ 125us) write_op.cc:270] Start()
0201 02:55:53.398547 (+ 18us) write_op.cc:276] Timestamp: P: 1769914542604172 usec, L: 0
0201 02:55:53.406578 (+ 8031us) write_op.cc:270] Start()
0201 02:55:53.406602 (+ 24us) write_op.cc:276] Timestamp: P: 1769914542637518 usec, L: 0
0201 02:55:53.406811 (+ 209us) write_op.cc:270] Start()
0201 02:55:53.406832 (+ 21us) write_op.cc:276] Timestamp: P: 1769914542648405 usec, L: 0
0201 02:55:53.406965 (+ 133us) write_op.cc:270] Start()
0201 02:55:53.406983 (+ 18us) write_op.cc:276] Timestamp: P: 1769914542656246 usec, L: 0
0201 02:55:53.407196 (+ 213us) write_op.cc:270] Start()
0201 02:55:53.407229 (+ 33us) write_op.cc:276] Timestamp: P: 1769914542659390 usec, L: 0
0201 02:55:53.407421 (+ 192us) write_op.cc:270] Start()
0201 02:55:53.407450 (+ 29us) write_op.cc:276] Timestamp: P: 1769914542689078 usec, L: 0
0201 02:55:53.407635 (+ 185us) write_op.cc:270] Start()
0201 02:55:53.407660 (+ 25us) write_op.cc:276] Timestamp: P: 1769914542711675 usec, L: 0
0201 02:55:53.407873 (+ 213us) write_op.cc:270] Start()
0201 02:55:53.407894 (+ 21us) write_op.cc:276] Timestamp: P: 1769914542718896 usec, L: 0
0201 02:55:53.441069 (+ 33175us) write_op.cc:270] Start()
0201 02:55:53.441116 (+ 47us) write_op.cc:276] Timestamp: P: 1769914542730894 usec, L: 0
0201 02:55:53.441306 (+ 190us) write_op.cc:270] Start()
0201 02:55:53.441330 (+ 24us) write_op.cc:276] Timestamp: P: 1769914542753008 usec, L: 0
0201 02:55:53.441586 (+ 256us) write_op.cc:270] Start()
0201 02:55:53.441609 (+ 23us) write_op.cc:276] Timestamp: P: 1769914542772735 usec, L: 0
0201 02:55:53.441805 (+ 196us) write_op.cc:270] Start()
0201 02:55:53.441831 (+ 26us) write_op.cc:276] Timestamp: P: 1769914542799405 usec, L: 0
0201 02:55:53.441975 (+ 144us) write_op.cc:270] Start()
0201 02:55:53.442014 (+ 39us) write_op.cc:276] Timestamp: P: 1769914542801908 usec, L: 0
0201 02:55:53.442177 (+ 163us) write_op.cc:270] Start()
0201 02:55:53.442198 (+ 21us) write_op.cc:276] Timestamp: P: 1769914542811049 usec, L: 0
0201 02:55:53.442349 (+ 151us) write_op.cc:270] Start()
0201 02:55:53.442369 (+ 20us) write_op.cc:276] Timestamp: P: 1769914542837867 usec, L: 0
0201 02:55:53.442520 (+ 151us) write_op.cc:270] Start()
0201 02:55:53.442539 (+ 19us) write_op.cc:276] Timestamp: P: 1769914542842409 usec, L: 0
0201 02:55:53.442711 (+ 172us) write_op.cc:270] Start()
0201 02:55:53.442733 (+ 22us) write_op.cc:276] Timestamp: P: 1769914542862948 usec, L: 0
0201 02:55:53.442938 (+ 205us) write_op.cc:270] Start()
0201 02:55:53.442960 (+ 22us) write_op.cc:276] Timestamp: P: 1769914542864196 usec, L: 0
0201 02:55:53.443126 (+ 166us) write_op.cc:270] Start()
0201 02:55:53.443148 (+ 22us) write_op.cc:276] Timestamp: P: 1769914542904333 usec, L: 0
0201 02:55:53.443316 (+ 168us) write_op.cc:270] Start()
0201 02:55:53.443336 (+ 20us) write_op.cc:276] Timestamp: P: 1769914542908054 usec, L: 0
0201 02:55:53.443496 (+ 160us) write_op.cc:270] Start()
0201 02:55:53.443519 (+ 23us) write_op.cc:276] Timestamp: P: 1769914542914616 usec, L: 0
0201 02:55:53.443675 (+ 156us) write_op.cc:270] Start()
0201 02:55:53.443700 (+ 25us) write_op.cc:276] Timestamp: P: 1769914542942183 usec, L: 0
0201 02:55:53.443851 (+ 151us) write_op.cc:270] Start()
0201 02:55:53.443872 (+ 21us) write_op.cc:276] Timestamp: P: 1769914542952423 usec, L: 0
0201 02:55:53.444005 (+ 133us) write_op.cc:270] Start()
0201 02:55:53.444024 (+ 19us) write_op.cc:276] Timestamp: P: 1769914542985765 usec, L: 0
0201 02:55:53.444209 (+ 185us) write_op.cc:270] Start()
0201 02:55:53.444232 (+ 23us) write_op.cc:276] Timestamp: P: 1769914542997692 usec, L: 0
0201 02:55:53.444448 (+ 216us) write_op.cc:270] Start()
0201 02:55:53.444473 (+ 25us) write_op.cc:276] Timestamp: P: 1769914543008166 usec, L: 0
0201 02:55:53.444643 (+ 170us) write_op.cc:270] Start()
0201 02:55:53.444665 (+ 22us) write_op.cc:276] Timestamp: P: 1769914543010212 usec, L: 0
0201 02:55:53.444818 (+ 153us) write_op.cc:270] Start()
0201 02:55:53.444839 (+ 21us) write_op.cc:276] Timestamp: P: 1769914543045178 usec, L: 0
0201 02:55:53.445025 (+ 186us) write_op.cc:270] Start()
0201 02:55:53.445047 (+ 22us) write_op.cc:276] Timestamp: P: 1769914543049083 usec, L: 0
0201 02:55:53.445227 (+ 180us) write_op.cc:270] Start()
0201 02:55:53.445254 (+ 27us) write_op.cc:276] Timestamp: P: 1769914543051941 usec, L: 0
0201 02:55:53.445428 (+ 174us) write_op.cc:270] Start()
0201 02:55:53.445451 (+ 23us) write_op.cc:276] Timestamp: P: 1769914543077071 usec, L: 0
0201 02:55:53.445604 (+ 153us) write_op.cc:270] Start()
0201 02:55:53.445624 (+ 20us) write_op.cc:276] Timestamp: P: 1769914543111137 usec, L: 0
0201 02:55:53.445781 (+ 157us) write_op.cc:270] Start()
0201 02:55:53.445801 (+ 20us) write_op.cc:276] Timestamp: P: 1769914543113343 usec, L: 0
0201 02:55:53.445986 (+ 185us) write_op.cc:270] Start()
0201 02:55:53.446009 (+ 23us) write_op.cc:276] Timestamp: P: 1769914543116938 usec, L: 0
0201 02:55:53.446172 (+ 163us) write_op.cc:270] Start()
0201 02:55:53.446194 (+ 22us) write_op.cc:276] Timestamp: P: 1769914543140712 usec, L: 0
0201 02:55:53.446391 (+ 197us) write_op.cc:270] Start()
0201 02:55:53.446416 (+ 25us) write_op.cc:276] Timestamp: P: 1769914543157894 usec, L: 0
0201 02:55:53.446565 (+ 149us) write_op.cc:270] Start()
0201 02:55:53.446587 (+ 22us) write_op.cc:276] Timestamp: P: 1769914543168923 usec, L: 0
0201 02:55:53.465512 (+ 18925us) write_op.cc:270] Start()
0201 02:55:53.465550 (+ 38us) write_op.cc:276] Timestamp: P: 1769914543169746 usec, L: 0
0201 02:55:53.465827 (+ 277us) write_op.cc:270] Start()
0201 02:55:53.465865 (+ 38us) write_op.cc:276] Timestamp: P: 1769914543197198 usec, L: 0
0201 02:55:53.466023 (+ 158us) write_op.cc:270] Start()
0201 02:55:53.466074 (+ 51us) write_op.cc:276] Timestamp: P: 1769914543209665 usec, L: 0
0201 02:55:53.466289 (+ 215us) write_op.cc:270] Start()
0201 02:55:53.466312 (+ 23us) write_op.cc:276] Timestamp: P: 1769914543233394 usec, L: 0
0201 02:55:53.466457 (+ 145us) write_op.cc:270] Start()
0201 02:55:53.466485 (+ 28us) write_op.cc:276] Timestamp: P: 1769914543240982 usec, L: 0
0201 02:55:53.466670 (+ 185us) write_op.cc:270] Start()
0201 02:55:53.466693 (+ 23us) write_op.cc:276] Timestamp: P: 1769914543243156 usec, L: 0
0201 02:55:53.466884 (+ 191us) write_op.cc:270] Start()
0201 02:55:53.466905 (+ 21us) write_op.cc:276] Timestamp: P: 1769914543267976 usec, L: 0
0201 02:55:53.467085 (+ 180us) write_op.cc:270] Start()
0201 02:55:53.467118 (+ 33us) write_op.cc:276] Timestamp: P: 1769914543281707 usec, L: 0
0201 02:55:53.467287 (+ 169us) write_op.cc:270] Start()
0201 02:55:53.467312 (+ 25us) write_op.cc:276] Timestamp: P: 1769914543295064 usec, L: 0
0201 02:55:53.467457 (+ 145us) write_op.cc:270] Start()
0201 02:55:53.467478 (+ 21us) write_op.cc:276] Timestamp: P: 1769914543315766 usec, L: 0
0201 02:55:53.467622 (+ 144us) write_op.cc:270] Start()
0201 02:55:53.467648 (+ 26us) write_op.cc:276] Timestamp: P: 1769914543327663 usec, L: 0
0201 02:55:53.467821 (+ 173us) write_op.cc:270] Start()
0201 02:55:53.467842 (+ 21us) write_op.cc:276] Timestamp: P: 1769914543334198 usec, L: 0
0201 02:55:53.468051 (+ 209us) write_op.cc:270] Start()
0201 02:55:53.468072 (+ 21us) write_op.cc:276] Timestamp: P: 1769914543358556 usec, L: 0
0201 02:55:53.468334 (+ 262us) write_op.cc:270] Start()
0201 02:55:53.468356 (+ 22us) write_op.cc:276] Timestamp: P: 1769914543385161 usec, L: 0
0201 02:55:53.468525 (+ 169us) write_op.cc:270] Start()
0201 02:55:53.468545 (+ 20us) write_op.cc:276] Timestamp: P: 1769914543394465 usec, L: 0
0201 02:55:53.468696 (+ 151us) write_op.cc:270] Start()
0201 02:55:53.468784 (+ 88us) write_op.cc:276] Timestamp: P: 1769914543395627 usec, L: 0
0201 02:55:53.468959 (+ 175us) write_op.cc:270] Start()
0201 02:55:53.468980 (+ 21us) write_op.cc:276] Timestamp: P: 1769914543406123 usec, L: 0
0201 02:55:53.469158 (+ 178us) write_op.cc:270] Start()
0201 02:55:53.469179 (+ 21us) write_op.cc:276] Timestamp: P: 1769914543445215 usec, L: 0
0201 02:55:53.469359 (+ 180us) write_op.cc:270] Start()
0201 02:55:53.469379 (+ 20us) write_op.cc:276] Timestamp: P: 1769914543473338 usec, L: 0
0201 02:55:53.469534 (+ 155us) write_op.cc:270] Start()
0201 02:55:53.469553 (+ 19us) write_op.cc:276] Timestamp: P: 1769914543479176 usec, L: 0
0201 02:55:53.469708 (+ 155us) write_op.cc:270] Start()
0201 02:55:53.469727 (+ 19us) write_op.cc:276] Timestamp: P: 1769914543480117 usec, L: 0
0201 02:55:53.469852 (+ 125us) write_op.cc:270] Start()
0201 02:55:53.469869 (+ 17us) write_op.cc:276] Timestamp: P: 1769914543502979 usec, L: 0
0201 02:55:53.469997 (+ 128us) write_op.cc:270] Start()
0201 02:55:53.470014 (+ 17us) write_op.cc:276] Timestamp: P: 1769914543532205 usec, L: 0
0201 02:55:53.470180 (+ 166us) write_op.cc:270] Start()
0201 02:55:53.470200 (+ 20us) write_op.cc:276] Timestamp: P: 1769914543534459 usec, L: 0
0201 02:55:53.470396 (+ 196us) write_op.cc:270] Start()
0201 02:55:53.470416 (+ 20us) write_op.cc:276] Timestamp: P: 1769914543535260 usec, L: 0
0201 02:55:53.470568 (+ 152us) write_op.cc:270] Start()
0201 02:55:53.470585 (+ 17us) write_op.cc:276] Timestamp: P: 1769914543576449 usec, L: 0
0201 02:55:53.477714 (+ 7129us) write_op.cc:270] Start()
0201 02:55:53.477758 (+ 44us) write_op.cc:276] Timestamp: P: 1769914543577093 usec, L: 0
0201 02:55:53.478026 (+ 268us) write_op.cc:270] Start()
0201 02:55:53.478051 (+ 25us) write_op.cc:276] Timestamp: P: 1769914543605481 usec, L: 0
0201 02:55:53.478246 (+ 195us) write_op.cc:270] Start()
0201 02:55:53.478262 (+ 16us) write_op.cc:276] Timestamp: P: 1769914543606235 usec, L: 0
0201 02:55:53.478428 (+ 166us) write_op.cc:270] Start()
0201 02:55:53.478449 (+ 21us) write_op.cc:276] Timestamp: P: 1769914543619456 usec, L: 0
0201 02:55:53.478608 (+ 159us) write_op.cc:270] Start()
0201 02:55:53.478637 (+ 29us) write_op.cc:276] Timestamp: P: 1769914543631419 usec, L: 0
0201 02:55:53.478841 (+ 204us) write_op.cc:270] Start()
0201 02:55:53.478869 (+ 28us) write_op.cc:276] Timestamp: P: 1769914543656330 usec, L: 0
0201 02:55:53.479030 (+ 161us) write_op.cc:270] Start()
0201 02:55:53.479050 (+ 20us) write_op.cc:276] Timestamp: P: 1769914543661417 usec, L: 0
0201 02:55:53.480039 (+ 989us) write_op.cc:270] Start()
0201 02:55:53.480073 (+ 34us) write_op.cc:276] Timestamp: P: 1769914543682021 usec, L: 0
0201 02:55:53.480271 (+ 198us) write_op.cc:270] Start()
0201 02:55:53.480292 (+ 21us) write_op.cc:276] Timestamp: P: 1769914543686046 usec, L: 0
0201 02:55:53.480457 (+ 165us) write_op.cc:270] Start()
0201 02:55:53.480481 (+ 24us) write_op.cc:276] Timestamp: P: 1769914543710336 usec, L: 0
0201 02:55:53.480639 (+ 158us) write_op.cc:270] Start()
0201 02:55:53.480662 (+ 23us) write_op.cc:276] Timestamp: P: 1769914543737945 usec, L: 0
0201 02:55:53.480796 (+ 134us) write_op.cc:270] Start()
0201 02:55:53.480814 (+ 18us) write_op.cc:276] Timestamp: P: 1769914543741292 usec, L: 0
0201 02:55:53.480951 (+ 137us) write_op.cc:270] Start()
0201 02:55:53.480970 (+ 19us) write_op.cc:276] Timestamp: P: 1769914543743570 usec, L: 0
0201 02:55:53.481106 (+ 136us) write_op.cc:270] Start()
0201 02:55:53.481126 (+ 20us) write_op.cc:276] Timestamp: P: 1769914543776462 usec, L: 0
0201 02:55:53.481253 (+ 127us) write_op.cc:270] Start()
0201 02:55:53.481271 (+ 18us) write_op.cc:276] Timestamp: P: 1769914543803239 usec, L: 0
0201 02:55:53.481412 (+ 141us) write_op.cc:270] Start()
0201 02:55:53.481430 (+ 18us) write_op.cc:276] Timestamp: P: 1769914543805439 usec, L: 0
0201 02:55:53.481550 (+ 120us) write_op.cc:270] Start()
0201 02:55:53.481567 (+ 17us) write_op.cc:276] Timestamp: P: 1769914543806194 usec, L: 0
0201 02:55:53.481686 (+ 119us) write_op.cc:270] Start()
0201 02:55:53.481703 (+ 17us) write_op.cc:276] Timestamp: P: 1769914543824997 usec, L: 0
0201 02:55:53.481827 (+ 124us) write_op.cc:270] Start()
0201 02:55:53.481850 (+ 23us) write_op.cc:276] Timestamp: P: 1769914543871820 usec, L: 0
0201 02:55:53.481968 (+ 118us) write_op.cc:270] Start()
0201 02:55:53.481984 (+ 16us) write_op.cc:276] Timestamp: P: 1769914543873209 usec, L: 0
0201 02:55:53.482121 (+ 137us) write_op.cc:270] Start()
0201 02:55:53.482139 (+ 18us) write_op.cc:276] Timestamp: P: 1769914543873926 usec, L: 0
0201 02:55:53.482273 (+ 134us) write_op.cc:270] Start()
0201 02:55:53.482290 (+ 17us) write_op.cc:276] Timestamp: P: 1769914543875408 usec, L: 0
0201 02:55:53.482406 (+ 116us) write_op.cc:270] Start()
0201 02:55:53.482423 (+ 17us) write_op.cc:276] Timestamp: P: 1769914543924808 usec, L: 0
0201 02:55:53.482538 (+ 115us) write_op.cc:270] Start()
0201 02:55:53.482555 (+ 17us) write_op.cc:276] Timestamp: P: 1769914543927911 usec, L: 0
0201 02:55:53.482688 (+ 133us) write_op.cc:270] Start()
0201 02:55:53.482705 (+ 17us) write_op.cc:276] Timestamp: P: 1769914543938330 usec, L: 0
0201 02:55:53.482904 (+ 199us) write_op.cc:270] Start()
0201 02:55:53.482925 (+ 21us) write_op.cc:276] Timestamp: P: 1769914543966435 usec, L: 0
0201 02:55:53.483143 (+ 218us) write_op.cc:270] Start()
0201 02:55:53.483168 (+ 25us) write_op.cc:276] Timestamp: P: 1769914543987354 usec, L: 0
0201 02:55:53.483340 (+ 172us) write_op.cc:270] Start()
0201 02:55:53.483361 (+ 21us) write_op.cc:276] Timestamp: P: 1769914543994828 usec, L: 0
0201 02:55:53.483516 (+ 155us) write_op.cc:270] Start()
0201 02:55:53.483537 (+ 21us) write_op.cc:276] Timestamp: P: 1769914544030971 usec, L: 0
0201 02:55:53.483678 (+ 141us) write_op.cc:270] Start()
0201 02:55:53.483697 (+ 19us) write_op.cc:276] Timestamp: P: 1769914544039244 usec, L: 0
0201 02:55:53.488535 (+ 4838us) write_op.cc:270] Start()
0201 02:55:53.488579 (+ 44us) write_op.cc:276] Timestamp: P: 1769914544052528 usec, L: 0
0201 02:55:53.488855 (+ 276us) write_op.cc:270] Start()
0201 02:55:53.488885 (+ 30us) write_op.cc:276] Timestamp: P: 1769914544056432 usec, L: 0
0201 02:55:53.489090 (+ 205us) write_op.cc:270] Start()
0201 02:55:53.489140 (+ 50us) write_op.cc:276] Timestamp: P: 1769914544089860 usec, L: 0
0201 02:55:53.489340 (+ 200us) write_op.cc:270] Start()
0201 02:55:53.489365 (+ 25us) write_op.cc:276] Timestamp: P: 1769914544091266 usec, L: 0
0201 02:55:53.489560 (+ 195us) write_op.cc:270] Start()
0201 02:55:53.489584 (+ 24us) write_op.cc:276] Timestamp: P: 1769914544092319 usec, L: 0
0201 02:55:53.489797 (+ 213us) write_op.cc:270] Start()
0201 02:55:53.489821 (+ 24us) write_op.cc:276] Timestamp: P: 1769914544093441 usec, L: 0
0201 02:55:53.490038 (+ 217us) write_op.cc:270] Start()
0201 02:55:53.490063 (+ 25us) write_op.cc:276] Timestamp: P: 1769914544144105 usec, L: 0
0201 02:55:53.490274 (+ 211us) write_op.cc:270] Start()
0201 02:55:53.490295 (+ 21us) write_op.cc:276] Timestamp: P: 1769914544153344 usec, L: 0
0201 02:55:53.490445 (+ 150us) write_op.cc:270] Start()
0201 02:55:53.490463 (+ 18us) write_op.cc:276] Timestamp: P: 1769914544154800 usec, L: 0
0201 02:55:53.490608 (+ 145us) write_op.cc:270] Start()
0201 02:55:53.490626 (+ 18us) write_op.cc:276] Timestamp: P: 1769914544160091 usec, L: 0
0201 02:55:53.502941 (+ 12315us) write_op.cc:270] Start()
0201 02:55:53.502971 (+ 30us) write_op.cc:276] Timestamp: P: 1769914544182495 usec, L: 0
0201 02:55:53.503179 (+ 208us) write_op.cc:270] Start()
0201 02:55:53.503204 (+ 25us) write_op.cc:276] Timestamp: P: 1769914544214054 usec, L: 0
0201 02:55:53.503354 (+ 150us) write_op.cc:270] Start()
0201 02:55:53.503375 (+ 21us) write_op.cc:276] Timestamp: P: 1769914544214844 usec, L: 0
0201 02:55:53.503556 (+ 181us) write_op.cc:270] Start()
0201 02:55:53.503576 (+ 20us) write_op.cc:276] Timestamp: P: 1769914544215467 usec, L: 0
0201 02:55:53.503733 (+ 157us) write_op.cc:270] Start()
0201 02:55:53.503754 (+ 21us) write_op.cc:276] Timestamp: P: 1769914544241329 usec, L: 0
0201 02:55:53.503917 (+ 163us) write_op.cc:270] Start()
0201 02:55:53.503939 (+ 22us) write_op.cc:276] Timestamp: P: 1769914544276684 usec, L: 0
0201 02:55:53.504124 (+ 185us) write_op.cc:270] Start()
0201 02:55:53.504146 (+ 22us) write_op.cc:276] Timestamp: P: 1769914544280972 usec, L: 0
0201 02:55:53.504309 (+ 163us) write_op.cc:270] Start()
0201 02:55:53.504330 (+ 21us) write_op.cc:276] Timestamp: P: 1769914544287191 usec, L: 0
0201 02:55:53.504480 (+ 150us) write_op.cc:270] Start()
0201 02:55:53.504502 (+ 22us) write_op.cc:276] Timestamp: P: 1769914544295221 usec, L: 0
0201 02:55:53.504660 (+ 158us) write_op.cc:270] Start()
0201 02:55:53.504683 (+ 23us) write_op.cc:276] Timestamp: P: 1769914544328088 usec, L: 0
0201 02:55:53.504883 (+ 200us) write_op.cc:270] Start()
0201 02:55:53.504913 (+ 30us) write_op.cc:276] Timestamp: P: 1769914544370728 usec, L: 0
0201 02:55:53.505070 (+ 157us) write_op.cc:270] Start()
0201 02:55:53.505103 (+ 33us) write_op.cc:276] Timestamp: P: 1769914544377226 usec, L: 0
0201 02:55:53.505269 (+ 166us) write_op.cc:270] Start()
0201 02:55:53.505290 (+ 21us) write_op.cc:276] Timestamp: P: 1769914544378824 usec, L: 0
0201 02:55:53.505453 (+ 163us) write_op.cc:270] Start()
0201 02:55:53.505475 (+ 22us) write_op.cc:276] Timestamp: P: 1769914544381541 usec, L: 0
0201 02:55:53.505614 (+ 139us) write_op.cc:270] Start()
0201 02:55:53.505634 (+ 20us) write_op.cc:276] Timestamp: P: 1769914544441718 usec, L: 0
0201 02:55:53.505794 (+ 160us) write_op.cc:270] Start()
0201 02:55:53.505813 (+ 19us) write_op.cc:276] Timestamp: P: 1769914544446593 usec, L: 0
0201 02:55:53.505951 (+ 138us) write_op.cc:270] Start()
0201 02:55:53.505969 (+ 18us) write_op.cc:276] Timestamp: P: 1769914544450878 usec, L: 0
0201 02:55:53.506134 (+ 165us) write_op.cc:270] Start()
0201 02:55:53.506155 (+ 21us) write_op.cc:276] Timestamp: P: 1769914544451561 usec, L: 0
0201 02:55:53.506340 (+ 185us) write_op.cc:270] Start()
0201 02:55:53.506366 (+ 26us) write_op.cc:276] Timestamp: P: 1769914544485573 usec, L: 0
0201 02:55:53.506518 (+ 152us) write_op.cc:270] Start()
0201 02:55:53.506539 (+ 21us) write_op.cc:276] Timestamp: P: 1769914544488207 usec, L: 0
0201 02:55:53.506759 (+ 220us) write_op.cc:270] Start()
0201 02:55:53.506808 (+ 49us) write_op.cc:276] Timestamp: P: 1769914544501155 usec, L: 0
0201 02:55:53.506981 (+ 173us) write_op.cc:270] Start()
0201 02:55:53.507002 (+ 21us) write_op.cc:276] Timestamp: P: 1769914544541385 usec, L: 0
0201 02:55:53.507151 (+ 149us) write_op.cc:270] Start()
0201 02:55:53.507170 (+ 19us) write_op.cc:276] Timestamp: P: 1769914544543376 usec, L: 0
0201 02:55:53.507302 (+ 132us) write_op.cc:270] Start()
0201 02:55:53.507319 (+ 17us) write_op.cc:276] Timestamp: P: 1769914544571440 usec, L: 0
0201 02:55:53.507434 (+ 115us) write_op.cc:270] Start()
0201 02:55:53.507516 (+ 82us) write_op.cc:276] Timestamp: P: 1769914544581107 usec, L: 0
0201 02:55:53.507671 (+ 155us) write_op.cc:270] Start()
0201 02:55:53.507689 (+ 18us) write_op.cc:276] Timestamp: P: 1769914544587678 usec, L: 0
0201 02:55:53.507828 (+ 139us) write_op.cc:270] Start()
0201 02:55:53.507844 (+ 16us) write_op.cc:276] Timestamp: P: 1769914544588268 usec, L: 0
0201 02:55:53.507966 (+ 122us) write_op.cc:270] Start()
0201 02:55:53.507982 (+ 16us) write_op.cc:276] Timestamp: P: 1769914544620604 usec, L: 0
0201 02:55:53.508106 (+ 124us) write_op.cc:270] Start()
0201 02:55:53.508122 (+ 16us) write_op.cc:276] Timestamp: P: 1769914544644053 usec, L: 0
0201 02:55:53.508256 (+ 134us) write_op.cc:270] Start()
0201 02:55:53.508274 (+ 18us) write_op.cc:276] Timestamp: P: 1769914544653939 usec, L: 0
0201 02:55:53.508389 (+ 115us) write_op.cc:270] Start()
0201 02:55:53.508406 (+ 17us) write_op.cc:276] Timestamp: P: 1769914544680182 usec, L: 0
0201 02:55:53.508536 (+ 130us) write_op.cc:270] Start()
0201 02:55:53.508563 (+ 27us) write_op.cc:276] Timestamp: P: 1769914544688926 usec, L: 0
0201 02:55:53.508676 (+ 113us) write_op.cc:270] Start()
0201 02:55:53.508693 (+ 17us) write_op.cc:276] Timestamp: P: 1769914544718941 usec, L: 0
0201 02:55:53.508822 (+ 129us) write_op.cc:270] Start()
0201 02:55:53.508845 (+ 23us) write_op.cc:276] Timestamp: P: 1769914544723192 usec, L: 0
0201 02:55:53.508991 (+ 146us) write_op.cc:270] Start()
0201 02:55:53.509009 (+ 18us) write_op.cc:276] Timestamp: P: 1769914544728580 usec, L: 0
0201 02:55:53.509154 (+ 145us) write_op.cc:270] Start()
0201 02:55:53.509171 (+ 17us) write_op.cc:276] Timestamp: P: 1769914544758278 usec, L: 0
0201 02:55:53.509318 (+ 147us) write_op.cc:270] Start()
0201 02:55:53.509338 (+ 20us) write_op.cc:276] Timestamp: P: 1769914544772950 usec, L: 0
0201 02:55:53.509496 (+ 158us) write_op.cc:270] Start()
0201 02:55:53.509517 (+ 21us) write_op.cc:276] Timestamp: P: 1769914544788392 usec, L: 0
0201 02:55:53.509697 (+ 180us) write_op.cc:270] Start()
0201 02:55:53.509718 (+ 21us) write_op.cc:276] Timestamp: P: 1769914544790213 usec, L: 0
0201 02:55:53.509870 (+ 152us) write_op.cc:270] Start()
0201 02:55:53.509890 (+ 20us) write_op.cc:276] Timestamp: P: 1769914544820098 usec, L: 0
0201 02:55:53.510029 (+ 139us) write_op.cc:270] Start()
0201 02:55:53.510048 (+ 19us) write_op.cc:276] Timestamp: P: 1769914544823000 usec, L: 0
0201 02:55:53.510210 (+ 162us) write_op.cc:270] Start()
0201 02:55:53.510231 (+ 21us) write_op.cc:276] Timestamp: P: 1769914544841364 usec, L: 0
0201 02:55:53.510394 (+ 163us) write_op.cc:270] Start()
0201 02:55:53.510417 (+ 23us) write_op.cc:276] Timestamp: P: 1769914544871055 usec, L: 0
0201 02:55:53.510557 (+ 140us) write_op.cc:270] Start()
0201 02:55:53.510574 (+ 17us) write_op.cc:276] Timestamp: P: 1769914544881215 usec, L: 0
0201 02:55:53.510777 (+ 203us) write_op.cc:270] Start()
0201 02:55:53.510798 (+ 21us) write_op.cc:276] Timestamp: P: 1769914544903015 usec, L: 0
0201 02:55:53.510999 (+ 201us) write_op.cc:270] Start()
0201 02:55:53.511020 (+ 21us) write_op.cc:276] Timestamp: P: 1769914544930553 usec, L: 0
0201 02:55:53.511215 (+ 195us) write_op.cc:270] Start()
0201 02:55:53.511239 (+ 24us) write_op.cc:276] Timestamp: P: 1769914544933105 usec, L: 0
0201 02:55:53.511436 (+ 197us) write_op.cc:270] Start()
0201 02:55:53.511459 (+ 23us) write_op.cc:276] Timestamp: P: 1769914544950346 usec, L: 0
0201 02:55:53.511654 (+ 195us) write_op.cc:270] Start()
0201 02:55:53.511675 (+ 21us) write_op.cc:276] Timestamp: P: 1769914544980588 usec, L: 0
0201 02:55:53.511887 (+ 212us) write_op.cc:270] Start()
0201 02:55:53.511909 (+ 22us) write_op.cc:276] Timestamp: P: 1769914545011444 usec, L: 0
0201 02:55:53.512711 (+ 802us) write_op.cc:270] Start()
0201 02:55:53.512734 (+ 23us) write_op.cc:276] Timestamp: P: 1769914545012166 usec, L: 0
0201 02:55:53.512904 (+ 170us) write_op.cc:270] Start()
0201 02:55:53.512927 (+ 23us) write_op.cc:276] Timestamp: P: 1769914545031975 usec, L: 0
0201 02:55:53.513101 (+ 174us) write_op.cc:270]
I20260201 02:55:55.774443 14895 raft_consensus.cc:359] T 7519edb327894747a21ff97e8a90f2f9 P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:55:55.776068 14895 raft_consensus.cc:740] T 7519edb327894747a21ff97e8a90f2f9 P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20beda53b20146fb90018bf4533dcd58, State: Initialized, Role: FOLLOWER
I20260201 02:55:55.776384 14895 consensus_queue.cc:260] T 7519edb327894747a21ff97e8a90f2f9 P 20beda53b20146fb90018bf4533dcd58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 167, Last appended: 1.167, Last appended by leader: 167, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:55:55.777732 14895 ts_tablet_manager.cc:1434] T 7519edb327894747a21ff97e8a90f2f9 P 20beda53b20146fb90018bf4533dcd58: Time spent starting tablet: real 0.010s user 0.000s sys 0.002s
I20260201 02:55:55.779043 14895 tablet_bootstrap.cc:492] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58: Bootstrap starting.
I20260201 02:55:54.341502 14963 rpcz_store.cc:276] 0201 02:55:53.256380 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 02:55:53.258726 (+ 2346us) service_pool.cc:225] Handling call
0201 02:55:53.357777 (+ 99051us) raft_consensus.cc:1471] Updating replica for 557 ops
0201 02:55:53.406046 (+ 48269us) raft_consensus.cc:1534] Early marking committed up to index 0
0201 02:55:53.406052 (+ 6us) raft_consensus.cc:1539] Triggering prepare for 557 ops
0201 02:55:53.406228 (+ 176us) write_op.cc:270] Start()
0201 02:55:53.406259 (+ 31us) write_op.cc:276] Timestamp: P: 1769914541667130 usec, L: 0
0201 02:55:53.478239 (+ 71980us) write_op.cc:270] Start()
0201 02:55:53.478261 (+ 22us) write_op.cc:276] Timestamp: P: 1769914541697096 usec, L: 0
0201 02:55:53.512711 (+ 34450us) write_op.cc:270] Start()
0201 02:55:53.512735 (+ 24us) write_op.cc:276] Timestamp: P: 1769914541727587 usec, L: 0
0201 02:55:53.519462 (+ 6727us) write_op.cc:270] Start()
0201 02:55:53.519485 (+ 23us) write_op.cc:276] Timestamp: P: 1769914541732113 usec, L: 0
0201 02:55:53.520189 (+ 704us) write_op.cc:270] Start()
0201 02:55:53.520216 (+ 27us) write_op.cc:276] Timestamp: P: 1769914542061232 usec, L: 0
0201 02:55:53.520872 (+ 656us) write_op.cc:270] Start()
0201 02:55:53.520895 (+ 23us) write_op.cc:276] Timestamp: P: 1769914542061937 usec, L: 0
0201 02:55:53.521462 (+ 567us) write_op.cc:270] Start()
0201 02:55:53.521515 (+ 53us) write_op.cc:276] Timestamp: P: 1769914542091170 usec, L: 0
0201 02:55:53.522074 (+ 559us) write_op.cc:270] Start()
0201 02:55:53.522107 (+ 33us) write_op.cc:276] Timestamp: P: 1769914542092641 usec, L: 0
0201 02:55:53.522740 (+ 633us) write_op.cc:270] Start()
0201 02:55:53.522762 (+ 22us) write_op.cc:276] Timestamp: P: 1769914542124988 usec, L: 0
0201 02:55:53.523416 (+ 654us) write_op.cc:270] Start()
0201 02:55:53.523442 (+ 26us) write_op.cc:276] Timestamp: P: 1769914542132954 usec, L: 0
0201 02:55:53.524647 (+ 1205us) write_op.cc:270] Start()
0201 02:55:53.524671 (+ 24us) write_op.cc:276] Timestamp: P: 1769914542134670 usec, L: 0
0201 02:55:53.524828 (+ 157us) write_op.cc:270] Start()
0201 02:55:53.524848 (+ 20us) write_op.cc:276] Timestamp: P: 1769914542154733 usec, L: 0
0201 02:55:53.525044 (+ 196us) write_op.cc:270] Start()
0201 02:55:53.526558 (+ 1514us) write_op.cc:276] Timestamp: P: 1769914542174493 usec, L: 0
0201 02:55:53.526744 (+ 186us) write_op.cc:270] Start()
0201 02:55:53.526763 (+ 19us) write_op.cc:276] Timestamp: P: 1769914542208255 usec, L: 0
0201 02:55:53.526886 (+ 123us) write_op.cc:270] Start()
0201 02:55:53.526902 (+ 16us) write_op.cc:276] Timestamp: P: 1769914542208878 usec, L: 0
0201 02:55:53.527032 (+ 130us) write_op.cc:270] Start()
0201 02:55:53.527049 (+ 17us) write_op.cc:276] Timestamp: P: 1769914542237861 usec, L: 0
0201 02:55:53.527176 (+ 127us) write_op.cc:270] Start()
0201 02:55:53.527199 (+ 23us) write_op.cc:276] Timestamp: P: 1769914542239645 usec, L: 0
0201 02:55:53.527312 (+ 113us) write_op.cc:270] Start()
0201 02:55:53.527329 (+ 17us) write_op.cc:276] Timestamp: P: 1769914542247704 usec, L: 0
0201 02:55:53.527460 (+ 131us) write_op.cc:270] Start()
0201 02:55:53.527476 (+ 16us) write_op.cc:276] Timestamp: P: 1769914542266756 usec, L: 0
0201 02:55:53.527581 (+ 105us) write_op.cc:270] Start()
0201 02:55:53.527595 (+ 14us) write_op.cc:276] Timestamp: P: 1769914542286327 usec, L: 0
0201 02:55:53.534682 (+ 7087us) write_op.cc:270] Start()
0201 02:55:53.534731 (+ 49us) write_op.cc:276] Timestamp: P: 1769914542292183 usec, L: 0
0201 02:55:53.535475 (+ 744us) write_op.cc:270] Start()
0201 02:55:53.535530 (+ 55us) write_op.cc:276] Timestamp: P: 1769914542309587 usec, L: 0
0201 02:55:53.535719 (+ 189us) write_op.cc:270] Start()
0201 02:55:53.555215 (+ 19496us) write_op.cc:276] Timestamp: P: 1769914542313749 usec, L: 0
0201 02:55:53.558750 (+ 3535us) write_op.cc:270] Start()
0201 02:55:53.558778 (+ 28us) write_op.cc:276] Timestamp: P: 1769914542343884 usec, L: 0
0201 02:55:53.559054 (+ 276us) write_op.cc:270] Start()
0201 02:55:53.559079 (+ 25us) write_op.cc:276] Timestamp: P: 1769914542353374 usec, L: 0
0201 02:55:53.561349 (+ 2270us) write_op.cc:270] Start()
0201 02:55:53.561379 (+ 30us) write_op.cc:276] Timestamp: P: 1769914542374215 usec, L: 0
0201 02:55:53.561559 (+ 180us) write_op.cc:270] Start()
0201 02:55:53.561586 (+ 27us) write_op.cc:276] Timestamp: P: 1769914542386719 usec, L: 0
0201 02:55:53.561743 (+ 157us) write_op.cc:270] Start()
0201 02:55:53.561763 (+ 20us) write_op.cc:276] Timestamp: P: 1769914542420288 usec, L: 0
0201 02:55:53.561919 (+ 156us) write_op.cc:270] Start()
0201 02:55:53.561940 (+ 21us) write_op.cc:276] Timestamp: P: 1769914542421249 usec, L: 0
0201 02:55:53.562096 (+ 156us) write_op.cc:270] Start()
0201 02:55:53.562117 (+ 21us) write_op.cc:276] Timestamp: P: 1769914542428513 usec, L: 0
0201 02:55:53.562256 (+ 139us) write_op.cc:270] Start()
0201 02:55:53.562461 (+ 205us) write_op.cc:276] Timestamp: P: 1769914542445394 usec, L: 0
0201 02:55:53.562682 (+ 221us) write_op.cc:270] Start()
0201 02:55:53.562704 (+ 22us) write_op.cc:276] Timestamp: P: 1769914542475643 usec, L: 0
0201 02:55:53.563494 (+ 790us) write_op.cc:270] Start()
0201 02:55:53.563522 (+ 28us) write_op.cc:276] Timestamp: P: 1769914542488347 usec, L: 0
0201 02:55:53.563688 (+ 166us) write_op.cc:270] Start()
0201 02:55:53.563708 (+ 20us) write_op.cc:276] Timestamp: P: 1769914542510485 usec, L: 0
0201 02:55:53.563851 (+ 143us) write_op.cc:270] Start()
0201 02:55:53.563871 (+ 20us) write_op.cc:276] Timestamp: P: 1769914542519678 usec, L: 0
0201 02:55:53.564002 (+ 131us) write_op.cc:270] Start()
0201 02:55:53.564023 (+ 21us) write_op.cc:276] Timestamp: P: 1769914542530699 usec, L: 0
0201 02:55:53.564705 (+ 682us) write_op.cc:270] Start()
0201 02:55:53.565526 (+ 821us) write_op.cc:276] Timestamp: P: 1769914542534192 usec, L: 0
0201 02:55:53.565700 (+ 174us) write_op.cc:270] Start()
0201 02:55:53.565731 (+ 31us) write_op.cc:276] Timestamp: P: 1769914542558055 usec, L: 0
0201 02:55:53.565867 (+ 136us) write_op.cc:270] Start()
0201 02:55:53.565887 (+ 20us) write_op.cc:276] Timestamp: P: 1769914542588000 usec, L: 0
0201 02:55:53.566032 (+ 145us) write_op.cc:270] Start()
0201 02:55:53.566053 (+ 21us) write_op.cc:276] Timestamp: P: 1769914542602597 usec, L: 0
0201 02:55:53.566226 (+ 173us) write_op.cc:270] Start()
0201 02:55:53.566248 (+ 22us) write_op.cc:276] Timestamp: P: 1769914542604872 usec, L: 0
0201 02:55:53.567852 (+ 1604us) write_op.cc:270] Start()
0201 02:55:53.567879 (+ 27us) write_op.cc:276] Timestamp: P: 1769914542605559 usec, L: 0
0201 02:55:53.568044 (+ 165us) write_op.cc:270] Start()
0201 02:55:53.568065 (+ 21us) write_op.cc:276] Timestamp: P: 1769914542649101 usec, L: 0
0201 02:55:53.568207 (+ 142us) write_op.cc:270] Start()
0201 02:55:53.568227 (+ 20us) write_op.cc:276] Timestamp: P: 1769914542652026 usec, L: 0
0201 02:55:53.578293 (+ 10066us) write_op.cc:270] Start()
0201 02:55:53.578336 (+ 43us) write_op.cc:276] Timestamp: P: 1769914542656125 usec, L: 0
0201 02:55:53.581955 (+ 3619us) write_op.cc:270] Start()
0201 02:55:53.581982 (+ 27us) write_op.cc:276] Timestamp: P: 1769914542658520 usec, L: 0
0201 02:55:53.582177 (+ 195us) write_op.cc:270] Start()
0201 02:55:53.582201 (+ 24us) write_op.cc:276] Timestamp: P: 1769914542687193 usec, L: 0
0201 02:55:53.582812 (+ 611us) write_op.cc:270] Start()
0201 02:55:53.582836 (+ 24us) write_op.cc:276] Timestamp: P: 1769914542709599 usec, L: 0
0201 02:55:53.583487 (+ 651us) write_op.cc:270] Start()
0201 02:55:53.583512 (+ 25us) write_op.cc:276] Timestamp: P: 1769914542718123 usec, L: 0
0201 02:55:53.585041 (+ 1529us) write_op.cc:270] Start()
0201 02:55:53.585068 (+ 27us) write_op.cc:276] Timestamp: P: 1769914542722873 usec, L: 0
0201 02:55:53.610733 (+ 25665us) write_op.cc:270] Start()
0201 02:55:53.610780 (+ 47us) write_op.cc:276] Timestamp: P: 1769914542745444 usec, L: 0
0201 02:55:53.612591 (+ 1811us) write_op.cc:270] Start()
0201 02:55:53.612615 (+ 24us) write_op.cc:276] Timestamp: P: 1769914542765008 usec, L: 0
0201 02:55:53.623478 (+ 10863us) write_op.cc:270] Start()
0201 02:55:53.623512 (+ 34us) write_op.cc:276] Timestamp: P: 1769914542784459 usec, L: 0
0201 02:55:53.626038 (+ 2526us) write_op.cc:270] Start()
0201 02:55:53.626068 (+ 30us) write_op.cc:276] Timestamp: P: 1769914542799396 usec, L: 0
0201 02:55:53.628753 (+ 2685us) write_op.cc:270] Start()
0201 02:55:53.628783 (+ 30us) write_op.cc:276] Timestamp: P: 1769914542811554 usec, L: 0
0201 02:55:53.633351 (+ 4568us) write_op.cc:270] Start()
0201 02:55:53.633383 (+ 32us) write_op.cc:276] Timestamp: P: 1769914542837609 usec, L: 0
0201 02:55:53.633571 (+ 188us) write_op.cc:270] Start()
0201 02:55:53.633593 (+ 22us) write_op.cc:276] Timestamp: P: 1769914542841544 usec, L: 0
0201 02:55:53.634083 (+ 490us) write_op.cc:270] Start()
0201 02:55:53.634106 (+ 23us) write_op.cc:276] Timestamp: P: 1769914542860776 usec, L: 0
0201 02:55:53.634267 (+ 161us) write_op.cc:270] Start()
0201 02:55:53.634289 (+ 22us) write_op.cc:276] Timestamp: P: 1769914542862306 usec, L: 0
0201 02:55:53.634464 (+ 175us) write_op.cc:270] Start()
0201 02:55:53.634514 (+ 50us) write_op.cc:276] Timestamp: P: 1769914542904134 usec, L: 0
0201 02:55:53.634735 (+ 221us) write_op.cc:270] Start()
0201 02:55:53.634761 (+ 26us) write_op.cc:276] Timestamp: P: 1769914542907409 usec, L: 0
0201 02:55:53.634945 (+ 184us) write_op.cc:270] Start()
0201 02:55:53.634967 (+ 22us) write_op.cc:276] Timestamp: P: 1769914542914289 usec, L: 0
0201 02:55:53.635162 (+ 195us) write_op.cc:270] Start()
0201 02:55:53.635188 (+ 26us) write_op.cc:276] Timestamp: P: 1769914542943809 usec, L: 0
0201 02:55:53.635369 (+ 181us) write_op.cc:270] Start()
0201 02:55:53.635392 (+ 23us) write_op.cc:276] Timestamp: P: 1769914542946346 usec, L: 0
0201 02:55:53.648871 (+ 13479us) write_op.cc:270] Start()
0201 02:55:53.648906 (+ 35us) write_op.cc:276] Timestamp: P: 1769914542980821 usec, L: 0
0201 02:55:53.650523 (+ 1617us) write_op.cc:270] Start()
0201 02:55:53.650552 (+ 29us) write_op.cc:276] Timestamp: P: 1769914542984007 usec, L: 0
0201 02:55:53.657515 (+ 6963us) write_op.cc:270] Start()
0201 02:55:53.657555 (+ 40us) write_op.cc:276] Timestamp: P: 1769914543007504 usec, L: 0
0201 02:55:53.663699 (+ 6144us) write_op.cc:270] Start()
0201 02:55:53.663726 (+ 27us) write_op.cc:276] Timestamp: P: 1769914543008592 usec, L: 0
0201 02:55:53.663888 (+ 162us) write_op.cc:270] Start()
0201 02:55:53.663913 (+ 25us) write_op.cc:276] Timestamp: P: 1769914543049991 usec, L: 0
0201 02:55:53.664081 (+ 168us) write_op.cc:270] Start()
0201 02:55:53.664103 (+ 22us) write_op.cc:276] Timestamp: P: 1769914543051825 usec, L: 0
0201 02:55:53.664264 (+ 161us) write_op.cc:270] Start()
0201 02:55:53.664288 (+ 24us) write_op.cc:276] Timestamp: P: 1769914543057719 usec, L: 0
0201 02:55:53.664447 (+ 159us) write_op.cc:270] Start()
0201 02:55:53.664467 (+ 20us) write_op.cc:276] Timestamp: P: 1769914543074656 usec, L: 0
0201 02:55:53.672767 (+ 8300us) write_op.cc:270] Start()
0201 02:55:53.672800 (+ 33us) write_op.cc:276] Timestamp: P: 1769914543096100 usec, L: 0
0201 02:55:53.673020 (+ 220us) write_op.cc:270] Start()
0201 02:55:53.673047 (+ 27us) write_op.cc:276] Timestamp: P: 1769914543113594 usec, L: 0
0201 02:55:53.673209 (+ 162us) write_op.cc:270] Start()
0201 02:55:53.673236 (+ 27us) write_op.cc:276] Timestamp: P: 1769914543114384 usec, L: 0
0201 02:55:53.673394 (+ 158us) write_op.cc:270] Start()
0201 02:55:53.673416 (+ 22us) write_op.cc:276] Timestamp: P: 1769914543140976 usec, L: 0
0201 02:55:53.673951 (+ 535us) write_op.cc:270] Start()
0201 02:55:53.673977 (+ 26us) write_op.cc:276] Timestamp: P: 1769914543141680 usec, L: 0
0201 02:55:53.674136 (+ 159us) write_op.cc:270] Start()
0201 02:55:53.674160 (+ 24us) write_op.cc:276] Timestamp: P: 1769914543167976 usec, L: 0
0201 02:55:53.674332 (+ 172us) write_op.cc:270] Start()
0201 02:55:53.674566 (+ 234us) write_op.cc:276] Timestamp: P: 1769914543168682 usec, L: 0
0201 02:55:53.676279 (+ 1713us) write_op.cc:270] Start()
0201 02:55:53.676306 (+ 27us) write_op.cc:276] Timestamp: P: 1769914543198175 usec, L: 0
0201 02:55:53.676485 (+ 179us) write_op.cc:270] Start()
0201 02:55:53.676509 (+ 24us) write_op.cc:276] Timestamp: P: 1769914543209766 usec, L: 0
0201 02:55:53.680706 (+ 4197us) write_op.cc:270] Start()
0201 02:55:53.680741 (+ 35us) write_op.cc:276] Timestamp: P: 1769914543232938 usec, L: 0
0201 02:55:53.681940 (+ 1199us) write_op.cc:270] Start()
0201 02:55:53.681971 (+ 31us) write_op.cc:276] Timestamp: P: 1769914543244604 usec, L: 0
0201 02:55:53.682149 (+ 178us) write_op.cc:270] Start()
0201 02:55:53.682171 (+ 22us) write_op.cc:276] Timestamp: P: 1769914543245391 usec, L: 0
0201 02:55:53.689912 (+ 7741us) write_op.cc:270] Start()
0201 02:55:53.689947 (+ 35us) write_op.cc:276] Timestamp: P: 1769914543266449 usec, L: 0
0201 02:55:53.690723 (+ 776us) write_op.cc:270] Start()
0201 02:55:53.690753 (+ 30us) write_op.cc:276] Timestamp: P: 1769914543282475 usec, L: 0
0201 02:55:53.690965 (+ 212us) write_op.cc:270] Start()
0201 02:55:53.690990 (+ 25us) write_op.cc:276] Timestamp: P: 1769914543295292 usec, L: 0
0201 02:55:53.692891 (+ 1901us) write_op.cc:270] Start()
0201 02:55:53.692912 (+ 21us) write_op.cc:276] Timestamp: P: 1769914543314962 usec, L: 0
0201 02:55:53.693422 (+ 510us) write_op.cc:270] Start()
0201 02:55:53.693451 (+ 29us) write_op.cc:276] Timestamp: P: 1769914543319984 usec, L: 0
0201 02:55:53.698768 (+ 5317us) write_op.cc:270] Start()
0201 02:55:53.698792 (+ 24us) write_op.cc:276] Timestamp: P: 1769914543333733 usec, L: 0
0201 02:55:53.698987 (+ 195us) write_op.cc:270] Start()
0201 02:55:53.699017 (+ 30us) write_op.cc:276] Timestamp: P: 1769914543360138 usec, L: 0
0201 02:55:53.699159 (+ 142us) write_op.cc:270] Start()
0201 02:55:53.699178 (+ 19us) write_op.cc:276] Timestamp: P: 1769914543381840 usec, L: 0
0201 02:55:53.699347 (+ 169us) write_op.cc:270] Start()
0201 02:55:53.699368 (+ 21us) write_op.cc:276] Timestamp: P: 1769914543384400 usec, L: 0
0201 02:55:53.699522 (+ 154us) write_op.cc:270] Start()
0201 02:55:53.699542 (+ 20us) write_op.cc:276] Timestamp: P: 1769914543395084 usec, L: 0
0201 02:55:53.699703 (+ 161us) write_op.cc:270] Start()
0201 02:55:53.699723 (+ 20us) write_op.cc:276] Timestamp: P: 1769914543407211 usec, L: 0
0201 02:55:53.699907 (+ 184us) write_op.cc:270] Start()
0201 02:55:53.699927 (+ 20us) write_op.cc:276] Timestamp: P: 1769914543444281 usec, L: 0
0201 02:55:53.700089 (+ 162us) write_op.cc:270] Start()
0201 02:55:53.700110 (+ 21us) write_op.cc:276] Timestamp: P: 1769914543467951 usec, L: 0
0201 02:55:53.700248 (+ 138us) write_op.cc:270] Start()
0201 02:55:53.700270 (+ 22us) write_op.cc:276] Timestamp: P: 1769914543471497 usec, L: 0
0201 02:55:53.700417 (+ 147us) write_op.cc:270] Start()
0201 02:55:53.700440 (+ 23us) write_op.cc:276] Timestamp: P: 1769914543472729 usec, L: 0
0201 02:55:53.700594 (+ 154us) write_op.cc:270] Start()
0201 02:55:53.700613 (+ 19us) write_op.cc:276] Timestamp: P: 1769914543503978 usec, L: 0
0201 02:55:53.700749 (+ 136us) write_op.cc:270] Start()
0201 02:55:53.700769 (+ 20us) write_op.cc:276] Timestamp: P: 1769914543533185 usec, L: 0
0201 02:55:53.700972 (+ 203us) write_op.cc:270] Start()
0201 02:55:53.700994 (+ 22us) write_op.cc:276] Timestamp: P: 1769914543534450 usec, L: 0
0201 02:55:53.701311 (+ 317us) write_op.cc:270] Start()
0201 02:55:53.701341 (+ 30us) write_op.cc:276] Timestamp: P: 1769914543535134 usec, L: 0
0201 02:55:53.701504 (+ 163us) write_op.cc:270] Start()
0201 02:55:53.701527 (+ 23us) write_op.cc:276] Timestamp: P: 1769914543574538 usec, L: 0
0201 02:55:53.701707 (+ 180us) write_op.cc:270] Start()
0201 02:55:53.701728 (+ 21us) write_op.cc:276] Timestamp: P: 1769914543578234 usec, L: 0
0201 02:55:53.701866 (+ 138us) write_op.cc:270] Start()
0201 02:55:53.701883 (+ 17us) write_op.cc:276] Timestamp: P: 1769914543606303 usec, L: 0
0201 02:55:53.702005 (+ 122us) write_op.cc:270] Start()
0201 02:55:53.702025 (+ 20us) write_op.cc:276] Timestamp: P: 1769914543607739 usec, L: 0
0201 02:55:53.718338 (+ 16313us) write_op.cc:270] Start()
0201 02:55:53.718388 (+ 50us) write_op.cc:276] Timestamp: P: 1769914543620833 usec, L: 0
0201 02:55:53.718671 (+ 283us) write_op.cc:270] Start()
0201 02:55:53.718699 (+ 28us) write_op.cc:276] Timestamp: P: 1769914543632068 usec, L: 0
0201 02:55:53.718902 (+ 203us) write_op.cc:270] Start()
0201 02:55:53.718922 (+ 20us) write_op.cc:276] Timestamp: P: 1769914543652609 usec, L: 0
0201 02:55:53.719048 (+ 126us) write_op.cc:270] Start()
0201 02:55:53.719082 (+ 34us) write_op.cc:276] Timestamp: P: 1769914543658969 usec, L: 0
0201 02:55:53.719280 (+ 198us) write_op.cc:270] Start()
0201 02:55:53.719306 (+ 26us) write_op.cc:276] Timestamp: P: 1769914543681329 usec, L: 0
0201 02:55:53.719480 (+ 174us) write_op.cc:270] Start()
0201 02:55:53.719505 (+ 25us) write_op.cc:276] Timestamp: P: 1769914543683606 usec, L: 0
0201 02:55:53.719669 (+ 164us) write_op.cc:270] Start()
0201 02:55:53.719694 (+ 25us) write_op.cc:276] Timestamp: P: 1769914543710359 usec, L: 0
0201 02:55:53.719854 (+ 160us) write_op.cc:270] Start()
0201 02:55:53.719880 (+ 26us) write_op.cc:276] Timestamp: P: 1769914543737753 usec, L: 0
0201 02:55:53.720060 (+ 180us) write_op.cc:270] Start()
0201 02:55:53.720097 (+ 37us) write_op.cc:276] Timestamp: P: 1769914543740303 usec, L: 0
0201 02:55:53.720277 (+ 180us) write_op.cc:270] Start()
0201 02:55:53.720301 (+ 24us) write_op.cc:276] Timestamp: P: 1769914543756558 usec, L: 0
0201 02:55:53.720493 (+ 192us) write_op.cc:270] Start()
0201 02:55:53.720516 (+ 23us) write_op.cc:276] Timestamp: P: 1769914543778267 usec, L: 0
0201 02:55:53.720685 (+ 169us) write_op.cc:270] Start()
0201 02:55:53.720708 (+ 23us) write_op.cc:276] Timestamp: P: 1769914543795035 usec, L: 0
0201 02:55:53.720850 (+ 142us) write_op.cc:270] Start()
0201 02:55:53.720880 (+ 30us) write_op.cc:276] Timestamp: P: 1769914543804195 usec, L: 0
0201 02:55:53.723694 (+ 2814us) write_op.cc:270] Start()
0201 02:55:53.723718 (+ 24us) write_op.cc:276] Timestamp: P: 1769914543806139 usec, L: 0
0201 02:55:53.723899 (+ 181us) write_op.cc:270] Start()
0201 02:55:53.733562 (+ 9663us) write_op.cc:276] Timestamp: P: 1769914543830580 usec, L: 0
0201 02:55:53.736221 (+ 2659us) write_op.cc:270] Start()
0201 02:55:53.736242 (+ 21us) write_op.cc:276] Timestamp: P: 1769914543867492 usec, L: 0
0201 02:55:53.736421 (+ 179us) write_op.cc:270] Start()
0201 02:55:53.736447 (+ 26us) write_op.cc:276] Timestamp: P: 1769914543869487 usec, L: 0
0201 02:55:53.741958 (+ 5511us) write_op.cc:270] Start()
0201 02:55:53.741987 (+ 29us) write_op.cc:276] Timestamp: P: 1769914543870161 usec, L: 0
0201 02:55:53.742183 (+ 196us) write_op.cc:270] Start()
0201 02:55:53.742204 (+ 21us) write_op.cc:276] Timestamp: P: 1769914543893529 usec, L: 0
0201 02:55:53.743437 (+ 1233us) write_op.cc:270] Start()
0201 02:55:53.743470 (+ 33us) write_op.cc:276] Timestamp: P: 1769914543926339 usec, L: 0
0201 02:55:53.748681 (+ 5211us) write_op.cc:270] Start()
0201 02:55:53.748699 (+ 18us) write_op.cc:276] Timestamp: P: 1769914543929698 usec, L: 0
0201 02:55:53.758397 (+ 9698us) write_op.cc:270] Start()
0201 02:55:53.758437 (+ 40us) write_op.cc:276] Timestamp: P: 1769914543939775 usec, L: 0
0201 02:55:53.758692 (+ 255us) write_op.cc:270] Start()
0201 02:55:53.758720 (+ 28us) write_op.cc:276] Timestamp: P: 1769914543966425 usec, L: 0
0201 02:55:53.786583 (+ 27863us) write_op.cc:270] Start()
0201 02:55:53.786682 (+ 99us) write_op.cc:276] Timestamp: P: 1769914543984420 usec, L: 0
0201 02:55:53.786912 (+ 230us) write_op.cc:270] Start()
0201 02:55:53.786937 (+ 25us) write_op.cc:276] Timestamp: P: 1769914544014443 usec, L: 0
0201 02:55:53.793523 (+ 6586us) write_op.cc:270] Start()
0201 02:55:53.793551 (+ 28us) write_op.cc:276] Timestamp: P: 1769914544019732 usec, L: 0
0201 02:55:53.797295 (+ 3744us) write_op.cc:270] Start()
0201 02:55:53.797339 (+ 44us) write_op.cc:276] Timestamp: P: 1769914544020514 usec, L: 0
0201 02:55:53.797551 (+ 212us) write_op.cc:270] Start()
0201 02:55:53.797576 (+ 25us) write_op.cc:276] Timestamp: P: 1769914544054985 usec, L: 0
0201 02:55:53.798148 (+ 572us) write_op.cc:270] Start()
0201 02:55:53.798174 (+ 26us) write_op.cc:276] Timestamp: P: 1769914544057648 usec, L: 0
0201 02:55:53.814691 (+ 16517us) write_op.cc:270] Start()
0201 02:55:53.814727 (+ 36us) write_op.cc:276] Timestamp: P: 1769914544090400 usec, L: 0
0201 02:55:53.814946 (+ 219us) write_op.cc:270] Start()
0201 02:55:53.814974 (+ 28us) write_op.cc:276] Timestamp: P: 1769914544091454 usec, L: 0
0201 02:55:53.821024 (+ 6050us) write_op.cc:270] Start()
0201 02:55:53.821045 (+ 21us) write_op.cc:276] Timestamp: P: 1769914544105295 usec, L: 0
0201 02:55:53.821332 (+ 287us) write_op.cc:270] Start()
0201 02:55:53.821355 (+ 23us) write_op.cc:276] Timestamp: P: 1769914544113178 usec, L: 0
0201 02:55:53.821521 (+ 166us) write_op.cc:270] Start()
0201 02:55:53.821541 (+ 20us) write_op.cc:276] Timestamp: P: 1769914544132952 usec, L: 0
0201 02:55:53.821688 (+ 147us) write_op.cc:270] Start()
0201 02:55:53.821711 (+ 23us) write_op.cc:276] Timestamp: P: 1769914544152586 usec, L: 0
0201 02:55:53.821843 (+ 132us) write_op.cc:270] Start()
0201 02:55:53.821867 (+ 24us) write_op.cc:276] Timestamp: P: 1769914544153672 usec, L: 0
0201 02:55:53.822021 (+ 154us) write_op.cc:270] Start()
0201 02:55:53.822043 (+ 22us) write_op.cc:276] Timestamp: P: 1769914544156769 usec, L: 0
0201 02:55:53.822193 (+ 150us) write_op.cc:270] Start()
0201 02:55:53.822213 (+ 20us) write_op.cc:276] Timestamp: P: 1769914544180860 usec, L: 0
0201 02:55:53.822386 (+ 173us) write_op.cc:270] Start()
0201 02:55:53.822409 (+ 23us) write_op.cc:276] Timestamp: P: 1769914544213845 usec, L: 0
0201 02:55:53.822569 (+ 160us) write_op.cc:270] Start()
0201 02:55:53.822588 (+ 19us) write_op.cc:276] Timestamp: P: 1769914544215357 usec, L: 0
0201 02:55:53.824327 (+ 1739us) write_op.cc:270] Start()
0201 02:55:53.824354 (+ 27us) write_op.cc:276] Timestamp: P: 1769914544226429 usec, L: 0
0201 02:55:53.825101 (+ 747us) write_op.cc:270] Start()
0201 02:55:53.825127 (+ 26us) write_op.cc:276] Timestamp: P: 1769914544233493 usec, L: 0
0201 02:55:53.825894 (+ 767us) write_op.cc:270] Start()
0201 02:55:53.825922 (+ 28us) write_op.cc:276] Timestamp: P: 1769914544278801 usec, L: 0
0201 02:55:53.838613 (+ 12691us) write_op.cc:270] Start()
0201 02:55:53.838684 (+ 71us) write_op.cc:276] Timestamp: P: 1769914544281766 usec, L: 0
0201 02:55:53.840435 (+ 1751us) write_op.cc:270] Start()
0201 02:55:53.840467 (+ 32us) write_op.cc:276] Timestamp: P: 1769914544287879 usec, L: 0
0201 02:55:53.842319 (+ 1852us) write_op.cc:270] Start()
0201 02:55:53.842349 (+ 30us) write_op.cc:276] Timestamp: P: 1769914544295149 usec, L: 0
0201 02:55:53.842507 (+ 158us) write_op.cc:270] Start()
0201 02:55:53.842528 (+ 21us) write_op.cc:276] Timestamp: P: 1769914544327971 usec, L: 0
0201 02:55:53.842694 (+ 166us) write_op.cc:270] Start()
0201 02:55:53.842716 (+ 22us) write_op.cc:276] Timestamp: P: 1769914544349616 usec, L: 0
0201 02:55:53.842891 (+ 175us) write_op.cc:270] Start()
0201 02:55:53.842911 (+ 20us) write_op.cc:276] Timestamp: P: 1769914544372244 usec, L: 0
0201 02:55:53.843078 (+ 167us) write_op.cc:270] Start()
0201 02:55:53.843098 (+ 20us) write_op.cc:276] Timestamp: P: 1769914544375560 usec, L: 0
0201 02:55:53.843251 (+ 153us) write_op.cc:270] Start()
0201 02:55:53.843281 (+ 30us) write_op.cc:276] Timestamp: P: 1769914544379580 usec, L: 0
0201 02:55:53.843422 (+ 141us) write_op.cc:270] Start()
0201 02:55:53.843443 (+ 21us) write_op.cc:276] Timestamp: P: 1769914544441709 usec, L: 0
0201 02:55:53.843582 (+ 139us) write_op.cc:270] Start()
0201 02:55:53.843602 (+ 20us) write_op.cc:276] Timestamp: P: 1769914544450730 usec, L: 0
0201 02:55:53.843762 (+ 160us) write_op.cc:270] Start()
0201 02:55:53.843783 (+ 21us) write_op.cc:276] Timestamp: P: 1769914544452823 usec, L: 0
0201 02:55:53.843930 (+ 147us) write_op.cc:270] Start()
0201 02:55:53.843951 (+ 21us) write_op.cc:276] Timestamp: P: 1769914544453514 usec, L: 0
0201 02:55:53.844109 (+ 158us) write_op.cc:270] Start()
0201 02:55:53.844131 (+ 22us) write_op.cc:276] Timestamp: P: 1769914544491574 usec, L: 0
0201 02:55:53.844286 (+ 155us) write_op.cc:270] Start()
0201 02:55:53.844307 (+ 21us) write_op.cc:276] Timestamp: P: 1769914544492230 usec, L: 0
0201 02:55:53.844467 (+ 160us) write_op.cc:270] Start()
0201 02:55:53.844488 (+ 21us) write_op.cc:276] Timestamp: P: 1769914544500480 usec, L: 0
0201 02:55:53.844666 (+ 178us) write_op.cc:270] Start()
0201 02:55:53.844688 (+ 22us) write_op.cc:276] Timestamp: P: 1769914544522994 usec, L: 0
0201 02:55:53.844878 (+ 190us) write_op.cc:270] Start()
0201 02:55:53.844954 (+ 76us) write_op.cc:276] Timestamp: P: 1769914544542293 usec, L: 0
0201 02:55:53.845204 (+ 250us) write_op.cc:270] Start()
0201 02:55:53.845227 (+ 23us) write_op.cc:276] Timestamp: P: 1769914544556647 usec, L: 0
0201 02:55:53.845445 (+ 218us) write_op.cc:270] Start()
0201 02:55:53.845462 (+ 17us) write_op.cc:276] Timestamp: P: 1769914544581098 usec, L: 0
0201 02:55:53.845627 (+ 165us) write_op.cc:270] Start()
0201 02:55:53.845647 (+ 20us) write_op.cc:276] Timestamp: P: 1769914544587436 usec, L: 0
0201 02:55:53.845808 (+ 161us) write_op.cc:270] Start()
0201 02:55:53.845829 (+ 21us) write_op.cc:276] Timestamp: P: 1769914544595881 usec, L: 0
0201 02:55:53.845973 (+ 144us) write_op.cc:270] Start()
0201 02:55:53.845994 (+ 21us) write_op.cc:276] Timestamp: P: 1769914544621774 usec, L: 0
0201 02:55:53.846162 (+ 168us) write_op.cc:270] Start()
0201 02:55:53.846190 (+ 28us) write_op.cc:276] Timestamp: P: 1769914544648478 usec, L: 0
0201 02:55:53.846378 (+ 188us) write_op.cc:270] Start()
0201 02:55:53.846399 (+ 21us) write_op.cc:276] Timestamp: P: 1769914544654751 usec, L: 0
0201 02:55:53.846553 (+ 154us) write_op.cc:270] Start()
0201 02:55:53.846573 (+ 20us) write_op.cc:276] Timestamp: P: 1769914544663795 usec, L: 0
0201 02:55:53.846766 (+ 193us) write_op.cc:270] Start()
0201 02:55:53.846789 (+ 23us) write_op.cc:276] Timestamp: P: 1769914544689544 usec, L: 0
0201 02:55:53.847008 (+ 219us) write_op.cc:270] Start()
0201 02:55:53.847028 (+ 20us) write_op.cc:276] Timestamp: P: 1769914544701082 usec, L: 0
0201 02:55:53.847185 (+ 157us) write_op.cc:270] Start()
0201 02:55:53.847222 (+ 37us) write_op.cc:276] Timestamp: P: 1769914544719503 usec, L: 0
0201 02:55:53.847442 (+ 220us) write_op.cc:270] Start()
0201 02:55:53.847464 (+ 22us) write_op.cc:276] Timestamp: P: 1769914544722090 usec, L: 0
0201 02:55:53.856737 (+ 9273us) write_op.cc:270] Start()
0201 02:55:53.856768 (+ 31us) write_op.cc:276] Timestamp: P: 1769914544756119 usec, L: 0
0201 02:55:53.856968 (+ 200us) write_op.cc:270] Start()
0201 02:55:53.856991 (+ 23us) write_op.cc:276] Timestamp: P: 1769914544772485 usec, L: 0
0201 02:55:53.857173 (+ 182us) write_op.cc:270] Start()
0201 02:55:53.857196 (+ 23us) write_op.cc:276] Timestamp: P: 1769914544789101 usec, L: 0
0201 02:55:53.867295 (+ 10099us) write_op.cc:270] Start()
0201 02:55:53.867322 (+ 27us) write_op.cc:276] Timestamp: P: 1769914544790851 usec, L: 0
0201 02:55:53.867467 (+ 145us) write_op.cc:270] Start()
0201 02:55:53.867486 (+ 19us) write_op.cc:276] Timestamp: P: 1769914544822855 usec, L: 0
0201 02:55:53.867647 (+ 161us) write_op.cc:270] Start()
0201 02:55:53.867670 (+ 23us) write_op.cc:276] Timestamp: P: 1769914544824161 usec, L: 0
0201 02:55:53.867845 (+ 175us) write_op.cc:270] Start()
0201 02:55:53.867870 (+ 25us) write_op.cc:276] Timestamp: P: 1769914544840653 usec, L: 0
0201 02:55:53.868576 (+ 706us) write_op.cc:270] Start()
0201 02:55:53.868601 (+ 25us) write_op.cc:276] Timestamp: P: 1769914544877257 usec, L: 0
0201 02:55:53.868763 (+ 162us) write_op.cc:270] Start()
0201 02:55:53.868794 (+ 31us) write_op.cc:276] Timestamp: P: 1769914544880272 usec, L: 0
0201 02:55:53.868952 (+ 158us) write_op.cc:270] Start()
0201 02:55:53.868972 (+ 20us) write_op.cc:276] Timestamp: P: 1769914544907486 usec, L: 0
0201 02:55:53.869150 (+ 178us) write_op.cc:270] Start()
0201 02:55:53.869171 (+ 21us) write_op.cc:276] Timestamp: P: 1769914544928490 usec, L: 0
0201 02:55:53.869340 (+ 169us) write_op.cc:270] Start()
0201 02:55:53.869362 (+ 22us) write_op.cc:276] Timestamp: P: 1769914544931189 usec, L: 0
0201 02:55:53.869519 (+ 157us) write_op.cc:270] Start()
0201 02:55:53.869539 (+ 20us) write_op.cc:276] Timestamp: P: 1769914544949639 usec, L: 0
0201 02:55:53.869705 (+ 166us) write_op.cc:270] Start()
0201 02:55:53.869730 (+ 25us) write_op.cc:276] Timestamp: P: 1769914544979390 usec, L: 0
0201 02:55:53.869869 (+ 139us) write_op.cc:270] Start()
0201 02:55:53.869889 (+ 20us) write_op.cc:276] Timestamp: P: 1769914545026993 usec, L: 0
0201 02:55:53.870031 (+ 142us) write_op.cc:270] Start()
0201 02:55:53.870050 (+ 19us) write_op.cc:276] Timestamp: P: 1769914545029676 usec, L: 0
0201 02:55:53.870195 (+ 145us) write_op.cc:270] Start()
0201 02:55:53.870216 (+ 21us) write_op.cc:276] Timestamp: P: 1769914545030402 usec, L: 0
0201 02:55:53.870396 (+ 180us) write_op.cc:270] Start()
0201 02:55:53.870418 (+ 22us) write_op.cc:276] Timestamp: P: 17699145
I20260201 02:55:56.435401 15050 raft_consensus.cc:493] T 9434d106c0374b5d928cc00f109846ce P 20beda53b20146fb90018bf4533dcd58 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 74bc17a87c2342958617c01904a29dac)
I20260201 02:55:56.435724 15050 raft_consensus.cc:515] T 9434d106c0374b5d928cc00f109846ce P 20beda53b20146fb90018bf4533dcd58 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:55:56.474282 15050 leader_election.cc:290] T 9434d106c0374b5d928cc00f109846ce P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 943634a8539f44a8969b8503616b09d6 (127.13.170.2:41045), 74bc17a87c2342958617c01904a29dac (127.13.170.3:45403)
I20260201 02:55:56.479513 14300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9434d106c0374b5d928cc00f109846ce" candidate_uuid: "20beda53b20146fb90018bf4533dcd58" candidate_term: 3 candidate_status { last_received { term: 2 index: 824 } } ignore_live_leader: false dest_uuid: "943634a8539f44a8969b8503616b09d6" is_pre_election: true
I20260201 02:55:56.491372 14431 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9434d106c0374b5d928cc00f109846ce" candidate_uuid: "20beda53b20146fb90018bf4533dcd58" candidate_term: 3 candidate_status { last_received { term: 2 index: 824 } } ignore_live_leader: false dest_uuid: "74bc17a87c2342958617c01904a29dac" is_pre_election: true
I20260201 02:55:56.514772 14892 leader_election.cc:304] T 9434d106c0374b5d928cc00f109846ce P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20beda53b20146fb90018bf4533dcd58; no voters: 74bc17a87c2342958617c01904a29dac, 943634a8539f44a8969b8503616b09d6
W20260201 02:55:56.605952 14368 consensus_peers.cc:597] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 106: this message will repeat every 5th retry.
I20260201 02:55:56.701891 15050 raft_consensus.cc:493] T af28911fb32b478b88b6779c6f0dc08f P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74bc17a87c2342958617c01904a29dac)
I20260201 02:55:56.702209 15050 raft_consensus.cc:515] T af28911fb32b478b88b6779c6f0dc08f P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } }
I20260201 02:55:56.730458 15051 raft_consensus.cc:2749] T 9434d106c0374b5d928cc00f109846ce P 20beda53b20146fb90018bf4533dcd58 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260201 02:55:56.796193 15050 leader_election.cc:290] T af28911fb32b478b88b6779c6f0dc08f P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74bc17a87c2342958617c01904a29dac (127.13.170.3:45403), 943634a8539f44a8969b8503616b09d6 (127.13.170.2:41045)
I20260201 02:55:56.797093 14302 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "af28911fb32b478b88b6779c6f0dc08f" candidate_uuid: "20beda53b20146fb90018bf4533dcd58" candidate_term: 2 candidate_status { last_received { term: 1 index: 836 } } ignore_live_leader: false dest_uuid: "943634a8539f44a8969b8503616b09d6" is_pre_election: true
I20260201 02:55:56.806794 14433 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "af28911fb32b478b88b6779c6f0dc08f" candidate_uuid: "20beda53b20146fb90018bf4533dcd58" candidate_term: 2 candidate_status { last_received { term: 1 index: 836 } } ignore_live_leader: false dest_uuid: "74bc17a87c2342958617c01904a29dac" is_pre_election: true
I20260201 02:55:56.844623 14892 leader_election.cc:304] T af28911fb32b478b88b6779c6f0dc08f P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20beda53b20146fb90018bf4533dcd58; no voters: 74bc17a87c2342958617c01904a29dac, 943634a8539f44a8969b8503616b09d6
I20260201 02:55:56.850297 15050 raft_consensus.cc:2749] T af28911fb32b478b88b6779c6f0dc08f P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260201 02:55:57.174396 14368 consensus_peers.cc:597] T 535b6fc9826f436089318f329dad0f4d P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 121: this message will repeat every 5th retry.
W20260201 02:55:57.610260 14238 consensus_peers.cc:597] T 1abdef8b45334d908fa08ec613374a3b P 943634a8539f44a8969b8503616b09d6 -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 121: this message will repeat every 5th retry.
W20260201 02:55:58.024299 14895 log.cc:927] Time spent T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58: Append to log took a long time: real 0.058s user 0.002s sys 0.000s
I20260201 02:55:58.443183 14895 tablet_bootstrap.cc:492] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58: Bootstrap replayed 1/1 log segments. Stats: ops{read=170 overwritten=1 applied=168 ignored=0} inserts{seen=1373 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260201 02:55:58.443971 14895 tablet_bootstrap.cc:492] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58: Bootstrap complete.
I20260201 02:55:58.445340 14895 ts_tablet_manager.cc:1403] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58: Time spent bootstrapping tablet: real 2.666s user 0.308s sys 0.037s
I20260201 02:55:58.446753 14895 raft_consensus.cc:359] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58 [term 2 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:55:58.447372 14895 raft_consensus.cc:740] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20beda53b20146fb90018bf4533dcd58, State: Initialized, Role: FOLLOWER
I20260201 02:55:58.447675 14895 consensus_queue.cc:260] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 168, Last appended: 2.169, Last appended by leader: 169, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
W20260201 02:55:58.515113 14368 consensus_peers.cc:597] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 111: this message will repeat every 5th retry.
I20260201 02:55:58.666060 14895 ts_tablet_manager.cc:1434] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58: Time spent starting tablet: real 0.221s user 0.092s sys 0.116s
I20260201 02:55:58.666504 14895 tablet_bootstrap.cc:492] T 535b6fc9826f436089318f329dad0f4d P 20beda53b20146fb90018bf4533dcd58: Bootstrap starting.
I20260201 02:55:58.734272 15031 raft_consensus.cc:493] T 7519edb327894747a21ff97e8a90f2f9 P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 943634a8539f44a8969b8503616b09d6)
I20260201 02:55:58.734467 15031 raft_consensus.cc:515] T 7519edb327894747a21ff97e8a90f2f9 P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:55:58.735765 15031 leader_election.cc:290] T 7519edb327894747a21ff97e8a90f2f9 P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 943634a8539f44a8969b8503616b09d6 (127.13.170.2:41045), 74bc17a87c2342958617c01904a29dac (127.13.170.3:45403)
I20260201 02:55:58.737418 14302 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7519edb327894747a21ff97e8a90f2f9" candidate_uuid: "20beda53b20146fb90018bf4533dcd58" candidate_term: 2 candidate_status { last_received { term: 1 index: 812 } } ignore_live_leader: false dest_uuid: "943634a8539f44a8969b8503616b09d6" is_pre_election: true
I20260201 02:55:58.752645 14964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.13.170.2:55457 (request call id 19) took 3107 ms. Trace:
I20260201 02:55:58.764216 14431 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7519edb327894747a21ff97e8a90f2f9" candidate_uuid: "20beda53b20146fb90018bf4533dcd58" candidate_term: 2 candidate_status { last_received { term: 1 index: 812 } } ignore_live_leader: false dest_uuid: "74bc17a87c2342958617c01904a29dac" is_pre_election: true
I20260201 02:55:58.773124 14892 leader_election.cc:304] T 7519edb327894747a21ff97e8a90f2f9 P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20beda53b20146fb90018bf4533dcd58; no voters: 74bc17a87c2342958617c01904a29dac, 943634a8539f44a8969b8503616b09d6
I20260201 02:55:58.776536 15055 raft_consensus.cc:2749] T 7519edb327894747a21ff97e8a90f2f9 P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 02:55:59.209683 15055 raft_consensus.cc:493] T 7519edb327894747a21ff97e8a90f2f9 P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 943634a8539f44a8969b8503616b09d6)
I20260201 02:55:59.212788 15055 raft_consensus.cc:515] T 7519edb327894747a21ff97e8a90f2f9 P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:55:59.214455 15055 leader_election.cc:290] T 7519edb327894747a21ff97e8a90f2f9 P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 943634a8539f44a8969b8503616b09d6 (127.13.170.2:41045), 74bc17a87c2342958617c01904a29dac (127.13.170.3:45403)
I20260201 02:55:59.219834 14301 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7519edb327894747a21ff97e8a90f2f9" candidate_uuid: "20beda53b20146fb90018bf4533dcd58" candidate_term: 2 candidate_status { last_received { term: 1 index: 812 } } ignore_live_leader: false dest_uuid: "943634a8539f44a8969b8503616b09d6" is_pre_election: true
I20260201 02:55:59.250077 14431 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7519edb327894747a21ff97e8a90f2f9" candidate_uuid: "20beda53b20146fb90018bf4533dcd58" candidate_term: 2 candidate_status { last_received { term: 1 index: 812 } } ignore_live_leader: false dest_uuid: "74bc17a87c2342958617c01904a29dac" is_pre_election: true
I20260201 02:55:59.257777 14892 leader_election.cc:304] T 7519edb327894747a21ff97e8a90f2f9 P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20beda53b20146fb90018bf4533dcd58; no voters: 74bc17a87c2342958617c01904a29dac, 943634a8539f44a8969b8503616b09d6
I20260201 02:55:59.267458 15055 raft_consensus.cc:2749] T 7519edb327894747a21ff97e8a90f2f9 P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260201 02:55:59.647200 14368 consensus_peers.cc:597] T 535b6fc9826f436089318f329dad0f4d P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 126: this message will repeat every 5th retry.
I20260201 02:55:59.940222 15062 raft_consensus.cc:493] T 7519edb327894747a21ff97e8a90f2f9 P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 943634a8539f44a8969b8503616b09d6)
I20260201 02:55:59.940543 15062 raft_consensus.cc:515] T 7519edb327894747a21ff97e8a90f2f9 P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:55:59.943162 14303 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7519edb327894747a21ff97e8a90f2f9" candidate_uuid: "20beda53b20146fb90018bf4533dcd58" candidate_term: 2 candidate_status { last_received { term: 1 index: 812 } } ignore_live_leader: false dest_uuid: "943634a8539f44a8969b8503616b09d6" is_pre_election: true
I20260201 02:55:59.942757 15062 leader_election.cc:290] T 7519edb327894747a21ff97e8a90f2f9 P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 943634a8539f44a8969b8503616b09d6 (127.13.170.2:41045), 74bc17a87c2342958617c01904a29dac (127.13.170.3:45403)
I20260201 02:55:59.955981 14431 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7519edb327894747a21ff97e8a90f2f9" candidate_uuid: "20beda53b20146fb90018bf4533dcd58" candidate_term: 2 candidate_status { last_received { term: 1 index: 812 } } ignore_live_leader: false dest_uuid: "74bc17a87c2342958617c01904a29dac" is_pre_election: true
I20260201 02:55:59.956677 14892 leader_election.cc:304] T 7519edb327894747a21ff97e8a90f2f9 P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20beda53b20146fb90018bf4533dcd58; no voters: 74bc17a87c2342958617c01904a29dac, 943634a8539f44a8969b8503616b09d6
I20260201 02:55:59.957027 15062 raft_consensus.cc:2749] T 7519edb327894747a21ff97e8a90f2f9 P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260201 02:56:00.079473 14542 meta_cache.cc:1261] Time spent looking up entry by key: real 0.101s user 0.004s sys 0.000s
I20260201 02:56:00.378775 15062 raft_consensus.cc:493] T 7519edb327894747a21ff97e8a90f2f9 P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 943634a8539f44a8969b8503616b09d6)
I20260201 02:56:00.379020 15062 raft_consensus.cc:515] T 7519edb327894747a21ff97e8a90f2f9 P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:56:00.383934 14301 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7519edb327894747a21ff97e8a90f2f9" candidate_uuid: "20beda53b20146fb90018bf4533dcd58" candidate_term: 2 candidate_status { last_received { term: 1 index: 812 } } ignore_live_leader: false dest_uuid: "943634a8539f44a8969b8503616b09d6" is_pre_election: true
I20260201 02:56:00.389514 15062 leader_election.cc:290] T 7519edb327894747a21ff97e8a90f2f9 P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 943634a8539f44a8969b8503616b09d6 (127.13.170.2:41045), 74bc17a87c2342958617c01904a29dac (127.13.170.3:45403)
I20260201 02:56:00.406049 14431 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7519edb327894747a21ff97e8a90f2f9" candidate_uuid: "20beda53b20146fb90018bf4533dcd58" candidate_term: 2 candidate_status { last_received { term: 1 index: 812 } } ignore_live_leader: false dest_uuid: "74bc17a87c2342958617c01904a29dac" is_pre_election: true
I20260201 02:56:00.422062 14892 leader_election.cc:304] T 7519edb327894747a21ff97e8a90f2f9 P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20beda53b20146fb90018bf4533dcd58; no voters: 74bc17a87c2342958617c01904a29dac, 943634a8539f44a8969b8503616b09d6
I20260201 02:56:00.422570 15062 raft_consensus.cc:2749] T 7519edb327894747a21ff97e8a90f2f9 P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 02:55:58.752889 14964 rpcz_store.cc:276] 0201 02:55:55.645519 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 02:55:55.645765 (+ 246us) service_pool.cc:225] Handling call
0201 02:55:55.893979 (+248214us) raft_consensus.cc:1471] Updating replica for 645 ops
0201 02:55:56.403532 (+509553us) raft_consensus.cc:1534] Early marking committed up to index 0
0201 02:55:56.403538 (+ 6us) raft_consensus.cc:1539] Triggering prepare for 645 ops
0201 02:55:56.429645 (+ 26107us) write_op.cc:270] Start()
0201 02:55:56.429681 (+ 36us) write_op.cc:276] Timestamp: P: 1769914541662629 usec, L: 0
0201 02:55:56.507099 (+ 77418us) write_op.cc:270] Start()
0201 02:55:56.507134 (+ 35us) write_op.cc:276] Timestamp: P: 1769914541685799 usec, L: 0
0201 02:55:56.509003 (+ 1869us) write_op.cc:270] Start()
0201 02:55:56.509039 (+ 36us) write_op.cc:276] Timestamp: P: 1769914541690497 usec, L: 0
0201 02:55:56.509173 (+ 134us) write_op.cc:270] Start()
0201 02:55:56.509222 (+ 49us) write_op.cc:276] Timestamp: P: 1769914541730961 usec, L: 0
0201 02:55:56.516667 (+ 7445us) write_op.cc:270] Start()
0201 02:55:56.516703 (+ 36us) write_op.cc:276] Timestamp: P: 1769914541733117 usec, L: 0
0201 02:55:56.564062 (+ 47359us) write_op.cc:270] Start()
0201 02:55:56.564097 (+ 35us) write_op.cc:276] Timestamp: P: 1769914542046768 usec, L: 0
0201 02:55:56.566842 (+ 2745us) write_op.cc:270] Start()
0201 02:55:56.567105 (+ 263us) write_op.cc:276] Timestamp: P: 1769914542054156 usec, L: 0
0201 02:55:56.569040 (+ 1935us) write_op.cc:270] Start()
0201 02:55:56.569069 (+ 29us) write_op.cc:276] Timestamp: P: 1769914542079758 usec, L: 0
0201 02:55:56.581253 (+ 12184us) write_op.cc:270] Start()
0201 02:55:56.581285 (+ 32us) write_op.cc:276] Timestamp: P: 1769914542081220 usec, L: 0
0201 02:55:56.595520 (+ 14235us) write_op.cc:270] Start()
0201 02:55:56.595558 (+ 38us) write_op.cc:276] Timestamp: P: 1769914542108789 usec, L: 0
0201 02:55:56.602730 (+ 7172us) write_op.cc:270] Start()
0201 02:55:56.602782 (+ 52us) write_op.cc:276] Timestamp: P: 1769914542121131 usec, L: 0
0201 02:55:56.603002 (+ 220us) write_op.cc:270] Start()
0201 02:55:56.603024 (+ 22us) write_op.cc:276] Timestamp: P: 1769914542138452 usec, L: 0
0201 02:55:56.608039 (+ 5015us) write_op.cc:270] Start()
0201 02:55:56.608074 (+ 35us) write_op.cc:276] Timestamp: P: 1769914542143107 usec, L: 0
0201 02:55:56.608299 (+ 225us) write_op.cc:270] Start()
0201 02:55:56.608327 (+ 28us) write_op.cc:276] Timestamp: P: 1769914542169734 usec, L: 0
0201 02:55:56.616172 (+ 7845us) write_op.cc:270] Start()
0201 02:55:56.616201 (+ 29us) write_op.cc:276] Timestamp: P: 1769914542184998 usec, L: 0
0201 02:55:56.618204 (+ 2003us) write_op.cc:270] Start()
0201 02:55:56.618231 (+ 27us) write_op.cc:276] Timestamp: P: 1769914542201302 usec, L: 0
0201 02:55:56.624334 (+ 6103us) write_op.cc:270] Start()
0201 02:55:56.624372 (+ 38us) write_op.cc:276] Timestamp: P: 1769914542233516 usec, L: 0
0201 02:55:56.635478 (+ 11106us) write_op.cc:270] Start()
0201 02:55:56.635517 (+ 39us) write_op.cc:276] Timestamp: P: 1769914542234324 usec, L: 0
0201 02:55:56.646768 (+ 11251us) write_op.cc:270] Start()
0201 02:55:56.646806 (+ 38us) write_op.cc:276] Timestamp: P: 1769914542242987 usec, L: 0
0201 02:55:56.654494 (+ 7688us) write_op.cc:270] Start()
0201 02:55:56.654529 (+ 35us) write_op.cc:276] Timestamp: P: 1769914542258457 usec, L: 0
0201 02:55:56.677260 (+ 22731us) write_op.cc:270] Start()
0201 02:55:56.677292 (+ 32us) write_op.cc:276] Timestamp: P: 1769914542299097 usec, L: 0
0201 02:55:56.677486 (+ 194us) write_op.cc:270] Start()
0201 02:55:56.677510 (+ 24us) write_op.cc:276] Timestamp: P: 1769914542302721 usec, L: 0
0201 02:55:56.689038 (+ 11528us) write_op.cc:270] Start()
0201 02:55:56.689081 (+ 43us) write_op.cc:276] Timestamp: P: 1769914542304469 usec, L: 0
0201 02:55:56.689302 (+ 221us) write_op.cc:270] Start()
0201 02:55:56.689325 (+ 23us) write_op.cc:276] Timestamp: P: 1769914542307156 usec, L: 0
0201 02:55:56.689535 (+ 210us) write_op.cc:270] Start()
0201 02:55:56.689560 (+ 25us) write_op.cc:276] Timestamp: P: 1769914542345033 usec, L: 0
0201 02:55:56.695245 (+ 5685us) write_op.cc:270] Start()
0201 02:55:56.695285 (+ 40us) write_op.cc:276] Timestamp: P: 1769914542349490 usec, L: 0
0201 02:55:56.696650 (+ 1365us) write_op.cc:270] Start()
0201 02:55:56.696716 (+ 66us) write_op.cc:276] Timestamp: P: 1769914542367608 usec, L: 0
0201 02:55:56.703588 (+ 6872us) write_op.cc:270] Start()
0201 02:55:56.703624 (+ 36us) write_op.cc:276] Timestamp: P: 1769914542381577 usec, L: 0
0201 02:55:56.709044 (+ 5420us) write_op.cc:270] Start()
0201 02:55:56.709079 (+ 35us) write_op.cc:276] Timestamp: P: 1769914542415875 usec, L: 0
0201 02:55:56.709734 (+ 655us) write_op.cc:270] Start()
0201 02:55:56.709759 (+ 25us) write_op.cc:276] Timestamp: P: 1769914542417498 usec, L: 0
0201 02:55:56.712470 (+ 2711us) write_op.cc:270] Start()
0201 02:55:56.712507 (+ 37us) write_op.cc:276] Timestamp: P: 1769914542426013 usec, L: 0
0201 02:55:56.721533 (+ 9026us) write_op.cc:270] Start()
0201 02:55:56.721571 (+ 38us) write_op.cc:276] Timestamp: P: 1769914542438512 usec, L: 0
0201 02:55:56.733989 (+ 12418us) write_op.cc:270] Start()
0201 02:55:56.734028 (+ 39us) write_op.cc:276] Timestamp: P: 1769914542471005 usec, L: 0
0201 02:55:56.734239 (+ 211us) write_op.cc:270] Start()
0201 02:55:56.734266 (+ 27us) write_op.cc:276] Timestamp: P: 1769914542490285 usec, L: 0
0201 02:55:56.734438 (+ 172us) write_op.cc:270] Start()
0201 02:55:56.734462 (+ 24us) write_op.cc:276] Timestamp: P: 1769914542510600 usec, L: 0
0201 02:55:56.734595 (+ 133us) write_op.cc:270] Start()
0201 02:55:56.734616 (+ 21us) write_op.cc:276] Timestamp: P: 1769914542513933 usec, L: 0
0201 02:55:56.734849 (+ 233us) write_op.cc:270] Start()
0201 02:55:56.734886 (+ 37us) write_op.cc:276] Timestamp: P: 1769914542516906 usec, L: 0
0201 02:55:56.735056 (+ 170us) write_op.cc:270] Start()
0201 02:55:56.735078 (+ 22us) write_op.cc:276] Timestamp: P: 1769914542532399 usec, L: 0
0201 02:55:56.735239 (+ 161us) write_op.cc:270] Start()
0201 02:55:56.735262 (+ 23us) write_op.cc:276] Timestamp: P: 1769914542559612 usec, L: 0
0201 02:55:56.735415 (+ 153us) write_op.cc:270] Start()
0201 02:55:56.735451 (+ 36us) write_op.cc:276] Timestamp: P: 1769914542584155 usec, L: 0
0201 02:55:56.735619 (+ 168us) write_op.cc:270] Start()
0201 02:55:56.735640 (+ 21us) write_op.cc:276] Timestamp: P: 1769914542585056 usec, L: 0
0201 02:55:56.735803 (+ 163us) write_op.cc:270] Start()
0201 02:55:56.735822 (+ 19us) write_op.cc:276] Timestamp: P: 1769914542586521 usec, L: 0
0201 02:55:56.736192 (+ 370us) write_op.cc:270] Start()
0201 02:55:56.736220 (+ 28us) write_op.cc:276] Timestamp: P: 1769914542606680 usec, L: 0
0201 02:55:56.736847 (+ 627us) write_op.cc:270] Start()
0201 02:55:56.736873 (+ 26us) write_op.cc:276] Timestamp: P: 1769914542642679 usec, L: 0
0201 02:55:56.737033 (+ 160us) write_op.cc:270] Start()
0201 02:55:56.737055 (+ 22us) write_op.cc:276] Timestamp: P: 1769914542644316 usec, L: 0
0201 02:55:56.737218 (+ 163us) write_op.cc:270] Start()
0201 02:55:56.737239 (+ 21us) write_op.cc:276] Timestamp: P: 1769914542644954 usec, L: 0
0201 02:55:56.737408 (+ 169us) write_op.cc:270] Start()
0201 02:55:56.737430 (+ 22us) write_op.cc:276] Timestamp: P: 1769914542649967 usec, L: 0
0201 02:55:56.737612 (+ 182us) write_op.cc:270] Start()
0201 02:55:56.737633 (+ 21us) write_op.cc:276] Timestamp: P: 1769914542684143 usec, L: 0
0201 02:55:56.737793 (+ 160us) write_op.cc:270] Start()
0201 02:55:56.737817 (+ 24us) write_op.cc:276] Timestamp: P: 1769914542711632 usec, L: 0
0201 02:55:56.737981 (+ 164us) write_op.cc:270] Start()
0201 02:55:56.738003 (+ 22us) write_op.cc:276] Timestamp: P: 1769914542712278 usec, L: 0
0201 02:55:56.738195 (+ 192us) write_op.cc:270] Start()
0201 02:55:56.738215 (+ 20us) write_op.cc:276] Timestamp: P: 1769914542723700 usec, L: 0
0201 02:55:56.738362 (+ 147us) write_op.cc:270] Start()
0201 02:55:56.738383 (+ 21us) write_op.cc:276] Timestamp: P: 1769914542748612 usec, L: 0
0201 02:55:56.738542 (+ 159us) write_op.cc:270] Start()
0201 02:55:56.738562 (+ 20us) write_op.cc:276] Timestamp: P: 1769914542762386 usec, L: 0
0201 02:55:56.738714 (+ 152us) write_op.cc:270] Start()
0201 02:55:56.738734 (+ 20us) write_op.cc:276] Timestamp: P: 1769914542784114 usec, L: 0
0201 02:55:56.738905 (+ 171us) write_op.cc:270] Start()
0201 02:55:56.738925 (+ 20us) write_op.cc:276] Timestamp: P: 1769914542793710 usec, L: 0
0201 02:55:56.739079 (+ 154us) write_op.cc:270] Start()
0201 02:55:56.739106 (+ 27us) write_op.cc:276] Timestamp: P: 1769914542806064 usec, L: 0
0201 02:55:56.739251 (+ 145us) write_op.cc:270] Start()
0201 02:55:56.739276 (+ 25us) write_op.cc:276] Timestamp: P: 1769914542820749 usec, L: 0
0201 02:55:56.739438 (+ 162us) write_op.cc:270] Start()
0201 02:55:56.739459 (+ 21us) write_op.cc:276] Timestamp: P: 1769914542839158 usec, L: 0
0201 02:55:56.739667 (+ 208us) write_op.cc:270] Start()
0201 02:55:56.739690 (+ 23us) write_op.cc:276] Timestamp: P: 1769914542860439 usec, L: 0
0201 02:55:56.739927 (+ 237us) write_op.cc:270] Start()
0201 02:55:56.739977 (+ 50us) write_op.cc:276] Timestamp: P: 1769914542863770 usec, L: 0
0201 02:55:56.740251 (+ 274us) write_op.cc:270] Start()
0201 02:55:56.740273 (+ 22us) write_op.cc:276] Timestamp: P: 1769914542897514 usec, L: 0
0201 02:55:56.740473 (+ 200us) write_op.cc:270] Start()
0201 02:55:56.740495 (+ 22us) write_op.cc:276] Timestamp: P: 1769914542900804 usec, L: 0
0201 02:55:56.750295 (+ 9800us) write_op.cc:270] Start()
0201 02:55:56.750323 (+ 28us) write_op.cc:276] Timestamp: P: 1769914542903788 usec, L: 0
0201 02:55:56.761693 (+ 11370us) write_op.cc:270] Start()
0201 02:55:56.761753 (+ 60us) write_op.cc:276] Timestamp: P: 1769914542931727 usec, L: 0
0201 02:55:56.796835 (+ 35082us) write_op.cc:270] Start()
0201 02:55:56.796867 (+ 32us) write_op.cc:276] Timestamp: P: 1769914542944848 usec, L: 0
0201 02:55:56.799295 (+ 2428us) write_op.cc:270] Start()
0201 02:55:56.799320 (+ 25us) write_op.cc:276] Timestamp: P: 1769914542977799 usec, L: 0
0201 02:55:56.806559 (+ 7239us) write_op.cc:270] Start()
0201 02:55:56.806589 (+ 30us) write_op.cc:276] Timestamp: P: 1769914542995656 usec, L: 0
0201 02:55:56.806798 (+ 209us) write_op.cc:270] Start()
0201 02:55:56.806829 (+ 31us) write_op.cc:276] Timestamp: P: 1769914543004220 usec, L: 0
0201 02:55:56.809736 (+ 2907us) write_op.cc:270] Start()
0201 02:55:56.809764 (+ 28us) write_op.cc:276] Timestamp: P: 1769914543005009 usec, L: 0
0201 02:55:56.827677 (+ 17913us) write_op.cc:270] Start()
0201 02:55:56.827707 (+ 30us) write_op.cc:276] Timestamp: P: 1769914543031713 usec, L: 0
0201 02:55:56.840442 (+ 12735us) write_op.cc:270] Start()
0201 02:55:56.840479 (+ 37us) write_op.cc:276] Timestamp: P: 1769914543045353 usec, L: 0
0201 02:55:56.847093 (+ 6614us) write_op.cc:270] Start()
0201 02:55:56.855550 (+ 8457us) write_op.cc:276] Timestamp: P: 1769914543048069 usec, L: 0
0201 02:55:56.861152 (+ 5602us) write_op.cc:270] Start()
0201 02:55:56.861184 (+ 32us) write_op.cc:276] Timestamp: P: 1769914543073530 usec, L: 0
0201 02:55:56.862361 (+ 1177us) write_op.cc:270] Start()
0201 02:55:56.862389 (+ 28us) write_op.cc:276] Timestamp: P: 1769914543092759 usec, L: 0
0201 02:55:56.877880 (+ 15491us) write_op.cc:270] Start()
0201 02:55:56.877905 (+ 25us) write_op.cc:276] Timestamp: P: 1769914543097728 usec, L: 0
0201 02:55:56.878077 (+ 172us) write_op.cc:270] Start()
0201 02:55:56.878097 (+ 20us) write_op.cc:276] Timestamp: P: 1769914543103844 usec, L: 0
0201 02:55:56.878285 (+ 188us) write_op.cc:270] Start()
0201 02:55:56.878306 (+ 21us) write_op.cc:276] Timestamp: P: 1769914543127106 usec, L: 0
0201 02:55:56.878446 (+ 140us) write_op.cc:270] Start()
0201 02:55:56.878464 (+ 18us) write_op.cc:276] Timestamp: P: 1769914543144736 usec, L: 0
0201 02:55:56.878587 (+ 123us) write_op.cc:270] Start()
0201 02:55:56.878641 (+ 54us) write_op.cc:276] Timestamp: P: 1769914543163207 usec, L: 0
0201 02:55:56.878954 (+ 313us) write_op.cc:270] Start()
0201 02:55:56.879025 (+ 71us) write_op.cc:276] Timestamp: P: 1769914543177248 usec, L: 0
0201 02:55:56.879186 (+ 161us) write_op.cc:270] Start()
0201 02:55:56.879206 (+ 20us) write_op.cc:276] Timestamp: P: 1769914543193152 usec, L: 0
0201 02:55:56.879353 (+ 147us) write_op.cc:270] Start()
0201 02:55:56.879372 (+ 19us) write_op.cc:276] Timestamp: P: 1769914543207072 usec, L: 0
0201 02:55:56.879522 (+ 150us) write_op.cc:270] Start()
0201 02:55:56.879544 (+ 22us) write_op.cc:276] Timestamp: P: 1769914543221780 usec, L: 0
0201 02:55:56.879699 (+ 155us) write_op.cc:270] Start()
0201 02:55:56.879719 (+ 20us) write_op.cc:276] Timestamp: P: 1769914543233661 usec, L: 0
0201 02:55:56.879931 (+ 212us) write_op.cc:270] Start()
0201 02:55:56.879955 (+ 24us) write_op.cc:276] Timestamp: P: 1769914543234943 usec, L: 0
0201 02:55:56.880121 (+ 166us) write_op.cc:270] Start()
0201 02:55:56.880142 (+ 21us) write_op.cc:276] Timestamp: P: 1769914543260312 usec, L: 0
0201 02:55:56.880455 (+ 313us) write_op.cc:270] Start()
0201 02:55:56.880475 (+ 20us) write_op.cc:276] Timestamp: P: 1769914543279916 usec, L: 0
0201 02:55:56.880575 (+ 100us) write_op.cc:270] Start()
0201 02:55:56.880598 (+ 23us) write_op.cc:276] Timestamp: P: 1769914543294465 usec, L: 0
0201 02:55:56.880678 (+ 80us) write_op.cc:270] Start()
0201 02:55:56.880690 (+ 12us) write_op.cc:276] Timestamp: P: 1769914543314902 usec, L: 0
0201 02:55:56.880781 (+ 91us) write_op.cc:270] Start()
0201 02:55:56.880793 (+ 12us) write_op.cc:276] Timestamp: P: 1769914543318252 usec, L: 0
0201 02:55:56.880928 (+ 135us) write_op.cc:270] Start()
0201 02:55:56.880941 (+ 13us) write_op.cc:276] Timestamp: P: 1769914543335304 usec, L: 0
0201 02:55:56.881038 (+ 97us) write_op.cc:270] Start()
0201 02:55:56.881051 (+ 13us) write_op.cc:276] Timestamp: P: 1769914543358577 usec, L: 0
0201 02:55:56.881207 (+ 156us) write_op.cc:270] Start()
0201 02:55:56.881233 (+ 26us) write_op.cc:276] Timestamp: P: 1769914543385381 usec, L: 0
0201 02:55:56.881369 (+ 136us) write_op.cc:270] Start()
0201 02:55:56.881384 (+ 15us) write_op.cc:276] Timestamp: P: 1769914543387837 usec, L: 0
0201 02:55:56.881523 (+ 139us) write_op.cc:270] Start()
0201 02:55:56.881539 (+ 16us) write_op.cc:276] Timestamp: P: 1769914543401637 usec, L: 0
0201 02:55:56.881672 (+ 133us) write_op.cc:270] Start()
0201 02:55:56.881686 (+ 14us) write_op.cc:276] Timestamp: P: 1769914543410793 usec, L: 0
0201 02:55:56.881805 (+ 119us) write_op.cc:270] Start()
0201 02:55:56.881858 (+ 53us) write_op.cc:276] Timestamp: P: 1769914543464018 usec, L: 0
0201 02:55:56.881978 (+ 120us) write_op.cc:270] Start()
0201 02:55:56.881992 (+ 14us) write_op.cc:276] Timestamp: P: 1769914543465414 usec, L: 0
0201 02:55:56.882082 (+ 90us) write_op.cc:270] Start()
0201 02:55:56.882096 (+ 14us) write_op.cc:276] Timestamp: P: 1769914543466241 usec, L: 0
0201 02:55:56.882182 (+ 86us) write_op.cc:270] Start()
0201 02:55:56.882194 (+ 12us) write_op.cc:276] Timestamp: P: 1769914543477892 usec, L: 0
0201 02:55:56.882288 (+ 94us) write_op.cc:270] Start()
0201 02:55:56.882300 (+ 12us) write_op.cc:276] Timestamp: P: 1769914543501110 usec, L: 0
0201 02:55:56.882407 (+ 107us) write_op.cc:270] Start()
0201 02:55:56.882420 (+ 13us) write_op.cc:276] Timestamp: P: 1769914543528721 usec, L: 0
0201 02:55:56.882499 (+ 79us) write_op.cc:270] Start()
0201 02:55:56.882511 (+ 12us) write_op.cc:276] Timestamp: P: 1769914543536121 usec, L: 0
0201 02:55:56.882606 (+ 95us) write_op.cc:270] Start()
0201 02:55:56.882654 (+ 48us) write_op.cc:276] Timestamp: P: 1769914543537850 usec, L: 0
0201 02:55:56.919363 (+ 36709us) write_op.cc:270] Start()
0201 02:55:56.919386 (+ 23us) write_op.cc:276] Timestamp: P: 1769914543572259 usec, L: 0
0201 02:55:56.930119 (+ 10733us) write_op.cc:270] Start()
0201 02:55:56.930144 (+ 25us) write_op.cc:276] Timestamp: P: 1769914543576601 usec, L: 0
0201 02:55:56.933078 (+ 2934us) write_op.cc:270] Start()
0201 02:55:56.933104 (+ 26us) write_op.cc:276] Timestamp: P: 1769914543585384 usec, L: 0
0201 02:55:56.933275 (+ 171us) write_op.cc:270] Start()
0201 02:55:56.933297 (+ 22us) write_op.cc:276] Timestamp: P: 1769914543588158 usec, L: 0
0201 02:55:56.941778 (+ 8481us) write_op.cc:270] Start()
0201 02:55:56.941811 (+ 33us) write_op.cc:276] Timestamp: P: 1769914543616672 usec, L: 0
0201 02:55:56.949932 (+ 8121us) write_op.cc:270] Start()
0201 02:55:56.949962 (+ 30us) write_op.cc:276] Timestamp: P: 1769914543623454 usec, L: 0
0201 02:55:56.950400 (+ 438us) write_op.cc:270] Start()
0201 02:55:56.950426 (+ 26us) write_op.cc:276] Timestamp: P: 1769914543648314 usec, L: 0
0201 02:55:56.953794 (+ 3368us) write_op.cc:270] Start()
0201 02:55:56.953826 (+ 32us) write_op.cc:276] Timestamp: P: 1769914543651763 usec, L: 0
0201 02:55:56.954015 (+ 189us) write_op.cc:270] Start()
0201 02:55:56.954034 (+ 19us) write_op.cc:276] Timestamp: P: 1769914543686910 usec, L: 0
0201 02:55:56.954184 (+ 150us) write_op.cc:270] Start()
0201 02:55:56.954208 (+ 24us) write_op.cc:276] Timestamp: P: 1769914543689257 usec, L: 0
0201 02:55:56.974533 (+ 20325us) write_op.cc:270] Start()
0201 02:55:56.974565 (+ 32us) write_op.cc:276] Timestamp: P: 1769914543711473 usec, L: 0
0201 02:55:56.975432 (+ 867us) write_op.cc:270] Start()
0201 02:55:56.975460 (+ 28us) write_op.cc:276] Timestamp: P: 1769914543731300 usec, L: 0
0201 02:55:56.978692 (+ 3232us) write_op.cc:270] Start()
0201 02:55:56.978720 (+ 28us) write_op.cc:276] Timestamp: P: 1769914543731991 usec, L: 0
0201 02:55:57.009514 (+ 30794us) write_op.cc:270] Start()
0201 02:55:57.009549 (+ 35us) write_op.cc:276] Timestamp: P: 1769914543742446 usec, L: 0
0201 02:55:57.018457 (+ 8908us) write_op.cc:270] Start()
0201 02:55:57.018496 (+ 39us) write_op.cc:276] Timestamp: P: 1769914543761307 usec, L: 0
0201 02:55:57.030705 (+ 12209us) write_op.cc:270] Start()
0201 02:55:57.037359 (+ 6654us) write_op.cc:276] Timestamp: P: 1769914543791064 usec, L: 0
0201 02:55:57.039656 (+ 2297us) write_op.cc:270] Start()
0201 02:55:57.039686 (+ 30us) write_op.cc:276] Timestamp: P: 1769914543795180 usec, L: 0
0201 02:55:57.041904 (+ 2218us) write_op.cc:270] Start()
0201 02:55:57.041945 (+ 41us) write_op.cc:276] Timestamp: P: 1769914543807186 usec, L: 0
0201 02:55:57.064542 (+ 22597us) write_op.cc:270] Start()
0201 02:55:57.064577 (+ 35us) write_op.cc:276] Timestamp: P: 1769914543818892 usec, L: 0
0201 02:55:57.064808 (+ 231us) write_op.cc:270] Start()
0201 02:55:57.064835 (+ 27us) write_op.cc:276] Timestamp: P: 1769914543864643 usec, L: 0
0201 02:55:57.069872 (+ 5037us) write_op.cc:270] Start()
0201 02:55:57.071765 (+ 1893us) write_op.cc:276] Timestamp: P: 1769914543865431 usec, L: 0
0201 02:55:57.071985 (+ 220us) write_op.cc:270] Start()
0201 02:55:57.072009 (+ 24us) write_op.cc:276] Timestamp: P: 1769914543866121 usec, L: 0
0201 02:55:57.072168 (+ 159us) write_op.cc:270] Start()
0201 02:55:57.102641 (+ 30473us) write_op.cc:276] Timestamp: P: 1769914543876324 usec, L: 0
0201 02:55:57.113014 (+ 10373us) write_op.cc:270] Start()
0201 02:55:57.113042 (+ 28us) write_op.cc:276] Timestamp: P: 1769914543916090 usec, L: 0
0201 02:55:57.113264 (+ 222us) write_op.cc:270] Start()
0201 02:55:57.113290 (+ 26us) write_op.cc:276] Timestamp: P: 1769914543916849 usec, L: 0
0201 02:55:57.113447 (+ 157us) write_op.cc:270] Start()
0201 02:55:57.113467 (+ 20us) write_op.cc:276] Timestamp: P: 1769914543937642 usec, L: 0
0201 02:55:57.113626 (+ 159us) write_op.cc:270] Start()
0201 02:55:57.114603 (+ 977us) write_op.cc:276] Timestamp: P: 1769914543954317 usec, L: 0
0201 02:55:57.114850 (+ 247us) write_op.cc:270] Start()
0201 02:55:57.114872 (+ 22us) write_op.cc:276] Timestamp: P: 1769914543982516 usec, L: 0
0201 02:55:57.115051 (+ 179us) write_op.cc:270] Start()
0201 02:55:57.115073 (+ 22us) write_op.cc:276] Timestamp: P: 1769914543993824 usec, L: 0
0201 02:55:57.115209 (+ 136us) write_op.cc:270] Start()
0201 02:55:57.115229 (+ 20us) write_op.cc:276] Timestamp: P: 1769914544016738 usec, L: 0
0201 02:55:57.115360 (+ 131us) write_op.cc:270] Start()
0201 02:55:57.115381 (+ 21us) write_op.cc:276] Timestamp: P: 1769914544028370 usec, L: 0
0201 02:55:57.115541 (+ 160us) write_op.cc:270] Start()
0201 02:55:57.115562 (+ 21us) write_op.cc:276] Timestamp: P: 1769914544036117 usec, L: 0
0201 02:55:57.115707 (+ 145us) write_op.cc:270] Start()
0201 02:55:57.115731 (+ 24us) write_op.cc:276] Timestamp: P: 1769914544036900 usec, L: 0
0201 02:55:57.116030 (+ 299us) write_op.cc:270] Start()
0201 02:55:57.116055 (+ 25us) write_op.cc:276] Timestamp: P: 1769914544080527 usec, L: 0
0201 02:55:57.116205 (+ 150us) write_op.cc:270] Start()
0201 02:55:57.116226 (+ 21us) write_op.cc:276] Timestamp: P: 1769914544084830 usec, L: 0
0201 02:55:57.116724 (+ 498us) write_op.cc:270] Start()
0201 02:55:57.116751 (+ 27us) write_op.cc:276] Timestamp: P: 1769914544095566 usec, L: 0
0201 02:55:57.116918 (+ 167us) write_op.cc:270] Start()
0201 02:55:57.116952 (+ 34us) write_op.cc:276] Timestamp: P: 1769914544101950 usec, L: 0
0201 02:55:57.117185 (+ 233us) write_op.cc:270] Start()
0201 02:55:57.117209 (+ 24us) write_op.cc:276] Timestamp: P: 1769914544141395 usec, L: 0
0201 02:55:57.125725 (+ 8516us) write_op.cc:270] Start()
0201 02:55:57.125766 (+ 41us) write_op.cc:276] Timestamp: P: 1769914544148084 usec, L: 0
0201 02:55:57.126110 (+ 344us) write_op.cc:270] Start()
0201 02:55:57.126139 (+ 29us) write_op.cc:276] Timestamp: P: 1769914544149053 usec, L: 0
0201 02:55:57.126328 (+ 189us) write_op.cc:270] Start()
0201 02:55:57.126349 (+ 21us) write_op.cc:276] Timestamp: P: 1769914544150264 usec, L: 0
0201 02:55:57.128419 (+ 2070us) write_op.cc:270] Start()
0201 02:55:57.128449 (+ 30us) write_op.cc:276] Timestamp: P: 1769914544176551 usec, L: 0
0201 02:55:57.128636 (+ 187us) write_op.cc:270] Start()
0201 02:55:57.128656 (+ 20us) write_op.cc:276] Timestamp: P: 1769914544208283 usec, L: 0
0201 02:55:57.128835 (+ 179us) write_op.cc:270] Start()
0201 02:55:57.128855 (+ 20us) write_op.cc:276] Timestamp: P: 1769914544209864 usec, L: 0
0201 02:55:57.129001 (+ 146us) write_op.cc:270] Start()
0201 02:55:57.129020 (+ 19us) write_op.cc:276] Timestamp: P: 1769914544221043 usec, L: 0
0201 02:55:57.129147 (+ 127us) write_op.cc:270] Start()
0201 02:55:57.129163 (+ 16us) write_op.cc:276] Timestamp: P: 1769914544236403 usec, L: 0
0201 02:55:57.129294 (+ 131us) write_op.cc:270] Start()
0201 02:55:57.129313 (+ 19us) write_op.cc:276] Timestamp: P: 1769914544263488 usec, L: 0
0201 02:55:57.129497 (+ 184us) write_op.cc:270] Start()
0201 02:55:57.129520 (+ 23us) write_op.cc:276] Timestamp: P: 1769914544272795 usec, L: 0
0201 02:55:57.152239 (+ 22719us) write_op.cc:270] Start()
0201 02:55:57.152284 (+ 45us) write_op.cc:276] Timestamp: P: 1769914544280239 usec, L: 0
0201 02:55:57.152510 (+ 226us) write_op.cc:270] Start()
0201 02:55:57.152532 (+ 22us) write_op.cc:276] Timestamp: P: 1769914544284959 usec, L: 0
0201 02:55:57.183043 (+ 30511us) write_op.cc:270] Start()
0201 02:55:57.183077 (+ 34us) write_op.cc:276] Timestamp: P: 1769914544321090 usec, L: 0
0201 02:55:57.197361 (+ 14284us) write_op.cc:270] Start()
0201 02:55:57.197399 (+ 38us) write_op.cc:276] Timestamp: P: 1769914544347925 usec, L: 0
0201 02:55:57.206085 (+ 8686us) write_op.cc:270] Start()
0201 02:55:57.206126 (+ 41us) write_op.cc:276] Timestamp: P: 1769914544351164 usec, L: 0
0201 02:55:57.208132 (+ 2006us) write_op.cc:270] Start()
0201 02:55:57.208164 (+ 32us) write_op.cc:276] Timestamp: P: 1769914544352728 usec, L: 0
0201 02:55:57.217397 (+ 9233us) write_op.cc:270] Start()
0201 02:55:57.217434 (+ 37us) write_op.cc:276] Timestamp: P: 1769914544378133 usec, L: 0
0201 02:55:57.224965 (+ 7531us) write_op.cc:270] Start()
0201 02:55:57.225013 (+ 48us) write_op.cc:276] Timestamp: P: 1769914544425113 usec, L: 0
0201 02:55:57.240048 (+ 15035us) write_op.cc:270] Start()
0201 02:55:57.240088 (+ 40us) write_op.cc:276] Timestamp: P: 1769914544427183 usec, L: 0
0201 02:55:57.240375 (+ 287us) write_op.cc:270] Start()
0201 02:55:57.240405 (+ 30us) write_op.cc:276] Timestamp: P: 1769914544429834 usec, L: 0
0201 02:55:57.243965 (+ 3560us) write_op.cc:270] Start()
0201 02:55:57.244003 (+ 38us) write_op.cc:276] Timestamp: P: 1769914544431495 usec, L: 0
0201 02:55:57.249522 (+ 5519us) write_op.cc:270] Start()
0201 02:55:57.249567 (+ 45us) write_op.cc:276] Timestamp: P: 1769914544488567 usec, L: 0
0201 02:55:57.266432 (+ 16865us) write_op.cc:270] Start()
0201 02:55:57.266466 (+ 34us) write_op.cc:276] Timestamp: P: 1769914544491668 usec, L: 0
0201 02:55:57.270726 (+ 4260us) write_op.cc:270] Start()
0201 02:55:57.270760 (+ 34us) write_op.cc:276] Timestamp: P: 1769914544494413 usec, L: 0
0201 02:55:57.293238 (+ 22478us) write_op.cc:270] Start()
0201 02:55:57.294839 (+ 1601us) write_op.cc:276] Timestamp: P: 1769914544522024 usec, L: 0
0201 02:55:57.300423 (+ 5584us) write_op.cc:270] Start()
0201 02:55:57.300453 (+ 30us) write_op.cc:276] Timestamp: P: 1769914544526187 usec, L: 0
0201 02:55:57.309239 (+ 8786us) write_op.cc:270] Start()
0201 02:55:57.309269 (+ 30us) write_op.cc:276] Timestamp: P: 1769914544561029 usec, L: 0
0201 02:55:57.309817 (+ 548us) write_op.cc:270] Start()
0201 02:55:57.309842 (+ 25us) write_op.cc:276] Timestamp: P: 1769914544581918 usec, L: 0
0201 02:55:57.319785 (+ 9943us) write_op.cc:270] Start()
0201 02:55:57.319818 (+ 33us) write_op.cc:276] Timestamp: P: 1769914544586891 usec, L: 0
0201 02:55:57.320029 (+ 211us) write_op.cc:270] Start()
0201 02:55:57.320054 (+ 25us) write_op.cc:276] Timestamp: P: 1769914544607441 usec, L: 0
0201 02:55:57.320197 (+ 143us) write_op.cc:270] Start()
0201 02:55:57.320215 (+ 18us) write_op.cc:276] Timestamp: P: 1769914544620524 usec, L: 0
0201 02:55:57.320408 (+ 193us) write_op.cc:270] Start()
0201 02:55:57.320433 (+ 25us) write_op.cc:276] Timestamp: P: 1769914544641092 usec, L: 0
0201 02:55:57.320612 (+ 179us) write_op.cc:270] Start()
0201 02:55:57.320634 (+ 22us) write_op.cc:276] Timestamp: P: 1769914544648095 usec, L: 0
0201 02:55:57.320808 (+ 174us) write_op.cc:270] Start()
0201 02:55:57.320830 (+ 22us) write_op.cc:276] Timestamp: P: 1769914544663405 usec, L: 0
0201 02:55:57.331459 (+ 10629us) write_op.cc:270] Start()
0201 02:55:57.331504 (+ 45us) write_op.cc:276] Timestamp: P: 1769914544682546 usec, L: 0
0201 02:55:57.331778 (+ 274us) write_op.cc:270] Start()
0201 02:55:57.331812 (+ 34us) write_op.cc:276] Timestamp: P: 1769914544695968 usec, L: 0
0201 02:55:57.332081 (+ 269us) write_op.cc:270] Start()
0201 02:55:57.332107 (+ 26us) write_op.cc:276] Timestamp: P: 1769914544721118 usec, L: 0
0201 02:55:57.332280 (+ 173us) write_op.cc:270] Start()
0201 02:55:57.332305 (+ 25us) write_op.cc:276] Timestamp: P: 1769914544725358 usec, L: 0
0201 02:55:57.332470 (+ 165us) write_op.cc:270] Start()
0201 02:55:57.332494 (+ 24us) write_op.cc:276] Timestamp: P: 1769914544753789 usec, L: 0
0201 02:55:57.354246 (+ 21752us) write_op.cc:270] Start()
0201 02:55:57.354279 (+ 33us) write_op.cc:276] Timestamp: P: 1769914544763760 usec, L: 0
0201 02:55:57.354730 (+ 451us) write_op.cc:270] Start()
0201 02:55:57.354759 (+ 29us) write_op.cc:276] Timestamp: P: 1769914544793890 usec, L: 0
0201 02:55:57.354962 (+ 203us) write_op.cc:270] Start()
0201 02:55:57.354983 (+ 21us) write_op.cc:276] Timestamp: P: 1769914544809865 usec, L: 0
0201 02:55:57.355166 (+ 183us) write_op.cc:270] Start()
0201 02:55:57.355187 (+ 21us) write_op.cc:276] Timestamp: P: 1769914544815458 usec, L: 0
0201 02:55:57.355344 (+ 157us) write_op.cc:270] Start()
0201 02:55:57.355365 (+ 21us) write_op.cc:276] Timestamp: P: 1769914544817491 usec, L: 0
0201 02:55:57.357235 (+ 1870us) write_op.cc:270] Start()
0201 02:55:57.357265 (+ 30us) write_op.cc:276] Timestamp: P: 1769914544837010 usec, L: 0
0201 02:55:57.357481 (+ 216us) write_op.cc:270] Start()
0201 02:55:57.357504 (+ 23us) write_op.cc:276] Timestamp: P: 1769914544869426 usec, L: 0
0201 02:55:57.357656 (+ 152us) write_op.cc:270] Start()
0201 02:55:57.357677 (+ 21us) write_op.cc:276] Timestamp: P: 1769914544875763 usec, L: 0
0201 02:55:57.358153 (+ 476us) write_op.cc:270] Start()
0201 02:55:57.358177 (+ 24us) write_op.cc:276] Timestamp: P: 1769914544897467 usec, L: 0
0201 02:55:57.358342 (+ 165us) write_op.cc:270] Start()
0201 02:55:57.358362 (+ 20us) write_op.cc:276] Timestamp: P: 1769914544910025 usec, L: 0
0201 02:55:57.358523 (+ 161us) write_op.cc:270] Start()
0201 02:55:57.358543 (+ 20us) write_op.cc:276] Timestamp: P: 1769914544919765 usec, L: 0
0201 02:55:57.358723 (+ 180us) write_op.cc:270] Start()
0201 02:55:57.358755 (+ 32us) write_op.cc:276] Timestamp: P: 1769914544947028 usec, L: 0
0201 02:55:57.358898 (+ 143us) write_op.cc:270] Start()
0201 02:55:57.358918 (+ 20us) write_op.cc:276] Timestamp: P: 1769914544973252 usec, L: 0
0201 02:55:57.359065 (+ 147us) write_op.cc:270] Start()
0201 02:55:57.359084 (+ 19us) write_op.cc:276] Timestamp: P: 1769914545010126 usec, L: 0
0201 02:55:57.359245 (+ 161us) write_op.cc:270] Start()
0201 02:55:57.359264 (+ 19us) write_op.cc:276] Timestamp: P: 1769914545021844 usec, L: 0
0201 02:55:57.359417 (+ 153us) write_op.cc:270] Start()
0201 02:55:57.359436 (+ 19us) write_op.cc:276] Timestamp: P: 17699145
I20260201 02:56:00.814105 14895 tablet_bootstrap.cc:492] T 535b6fc9826f436089318f329dad0f4d P 20beda53b20146fb90018bf4533dcd58: Bootstrap replayed 1/1 log segments. Stats: ops{read=169 overwritten=0 applied=168 ignored=0} inserts{seen=1412 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260201 02:56:00.815080 14895 tablet_bootstrap.cc:492] T 535b6fc9826f436089318f329dad0f4d P 20beda53b20146fb90018bf4533dcd58: Bootstrap complete.
I20260201 02:56:00.816478 14895 ts_tablet_manager.cc:1403] T 535b6fc9826f436089318f329dad0f4d P 20beda53b20146fb90018bf4533dcd58: Time spent bootstrapping tablet: real 2.150s user 0.274s sys 0.063s
I20260201 02:56:00.817445 14895 raft_consensus.cc:359] T 535b6fc9826f436089318f329dad0f4d P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:56:00.818631 14895 raft_consensus.cc:740] T 535b6fc9826f436089318f329dad0f4d P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20beda53b20146fb90018bf4533dcd58, State: Initialized, Role: FOLLOWER
I20260201 02:56:00.818998 14895 consensus_queue.cc:260] T 535b6fc9826f436089318f329dad0f4d P 20beda53b20146fb90018bf4533dcd58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 168, Last appended: 1.169, Last appended by leader: 169, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:56:00.819751 14895 ts_tablet_manager.cc:1434] T 535b6fc9826f436089318f329dad0f4d P 20beda53b20146fb90018bf4533dcd58: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260201 02:56:00.820161 14895 tablet_bootstrap.cc:492] T 7b2f386887ef4ab0a692195c4f968c12 P 20beda53b20146fb90018bf4533dcd58: Bootstrap starting.
W20260201 02:56:01.309897 14368 consensus_peers.cc:597] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 116: this message will repeat every 5th retry.
W20260201 02:56:01.438057 14368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.170.1:36225, user_credentials={real_user=slave}} blocked reactor thread for 44787.1us
I20260201 02:56:01.458827 14963 raft_consensus.cc:1217] T 535b6fc9826f436089318f329dad0f4d P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.168->[1.169-1.1057] Dedup: 1.169->[1.170-1.1057]
I20260201 02:56:01.854525 14964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.13.170.2:55457 (request call id 27) took 1046 ms. Trace:
I20260201 02:56:01.854467 15066 raft_consensus.cc:493] T 7519edb327894747a21ff97e8a90f2f9 P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 943634a8539f44a8969b8503616b09d6)
I20260201 02:56:01.854802 15066 raft_consensus.cc:515] T 7519edb327894747a21ff97e8a90f2f9 P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:56:01.869869 14301 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7519edb327894747a21ff97e8a90f2f9" candidate_uuid: "20beda53b20146fb90018bf4533dcd58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1055 } } ignore_live_leader: false dest_uuid: "943634a8539f44a8969b8503616b09d6" is_pre_election: true
I20260201 02:56:01.871181 14433 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7519edb327894747a21ff97e8a90f2f9" candidate_uuid: "20beda53b20146fb90018bf4533dcd58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1055 } } ignore_live_leader: false dest_uuid: "74bc17a87c2342958617c01904a29dac" is_pre_election: true
I20260201 02:56:01.881346 15066 leader_election.cc:290] T 7519edb327894747a21ff97e8a90f2f9 P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 943634a8539f44a8969b8503616b09d6 (127.13.170.2:41045), 74bc17a87c2342958617c01904a29dac (127.13.170.3:45403)
I20260201 02:56:01.886276 14892 leader_election.cc:304] T 7519edb327894747a21ff97e8a90f2f9 P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20beda53b20146fb90018bf4533dcd58; no voters: 74bc17a87c2342958617c01904a29dac, 943634a8539f44a8969b8503616b09d6
I20260201 02:56:01.888937 15066 raft_consensus.cc:2749] T 7519edb327894747a21ff97e8a90f2f9 P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 02:56:02.087915 15031 raft_consensus.cc:493] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 943634a8539f44a8969b8503616b09d6)
I20260201 02:56:02.088286 14961 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.13.170.2:55457 (request call id 26) took 3574 ms. Trace:
I20260201 02:56:02.089031 15031 raft_consensus.cc:515] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:56:02.104877 14921 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:33648 (request call id 27) took 6057 ms. Trace:
I20260201 02:56:02.105037 14921 rpcz_store.cc:276] 0201 02:55:56.032826 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 02:55:56.033678 (+ 852us) service_pool.cc:225] Handling call
0201 02:55:58.736081 (+2702403us) spinlock_profiling.cc:243] Waited 2.69 s on lock 0x616000019654. stack: 00007f9743ab1a86 00007f9743ab1840 00007f9742a8c3ad 0000000000984f94 0000000000984f5d 000000000098492a 00007f974f96e2c0 00007f975381eb2f 00007f974dc43c36 00007f974dc43965 00007f974aa7455e 00007f974aa7343e 00007f974aa79675 00007f974aa79f9f 00007f974aa79dc8 0000000000a8970c
0201 02:56:02.085903 (+3349822us) spinlock_profiling.cc:243] Waited 3.35 s on lock 0x616000019c54. stack: 00007f9743ab1a86 00007f9743ab1840 00007f9742a8c3ad 0000000000984f94 0000000000984f5d 000000000098492a 00007f974f96e2c0 00007f975381eb2f 00007f974dc43c36 00007f974dc43965 00007f974aa7455e 00007f974aa7343e 00007f974aa79675 00007f974aa79f9f 00007f974aa79dc8 0000000000a8970c
0201 02:56:02.090177 (+ 4274us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":13890857216}
I20260201 02:56:02.125239 14301 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1abdef8b45334d908fa08ec613374a3b" candidate_uuid: "20beda53b20146fb90018bf4533dcd58" candidate_term: 3 candidate_status { last_received { term: 2 index: 946 } } ignore_live_leader: false dest_uuid: "943634a8539f44a8969b8503616b09d6" is_pre_election: true
I20260201 02:56:02.131254 15031 leader_election.cc:290] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 943634a8539f44a8969b8503616b09d6 (127.13.170.2:41045), 74bc17a87c2342958617c01904a29dac (127.13.170.3:45403)
I20260201 02:56:02.137488 14431 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1abdef8b45334d908fa08ec613374a3b" candidate_uuid: "20beda53b20146fb90018bf4533dcd58" candidate_term: 3 candidate_status { last_received { term: 2 index: 946 } } ignore_live_leader: false dest_uuid: "74bc17a87c2342958617c01904a29dac" is_pre_election: true
I20260201 02:56:02.188666 14892 leader_election.cc:304] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20beda53b20146fb90018bf4533dcd58; no voters: 74bc17a87c2342958617c01904a29dac, 943634a8539f44a8969b8503616b09d6
I20260201 02:56:02.190554 15031 raft_consensus.cc:2749] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260201 02:56:02.328083 15031 raft_consensus.cc:493] T 7519edb327894747a21ff97e8a90f2f9 P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 943634a8539f44a8969b8503616b09d6)
I20260201 02:56:02.332281 15031 raft_consensus.cc:515] T 7519edb327894747a21ff97e8a90f2f9 P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:56:02.351663 15031 leader_election.cc:290] T 7519edb327894747a21ff97e8a90f2f9 P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 943634a8539f44a8969b8503616b09d6 (127.13.170.2:41045), 74bc17a87c2342958617c01904a29dac (127.13.170.3:45403)
I20260201 02:56:02.353228 14303 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7519edb327894747a21ff97e8a90f2f9" candidate_uuid: "20beda53b20146fb90018bf4533dcd58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1055 } } ignore_live_leader: false dest_uuid: "943634a8539f44a8969b8503616b09d6" is_pre_election: true
I20260201 02:56:02.354472 14430 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7519edb327894747a21ff97e8a90f2f9" candidate_uuid: "20beda53b20146fb90018bf4533dcd58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1055 } } ignore_live_leader: false dest_uuid: "74bc17a87c2342958617c01904a29dac" is_pre_election: true
I20260201 02:56:02.355873 14892 leader_election.cc:304] T 7519edb327894747a21ff97e8a90f2f9 P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20beda53b20146fb90018bf4533dcd58; no voters: 74bc17a87c2342958617c01904a29dac, 943634a8539f44a8969b8503616b09d6
I20260201 02:56:02.356403 15031 raft_consensus.cc:2749] T 7519edb327894747a21ff97e8a90f2f9 P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 02:56:02.542685 15031 raft_consensus.cc:493] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 943634a8539f44a8969b8503616b09d6)
I20260201 02:56:01.854694 14964 rpcz_store.cc:276] 0201 02:56:00.777986 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 02:56:00.785786 (+ 7800us) service_pool.cc:225] Handling call
0201 02:56:00.805279 (+ 19493us) raft_consensus.cc:1471] Updating replica for 243 ops
0201 02:56:00.843561 (+ 38282us) raft_consensus.cc:1534] Early marking committed up to index 812
0201 02:56:00.843626 (+ 65us) raft_consensus.cc:1539] Triggering prepare for 243 ops
0201 02:56:00.843762 (+ 136us) write_op.cc:270] Start()
0201 02:56:00.843786 (+ 24us) write_op.cc:276] Timestamp: P: 1769914555525342 usec, L: 0
0201 02:56:00.844068 (+ 282us) write_op.cc:270] Start()
0201 02:56:00.844089 (+ 21us) write_op.cc:276] Timestamp: P: 1769914555572036 usec, L: 0
0201 02:56:00.844453 (+ 364us) write_op.cc:270] Start()
0201 02:56:00.844477 (+ 24us) write_op.cc:276] Timestamp: P: 1769914555601670 usec, L: 0
0201 02:56:00.844698 (+ 221us) write_op.cc:270] Start()
0201 02:56:00.844730 (+ 32us) write_op.cc:276] Timestamp: P: 1769914555620264 usec, L: 0
0201 02:56:00.844995 (+ 265us) write_op.cc:270] Start()
0201 02:56:00.845016 (+ 21us) write_op.cc:276] Timestamp: P: 1769914555631782 usec, L: 0
0201 02:56:00.845222 (+ 206us) write_op.cc:270] Start()
0201 02:56:00.845243 (+ 21us) write_op.cc:276] Timestamp: P: 1769914555648355 usec, L: 0
0201 02:56:00.845585 (+ 342us) write_op.cc:270] Start()
0201 02:56:00.845781 (+ 196us) write_op.cc:276] Timestamp: P: 1769914555662872 usec, L: 0
0201 02:56:00.846075 (+ 294us) write_op.cc:270] Start()
0201 02:56:00.846099 (+ 24us) write_op.cc:276] Timestamp: P: 1769914555712803 usec, L: 0
0201 02:56:00.846360 (+ 261us) write_op.cc:270] Start()
0201 02:56:00.846382 (+ 22us) write_op.cc:276] Timestamp: P: 1769914555725353 usec, L: 0
0201 02:56:00.846708 (+ 326us) write_op.cc:270] Start()
0201 02:56:00.846731 (+ 23us) write_op.cc:276] Timestamp: P: 1769914555738803 usec, L: 0
0201 02:56:00.846937 (+ 206us) write_op.cc:270] Start()
0201 02:56:00.846982 (+ 45us) write_op.cc:276] Timestamp: P: 1769914555744305 usec, L: 0
0201 02:56:00.847254 (+ 272us) write_op.cc:270] Start()
0201 02:56:00.847278 (+ 24us) write_op.cc:276] Timestamp: P: 1769914555804388 usec, L: 0
0201 02:56:00.847528 (+ 250us) write_op.cc:270] Start()
0201 02:56:00.847549 (+ 21us) write_op.cc:276] Timestamp: P: 1769914555816757 usec, L: 0
0201 02:56:00.847721 (+ 172us) write_op.cc:270] Start()
0201 02:56:00.847742 (+ 21us) write_op.cc:276] Timestamp: P: 1769914555854950 usec, L: 0
0201 02:56:00.847992 (+ 250us) write_op.cc:270] Start()
0201 02:56:00.848019 (+ 27us) write_op.cc:276] Timestamp: P: 1769914555867209 usec, L: 0
0201 02:56:00.848214 (+ 195us) write_op.cc:270] Start()
0201 02:56:00.848234 (+ 20us) write_op.cc:276] Timestamp: P: 1769914555886336 usec, L: 0
0201 02:56:00.848462 (+ 228us) write_op.cc:270] Start()
0201 02:56:00.848488 (+ 26us) write_op.cc:276] Timestamp: P: 1769914555916792 usec, L: 0
0201 02:56:00.848674 (+ 186us) write_op.cc:270] Start()
0201 02:56:00.848696 (+ 22us) write_op.cc:276] Timestamp: P: 1769914555929660 usec, L: 0
0201 02:56:00.848889 (+ 193us) write_op.cc:270] Start()
0201 02:56:00.848913 (+ 24us) write_op.cc:276] Timestamp: P: 1769914555945087 usec, L: 0
0201 02:56:00.849140 (+ 227us) write_op.cc:270] Start()
0201 02:56:00.849162 (+ 22us) write_op.cc:276] Timestamp: P: 1769914555953562 usec, L: 0
0201 02:56:00.849353 (+ 191us) write_op.cc:270] Start()
0201 02:56:00.849376 (+ 23us) write_op.cc:276] Timestamp: P: 1769914556010484 usec, L: 0
0201 02:56:00.849578 (+ 202us) write_op.cc:270] Start()
0201 02:56:00.849599 (+ 21us) write_op.cc:276] Timestamp: P: 1769914556012525 usec, L: 0
0201 02:56:00.849810 (+ 211us) write_op.cc:270] Start()
0201 02:56:00.849831 (+ 21us) write_op.cc:276] Timestamp: P: 1769914556014157 usec, L: 0
0201 02:56:00.850046 (+ 215us) write_op.cc:270] Start()
0201 02:56:00.850065 (+ 19us) write_op.cc:276] Timestamp: P: 1769914556030629 usec, L: 0
0201 02:56:00.850266 (+ 201us) write_op.cc:270] Start()
0201 02:56:00.850284 (+ 18us) write_op.cc:276] Timestamp: P: 1769914556081992 usec, L: 0
0201 02:56:00.850483 (+ 199us) write_op.cc:270] Start()
0201 02:56:00.850501 (+ 18us) write_op.cc:276] Timestamp: P: 1769914556084767 usec, L: 0
0201 02:56:00.850641 (+ 140us) write_op.cc:270] Start()
0201 02:56:00.850683 (+ 42us) write_op.cc:276] Timestamp: P: 1769914556108901 usec, L: 0
0201 02:56:00.850861 (+ 178us) write_op.cc:270] Start()
0201 02:56:00.850879 (+ 18us) write_op.cc:276] Timestamp: P: 1769914556112537 usec, L: 0
0201 02:56:00.851041 (+ 162us) write_op.cc:270] Start()
0201 02:56:00.851060 (+ 19us) write_op.cc:276] Timestamp: P: 1769914556146822 usec, L: 0
0201 02:56:00.851240 (+ 180us) write_op.cc:270] Start()
0201 02:56:00.851258 (+ 18us) write_op.cc:276] Timestamp: P: 1769914556178502 usec, L: 0
0201 02:56:00.851426 (+ 168us) write_op.cc:270] Start()
0201 02:56:00.851443 (+ 17us) write_op.cc:276] Timestamp: P: 1769914556179382 usec, L: 0
0201 02:56:00.851820 (+ 377us) write_op.cc:270] Start()
0201 02:56:00.851837 (+ 17us) write_op.cc:276] Timestamp: P: 1769914556184481 usec, L: 0
0201 02:56:00.852277 (+ 440us) write_op.cc:270] Start()
0201 02:56:00.852296 (+ 19us) write_op.cc:276] Timestamp: P: 1769914556237093 usec, L: 0
0201 02:56:00.852643 (+ 347us) write_op.cc:270] Start()
0201 02:56:00.852661 (+ 18us) write_op.cc:276] Timestamp: P: 1769914556268639 usec, L: 0
0201 02:56:00.853073 (+ 412us) write_op.cc:270] Start()
0201 02:56:00.853091 (+ 18us) write_op.cc:276] Timestamp: P: 1769914556274990 usec, L: 0
0201 02:56:00.853504 (+ 413us) write_op.cc:270] Start()
0201 02:56:00.853524 (+ 20us) write_op.cc:276] Timestamp: P: 1769914556290805 usec, L: 0
0201 02:56:00.853843 (+ 319us) write_op.cc:270] Start()
0201 02:56:00.853860 (+ 17us) write_op.cc:276] Timestamp: P: 1769914556292129 usec, L: 0
0201 02:56:00.854290 (+ 430us) write_op.cc:270] Start()
0201 02:56:00.854313 (+ 23us) write_op.cc:276] Timestamp: P: 1769914556326272 usec, L: 0
0201 02:56:00.854816 (+ 503us) write_op.cc:270] Start()
0201 02:56:00.854836 (+ 20us) write_op.cc:276] Timestamp: P: 1769914556359318 usec, L: 0
0201 02:56:00.855180 (+ 344us) write_op.cc:270] Start()
0201 02:56:00.855198 (+ 18us) write_op.cc:276] Timestamp: P: 1769914556390129 usec, L: 0
0201 02:56:00.855795 (+ 597us) write_op.cc:270] Start()
0201 02:56:00.855817 (+ 22us) write_op.cc:276] Timestamp: P: 1769914556392474 usec, L: 0
0201 02:56:00.856275 (+ 458us) write_op.cc:270] Start()
0201 02:56:00.856301 (+ 26us) write_op.cc:276] Timestamp: P: 1769914556394279 usec, L: 0
0201 02:56:00.856683 (+ 382us) write_op.cc:270] Start()
0201 02:56:00.856703 (+ 20us) write_op.cc:276] Timestamp: P: 1769914556425754 usec, L: 0
0201 02:56:00.857118 (+ 415us) write_op.cc:270] Start()
0201 02:56:00.857140 (+ 22us) write_op.cc:276] Timestamp: P: 1769914556467967 usec, L: 0
0201 02:56:00.857755 (+ 615us) write_op.cc:270] Start()
0201 02:56:00.857779 (+ 24us) write_op.cc:276] Timestamp: P: 1769914556503055 usec, L: 0
0201 02:56:00.858017 (+ 238us) write_op.cc:270] Start()
0201 02:56:00.858039 (+ 22us) write_op.cc:276] Timestamp: P: 1769914556510510 usec, L: 0
0201 02:56:00.858482 (+ 443us) write_op.cc:270] Start()
0201 02:56:00.858504 (+ 22us) write_op.cc:276] Timestamp: P: 1769914556526888 usec, L: 0
0201 02:56:00.859041 (+ 537us) write_op.cc:270] Start()
0201 02:56:00.859063 (+ 22us) write_op.cc:276] Timestamp: P: 1769914556548210 usec, L: 0
0201 02:56:00.859531 (+ 468us) write_op.cc:270] Start()
0201 02:56:00.859552 (+ 21us) write_op.cc:276] Timestamp: P: 1769914556593911 usec, L: 0
0201 02:56:00.859958 (+ 406us) write_op.cc:270] Start()
0201 02:56:00.859978 (+ 20us) write_op.cc:276] Timestamp: P: 1769914556596259 usec, L: 0
0201 02:56:00.860452 (+ 474us) write_op.cc:270] Start()
0201 02:56:00.860474 (+ 22us) write_op.cc:276] Timestamp: P: 1769914556624602 usec, L: 0
0201 02:56:00.860974 (+ 500us) write_op.cc:270] Start()
0201 02:56:00.861009 (+ 35us) write_op.cc:276] Timestamp: P: 1769914556641791 usec, L: 0
0201 02:56:00.861372 (+ 363us) write_op.cc:270] Start()
0201 02:56:00.861413 (+ 41us) write_op.cc:276] Timestamp: P: 1769914556662491 usec, L: 0
0201 02:56:00.872983 (+ 11570us) write_op.cc:270] Start()
0201 02:56:00.873017 (+ 34us) write_op.cc:276] Timestamp: P: 1769914556663675 usec, L: 0
0201 02:56:00.877491 (+ 4474us) write_op.cc:270] Start()
0201 02:56:00.877519 (+ 28us) write_op.cc:276] Timestamp: P: 1769914556688187 usec, L: 0
0201 02:56:00.885110 (+ 7591us) write_op.cc:270] Start()
0201 02:56:00.885163 (+ 53us) write_op.cc:276] Timestamp: P: 1769914556726796 usec, L: 0
0201 02:56:00.885373 (+ 210us) write_op.cc:270] Start()
0201 02:56:00.885415 (+ 42us) write_op.cc:276] Timestamp: P: 1769914556772380 usec, L: 0
0201 02:56:00.885624 (+ 209us) write_op.cc:270] Start()
0201 02:56:00.885649 (+ 25us) write_op.cc:276] Timestamp: P: 1769914556800528 usec, L: 0
0201 02:56:00.908379 (+ 22730us) write_op.cc:270] Start()
0201 02:56:00.908410 (+ 31us) write_op.cc:276] Timestamp: P: 1769914556801205 usec, L: 0
0201 02:56:00.910416 (+ 2006us) write_op.cc:270] Start()
0201 02:56:00.910475 (+ 59us) write_op.cc:276] Timestamp: P: 1769914556804823 usec, L: 0
0201 02:56:00.919700 (+ 9225us) write_op.cc:270] Start()
0201 02:56:00.919726 (+ 26us) write_op.cc:276] Timestamp: P: 1769914556833697 usec, L: 0
0201 02:56:00.932324 (+ 12598us) write_op.cc:270] Start()
0201 02:56:00.932363 (+ 39us) write_op.cc:276] Timestamp: P: 1769914556892425 usec, L: 0
0201 02:56:00.946095 (+ 13732us) write_op.cc:270] Start()
0201 02:56:00.946127 (+ 32us) write_op.cc:276] Timestamp: P: 1769914556893382 usec, L: 0
0201 02:56:00.946573 (+ 446us) write_op.cc:270] Start()
0201 02:56:00.946602 (+ 29us) write_op.cc:276] Timestamp: P: 1769914556897757 usec, L: 0
0201 02:56:00.946847 (+ 245us) write_op.cc:270] Start()
0201 02:56:00.946869 (+ 22us) write_op.cc:276] Timestamp: P: 1769914556914099 usec, L: 0
0201 02:56:00.947052 (+ 183us) write_op.cc:270] Start()
0201 02:56:00.947073 (+ 21us) write_op.cc:276] Timestamp: P: 1769914556959481 usec, L: 0
0201 02:56:00.947231 (+ 158us) write_op.cc:270] Start()
0201 02:56:00.947250 (+ 19us) write_op.cc:276] Timestamp: P: 1769914556961004 usec, L: 0
0201 02:56:00.948708 (+ 1458us) write_op.cc:270] Start()
0201 02:56:00.948734 (+ 26us) write_op.cc:276] Timestamp: P: 1769914556967131 usec, L: 0
0201 02:56:00.950384 (+ 1650us) write_op.cc:270] Start()
0201 02:56:00.950411 (+ 27us) write_op.cc:276] Timestamp: P: 1769914556997683 usec, L: 0
0201 02:56:00.950668 (+ 257us) write_op.cc:270] Start()
0201 02:56:00.950696 (+ 28us) write_op.cc:276] Timestamp: P: 1769914557018126 usec, L: 0
0201 02:56:00.980528 (+ 29832us) write_op.cc:270] Start()
0201 02:56:00.980565 (+ 37us) write_op.cc:276] Timestamp: P: 1769914557030940 usec, L: 0
0201 02:56:00.980790 (+ 225us) write_op.cc:270] Start()
0201 02:56:00.980812 (+ 22us) write_op.cc:276] Timestamp: P: 1769914557061955 usec, L: 0
0201 02:56:00.984146 (+ 3334us) write_op.cc:270] Start()
0201 02:56:00.984173 (+ 27us) write_op.cc:276] Timestamp: P: 1769914557081910 usec, L: 0
0201 02:56:00.985955 (+ 1782us) write_op.cc:270] Start()
0201 02:56:00.985984 (+ 29us) write_op.cc:276] Timestamp: P: 1769914557112381 usec, L: 0
0201 02:56:00.989968 (+ 3984us) write_op.cc:270] Start()
0201 02:56:00.989995 (+ 27us) write_op.cc:276] Timestamp: P: 1769914557114499 usec, L: 0
0201 02:56:01.005078 (+ 15083us) write_op.cc:270] Start()
0201 02:56:01.005111 (+ 33us) write_op.cc:276] Timestamp: P: 1769914557134791 usec, L: 0
0201 02:56:01.061142 (+ 56031us) write_op.cc:270] Start()
0201 02:56:01.061170 (+ 28us) write_op.cc:276] Timestamp: P: 1769914557135553 usec, L: 0
0201 02:56:01.061372 (+ 202us) write_op.cc:270] Start()
0201 02:56:01.061396 (+ 24us) write_op.cc:276] Timestamp: P: 1769914557175872 usec, L: 0
0201 02:56:01.061611 (+ 215us) write_op.cc:270] Start()
0201 02:56:01.061632 (+ 21us) write_op.cc:276] Timestamp: P: 1769914557177180 usec, L: 0
0201 02:56:01.061813 (+ 181us) write_op.cc:270] Start()
0201 02:56:01.061831 (+ 18us) write_op.cc:276] Timestamp: P: 1769914557209003 usec, L: 0
0201 02:56:01.062025 (+ 194us) write_op.cc:270] Start()
0201 02:56:01.062048 (+ 23us) write_op.cc:276] Timestamp: P: 1769914557209704 usec, L: 0
0201 02:56:01.062208 (+ 160us) write_op.cc:270] Start()
0201 02:56:01.062225 (+ 17us) write_op.cc:276] Timestamp: P: 1769914557251388 usec, L: 0
0201 02:56:01.105608 (+ 43383us) write_op.cc:270] Start()
0201 02:56:01.105647 (+ 39us) write_op.cc:276] Timestamp: P: 1769914557276265 usec, L: 0
0201 02:56:01.154029 (+ 48382us) write_op.cc:270] Start()
0201 02:56:01.154092 (+ 63us) write_op.cc:276] Timestamp: P: 1769914557280006 usec, L: 0
0201 02:56:01.155894 (+ 1802us) write_op.cc:270] Start()
0201 02:56:01.155928 (+ 34us) write_op.cc:276] Timestamp: P: 1769914557295777 usec, L: 0
0201 02:56:01.156177 (+ 249us) write_op.cc:270] Start()
0201 02:56:01.156203 (+ 26us) write_op.cc:276] Timestamp: P: 1769914557322498 usec, L: 0
0201 02:56:01.166001 (+ 9798us) write_op.cc:270] Start()
0201 02:56:01.166029 (+ 28us) write_op.cc:276] Timestamp: P: 1769914557337043 usec, L: 0
0201 02:56:01.184721 (+ 18692us) write_op.cc:270] Start()
0201 02:56:01.184744 (+ 23us) write_op.cc:276] Timestamp: P: 1769914557344869 usec, L: 0
0201 02:56:01.187104 (+ 2360us) write_op.cc:270] Start()
0201 02:56:01.187130 (+ 26us) write_op.cc:276] Timestamp: P: 1769914557376238 usec, L: 0
0201 02:56:01.189006 (+ 1876us) write_op.cc:270] Start()
0201 02:56:01.189027 (+ 21us) write_op.cc:276] Timestamp: P: 1769914557410323 usec, L: 0
0201 02:56:01.189209 (+ 182us) write_op.cc:270] Start()
0201 02:56:01.189225 (+ 16us) write_op.cc:276] Timestamp: P: 1769914557411826 usec, L: 0
0201 02:56:01.189893 (+ 668us) write_op.cc:270] Start()
0201 02:56:01.189919 (+ 26us) write_op.cc:276] Timestamp: P: 1769914557436683 usec, L: 0
0201 02:56:01.198781 (+ 8862us) write_op.cc:270] Start()
0201 02:56:01.198828 (+ 47us) write_op.cc:276] Timestamp: P: 1769914557451193 usec, L: 0
0201 02:56:01.200823 (+ 1995us) write_op.cc:270] Start()
0201 02:56:01.200849 (+ 26us) write_op.cc:276] Timestamp: P: 1769914557483661 usec, L: 0
0201 02:56:01.208960 (+ 8111us) write_op.cc:270] Start()
0201 02:56:01.209001 (+ 41us) write_op.cc:276] Timestamp: P: 1769914557519549 usec, L: 0
0201 02:56:01.210212 (+ 1211us) write_op.cc:270] Start()
0201 02:56:01.210256 (+ 44us) write_op.cc:276] Timestamp: P: 1769914557526589 usec, L: 0
0201 02:56:01.213631 (+ 3375us) write_op.cc:270] Start()
0201 02:56:01.213659 (+ 28us) write_op.cc:276] Timestamp: P: 1769914557535944 usec, L: 0
0201 02:56:01.219306 (+ 5647us) write_op.cc:270] Start()
0201 02:56:01.219345 (+ 39us) write_op.cc:276] Timestamp: P: 1769914557574064 usec, L: 0
0201 02:56:01.222082 (+ 2737us) write_op.cc:270] Start()
0201 02:56:01.222116 (+ 34us) write_op.cc:276] Timestamp: P: 1769914557600968 usec, L: 0
0201 02:56:01.223147 (+ 1031us) write_op.cc:270] Start()
0201 02:56:01.223174 (+ 27us) write_op.cc:276] Timestamp: P: 1769914557604466 usec, L: 0
0201 02:56:01.223573 (+ 399us) write_op.cc:270] Start()
0201 02:56:01.223599 (+ 26us) write_op.cc:276] Timestamp: P: 1769914557612058 usec, L: 0
0201 02:56:01.230903 (+ 7304us) write_op.cc:270] Start()
0201 02:56:01.230942 (+ 39us) write_op.cc:276] Timestamp: P: 1769914557644950 usec, L: 0
0201 02:56:01.236470 (+ 5528us) write_op.cc:270] Start()
0201 02:56:01.236499 (+ 29us) write_op.cc:276] Timestamp: P: 1769914557684807 usec, L: 0
0201 02:56:01.236647 (+ 148us) write_op.cc:270] Start()
0201 02:56:01.236819 (+ 172us) write_op.cc:276] Timestamp: P: 1769914557695440 usec, L: 0
0201 02:56:01.236996 (+ 177us) write_op.cc:270] Start()
0201 02:56:01.237017 (+ 21us) write_op.cc:276] Timestamp: P: 1769914557704098 usec, L: 0
0201 02:56:01.237172 (+ 155us) write_op.cc:270] Start()
0201 02:56:01.237191 (+ 19us) write_op.cc:276] Timestamp: P: 1769914557706452 usec, L: 0
0201 02:56:01.237322 (+ 131us) write_op.cc:270] Start()
0201 02:56:01.237340 (+ 18us) write_op.cc:276] Timestamp: P: 1769914557769650 usec, L: 0
0201 02:56:01.237503 (+ 163us) write_op.cc:270] Start()
0201 02:56:01.237526 (+ 23us) write_op.cc:276] Timestamp: P: 1769914557780192 usec, L: 0
0201 02:56:01.237731 (+ 205us) write_op.cc:270] Start()
0201 02:56:01.237753 (+ 22us) write_op.cc:276] Timestamp: P: 1769914557790345 usec, L: 0
0201 02:56:01.237908 (+ 155us) write_op.cc:270] Start()
0201 02:56:01.237929 (+ 21us) write_op.cc:276] Timestamp: P: 1769914557795327 usec, L: 0
0201 02:56:01.238121 (+ 192us) write_op.cc:270] Start()
0201 02:56:01.238142 (+ 21us) write_op.cc:276] Timestamp: P: 1769914557826305 usec, L: 0
0201 02:56:01.238295 (+ 153us) write_op.cc:270] Start()
0201 02:56:01.238315 (+ 20us) write_op.cc:276] Timestamp: P: 1769914557851575 usec, L: 0
0201 02:56:01.238486 (+ 171us) write_op.cc:270] Start()
0201 02:56:01.238507 (+ 21us) write_op.cc:276] Timestamp: P: 1769914557852819 usec, L: 0
0201 02:56:01.242106 (+ 3599us) write_op.cc:270] Start()
0201 02:56:01.242128 (+ 22us) write_op.cc:276] Timestamp: P: 1769914557863481 usec, L: 0
0201 02:56:01.244000 (+ 1872us) write_op.cc:270] Start()
0201 02:56:01.244026 (+ 26us) write_op.cc:276] Timestamp: P: 1769914557922499 usec, L: 0
0201 02:56:01.255826 (+ 11800us) write_op.cc:270] Start()
0201 02:56:01.255858 (+ 32us) write_op.cc:276] Timestamp: P: 1769914557936391 usec, L: 0
0201 02:56:01.261990 (+ 6132us) write_op.cc:270] Start()
0201 02:56:01.262020 (+ 30us) write_op.cc:276] Timestamp: P: 1769914557937058 usec, L: 0
0201 02:56:01.262195 (+ 175us) write_op.cc:270] Start()
0201 02:56:01.262217 (+ 22us) write_op.cc:276] Timestamp: P: 1769914557948243 usec, L: 0
0201 02:56:01.304436 (+ 42219us) write_op.cc:270] Start()
0201 02:56:01.304460 (+ 24us) write_op.cc:276] Timestamp: P: 1769914558005104 usec, L: 0
0201 02:56:01.311527 (+ 7067us) write_op.cc:270] Start()
0201 02:56:01.311554 (+ 27us) write_op.cc:276] Timestamp: P: 1769914558018302 usec, L: 0
0201 02:56:01.312432 (+ 878us) write_op.cc:270] Start()
0201 02:56:01.312459 (+ 27us) write_op.cc:276] Timestamp: P: 1769914558030300 usec, L: 0
0201 02:56:01.312832 (+ 373us) write_op.cc:270] Start()
0201 02:56:01.312854 (+ 22us) write_op.cc:276] Timestamp: P: 1769914558032010 usec, L: 0
0201 02:56:01.313525 (+ 671us) write_op.cc:270] Start()
0201 02:56:01.313550 (+ 25us) write_op.cc:276] Timestamp: P: 1769914558063835 usec, L: 0
0201 02:56:01.313732 (+ 182us) write_op.cc:270] Start()
0201 02:56:01.313755 (+ 23us) write_op.cc:276] Timestamp: P: 1769914558093924 usec, L: 0
0201 02:56:01.313917 (+ 162us) write_op.cc:270] Start()
0201 02:56:01.314389 (+ 472us) write_op.cc:276] Timestamp: P: 1769914558095528 usec, L: 0
0201 02:56:01.314558 (+ 169us) write_op.cc:270] Start()
0201 02:56:01.314580 (+ 22us) write_op.cc:276] Timestamp: P: 1769914558099001 usec, L: 0
0201 02:56:01.314786 (+ 206us) write_op.cc:270] Start()
0201 02:56:01.314807 (+ 21us) write_op.cc:276] Timestamp: P: 1769914558151316 usec, L: 0
0201 02:56:01.314968 (+ 161us) write_op.cc:270] Start()
0201 02:56:01.314989 (+ 21us) write_op.cc:276] Timestamp: P: 1769914558191917 usec, L: 0
0201 02:56:01.319441 (+ 4452us) write_op.cc:270] Start()
0201 02:56:01.319471 (+ 30us) write_op.cc:276] Timestamp: P: 1769914558216112 usec, L: 0
0201 02:56:01.319993 (+ 522us) write_op.cc:270] Start()
0201 02:56:01.320017 (+ 24us) write_op.cc:276] Timestamp: P: 1769914558218532 usec, L: 0
0201 02:56:01.320228 (+ 211us) write_op.cc:270] Start()
0201 02:56:01.320273 (+ 45us) write_op.cc:276] Timestamp: P: 1769914558271018 usec, L: 0
0201 02:56:01.320460 (+ 187us) write_op.cc:270] Start()
0201 02:56:01.320481 (+ 21us) write_op.cc:276] Timestamp: P: 1769914558302755 usec, L: 0
0201 02:56:01.322354 (+ 1873us) write_op.cc:270] Start()
0201 02:56:01.322379 (+ 25us) write_op.cc:276] Timestamp: P: 1769914558310532 usec, L: 0
0201 02:56:01.326015 (+ 3636us) write_op.cc:270] Start()
0201 02:56:01.326046 (+ 31us) write_op.cc:276] Timestamp: P: 1769914558320020 usec, L: 0
0201 02:56:01.334923 (+ 8877us) write_op.cc:270] Start()
0201 02:56:01.334954 (+ 31us) write_op.cc:276] Timestamp: P: 1769914558424457 usec, L: 0
0201 02:56:01.335202 (+ 248us) write_op.cc:270] Start()
0201 02:56:01.335218 (+ 16us) write_op.cc:276] Timestamp: P: 1769914558436439 usec, L: 0
0201 02:56:01.335412 (+ 194us) write_op.cc:270] Start()
0201 02:56:01.335434 (+ 22us) write_op.cc:276] Timestamp: P: 1769914558437087 usec, L: 0
0201 02:56:01.351103 (+ 15669us) write_op.cc:270] Start()
0201 02:56:01.351136 (+ 33us) write_op.cc:276] Timestamp: P: 1769914558439166 usec, L: 0
0201 02:56:01.355830 (+ 4694us) write_op.cc:270] Start()
0201 02:56:01.355855 (+ 25us) write_op.cc:276] Timestamp: P: 1769914558520731 usec, L: 0
0201 02:56:01.364199 (+ 8344us) write_op.cc:270] Start()
0201 02:56:01.364228 (+ 29us) write_op.cc:276] Timestamp: P: 1769914558525722 usec, L: 0
0201 02:56:01.386856 (+ 22628us) write_op.cc:270] Start()
0201 02:56:01.386897 (+ 41us) write_op.cc:276] Timestamp: P: 1769914558574757 usec, L: 0
0201 02:56:01.387102 (+ 205us) write_op.cc:270] Start()
0201 02:56:01.387124 (+ 22us) write_op.cc:276] Timestamp: P: 1769914558579215 usec, L: 0
0201 02:56:01.387781 (+ 657us) write_op.cc:270] Start()
0201 02:56:01.387808 (+ 27us) write_op.cc:276] Timestamp: P: 1769914558600462 usec, L: 0
0201 02:56:01.387986 (+ 178us) write_op.cc:270] Start()
0201 02:56:01.388007 (+ 21us) write_op.cc:276] Timestamp: P: 1769914558608340 usec, L: 0
0201 02:56:01.388315 (+ 308us) write_op.cc:270] Start()
0201 02:56:01.388336 (+ 21us) write_op.cc:276] Timestamp: P: 1769914558690328 usec, L: 0
0201 02:56:01.388504 (+ 168us) write_op.cc:270] Start()
0201 02:56:01.388527 (+ 23us) write_op.cc:276] Timestamp: P: 1769914558695766 usec, L: 0
0201 02:56:01.388690 (+ 163us) write_op.cc:270] Start()
0201 02:56:01.388712 (+ 22us) write_op.cc:276] Timestamp: P: 1769914558721501 usec, L: 0
0201 02:56:01.388865 (+ 153us) write_op.cc:270] Start()
0201 02:56:01.388883 (+ 18us) write_op.cc:276] Timestamp: P: 1769914558762937 usec, L: 0
0201 02:56:01.389022 (+ 139us) write_op.cc:270] Start()
0201 02:56:01.389042 (+ 20us) write_op.cc:276] Timestamp: P: 1769914558786321 usec, L: 0
0201 02:56:01.389177 (+ 135us) write_op.cc:270] Start()
0201 02:56:01.389197 (+ 20us) write_op.cc:276] Timestamp: P: 1769914558801195 usec, L: 0
0201 02:56:01.389374 (+ 177us) write_op.cc:270] Start()
0201 02:56:01.389399 (+ 25us) write_op.cc:276] Timestamp: P: 1769914558820525 usec, L: 0
0201 02:56:01.389931 (+ 532us) write_op.cc:270] Start()
0201 02:56:01.389956 (+ 25us) write_op.cc:276] Timestamp: P: 1769914558846295 usec, L: 0
0201 02:56:01.390166 (+ 210us) write_op.cc:270] Start()
0201 02:56:01.390195 (+ 29us) write_op.cc:276] Timestamp: P: 1769914558858109 usec, L: 0
0201 02:56:01.390399 (+ 204us) write_op.cc:270] Start()
0201 02:56:01.390421 (+ 22us) write_op.cc:276] Timestamp: P: 1769914558862895 usec, L: 0
0201 02:56:01.390601 (+ 180us) write_op.cc:270] Start()
0201 02:56:01.390623 (+ 22us) write_op.cc:276] Timestamp: P: 1769914558868538 usec, L: 0
0201 02:56:01.390826 (+ 203us) write_op.cc:270] Start()
0201 02:56:01.390847 (+ 21us) write_op.cc:276] Timestamp: P: 1769914558910479 usec, L: 0
0201 02:56:01.398204 (+ 7357us) write_op.cc:270] Start()
0201 02:56:01.398435 (+ 231us) write_op.cc:276] Timestamp: P: 1769914558934038 usec, L: 0
0201 02:56:01.398713 (+ 278us) write_op.cc:270] Start()
0201 02:56:01.398740 (+ 27us) write_op.cc:276] Timestamp: P: 1769914558952552 usec, L: 0
0201 02:56:01.398952 (+ 212us) write_op.cc:270] Start()
0201 02:56:01.398976 (+ 24us) write_op.cc:276] Timestamp: P: 1769914558954250 usec, L: 0
0201 02:56:01.399196 (+ 220us) write_op.cc:270] Start()
0201 02:56:01.399218 (+ 22us) write_op.cc:276] Timestamp: P: 1769914558989485 usec, L: 0
0201 02:56:01.399420 (+ 202us) write_op.cc:270] Start()
0201 02:56:01.399442 (+ 22us) write_op.cc:276] Timestamp: P: 1769914559001692 usec, L: 0
0201 02:56:01.439376 (+ 39934us) write_op.cc:270] Start()
0201 02:56:01.439413 (+ 37us) write_op.cc:276] Timestamp: P: 1769914559020620 usec, L: 0
0201 02:56:01.439670 (+ 257us) write_op.cc:270] Start()
0201 02:56:01.439698 (+ 28us) write_op.cc:276] Timestamp: P: 1769914559022461 usec, L: 0
0201 02:56:01.441510 (+ 1812us) write_op.cc:270] Start()
0201 02:56:01.441538 (+ 28us) write_op.cc:276] Timestamp: P: 1769914559060743 usec, L: 0
0201 02:56:01.444084 (+ 2546us) write_op.cc:270] Start()
0201 02:56:01.444116 (+ 32us) write_op.cc:276] Timestamp: P: 1769914559106076 usec, L: 0
0201 02:56:01.450971 (+ 6855us) write_op.cc:270] Start()
0201 02:56:01.451004 (+ 33us) write_op.cc:276] Timestamp: P: 1769914559107016 usec, L: 0
0201 02:56:01.451232 (+ 228us) write_op.cc:270] Start()
0201 02:56:01.451253 (+ 21us) write_op.cc:276] Timestamp: P: 1769914559109429 usec, L: 0
0201 02:56:01.451447 (+ 194us) write_op.cc:270] Start()
0201 02:56:01.451468 (+ 21us) write_op.cc:276] Timestamp: P: 1769914559125495 usec, L: 0
0201 02:56:01.451637 (+ 169us) write_op.cc:270] Start()
0201 02:56:01.451656 (+ 19us) write_op.cc:276] Timestamp: P: 1769914559173073 usec, L: 0
0201 02:56:01.451827 (+ 171us) write_op.cc:270] Start()
0201 02:56:01.451846 (+ 19us) write_op.cc:276] Timestamp: P: 1769914559207045 usec, L: 0
0201 02:56:01.452012 (+ 166us) write_op.cc:270] Start()
0201 02:56:01.452032 (+ 20us) write_op.cc:276] Timestamp: P: 1769914559218506 usec, L: 0
0201 02:56:01.452227 (+ 195us) write_op.cc:270] Start()
0201 02:56:01.452246 (+ 19us) write_op.cc:276] Timestamp: P: 1769914559224559 usec, L: 0
0201 02:56:01.452521 (+ 275us) write_op.cc:270] Start()
0201 02:56:01.452544 (+ 23us) write_op.cc:276] Timestamp: P: 1769914559251949 usec, L: 0
0201 02:56:01.452700 (+ 156us) write_op.cc:270] Start()
0201 02:56:01.452734 (+ 34us) write_op.cc:276] Timestamp: P: 1769914559284656 usec, L: 0
0201 02:56:01.452876 (+ 142us) write_op.cc:270] Start()
0201 02:56:01.452892 (+ 16us) write_op.cc:276] Timestamp: P: 1769914559335160 usec, L: 0
0201 02:56:01.453042 (+ 150us) write_op.cc:270] Start()
0201 02:56:01.453059 (+ 17us) write_op.cc:276] Timestamp: P: 1769914559343738 usec, L: 0
0201 02:56:01.453183 (+ 124us) write_op.cc:270] Start()
0201 02:56:01.453199 (+ 16us) write_op.cc:276] Timestamp: P: 1769914559344418 usec, L: 0
0201 02:56:01.453326 (+ 127us) write_op.cc:270] Start()
0201 02:56:01.453346 (+ 20us) write_op.cc:276] Timestamp: P: 1769914559369325 usec, L: 0
0201 02:56:01.453548 (+ 202us) write_op.cc:270] Start()
0201 02:56:01.453566 (+ 18us) write_op.cc:276] Timestamp: P: 1769914559425264 usec, L: 0
0201 02:56:01.453739 (+ 173us) write_op.cc:270] Start()
0201 02:56:01.453758 (+ 19us) write_op.cc:276] Timestamp: P: 1769914559445734 usec, L: 0
0201 02:56:01.453929 (+ 171us) write_op.cc:270] Start()
0201 02:56:01.453953 (+ 24us) write_op.cc:276] Timestamp: P: 1769914559463996 usec, L: 0
0201 02:56:01.454121 (+ 168us) write_op.cc:270] Start()
0201 02:56:01.454141 (+ 20us) write_op.cc:276] Timestamp: P: 1769914559493129 usec, L: 0
0201 02:56:01.454415 (+ 274us) write_op.cc:270] Start()
0201 02:56:01.454438 (+ 23us) write_op.cc:276] Timestamp: P: 1769914559502713 usec, L: 0
0201 02:56:01.454598 (+ 160us) write_op.cc:270] Start()
0201 02:56:01.454623 (+ 25us) write_op.cc:276] Timestamp: P: 1769914559539220 usec, L: 0
0201 02:56:01.454842 (+ 219us) write_op.cc:270] Start()
0201 02:56:01.454865 (+ 23us) write_op.cc:276] Timestamp: P: 1769914559552481 usec, L: 0
0201 02:56:01.455103 (+ 238us) write_op.cc:270] Start()
0201 02:56:01.455125 (+ 22us) write_op.cc:276] Timestamp: P: 1769914559558769 usec, L: 0
0201 02:56:01.455316 (+ 191us) write_op.cc:270] Start()
0201 02:56:01.455336 (+ 20us) write_op.cc:276] Timestamp: P: 1769914559585108 usec, L: 0
0201 02:56:01.455503 (+ 167us) write_op.cc:270] Start()
0201 02:56:01.455521 (+ 18us) write_op.cc:276] Timestamp: P: 1769914559602939 usec, L: 0
0201 02:56:01.455672 (+ 151us) write_op.cc:270] Start()
0201 02:56:01.455689 (+ 17us) write_op.cc:276] Timestamp: P: 1769914559610896 usec, L: 0
0201 02:56:01.455848 (+ 159us) write_op.cc:270] Start()
0201 02:56:01.455877 (+ 29us) write_op.cc:276] Timestamp: P: 1769914559625174 usec, L: 0
0201 02:56:01.456012 (+ 135us) write_op.cc:270] Start()
0201 02:56:01.456028 (+ 16us) write_op.cc:276] Timestamp: P: 1769914559645160 usec, L: 0
0201 02:56:01.456205 (+ 177us) write_op.cc:270] Start()
0201 02:56:01.456223 (+ 18us) write_op.cc:276] Timestamp: P: 1769914559667348 usec, L: 0
0201 02:56:01.456403 (+ 180us) write_op.cc:270] Start()
0201 02:56:01.456423 (+ 20us) write_op.cc:276] Timestamp: P: 1769914559684302 usec, L: 0
0201 02:56:01.456575 (+ 152us) write_op.cc:270] Start()
0201 02:56:01.456591 (+ 16us) write_op.cc:276] Timestamp: P: 1769914559695620 usec, L: 0
0201 02:56:01.456728 (+ 137us) write_op.cc:270] Start()
0201 02:56:01.456745 (+ 17us) write_op.cc:276] Timestamp: P: 1769914559735094 usec, L: 0
0201 02:56:01.456870 (+ 125us) write_op.cc:270] Start()
0201 02:56:01.456888 (+ 18us) write_op.cc:276] Timestamp: P: 1769914559765967 usec, L: 0
0201 02:56:01.457057 (+ 169us) write_op.cc:270] Start()
0201 02:56:01.457077 (+ 20us) write_op.cc:276] Timestamp: P: 176991
I20260201 02:56:02.547648 15031 raft_consensus.cc:515] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:56:02.548349 15031 leader_election.cc:290] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 943634a8539f44a8969b8503616b09d6 (127.13.170.2:41045), 74bc17a87c2342958617c01904a29dac (127.13.170.3:45403)
I20260201 02:56:02.549060 14300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1abdef8b45334d908fa08ec613374a3b" candidate_uuid: "20beda53b20146fb90018bf4533dcd58" candidate_term: 3 candidate_status { last_received { term: 2 index: 946 } } ignore_live_leader: false dest_uuid: "943634a8539f44a8969b8503616b09d6" is_pre_election: true
I20260201 02:56:02.577858 14430 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1abdef8b45334d908fa08ec613374a3b" candidate_uuid: "20beda53b20146fb90018bf4533dcd58" candidate_term: 3 candidate_status { last_received { term: 2 index: 946 } } ignore_live_leader: false dest_uuid: "74bc17a87c2342958617c01904a29dac" is_pre_election: true
I20260201 02:56:02.589326 14892 leader_election.cc:304] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20beda53b20146fb90018bf4533dcd58; no voters: 74bc17a87c2342958617c01904a29dac, 943634a8539f44a8969b8503616b09d6
I20260201 02:56:02.597698 15031 raft_consensus.cc:2749] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260201 02:56:03.030635 15031 raft_consensus.cc:493] T 7519edb327894747a21ff97e8a90f2f9 P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 943634a8539f44a8969b8503616b09d6)
I20260201 02:56:03.032379 15031 raft_consensus.cc:515] T 7519edb327894747a21ff97e8a90f2f9 P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:56:03.062881 15031 leader_election.cc:290] T 7519edb327894747a21ff97e8a90f2f9 P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 943634a8539f44a8969b8503616b09d6 (127.13.170.2:41045), 74bc17a87c2342958617c01904a29dac (127.13.170.3:45403)
I20260201 02:56:03.065618 14301 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7519edb327894747a21ff97e8a90f2f9" candidate_uuid: "20beda53b20146fb90018bf4533dcd58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1133 } } ignore_live_leader: false dest_uuid: "943634a8539f44a8969b8503616b09d6" is_pre_election: true
I20260201 02:56:03.073240 14433 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7519edb327894747a21ff97e8a90f2f9" candidate_uuid: "20beda53b20146fb90018bf4533dcd58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1133 } } ignore_live_leader: false dest_uuid: "74bc17a87c2342958617c01904a29dac" is_pre_election: true
I20260201 02:56:03.082247 14892 leader_election.cc:304] T 7519edb327894747a21ff97e8a90f2f9 P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20beda53b20146fb90018bf4533dcd58; no voters: 74bc17a87c2342958617c01904a29dac, 943634a8539f44a8969b8503616b09d6
I20260201 02:56:03.095947 15031 raft_consensus.cc:2749] T 7519edb327894747a21ff97e8a90f2f9 P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 02:56:03.243650 15031 raft_consensus.cc:493] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 943634a8539f44a8969b8503616b09d6)
I20260201 02:56:03.271461 15031 raft_consensus.cc:515] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:56:03.272279 15031 leader_election.cc:290] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 943634a8539f44a8969b8503616b09d6 (127.13.170.2:41045), 74bc17a87c2342958617c01904a29dac (127.13.170.3:45403)
I20260201 02:56:03.276511 14300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1abdef8b45334d908fa08ec613374a3b" candidate_uuid: "20beda53b20146fb90018bf4533dcd58" candidate_term: 3 candidate_status { last_received { term: 2 index: 946 } } ignore_live_leader: false dest_uuid: "943634a8539f44a8969b8503616b09d6" is_pre_election: true
I20260201 02:56:03.279328 14430 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1abdef8b45334d908fa08ec613374a3b" candidate_uuid: "20beda53b20146fb90018bf4533dcd58" candidate_term: 3 candidate_status { last_received { term: 2 index: 946 } } ignore_live_leader: false dest_uuid: "74bc17a87c2342958617c01904a29dac" is_pre_election: true
I20260201 02:56:03.296216 14892 leader_election.cc:304] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20beda53b20146fb90018bf4533dcd58; no voters: 74bc17a87c2342958617c01904a29dac, 943634a8539f44a8969b8503616b09d6
I20260201 02:56:03.318943 15031 raft_consensus.cc:2749] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260201 02:56:03.656019 15031 raft_consensus.cc:493] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 943634a8539f44a8969b8503616b09d6)
I20260201 02:56:03.662588 15031 raft_consensus.cc:515] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:56:03.681114 15031 leader_election.cc:290] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 943634a8539f44a8969b8503616b09d6 (127.13.170.2:41045), 74bc17a87c2342958617c01904a29dac (127.13.170.3:45403)
I20260201 02:56:03.683198 14430 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1abdef8b45334d908fa08ec613374a3b" candidate_uuid: "20beda53b20146fb90018bf4533dcd58" candidate_term: 3 candidate_status { last_received { term: 2 index: 946 } } ignore_live_leader: false dest_uuid: "74bc17a87c2342958617c01904a29dac" is_pre_election: true
I20260201 02:56:03.683944 14300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1abdef8b45334d908fa08ec613374a3b" candidate_uuid: "20beda53b20146fb90018bf4533dcd58" candidate_term: 3 candidate_status { last_received { term: 2 index: 946 } } ignore_live_leader: false dest_uuid: "943634a8539f44a8969b8503616b09d6" is_pre_election: true
I20260201 02:56:03.690521 14892 leader_election.cc:304] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20beda53b20146fb90018bf4533dcd58; no voters: 74bc17a87c2342958617c01904a29dac, 943634a8539f44a8969b8503616b09d6
I20260201 02:56:03.695987 15031 raft_consensus.cc:2749] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260201 02:56:04.034675 14368 consensus_peers.cc:597] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 121: this message will repeat every 5th retry.
I20260201 02:56:04.190591 15031 raft_consensus.cc:493] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 943634a8539f44a8969b8503616b09d6)
I20260201 02:56:04.190799 15031 raft_consensus.cc:515] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:56:04.193588 15031 leader_election.cc:290] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 943634a8539f44a8969b8503616b09d6 (127.13.170.2:41045), 74bc17a87c2342958617c01904a29dac (127.13.170.3:45403)
I20260201 02:56:04.196158 14302 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1abdef8b45334d908fa08ec613374a3b" candidate_uuid: "20beda53b20146fb90018bf4533dcd58" candidate_term: 3 candidate_status { last_received { term: 2 index: 946 } } ignore_live_leader: false dest_uuid: "943634a8539f44a8969b8503616b09d6" is_pre_election: true
I20260201 02:56:04.208180 14433 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1abdef8b45334d908fa08ec613374a3b" candidate_uuid: "20beda53b20146fb90018bf4533dcd58" candidate_term: 3 candidate_status { last_received { term: 2 index: 946 } } ignore_live_leader: false dest_uuid: "74bc17a87c2342958617c01904a29dac" is_pre_election: true
I20260201 02:56:04.229965 14892 leader_election.cc:304] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20beda53b20146fb90018bf4533dcd58; no voters: 74bc17a87c2342958617c01904a29dac, 943634a8539f44a8969b8503616b09d6
I20260201 02:56:04.230805 15031 raft_consensus.cc:2749] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260201 02:56:04.796631 14895 tablet_bootstrap.cc:492] T 7b2f386887ef4ab0a692195c4f968c12 P 20beda53b20146fb90018bf4533dcd58: Bootstrap replayed 1/1 log segments. Stats: ops{read=169 overwritten=0 applied=169 ignored=0} inserts{seen=1350 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 02:56:04.799533 14895 tablet_bootstrap.cc:492] T 7b2f386887ef4ab0a692195c4f968c12 P 20beda53b20146fb90018bf4533dcd58: Bootstrap complete.
I20260201 02:56:04.809125 14895 ts_tablet_manager.cc:1403] T 7b2f386887ef4ab0a692195c4f968c12 P 20beda53b20146fb90018bf4533dcd58: Time spent bootstrapping tablet: real 3.989s user 0.289s sys 0.084s
I20260201 02:56:04.814590 14895 raft_consensus.cc:359] T 7b2f386887ef4ab0a692195c4f968c12 P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:56:04.816066 14895 raft_consensus.cc:740] T 7b2f386887ef4ab0a692195c4f968c12 P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20beda53b20146fb90018bf4533dcd58, State: Initialized, Role: FOLLOWER
I20260201 02:56:04.818181 14895 consensus_queue.cc:260] T 7b2f386887ef4ab0a692195c4f968c12 P 20beda53b20146fb90018bf4533dcd58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 169, Last appended: 1.169, Last appended by leader: 169, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:56:04.888854 14895 ts_tablet_manager.cc:1434] T 7b2f386887ef4ab0a692195c4f968c12 P 20beda53b20146fb90018bf4533dcd58: Time spent starting tablet: real 0.078s user 0.006s sys 0.001s
I20260201 02:56:05.055805 15075 raft_consensus.cc:493] T 7b2f386887ef4ab0a692195c4f968c12 P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 02:56:05.056007 15075 raft_consensus.cc:515] T 7b2f386887ef4ab0a692195c4f968c12 P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:56:05.065230 15075 leader_election.cc:290] T 7b2f386887ef4ab0a692195c4f968c12 P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 943634a8539f44a8969b8503616b09d6 (127.13.170.2:41045), 74bc17a87c2342958617c01904a29dac (127.13.170.3:45403)
I20260201 02:56:05.069310 14431 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b2f386887ef4ab0a692195c4f968c12" candidate_uuid: "20beda53b20146fb90018bf4533dcd58" candidate_term: 2 candidate_status { last_received { term: 1 index: 169 } } ignore_live_leader: false dest_uuid: "74bc17a87c2342958617c01904a29dac" is_pre_election: true
I20260201 02:56:05.070060 14301 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b2f386887ef4ab0a692195c4f968c12" candidate_uuid: "20beda53b20146fb90018bf4533dcd58" candidate_term: 2 candidate_status { last_received { term: 1 index: 169 } } ignore_live_leader: false dest_uuid: "943634a8539f44a8969b8503616b09d6" is_pre_election: true
I20260201 02:56:05.076743 14892 leader_election.cc:304] T 7b2f386887ef4ab0a692195c4f968c12 P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20beda53b20146fb90018bf4533dcd58; no voters: 74bc17a87c2342958617c01904a29dac, 943634a8539f44a8969b8503616b09d6
I20260201 02:56:05.077173 15075 raft_consensus.cc:2749] T 7b2f386887ef4ab0a692195c4f968c12 P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 02:56:05.089393 15062 raft_consensus.cc:493] T 535b6fc9826f436089318f329dad0f4d P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74bc17a87c2342958617c01904a29dac)
I20260201 02:56:05.090044 14963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.13.170.3:46631 (request call id 292) took 4199 ms. Trace:
I20260201 02:56:05.094019 15062 raft_consensus.cc:515] T 535b6fc9826f436089318f329dad0f4d P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:56:05.094519 14921 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:33648 (request call id 32) took 2324 ms. Trace:
I20260201 02:56:05.094607 14921 rpcz_store.cc:276] 0201 02:56:02.770266 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 02:56:02.770328 (+ 62us) service_pool.cc:225] Handling call
0201 02:56:05.090260 (+2319932us) spinlock_profiling.cc:243] Waited 2.32 s on lock 0x61600001a254. stack: 00007f9743ab1a86 00007f9743ab1840 00007f9742a8c3ad 0000000000984f94 0000000000984f5d 000000000098492a 00007f974f96e2c0 00007f975381eb2f 00007f974dc43c36 00007f974dc43965 00007f974aa7455e 00007f974aa7343e 00007f974aa79675 00007f974aa79f9f 00007f974aa79dc8 0000000000a8970c
0201 02:56:05.094502 (+ 4242us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5335080576}
I20260201 02:56:05.094997 15062 leader_election.cc:290] T 535b6fc9826f436089318f329dad0f4d P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 943634a8539f44a8969b8503616b09d6 (127.13.170.2:41045), 74bc17a87c2342958617c01904a29dac (127.13.170.3:45403)
I20260201 02:56:02.135326 14961 rpcz_store.cc:276] 0201 02:55:58.507844 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 02:55:58.507891 (+ 47us) service_pool.cc:225] Handling call
0201 02:55:58.706687 (+198796us) raft_consensus.cc:1471] Updating replica for 777 ops
0201 02:55:59.117958 (+411271us) raft_consensus.cc:1534] Early marking committed up to index 169
0201 02:55:59.118042 (+ 84us) raft_consensus.cc:1539] Triggering prepare for 777 ops
0201 02:55:59.118166 (+ 124us) write_op.cc:270] Start()
0201 02:55:59.118195 (+ 29us) write_op.cc:276] Timestamp: P: 1769914541690131 usec, L: 0
0201 02:55:59.119685 (+ 1490us) write_op.cc:270] Start()
0201 02:55:59.119723 (+ 38us) write_op.cc:276] Timestamp: P: 1769914541728500 usec, L: 0
0201 02:55:59.119952 (+ 229us) write_op.cc:270] Start()
0201 02:55:59.119979 (+ 27us) write_op.cc:276] Timestamp: P: 1769914541729220 usec, L: 0
0201 02:55:59.120141 (+ 162us) write_op.cc:270] Start()
0201 02:55:59.120163 (+ 22us) write_op.cc:276] Timestamp: P: 1769914542048141 usec, L: 0
0201 02:55:59.120327 (+ 164us) write_op.cc:270] Start()
0201 02:55:59.120346 (+ 19us) write_op.cc:276] Timestamp: P: 1769914542051690 usec, L: 0
0201 02:55:59.120492 (+ 146us) write_op.cc:270] Start()
0201 02:55:59.120518 (+ 26us) write_op.cc:276] Timestamp: P: 1769914542079922 usec, L: 0
0201 02:55:59.120693 (+ 175us) write_op.cc:270] Start()
0201 02:55:59.120737 (+ 44us) write_op.cc:276] Timestamp: P: 1769914542081374 usec, L: 0
0201 02:55:59.120898 (+ 161us) write_op.cc:270] Start()
0201 02:55:59.120920 (+ 22us) write_op.cc:276] Timestamp: P: 1769914542108023 usec, L: 0
0201 02:55:59.121075 (+ 155us) write_op.cc:270] Start()
0201 02:55:59.121100 (+ 25us) write_op.cc:276] Timestamp: P: 1769914542120227 usec, L: 0
0201 02:55:59.121264 (+ 164us) write_op.cc:270] Start()
0201 02:55:59.121290 (+ 26us) write_op.cc:276] Timestamp: P: 1769914542133428 usec, L: 0
0201 02:55:59.121476 (+ 186us) write_op.cc:270] Start()
0201 02:55:59.121498 (+ 22us) write_op.cc:276] Timestamp: P: 1769914542144161 usec, L: 0
0201 02:55:59.121667 (+ 169us) write_op.cc:270] Start()
0201 02:55:59.121700 (+ 33us) write_op.cc:276] Timestamp: P: 1769914542167441 usec, L: 0
0201 02:55:59.121858 (+ 158us) write_op.cc:270] Start()
0201 02:55:59.121877 (+ 19us) write_op.cc:276] Timestamp: P: 1769914542185091 usec, L: 0
0201 02:55:59.122024 (+ 147us) write_op.cc:270] Start()
0201 02:55:59.122045 (+ 21us) write_op.cc:276] Timestamp: P: 1769914542201506 usec, L: 0
0201 02:55:59.146258 (+ 24213us) write_op.cc:270] Start()
0201 02:55:59.146288 (+ 30us) write_op.cc:276] Timestamp: P: 1769914542233811 usec, L: 0
0201 02:55:59.146511 (+ 223us) write_op.cc:270] Start()
0201 02:55:59.146544 (+ 33us) write_op.cc:276] Timestamp: P: 1769914542234553 usec, L: 0
0201 02:55:59.146776 (+ 232us) write_op.cc:270] Start()
0201 02:55:59.146798 (+ 22us) write_op.cc:276] Timestamp: P: 1769914542251150 usec, L: 0
0201 02:55:59.146989 (+ 191us) write_op.cc:270] Start()
0201 02:55:59.147012 (+ 23us) write_op.cc:276] Timestamp: P: 1769914542264604 usec, L: 0
0201 02:55:59.147160 (+ 148us) write_op.cc:270] Start()
0201 02:55:59.147181 (+ 21us) write_op.cc:276] Timestamp: P: 1769914542287624 usec, L: 0
0201 02:55:59.153984 (+ 6803us) write_op.cc:270] Start()
0201 02:55:59.154012 (+ 28us) write_op.cc:276] Timestamp: P: 1769914542292542 usec, L: 0
0201 02:55:59.168897 (+ 14885us) write_op.cc:270] Start()
0201 02:55:59.168932 (+ 35us) write_op.cc:276] Timestamp: P: 1769914542302888 usec, L: 0
0201 02:55:59.181770 (+ 12838us) write_op.cc:270] Start()
0201 02:55:59.181809 (+ 39us) write_op.cc:276] Timestamp: P: 1769914542304417 usec, L: 0
0201 02:55:59.184667 (+ 2858us) write_op.cc:270] Start()
0201 02:55:59.184701 (+ 34us) write_op.cc:276] Timestamp: P: 1769914542345017 usec, L: 0
0201 02:55:59.184932 (+ 231us) write_op.cc:270] Start()
0201 02:55:59.184958 (+ 26us) write_op.cc:276] Timestamp: P: 1769914542346488 usec, L: 0
0201 02:55:59.185146 (+ 188us) write_op.cc:270] Start()
0201 02:55:59.185171 (+ 25us) write_op.cc:276] Timestamp: P: 1769914542355894 usec, L: 0
0201 02:55:59.185383 (+ 212us) write_op.cc:270] Start()
0201 02:55:59.185408 (+ 25us) write_op.cc:276] Timestamp: P: 1769914542377249 usec, L: 0
0201 02:55:59.187030 (+ 1622us) write_op.cc:270] Start()
0201 02:55:59.187058 (+ 28us) write_op.cc:276] Timestamp: P: 1769914542414185 usec, L: 0
0201 02:55:59.187230 (+ 172us) write_op.cc:270] Start()
0201 02:55:59.187272 (+ 42us) write_op.cc:276] Timestamp: P: 1769914542423581 usec, L: 0
0201 02:55:59.187439 (+ 167us) write_op.cc:270] Start()
0201 02:55:59.187463 (+ 24us) write_op.cc:276] Timestamp: P: 1769914542431316 usec, L: 0
0201 02:55:59.187647 (+ 184us) write_op.cc:270] Start()
0201 02:55:59.187669 (+ 22us) write_op.cc:276] Timestamp: P: 1769914542437819 usec, L: 0
0201 02:55:59.187819 (+ 150us) write_op.cc:270] Start()
0201 02:55:59.187846 (+ 27us) write_op.cc:276] Timestamp: P: 1769914542472136 usec, L: 0
0201 02:55:59.188006 (+ 160us) write_op.cc:270] Start()
0201 02:55:59.188028 (+ 22us) write_op.cc:276] Timestamp: P: 1769914542488041 usec, L: 0
0201 02:55:59.191099 (+ 3071us) write_op.cc:270] Start()
0201 02:55:59.191131 (+ 32us) write_op.cc:276] Timestamp: P: 1769914542511991 usec, L: 0
0201 02:55:59.191364 (+ 233us) write_op.cc:270] Start()
0201 02:55:59.191389 (+ 25us) write_op.cc:276] Timestamp: P: 1769914542516869 usec, L: 0
0201 02:55:59.191557 (+ 168us) write_op.cc:270] Start()
0201 02:55:59.191578 (+ 21us) write_op.cc:276] Timestamp: P: 1769914542518246 usec, L: 0
0201 02:55:59.191746 (+ 168us) write_op.cc:270] Start()
0201 02:55:59.191779 (+ 33us) write_op.cc:276] Timestamp: P: 1769914542530322 usec, L: 0
0201 02:55:59.191973 (+ 194us) write_op.cc:270] Start()
0201 02:55:59.191996 (+ 23us) write_op.cc:276] Timestamp: P: 1769914542558756 usec, L: 0
0201 02:55:59.192168 (+ 172us) write_op.cc:270] Start()
0201 02:55:59.192190 (+ 22us) write_op.cc:276] Timestamp: P: 1769914542582354 usec, L: 0
0201 02:55:59.192331 (+ 141us) write_op.cc:270] Start()
0201 02:55:59.192353 (+ 22us) write_op.cc:276] Timestamp: P: 1769914542583924 usec, L: 0
0201 02:55:59.192527 (+ 174us) write_op.cc:270] Start()
0201 02:55:59.192549 (+ 22us) write_op.cc:276] Timestamp: P: 1769914542584917 usec, L: 0
0201 02:55:59.192733 (+ 184us) write_op.cc:270] Start()
0201 02:55:59.192755 (+ 22us) write_op.cc:276] Timestamp: P: 1769914542598980 usec, L: 0
0201 02:55:59.192934 (+ 179us) write_op.cc:270] Start()
0201 02:55:59.192956 (+ 22us) write_op.cc:276] Timestamp: P: 1769914542635869 usec, L: 0
0201 02:55:59.193117 (+ 161us) write_op.cc:270] Start()
0201 02:55:59.193139 (+ 22us) write_op.cc:276] Timestamp: P: 1769914542643544 usec, L: 0
0201 02:55:59.193281 (+ 142us) write_op.cc:270] Start()
0201 02:55:59.193311 (+ 30us) write_op.cc:276] Timestamp: P: 1769914542644963 usec, L: 0
0201 02:55:59.193472 (+ 161us) write_op.cc:270] Start()
0201 02:55:59.193493 (+ 21us) write_op.cc:276] Timestamp: P: 1769914542646554 usec, L: 0
0201 02:55:59.193673 (+ 180us) write_op.cc:270] Start()
0201 02:55:59.193696 (+ 23us) write_op.cc:276] Timestamp: P: 1769914542684770 usec, L: 0
0201 02:55:59.193900 (+ 204us) write_op.cc:270] Start()
0201 02:55:59.193922 (+ 22us) write_op.cc:276] Timestamp: P: 1769914542710803 usec, L: 0
0201 02:55:59.194103 (+ 181us) write_op.cc:270] Start()
0201 02:55:59.194125 (+ 22us) write_op.cc:276] Timestamp: P: 1769914542719297 usec, L: 0
0201 02:55:59.197859 (+ 3734us) write_op.cc:270] Start()
0201 02:55:59.197890 (+ 31us) write_op.cc:276] Timestamp: P: 1769914542727960 usec, L: 0
0201 02:55:59.198127 (+ 237us) write_op.cc:270] Start()
0201 02:55:59.198154 (+ 27us) write_op.cc:276] Timestamp: P: 1769914542745388 usec, L: 0
0201 02:55:59.201638 (+ 3484us) write_op.cc:270] Start()
0201 02:55:59.201666 (+ 28us) write_op.cc:276] Timestamp: P: 1769914542769082 usec, L: 0
0201 02:55:59.204843 (+ 3177us) write_op.cc:270] Start()
0201 02:55:59.204874 (+ 31us) write_op.cc:276] Timestamp: P: 1769914542780753 usec, L: 0
0201 02:55:59.225140 (+ 20266us) write_op.cc:270] Start()
0201 02:55:59.225174 (+ 34us) write_op.cc:276] Timestamp: P: 1769914542790000 usec, L: 0
0201 02:55:59.229663 (+ 4489us) write_op.cc:270] Start()
0201 02:55:59.229696 (+ 33us) write_op.cc:276] Timestamp: P: 1769914542808766 usec, L: 0
0201 02:55:59.229915 (+ 219us) write_op.cc:270] Start()
0201 02:55:59.229940 (+ 25us) write_op.cc:276] Timestamp: P: 1769914542824319 usec, L: 0
0201 02:55:59.234015 (+ 4075us) write_op.cc:270] Start()
0201 02:55:59.234043 (+ 28us) write_op.cc:276] Timestamp: P: 1769914542834719 usec, L: 0
0201 02:55:59.236334 (+ 2291us) write_op.cc:270] Start()
0201 02:55:59.236363 (+ 29us) write_op.cc:276] Timestamp: P: 1769914542864000 usec, L: 0
0201 02:55:59.236580 (+ 217us) write_op.cc:270] Start()
0201 02:55:59.236605 (+ 25us) write_op.cc:276] Timestamp: P: 1769914542867251 usec, L: 0
0201 02:55:59.236777 (+ 172us) write_op.cc:270] Start()
0201 02:55:59.236798 (+ 21us) write_op.cc:276] Timestamp: P: 1769914542898388 usec, L: 0
0201 02:55:59.236950 (+ 152us) write_op.cc:270] Start()
0201 02:55:59.255273 (+ 18323us) write_op.cc:276] Timestamp: P: 1769914542900795 usec, L: 0
0201 02:55:59.258359 (+ 3086us) write_op.cc:270] Start()
0201 02:55:59.258402 (+ 43us) write_op.cc:276] Timestamp: P: 1769914542904618 usec, L: 0
0201 02:55:59.263509 (+ 5107us) write_op.cc:270] Start()
0201 02:55:59.263578 (+ 69us) write_op.cc:276] Timestamp: P: 1769914542930758 usec, L: 0
0201 02:55:59.263871 (+ 293us) write_op.cc:270] Start()
0201 02:55:59.263904 (+ 33us) write_op.cc:276] Timestamp: P: 1769914542946738 usec, L: 0
0201 02:55:59.266540 (+ 2636us) write_op.cc:270] Start()
0201 02:55:59.266575 (+ 35us) write_op.cc:276] Timestamp: P: 1769914542976903 usec, L: 0
0201 02:55:59.277352 (+ 10777us) write_op.cc:270] Start()
0201 02:55:59.277389 (+ 37us) write_op.cc:276] Timestamp: P: 1769914542981069 usec, L: 0
0201 02:55:59.277674 (+ 285us) write_op.cc:270] Start()
0201 02:55:59.277701 (+ 27us) write_op.cc:276] Timestamp: P: 1769914543003921 usec, L: 0
0201 02:55:59.277886 (+ 185us) write_op.cc:270] Start()
0201 02:55:59.277907 (+ 21us) write_op.cc:276] Timestamp: P: 1769914543004691 usec, L: 0
0201 02:55:59.278039 (+ 132us) write_op.cc:270] Start()
0201 02:55:59.278060 (+ 21us) write_op.cc:276] Timestamp: P: 1769914543032823 usec, L: 0
0201 02:55:59.278246 (+ 186us) write_op.cc:270] Start()
0201 02:55:59.278266 (+ 20us) write_op.cc:276] Timestamp: P: 1769914543044583 usec, L: 0
0201 02:55:59.279557 (+ 1291us) write_op.cc:270] Start()
0201 02:55:59.279586 (+ 29us) write_op.cc:276] Timestamp: P: 1769914543050488 usec, L: 0
0201 02:55:59.279774 (+ 188us) write_op.cc:270] Start()
0201 02:55:59.279795 (+ 21us) write_op.cc:276] Timestamp: P: 1769914543075177 usec, L: 0
0201 02:55:59.279971 (+ 176us) write_op.cc:270] Start()
0201 02:55:59.279998 (+ 27us) write_op.cc:276] Timestamp: P: 1769914543098507 usec, L: 0
0201 02:55:59.280180 (+ 182us) write_op.cc:270] Start()
0201 02:55:59.280208 (+ 28us) write_op.cc:276] Timestamp: P: 1769914543101957 usec, L: 0
0201 02:55:59.280383 (+ 175us) write_op.cc:270] Start()
0201 02:55:59.280409 (+ 26us) write_op.cc:276] Timestamp: P: 1769914543103755 usec, L: 0
0201 02:55:59.280567 (+ 158us) write_op.cc:270] Start()
0201 02:55:59.280588 (+ 21us) write_op.cc:276] Timestamp: P: 1769914543126621 usec, L: 0
0201 02:55:59.280739 (+ 151us) write_op.cc:270] Start()
0201 02:55:59.280817 (+ 78us) write_op.cc:276] Timestamp: P: 1769914543142417 usec, L: 0
0201 02:55:59.280972 (+ 155us) write_op.cc:270] Start()
0201 02:55:59.280995 (+ 23us) write_op.cc:276] Timestamp: P: 1769914543163935 usec, L: 0
0201 02:55:59.302520 (+ 21525us) write_op.cc:270] Start()
0201 02:55:59.302590 (+ 70us) write_op.cc:276] Timestamp: P: 1769914543166175 usec, L: 0
0201 02:55:59.311720 (+ 9130us) write_op.cc:270] Start()
0201 02:55:59.311763 (+ 43us) write_op.cc:276] Timestamp: P: 1769914543193587 usec, L: 0
0201 02:55:59.316431 (+ 4668us) write_op.cc:270] Start()
0201 02:55:59.316474 (+ 43us) write_op.cc:276] Timestamp: P: 1769914543206121 usec, L: 0
0201 02:55:59.318386 (+ 1912us) write_op.cc:270] Start()
0201 02:55:59.318410 (+ 24us) write_op.cc:276] Timestamp: P: 1769914543220578 usec, L: 0
0201 02:55:59.331522 (+ 13112us) write_op.cc:270] Start()
0201 02:55:59.331594 (+ 72us) write_op.cc:276] Timestamp: P: 1769914543235354 usec, L: 0
0201 02:55:59.344127 (+ 12533us) write_op.cc:270] Start()
0201 02:55:59.344162 (+ 35us) write_op.cc:276] Timestamp: P: 1769914543236479 usec, L: 0
0201 02:55:59.344416 (+ 254us) write_op.cc:270] Start()
0201 02:55:59.344441 (+ 25us) write_op.cc:276] Timestamp: P: 1769914543259919 usec, L: 0
0201 02:55:59.345179 (+ 738us) write_op.cc:270] Start()
0201 02:55:59.345205 (+ 26us) write_op.cc:276] Timestamp: P: 1769914543278966 usec, L: 0
0201 02:55:59.382697 (+ 37492us) write_op.cc:270] Start()
0201 02:55:59.382739 (+ 42us) write_op.cc:276] Timestamp: P: 1769914543292922 usec, L: 0
0201 02:55:59.383015 (+ 276us) write_op.cc:270] Start()
0201 02:55:59.383042 (+ 27us) write_op.cc:276] Timestamp: P: 1769914543313665 usec, L: 0
0201 02:55:59.397824 (+ 14782us) write_op.cc:270] Start()
0201 02:55:59.397869 (+ 45us) write_op.cc:276] Timestamp: P: 1769914543329983 usec, L: 0
0201 02:55:59.398176 (+ 307us) write_op.cc:270] Start()
0201 02:55:59.398203 (+ 27us) write_op.cc:276] Timestamp: P: 1769914543333629 usec, L: 0
0201 02:55:59.403076 (+ 4873us) write_op.cc:270] Start()
0201 02:55:59.403103 (+ 27us) write_op.cc:276] Timestamp: P: 1769914543355642 usec, L: 0
0201 02:55:59.405159 (+ 2056us) write_op.cc:270] Start()
0201 02:55:59.405200 (+ 41us) write_op.cc:276] Timestamp: P: 1769914543378535 usec, L: 0
0201 02:55:59.415995 (+ 10795us) write_op.cc:270] Start()
0201 02:55:59.417420 (+ 1425us) write_op.cc:276] Timestamp: P: 1769914543386601 usec, L: 0
0201 02:55:59.419680 (+ 2260us) write_op.cc:270] Start()
0201 02:55:59.419713 (+ 33us) write_op.cc:276] Timestamp: P: 1769914543389445 usec, L: 0
0201 02:55:59.419956 (+ 243us) write_op.cc:270] Start()
0201 02:55:59.419978 (+ 22us) write_op.cc:276] Timestamp: P: 1769914543402279 usec, L: 0
0201 02:55:59.420183 (+ 205us) write_op.cc:270] Start()
0201 02:55:59.420206 (+ 23us) write_op.cc:276] Timestamp: P: 1769914543457970 usec, L: 0
0201 02:55:59.420424 (+ 218us) write_op.cc:270] Start()
0201 02:55:59.420446 (+ 22us) write_op.cc:276] Timestamp: P: 1769914543458831 usec, L: 0
0201 02:55:59.420646 (+ 200us) write_op.cc:270] Start()
0201 02:55:59.420670 (+ 24us) write_op.cc:276] Timestamp: P: 1769914543459475 usec, L: 0
0201 02:55:59.421809 (+ 1139us) write_op.cc:270] Start()
0201 02:55:59.421835 (+ 26us) write_op.cc:276] Timestamp: P: 1769914543475992 usec, L: 0
0201 02:55:59.422020 (+ 185us) write_op.cc:270] Start()
0201 02:55:59.422041 (+ 21us) write_op.cc:276] Timestamp: P: 1769914543500289 usec, L: 0
0201 02:55:59.422239 (+ 198us) write_op.cc:270] Start()
0201 02:55:59.422260 (+ 21us) write_op.cc:276] Timestamp: P: 1769914543528362 usec, L: 0
0201 02:55:59.422470 (+ 210us) write_op.cc:270] Start()
0201 02:55:59.422497 (+ 27us) write_op.cc:276] Timestamp: P: 1769914543529148 usec, L: 0
0201 02:55:59.437673 (+ 15176us) write_op.cc:270] Start()
0201 02:55:59.437709 (+ 36us) write_op.cc:276] Timestamp: P: 1769914543529838 usec, L: 0
0201 02:55:59.437958 (+ 249us) write_op.cc:270] Start()
0201 02:55:59.437975 (+ 17us) write_op.cc:276] Timestamp: P: 1769914543572341 usec, L: 0
0201 02:55:59.440419 (+ 2444us) write_op.cc:270] Start()
0201 02:55:59.440456 (+ 37us) write_op.cc:276] Timestamp: P: 1769914543573061 usec, L: 0
0201 02:55:59.440717 (+ 261us) write_op.cc:270] Start()
0201 02:55:59.440741 (+ 24us) write_op.cc:276] Timestamp: P: 1769914543584267 usec, L: 0
0201 02:55:59.440943 (+ 202us) write_op.cc:270] Start()
0201 02:55:59.440965 (+ 22us) write_op.cc:276] Timestamp: P: 1769914543593369 usec, L: 0
0201 02:55:59.442282 (+ 1317us) write_op.cc:270] Start()
0201 02:55:59.442311 (+ 29us) write_op.cc:276] Timestamp: P: 1769914543615917 usec, L: 0
0201 02:55:59.445054 (+ 2743us) write_op.cc:270] Start()
0201 02:55:59.445080 (+ 26us) write_op.cc:276] Timestamp: P: 1769914543626112 usec, L: 0
0201 02:55:59.446338 (+ 1258us) write_op.cc:270] Start()
0201 02:55:59.446366 (+ 28us) write_op.cc:276] Timestamp: P: 1769914543647568 usec, L: 0
0201 02:55:59.447286 (+ 920us) write_op.cc:270] Start()
0201 02:55:59.447310 (+ 24us) write_op.cc:276] Timestamp: P: 1769914543648226 usec, L: 0
0201 02:55:59.452065 (+ 4755us) write_op.cc:270] Start()
0201 02:55:59.452099 (+ 34us) write_op.cc:276] Timestamp: P: 1769914543679211 usec, L: 0
0201 02:55:59.478212 (+ 26113us) write_op.cc:270] Start()
0201 02:55:59.478247 (+ 35us) write_op.cc:276] Timestamp: P: 1769914543686412 usec, L: 0
0201 02:55:59.478975 (+ 728us) write_op.cc:270] Start()
0201 02:55:59.479004 (+ 29us) write_op.cc:276] Timestamp: P: 1769914543731313 usec, L: 0
0201 02:55:59.479212 (+ 208us) write_op.cc:270] Start()
0201 02:55:59.479230 (+ 18us) write_op.cc:276] Timestamp: P: 1769914543732345 usec, L: 0
0201 02:55:59.486110 (+ 6880us) write_op.cc:270] Start()
0201 02:55:59.486149 (+ 39us) write_op.cc:276] Timestamp: P: 1769914543733016 usec, L: 0
0201 02:55:59.491249 (+ 5100us) write_op.cc:270] Start()
0201 02:55:59.491271 (+ 22us) write_op.cc:276] Timestamp: P: 1769914543744052 usec, L: 0
0201 02:55:59.496672 (+ 5401us) write_op.cc:270] Start()
0201 02:55:59.496707 (+ 35us) write_op.cc:276] Timestamp: P: 1769914543760464 usec, L: 0
0201 02:55:59.498443 (+ 1736us) write_op.cc:270] Start()
0201 02:55:59.498473 (+ 30us) write_op.cc:276] Timestamp: P: 1769914543784951 usec, L: 0
0201 02:55:59.498759 (+ 286us) write_op.cc:270] Start()
0201 02:55:59.498786 (+ 27us) write_op.cc:276] Timestamp: P: 1769914543795170 usec, L: 0
0201 02:55:59.539237 (+ 40451us) write_op.cc:270] Start()
0201 02:55:59.539272 (+ 35us) write_op.cc:276] Timestamp: P: 1769914543808314 usec, L: 0
0201 02:55:59.542104 (+ 2832us) write_op.cc:270] Start()
0201 02:55:59.542139 (+ 35us) write_op.cc:276] Timestamp: P: 1769914543831261 usec, L: 0
0201 02:55:59.542428 (+ 289us) write_op.cc:270] Start()
0201 02:55:59.542455 (+ 27us) write_op.cc:276] Timestamp: P: 1769914543861440 usec, L: 0
0201 02:55:59.564237 (+ 21782us) write_op.cc:270] Start()
0201 02:55:59.564267 (+ 30us) write_op.cc:276] Timestamp: P: 1769914543863959 usec, L: 0
0201 02:55:59.566680 (+ 2413us) write_op.cc:270] Start()
0201 02:55:59.566716 (+ 36us) write_op.cc:276] Timestamp: P: 1769914543864729 usec, L: 0
0201 02:55:59.566956 (+ 240us) write_op.cc:270] Start()
0201 02:55:59.566980 (+ 24us) write_op.cc:276] Timestamp: P: 1769914543881043 usec, L: 0
0201 02:55:59.567187 (+ 207us) write_op.cc:270] Start()
0201 02:55:59.567208 (+ 21us) write_op.cc:276] Timestamp: P: 1769914543913608 usec, L: 0
0201 02:55:59.567377 (+ 169us) write_op.cc:270] Start()
0201 02:55:59.567401 (+ 24us) write_op.cc:276] Timestamp: P: 1769914543918430 usec, L: 0
0201 02:55:59.567611 (+ 210us) write_op.cc:270] Start()
0201 02:55:59.567633 (+ 22us) write_op.cc:276] Timestamp: P: 1769914543936008 usec, L: 0
0201 02:55:59.577041 (+ 9408us) write_op.cc:270] Start()
0201 02:55:59.577081 (+ 40us) write_op.cc:276] Timestamp: P: 1769914543952940 usec, L: 0
0201 02:55:59.577334 (+ 253us) write_op.cc:270] Start()
0201 02:55:59.577359 (+ 25us) write_op.cc:276] Timestamp: P: 1769914544001224 usec, L: 0
0201 02:55:59.577570 (+ 211us) write_op.cc:270] Start()
0201 02:55:59.577622 (+ 52us) write_op.cc:276] Timestamp: P: 1769914544013619 usec, L: 0
0201 02:55:59.579062 (+ 1440us) write_op.cc:270] Start()
0201 02:55:59.579093 (+ 31us) write_op.cc:276] Timestamp: P: 1769914544019210 usec, L: 0
0201 02:55:59.582532 (+ 3439us) write_op.cc:270] Start()
0201 02:55:59.582562 (+ 30us) write_op.cc:276] Timestamp: P: 1769914544023685 usec, L: 0
0201 02:55:59.582843 (+ 281us) write_op.cc:270] Start()
0201 02:55:59.582871 (+ 28us) write_op.cc:276] Timestamp: P: 1769914544042906 usec, L: 0
0201 02:55:59.583049 (+ 178us) write_op.cc:270] Start()
0201 02:55:59.583070 (+ 21us) write_op.cc:276] Timestamp: P: 1769914544045125 usec, L: 0
0201 02:55:59.583223 (+ 153us) write_op.cc:270] Start()
0201 02:55:59.583245 (+ 22us) write_op.cc:276] Timestamp: P: 1769914544080000 usec, L: 0
0201 02:55:59.583414 (+ 169us) write_op.cc:270] Start()
0201 02:55:59.583434 (+ 20us) write_op.cc:276] Timestamp: P: 1769914544083886 usec, L: 0
0201 02:55:59.583612 (+ 178us) write_op.cc:270] Start()
0201 02:55:59.583633 (+ 21us) write_op.cc:276] Timestamp: P: 1769914544086220 usec, L: 0
0201 02:55:59.583797 (+ 164us) write_op.cc:270] Start()
0201 02:55:59.583817 (+ 20us) write_op.cc:276] Timestamp: P: 1769914544101185 usec, L: 0
0201 02:55:59.583985 (+ 168us) write_op.cc:270] Start()
0201 02:55:59.584006 (+ 21us) write_op.cc:276] Timestamp: P: 1769914544132861 usec, L: 0
0201 02:55:59.584509 (+ 503us) write_op.cc:270] Start()
0201 02:55:59.584542 (+ 33us) write_op.cc:276] Timestamp: P: 1769914544142023 usec, L: 0
0201 02:55:59.586943 (+ 2401us) write_op.cc:270] Start()
0201 02:55:59.586971 (+ 28us) write_op.cc:276] Timestamp: P: 1769914544142859 usec, L: 0
0201 02:55:59.618170 (+ 31199us) write_op.cc:270] Start()
0201 02:55:59.618200 (+ 30us) write_op.cc:276] Timestamp: P: 1769914544151096 usec, L: 0
0201 02:55:59.623856 (+ 5656us) write_op.cc:270] Start()
0201 02:55:59.623886 (+ 30us) write_op.cc:276] Timestamp: P: 1769914544177962 usec, L: 0
0201 02:55:59.630854 (+ 6968us) write_op.cc:270] Start()
0201 02:55:59.634444 (+ 3590us) write_op.cc:276] Timestamp: P: 1769914544208274 usec, L: 0
0201 02:55:59.659786 (+ 25342us) write_op.cc:270] Start()
0201 02:55:59.659819 (+ 33us) write_op.cc:276] Timestamp: P: 1769914544210316 usec, L: 0
0201 02:55:59.660064 (+ 245us) write_op.cc:270] Start()
0201 02:55:59.660091 (+ 27us) write_op.cc:276] Timestamp: P: 1769914544212286 usec, L: 0
0201 02:55:59.660363 (+ 272us) write_op.cc:270] Start()
0201 02:55:59.660388 (+ 25us) write_op.cc:276] Timestamp: P: 1769914544241717 usec, L: 0
0201 02:55:59.660587 (+ 199us) write_op.cc:270] Start()
0201 02:55:59.660613 (+ 26us) write_op.cc:276] Timestamp: P: 1769914544263473 usec, L: 0
0201 02:55:59.660822 (+ 209us) write_op.cc:270] Start()
0201 02:55:59.660844 (+ 22us) write_op.cc:276] Timestamp: P: 1769914544273399 usec, L: 0
0201 02:55:59.661313 (+ 469us) write_op.cc:270] Start()
0201 02:55:59.661348 (+ 35us) write_op.cc:276] Timestamp: P: 1769914544289910 usec, L: 0
0201 02:55:59.661621 (+ 273us) write_op.cc:270] Start()
0201 02:55:59.661650 (+ 29us) write_op.cc:276] Timestamp: P: 1769914544291505 usec, L: 0
0201 02:55:59.661880 (+ 230us) write_op.cc:270] Start()
0201 02:55:59.661907 (+ 27us) write_op.cc:276] Timestamp: P: 1769914544320408 usec, L: 0
0201 02:55:59.662121 (+ 214us) write_op.cc:270] Start()
0201 02:55:59.662142 (+ 21us) write_op.cc:276] Timestamp: P: 1769914544347348 usec, L: 0
0201 02:55:59.692545 (+ 30403us) write_op.cc:270] Start()
0201 02:55:59.692581 (+ 36us) write_op.cc:276] Timestamp: P: 1769914544352087 usec, L: 0
0201 02:55:59.692830 (+ 249us) write_op.cc:270] Start()
0201 02:55:59.692857 (+ 27us) write_op.cc:276] Timestamp: P: 1769914544355338 usec, L: 0
0201 02:55:59.693041 (+ 184us) write_op.cc:270] Start()
0201 02:55:59.693063 (+ 22us) write_op.cc:276] Timestamp: P: 1769914544375309 usec, L: 0
0201 02:55:59.693210 (+ 147us) write_op.cc:270] Start()
0201 02:55:59.693234 (+ 24us) write_op.cc:276] Timestamp: P: 1769914544426978 usec, L: 0
0201 02:55:59.693421 (+ 187us) write_op.cc:270] Start()
0201 02:55:59.693443 (+ 22us) write_op.cc:276] Timestamp: P: 1769914544431373 usec, L: 0
0201 02:55:59.693645 (+ 202us) write_op.cc:270] Start()
0201 02:55:59.693669 (+ 24us) write_op.cc:276] Timestamp: P: 1769914544433368 usec, L: 0
0201 02:55:59.693857 (+ 188us) write_op.cc:270] Start()
0201 02:55:59.693887 (+ 30us) write_op.cc:276] Timestamp: P: 1769914544455016 usec, L: 0
0201 02:55:59.694064 (+ 177us) write_op.cc:270] Start()
0201 02:55:59.694085 (+ 21us) write_op.cc:276] Timestamp: P: 1769914544489008 usec, L: 0
0201 02:55:59.694261 (+ 176us) write_op.cc:270] Start()
0201 02:55:59.694279 (+ 18us) write_op.cc:276] Timestamp: P: 1769914544494523 usec, L: 0
0201 02:55:59.694476 (+ 197us) write_op.cc:270] Start()
0201 02:55:59.694498 (+ 22us) write_op.cc:276] Timestamp: P: 1769914544497452 usec, L: 0
0201 02:55:59.713759 (+ 19261us) write_op.cc:270] Start()
0201 02:55:59.713785 (+ 26us) write_op.cc:276] Timestamp: P: 1769914544518197 usec, L: 0
0201 02:55:59.721674 (+ 7889us) write_op.cc:270] Start()
0201 02:55:59.721709 (+ 35us) write_op.cc:276] Timestamp: P: 1769914544527064 usec, L: 0
0201 02:55:59.732223 (+ 10514us) write_op.cc:270] Start()
0201 02:55:59.732315 (+ 92us) write_op.cc:276] Timestamp: P: 1769914544561251 usec, L: 0
0201 02:55:59.736241 (+ 3926us) write_op.cc:270] Start()
0201 02:55:59.736281 (+ 40us) write_op.cc:276] Timestamp: P: 1769914544583880 usec, L: 0
0201 02:55:59.740403 (+ 4122us) write_op.cc:270] Start()
0201 02:55:59.740430 (+ 27us) write_op.cc:276] Timestamp: P: 1769914544584610 usec, L: 0
0201 02:55:59.740742 (+ 312us) write_op.cc:270] Start()
0201 02:55:59.740766 (+ 24us) write_op.cc:276] Timestamp: P: 1769914544590322 usec, L: 0
0201 02:55:59.740932 (+ 166us) write_op.cc:270] Start()
0201 02:55:59.740953 (+ 21us) write_op.cc:276] Timestamp: P: 1769914544620322 usec, L: 0
0201 02:55:59.741112 (+ 159us) write_op.cc:270] Start()
0201 02:55:59.741132 (+ 20us) write_op.cc:276] Timestamp: P: 1769914544643194 usec, L: 0
0201 02:55:59.741256 (+ 124us) write_op.cc:270] Start()
0201 02:55:59.741277 (+ 21us) write_op.cc:276] Timestamp: P: 1769914544646571 usec, L: 0
0201 02:55:59.741416 (+ 139us) write_op.cc:270] Start()
0201 02:55:59.741440 (+ 24us) write_op.cc:276] Timestamp: P: 1769914544667189 usec, L: 0
0201 02:55:59.741624 (+ 184us) write_op.cc:270] Start()
0201 02:55:59.741647 (+ 23us) write_op.cc:276] Timestamp: P: 1769914544682533 usec, L: 0
0201 02:55:59.741804 (+ 157us) write_op.cc:270] Start()
0201 02:55:59.741826 (+ 22us) write_op.cc:276] Timestamp: P: 1769914544697608 usec, L: 0
0201 02:55:59.741996 (+ 170us) write_op.cc:270] Start()
0201 02:55:59.742018 (+ 22us) write_op.cc:276] Timestamp: P: 1769914544716907 usec, L: 0
0201 02:55:59.742159 (+ 141us) write_op.cc:270] Start()
0201 02:55:59.742180 (+ 21us) write_op.cc:276] Timestamp: P: 1769914544723203 usec, L: 0
0201 02:55:59.742328 (+ 148us) write_op.cc:270] Start()
0201 02:55:59.742350 (+ 22us) write_op.cc:276] Timestamp: P: 1769914544752273 usec, L: 0
0201 02:55:59.763023 (+ 20673us) write_op.cc:270] Start()
0201 02:55:59.763046 (+ 23us) write_op.cc:276] Timestamp: P: 1769914544763748 usec, L: 0
0201 02:55:59.782813 (+ 19767us) write_op.cc:270] Start()
0201 02:55:59.782844 (+ 31us) write_op.cc:276] Timestamp: P: 1769914544790105 usec, L: 0
0201 02:55:59.787545 (+ 4701us) write_op.cc:270] Start()
0201 02:55:59.787585 (+ 40us) write_op.cc:276] Timestamp: P: 1769914544793161 usec, L: 0
0201 02:55:59.787832 (+ 247us) write_op.cc:270] Start()
0201 02:55:59.787859 (+ 27us) write_op.cc:276] Timestamp: P: 1769914544810988 usec, L: 0
0201 02:55:59.801977 (+ 14118us) write_op.cc:270] Start()
0201 02:55:59.802010 (+ 33us) write_op.cc:276] Timestamp: P: 1769914544817970 usec, L: 0
0201 02:55:59.802243 (+ 233us) write_op.cc:270] Start()
0201 02:55:59.802268 (+ 25us) write_op.cc:276] Timestamp: P: 1769914544836874 usec, L: 0
0201 02:55:59.802449 (+ 181us) write_op.cc:270] Start()
0201 02:55:59.802471 (+ 22us) write_op.cc:276] Timestamp: P: 1769914544875253 usec, L: 0
0201 02:55:59.826594 (+ 24123us) write_op.cc:270] Start()
0201 02:55:59.826629 (+ 35us) write_op.cc:276] Timestamp: P: 1769914544876318 usec, L: 0
0201 02:55:59.826912 (+ 283us) write_op.cc:270] Start()
0201 02:55:59.826939 (+ 27us) write_op.cc:276] Timestamp: P: 1769914544897452 usec, L: 0
0201 02:55:59.827164 (+ 225us) write_op.cc:270] Start()
0201 02:55:59.827186 (+ 22us) write_op.cc:276] Timestamp: P: 1769914544910461 usec, L: 0
0201 02:55:59.827373 (+ 187us) write_op.cc:270] Start()
0201 02:55:59.827395 (+ 22us) write_op.cc:276] Timestamp: P: 1769914544924216 usec, L: 0
0201 02:55:59.827582 (+ 187us) write_op.cc:270] Start()
0201 02:55:59.827614 (+ 32us) write_op.cc:276] Timestamp: P: 1769914544945136 usec, L: 0
0201 02:55:59.862614 (+ 35000us) write_op.cc:270] Start()
0201 02:55:59.862642 (+ 28us) write_op.cc:276] Timestamp: P: 1769914544973294 usec, L: 0
0201 02:55:59.862905 (+ 263us) write_op.cc:270] Start()
0201 02:55:59.862928 (+ 23us) write_op.cc:276] Timestamp: P: 1769914545011805 usec, L: 0
0201 02:55:59.863095 (+ 167us) write_op.cc:270] Start()
0201 02:55:59.863114 (+ 19us) write_op.cc:276] Timestamp: P: 1769914545021813 usec, L: 0
0201 02:55:59.873375 (+ 10261us) write_op.cc:270] Start()
0201 02:55:59.873400 (+ 25us) write_op.cc:276] Timestamp: P: 1769914545022553 usec, L: 0
0201 02:55:59.873620 (+ 220us) write_op.cc:270] Start()
0201 02:55:59.878695 (+ 5075us) write_op.cc:276] Timestamp: P: 1769914545024269 usec, L: 0
0201 02:55:59.878936 (+ 241us) write_op.cc:270] Start()
0201 02:55:59.878959 (+ 23us) write_op.cc:276] Timestamp: P: 176991
I20260201 02:56:05.109234 14301 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "535b6fc9826f436089318f329dad0f4d" candidate_uuid: "20beda53b20146fb90018bf4533dcd58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1057 } } ignore_live_leader: false dest_uuid: "943634a8539f44a8969b8503616b09d6" is_pre_election: true
I20260201 02:56:05.119781 14430 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "535b6fc9826f436089318f329dad0f4d" candidate_uuid: "20beda53b20146fb90018bf4533dcd58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1057 } } ignore_live_leader: false dest_uuid: "74bc17a87c2342958617c01904a29dac" is_pre_election: true
I20260201 02:56:05.125252 14892 leader_election.cc:304] T 535b6fc9826f436089318f329dad0f4d P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20beda53b20146fb90018bf4533dcd58; no voters: 74bc17a87c2342958617c01904a29dac, 943634a8539f44a8969b8503616b09d6
I20260201 02:56:05.125679 15062 raft_consensus.cc:2749] T 535b6fc9826f436089318f329dad0f4d P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 02:56:05.539088 15075 raft_consensus.cc:493] T 535b6fc9826f436089318f329dad0f4d P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74bc17a87c2342958617c01904a29dac)
I20260201 02:56:05.539271 15075 raft_consensus.cc:515] T 535b6fc9826f436089318f329dad0f4d P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:56:05.539862 15075 leader_election.cc:290] T 535b6fc9826f436089318f329dad0f4d P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 943634a8539f44a8969b8503616b09d6 (127.13.170.2:41045), 74bc17a87c2342958617c01904a29dac (127.13.170.3:45403)
I20260201 02:56:05.541258 14302 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "535b6fc9826f436089318f329dad0f4d" candidate_uuid: "20beda53b20146fb90018bf4533dcd58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1057 } } ignore_live_leader: false dest_uuid: "943634a8539f44a8969b8503616b09d6" is_pre_election: true
I20260201 02:56:05.552785 14433 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "535b6fc9826f436089318f329dad0f4d" candidate_uuid: "20beda53b20146fb90018bf4533dcd58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1057 } } ignore_live_leader: false dest_uuid: "74bc17a87c2342958617c01904a29dac" is_pre_election: true
I20260201 02:56:05.556080 14892 leader_election.cc:304] T 535b6fc9826f436089318f329dad0f4d P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20beda53b20146fb90018bf4533dcd58; no voters: 74bc17a87c2342958617c01904a29dac, 943634a8539f44a8969b8503616b09d6
I20260201 02:56:05.556640 15075 raft_consensus.cc:2749] T 535b6fc9826f436089318f329dad0f4d P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 02:56:05.598084 14960 raft_consensus.cc:3060] T 7b2f386887ef4ab0a692195c4f968c12 P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Advancing to term 2
W20260201 02:56:06.167909 14489 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.13.170.2:41045, user_credentials={real_user=slave}} blocked reactor thread for 54033.1us
I20260201 02:56:06.191550 15085 raft_consensus.cc:493] T 535b6fc9826f436089318f329dad0f4d P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74bc17a87c2342958617c01904a29dac)
I20260201 02:56:06.191754 15085 raft_consensus.cc:515] T 535b6fc9826f436089318f329dad0f4d P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:56:06.201889 14303 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "535b6fc9826f436089318f329dad0f4d" candidate_uuid: "20beda53b20146fb90018bf4533dcd58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1057 } } ignore_live_leader: false dest_uuid: "943634a8539f44a8969b8503616b09d6" is_pre_election: true
I20260201 02:56:06.211664 14433 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "535b6fc9826f436089318f329dad0f4d" candidate_uuid: "20beda53b20146fb90018bf4533dcd58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1057 } } ignore_live_leader: false dest_uuid: "74bc17a87c2342958617c01904a29dac" is_pre_election: true
I20260201 02:56:06.212213 14892 leader_election.cc:304] T 535b6fc9826f436089318f329dad0f4d P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20beda53b20146fb90018bf4533dcd58; no voters: 74bc17a87c2342958617c01904a29dac, 943634a8539f44a8969b8503616b09d6
I20260201 02:56:06.194829 15085 leader_election.cc:290] T 535b6fc9826f436089318f329dad0f4d P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 943634a8539f44a8969b8503616b09d6 (127.13.170.2:41045), 74bc17a87c2342958617c01904a29dac (127.13.170.3:45403)
I20260201 02:56:06.214069 15085 raft_consensus.cc:2749] T 535b6fc9826f436089318f329dad0f4d P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260201 02:56:06.270670 14892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.170.3:45403, user_credentials={real_user=slave}} blocked reactor thread for 49973.2us
I20260201 02:56:06.932842 15075 raft_consensus.cc:493] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 943634a8539f44a8969b8503616b09d6)
I20260201 02:56:06.933027 15075 raft_consensus.cc:515] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:56:06.933813 15075 leader_election.cc:290] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 943634a8539f44a8969b8503616b09d6 (127.13.170.2:41045), 74bc17a87c2342958617c01904a29dac (127.13.170.3:45403)
I20260201 02:56:06.934150 14959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.13.170.2:55457 (request call id 163) took 1541 ms. Trace:
I20260201 02:56:06.959163 14301 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1abdef8b45334d908fa08ec613374a3b" candidate_uuid: "20beda53b20146fb90018bf4533dcd58" candidate_term: 3 candidate_status { last_received { term: 2 index: 1256 } } ignore_live_leader: false dest_uuid: "943634a8539f44a8969b8503616b09d6" is_pre_election: true
I20260201 02:56:06.969621 14431 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1abdef8b45334d908fa08ec613374a3b" candidate_uuid: "20beda53b20146fb90018bf4533dcd58" candidate_term: 3 candidate_status { last_received { term: 2 index: 1256 } } ignore_live_leader: false dest_uuid: "74bc17a87c2342958617c01904a29dac" is_pre_election: true
I20260201 02:56:06.984532 14892 leader_election.cc:304] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20beda53b20146fb90018bf4533dcd58; no voters: 74bc17a87c2342958617c01904a29dac, 943634a8539f44a8969b8503616b09d6
I20260201 02:56:06.984836 15075 raft_consensus.cc:2749] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260201 02:56:07.124357 15075 raft_consensus.cc:493] T 535b6fc9826f436089318f329dad0f4d P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74bc17a87c2342958617c01904a29dac)
I20260201 02:56:07.124542 15075 raft_consensus.cc:515] T 535b6fc9826f436089318f329dad0f4d P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:56:07.125156 15075 leader_election.cc:290] T 535b6fc9826f436089318f329dad0f4d P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 943634a8539f44a8969b8503616b09d6 (127.13.170.2:41045), 74bc17a87c2342958617c01904a29dac (127.13.170.3:45403)
I20260201 02:56:07.125577 14430 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "535b6fc9826f436089318f329dad0f4d" candidate_uuid: "20beda53b20146fb90018bf4533dcd58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1057 } } ignore_live_leader: false dest_uuid: "74bc17a87c2342958617c01904a29dac" is_pre_election: true
I20260201 02:56:07.127805 14299 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "535b6fc9826f436089318f329dad0f4d" candidate_uuid: "20beda53b20146fb90018bf4533dcd58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1057 } } ignore_live_leader: false dest_uuid: "943634a8539f44a8969b8503616b09d6" is_pre_election: true
I20260201 02:56:07.131433 14892 leader_election.cc:304] T 535b6fc9826f436089318f329dad0f4d P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20beda53b20146fb90018bf4533dcd58; no voters: 74bc17a87c2342958617c01904a29dac, 943634a8539f44a8969b8503616b09d6
I20260201 02:56:07.131925 15075 raft_consensus.cc:2749] T 535b6fc9826f436089318f329dad0f4d P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 02:56:05.090150 14963 rpcz_store.cc:276] 0201 02:56:00.887918 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 02:56:00.887973 (+ 55us) service_pool.cc:225] Handling call
0201 02:56:01.048784 (+160811us) raft_consensus.cc:1471] Updating replica for 889 ops
0201 02:56:01.515744 (+466960us) raft_consensus.cc:1534] Early marking committed up to index 169
0201 02:56:01.515857 (+ 113us) raft_consensus.cc:1539] Triggering prepare for 888 ops
0201 02:56:01.516027 (+ 170us) write_op.cc:270] Start()
0201 02:56:01.516060 (+ 33us) write_op.cc:276] Timestamp: P: 1769914541687949 usec, L: 0
0201 02:56:01.516665 (+ 605us) write_op.cc:270] Start()
0201 02:56:01.516696 (+ 31us) write_op.cc:276] Timestamp: P: 1769914541726270 usec, L: 0
0201 02:56:01.516859 (+ 163us) write_op.cc:270] Start()
0201 02:56:01.516877 (+ 18us) write_op.cc:276] Timestamp: P: 1769914541735520 usec, L: 0
0201 02:56:01.517021 (+ 144us) write_op.cc:270] Start()
0201 02:56:01.517043 (+ 22us) write_op.cc:276] Timestamp: P: 1769914542048653 usec, L: 0
0201 02:56:01.517205 (+ 162us) write_op.cc:270] Start()
0201 02:56:01.517224 (+ 19us) write_op.cc:276] Timestamp: P: 1769914542065384 usec, L: 0
0201 02:56:01.517353 (+ 129us) write_op.cc:270] Start()
0201 02:56:01.517377 (+ 24us) write_op.cc:276] Timestamp: P: 1769914542091961 usec, L: 0
0201 02:56:01.517526 (+ 149us) write_op.cc:270] Start()
0201 02:56:01.517567 (+ 41us) write_op.cc:276] Timestamp: P: 1769914542093268 usec, L: 0
0201 02:56:01.517724 (+ 157us) write_op.cc:270] Start()
0201 02:56:01.517766 (+ 42us) write_op.cc:276] Timestamp: P: 1769914542124682 usec, L: 0
0201 02:56:01.517915 (+ 149us) write_op.cc:270] Start()
0201 02:56:01.517934 (+ 19us) write_op.cc:276] Timestamp: P: 1769914542126539 usec, L: 0
0201 02:56:01.518087 (+ 153us) write_op.cc:270] Start()
0201 02:56:01.518106 (+ 19us) write_op.cc:276] Timestamp: P: 1769914542132764 usec, L: 0
0201 02:56:01.518238 (+ 132us) write_op.cc:270] Start()
0201 02:56:01.518258 (+ 20us) write_op.cc:276] Timestamp: P: 1769914542155418 usec, L: 0
0201 02:56:01.518441 (+ 183us) write_op.cc:270] Start()
0201 02:56:01.518462 (+ 21us) write_op.cc:276] Timestamp: P: 1769914542174332 usec, L: 0
0201 02:56:01.518615 (+ 153us) write_op.cc:270] Start()
0201 02:56:01.518635 (+ 20us) write_op.cc:276] Timestamp: P: 1769914542193196 usec, L: 0
0201 02:56:01.518839 (+ 204us) write_op.cc:270] Start()
0201 02:56:01.518860 (+ 21us) write_op.cc:276] Timestamp: P: 1769914542205579 usec, L: 0
0201 02:56:01.519041 (+ 181us) write_op.cc:270] Start()
0201 02:56:01.519061 (+ 20us) write_op.cc:276] Timestamp: P: 1769914542237000 usec, L: 0
0201 02:56:01.519205 (+ 144us) write_op.cc:270] Start()
0201 02:56:01.519234 (+ 29us) write_op.cc:276] Timestamp: P: 1769914542239426 usec, L: 0
0201 02:56:01.549661 (+ 30427us) write_op.cc:270] Start()
0201 02:56:01.549703 (+ 42us) write_op.cc:276] Timestamp: P: 1769914542246795 usec, L: 0
0201 02:56:01.549952 (+ 249us) write_op.cc:270] Start()
0201 02:56:01.549980 (+ 28us) write_op.cc:276] Timestamp: P: 1769914542280515 usec, L: 0
0201 02:56:01.550147 (+ 167us) write_op.cc:270] Start()
0201 02:56:01.550172 (+ 25us) write_op.cc:276] Timestamp: P: 1769914542287552 usec, L: 0
0201 02:56:01.550354 (+ 182us) write_op.cc:270] Start()
0201 02:56:01.550382 (+ 28us) write_op.cc:276] Timestamp: P: 1769914542289598 usec, L: 0
0201 02:56:01.550562 (+ 180us) write_op.cc:270] Start()
0201 02:56:01.550596 (+ 34us) write_op.cc:276] Timestamp: P: 1769914542310985 usec, L: 0
0201 02:56:01.550842 (+ 246us) write_op.cc:270] Start()
0201 02:56:01.550871 (+ 29us) write_op.cc:276] Timestamp: P: 1769914542314573 usec, L: 0
0201 02:56:01.551055 (+ 184us) write_op.cc:270] Start()
0201 02:56:01.551080 (+ 25us) write_op.cc:276] Timestamp: P: 1769914542349284 usec, L: 0
0201 02:56:01.551314 (+ 234us) write_op.cc:270] Start()
0201 02:56:01.551365 (+ 51us) write_op.cc:276] Timestamp: P: 1769914542355061 usec, L: 0
0201 02:56:01.551656 (+ 291us) write_op.cc:270] Start()
0201 02:56:01.551685 (+ 29us) write_op.cc:276] Timestamp: P: 1769914542374159 usec, L: 0
0201 02:56:01.551896 (+ 211us) write_op.cc:270] Start()
0201 02:56:01.551922 (+ 26us) write_op.cc:276] Timestamp: P: 1769914542384783 usec, L: 0
0201 02:56:01.552092 (+ 170us) write_op.cc:270] Start()
0201 02:56:01.552118 (+ 26us) write_op.cc:276] Timestamp: P: 1769914542420601 usec, L: 0
0201 02:56:01.552332 (+ 214us) write_op.cc:270] Start()
0201 02:56:01.552356 (+ 24us) write_op.cc:276] Timestamp: P: 1769914542421706 usec, L: 0
0201 02:56:01.552541 (+ 185us) write_op.cc:270] Start()
0201 02:56:01.552572 (+ 31us) write_op.cc:276] Timestamp: P: 1769914542428216 usec, L: 0
0201 02:56:01.552722 (+ 150us) write_op.cc:270] Start()
0201 02:56:01.552744 (+ 22us) write_op.cc:276] Timestamp: P: 1769914542448158 usec, L: 0
0201 02:56:01.552887 (+ 143us) write_op.cc:270] Start()
0201 02:56:01.552918 (+ 31us) write_op.cc:276] Timestamp: P: 1769914542470951 usec, L: 0
0201 02:56:01.553061 (+ 143us) write_op.cc:270] Start()
0201 02:56:01.553080 (+ 19us) write_op.cc:276] Timestamp: P: 1769914542488213 usec, L: 0
0201 02:56:01.553243 (+ 163us) write_op.cc:270] Start()
0201 02:56:01.553264 (+ 21us) write_op.cc:276] Timestamp: P: 1769914542513390 usec, L: 0
0201 02:56:01.553414 (+ 150us) write_op.cc:270] Start()
0201 02:56:01.553433 (+ 19us) write_op.cc:276] Timestamp: P: 1769914542518986 usec, L: 0
0201 02:56:01.553572 (+ 139us) write_op.cc:270] Start()
0201 02:56:01.553605 (+ 33us) write_op.cc:276] Timestamp: P: 1769914542532426 usec, L: 0
0201 02:56:01.620697 (+ 67092us) write_op.cc:270] Start()
0201 02:56:01.622633 (+ 1936us) write_op.cc:276] Timestamp: P: 1769914542538975 usec, L: 0
0201 02:56:01.623924 (+ 1291us) write_op.cc:270] Start()
0201 02:56:01.623947 (+ 23us) write_op.cc:276] Timestamp: P: 1769914542560362 usec, L: 0
0201 02:56:01.624114 (+ 167us) write_op.cc:270] Start()
0201 02:56:01.624134 (+ 20us) write_op.cc:276] Timestamp: P: 1769914542581113 usec, L: 0
0201 02:56:01.647099 (+ 22965us) write_op.cc:270] Start()
0201 02:56:01.647126 (+ 27us) write_op.cc:276] Timestamp: P: 1769914542593621 usec, L: 0
0201 02:56:01.650885 (+ 3759us) write_op.cc:270] Start()
0201 02:56:01.650920 (+ 35us) write_op.cc:276] Timestamp: P: 1769914542603017 usec, L: 0
0201 02:56:01.651137 (+ 217us) write_op.cc:270] Start()
0201 02:56:01.651167 (+ 30us) write_op.cc:276] Timestamp: P: 1769914542606412 usec, L: 0
0201 02:56:01.651391 (+ 224us) write_op.cc:270] Start()
0201 02:56:01.651419 (+ 28us) write_op.cc:276] Timestamp: P: 1769914542648158 usec, L: 0
0201 02:56:01.666354 (+ 14935us) write_op.cc:270] Start()
0201 02:56:01.666401 (+ 47us) write_op.cc:276] Timestamp: P: 1769914542651734 usec, L: 0
0201 02:56:01.672889 (+ 6488us) write_op.cc:270] Start()
0201 02:56:01.672917 (+ 28us) write_op.cc:276] Timestamp: P: 1769914542655213 usec, L: 0
0201 02:56:01.674636 (+ 1719us) write_op.cc:270] Start()
0201 02:56:01.674706 (+ 70us) write_op.cc:276] Timestamp: P: 1769914542660503 usec, L: 0
0201 02:56:01.674935 (+ 229us) write_op.cc:270] Start()
0201 02:56:01.674962 (+ 27us) write_op.cc:276] Timestamp: P: 1769914542687618 usec, L: 0
0201 02:56:01.677338 (+ 2376us) write_op.cc:270] Start()
0201 02:56:01.677377 (+ 39us) write_op.cc:276] Timestamp: P: 1769914542711341 usec, L: 0
0201 02:56:01.679532 (+ 2155us) write_op.cc:270] Start()
0201 02:56:01.679568 (+ 36us) write_op.cc:276] Timestamp: P: 1769914542712046 usec, L: 0
0201 02:56:01.682641 (+ 3073us) write_op.cc:270] Start()
0201 02:56:01.682696 (+ 55us) write_op.cc:276] Timestamp: P: 1769914542730454 usec, L: 0
0201 02:56:01.682919 (+ 223us) write_op.cc:270] Start()
0201 02:56:01.682944 (+ 25us) write_op.cc:276] Timestamp: P: 1769914542753755 usec, L: 0
0201 02:56:01.683115 (+ 171us) write_op.cc:270] Start()
0201 02:56:01.683136 (+ 21us) write_op.cc:276] Timestamp: P: 1769914542763458 usec, L: 0
0201 02:56:01.683316 (+ 180us) write_op.cc:270] Start()
0201 02:56:01.683336 (+ 20us) write_op.cc:276] Timestamp: P: 1769914542797754 usec, L: 0
0201 02:56:01.683900 (+ 564us) write_op.cc:270] Start()
0201 02:56:01.683928 (+ 28us) write_op.cc:276] Timestamp: P: 1769914542803695 usec, L: 0
0201 02:56:01.685905 (+ 1977us) write_op.cc:270] Start()
0201 02:56:01.685928 (+ 23us) write_op.cc:276] Timestamp: P: 1769914542811747 usec, L: 0
0201 02:56:01.690858 (+ 4930us) write_op.cc:270] Start()
0201 02:56:01.690890 (+ 32us) write_op.cc:276] Timestamp: P: 1769914542838045 usec, L: 0
0201 02:56:01.695032 (+ 4142us) write_op.cc:270] Start()
0201 02:56:01.695051 (+ 19us) write_op.cc:276] Timestamp: P: 1769914542842003 usec, L: 0
0201 02:56:01.699173 (+ 4122us) write_op.cc:270] Start()
0201 02:56:01.699214 (+ 41us) write_op.cc:276] Timestamp: P: 1769914542860397 usec, L: 0
0201 02:56:01.710945 (+ 11731us) write_op.cc:270] Start()
0201 02:56:01.710976 (+ 31us) write_op.cc:276] Timestamp: P: 1769914542861160 usec, L: 0
0201 02:56:01.712468 (+ 1492us) write_op.cc:270] Start()
0201 02:56:01.712496 (+ 28us) write_op.cc:276] Timestamp: P: 1769914542906866 usec, L: 0
0201 02:56:01.715042 (+ 2546us) write_op.cc:270] Start()
0201 02:56:01.732556 (+ 17514us) write_op.cc:276] Timestamp: P: 1769914542907772 usec, L: 0
0201 02:56:01.736321 (+ 3765us) write_op.cc:270] Start()
0201 02:56:01.736361 (+ 40us) write_op.cc:276] Timestamp: P: 1769914542910210 usec, L: 0
0201 02:56:01.737065 (+ 704us) write_op.cc:270] Start()
0201 02:56:01.737091 (+ 26us) write_op.cc:276] Timestamp: P: 1769914542945207 usec, L: 0
0201 02:56:01.739815 (+ 2724us) write_op.cc:270] Start()
0201 02:56:01.739841 (+ 26us) write_op.cc:276] Timestamp: P: 1769914542945895 usec, L: 0
0201 02:56:01.761784 (+ 21943us) write_op.cc:270] Start()
0201 02:56:01.761819 (+ 35us) write_op.cc:276] Timestamp: P: 1769914542984823 usec, L: 0
0201 02:56:01.765334 (+ 3515us) write_op.cc:270] Start()
0201 02:56:01.765373 (+ 39us) write_op.cc:276] Timestamp: P: 1769914542994666 usec, L: 0
0201 02:56:01.783838 (+ 18465us) write_op.cc:270] Start()
0201 02:56:01.783867 (+ 29us) write_op.cc:276] Timestamp: P: 1769914543008583 usec, L: 0
0201 02:56:01.784076 (+ 209us) write_op.cc:270] Start()
0201 02:56:01.784098 (+ 22us) write_op.cc:276] Timestamp: P: 1769914543009459 usec, L: 0
0201 02:56:01.784300 (+ 202us) write_op.cc:270] Start()
0201 02:56:01.784339 (+ 39us) write_op.cc:276] Timestamp: P: 1769914543044670 usec, L: 0
0201 02:56:01.784490 (+ 151us) write_op.cc:270] Start()
0201 02:56:01.784509 (+ 19us) write_op.cc:276] Timestamp: P: 1769914543048405 usec, L: 0
0201 02:56:01.784662 (+ 153us) write_op.cc:270] Start()
0201 02:56:01.784683 (+ 21us) write_op.cc:276] Timestamp: P: 1769914543054086 usec, L: 0
0201 02:56:01.784848 (+ 165us) write_op.cc:270] Start()
0201 02:56:01.784871 (+ 23us) write_op.cc:276] Timestamp: P: 1769914543073122 usec, L: 0
0201 02:56:01.788549 (+ 3678us) write_op.cc:270] Start()
0201 02:56:01.788583 (+ 34us) write_op.cc:276] Timestamp: P: 1769914543096773 usec, L: 0
0201 02:56:01.788756 (+ 173us) write_op.cc:270] Start()
0201 02:56:01.788776 (+ 20us) write_op.cc:276] Timestamp: P: 1769914543111577 usec, L: 0
0201 02:56:01.796258 (+ 7482us) write_op.cc:270] Start()
0201 02:56:01.796292 (+ 34us) write_op.cc:276] Timestamp: P: 1769914543113407 usec, L: 0
0201 02:56:01.796516 (+ 224us) write_op.cc:270] Start()
0201 02:56:01.796542 (+ 26us) write_op.cc:276] Timestamp: P: 1769914543140699 usec, L: 0
0201 02:56:01.796769 (+ 227us) write_op.cc:270] Start()
0201 02:56:01.796790 (+ 21us) write_op.cc:276] Timestamp: P: 1769914543160678 usec, L: 0
0201 02:56:01.796997 (+ 207us) write_op.cc:270] Start()
0201 02:56:01.797020 (+ 23us) write_op.cc:276] Timestamp: P: 1769914543168068 usec, L: 0
0201 02:56:01.797225 (+ 205us) write_op.cc:270] Start()
0201 02:56:01.797247 (+ 22us) write_op.cc:276] Timestamp: P: 1769914543181410 usec, L: 0
0201 02:56:01.797446 (+ 199us) write_op.cc:270] Start()
0201 02:56:01.797497 (+ 51us) write_op.cc:276] Timestamp: P: 1769914543195509 usec, L: 0
0201 02:56:01.797711 (+ 214us) write_op.cc:270] Start()
0201 02:56:01.797735 (+ 24us) write_op.cc:276] Timestamp: P: 1769914543210059 usec, L: 0
0201 02:56:01.797932 (+ 197us) write_op.cc:270] Start()
0201 02:56:01.797955 (+ 23us) write_op.cc:276] Timestamp: P: 1769914543233840 usec, L: 0
0201 02:56:01.798341 (+ 386us) write_op.cc:270] Start()
0201 02:56:01.798364 (+ 23us) write_op.cc:276] Timestamp: P: 1769914543241546 usec, L: 0
0201 02:56:01.798554 (+ 190us) write_op.cc:270] Start()
0201 02:56:01.798576 (+ 22us) write_op.cc:276] Timestamp: P: 1769914543246317 usec, L: 0
0201 02:56:01.798996 (+ 420us) write_op.cc:270] Start()
0201 02:56:01.799018 (+ 22us) write_op.cc:276] Timestamp: P: 1769914543269304 usec, L: 0
0201 02:56:01.799207 (+ 189us) write_op.cc:270] Start()
0201 02:56:01.799230 (+ 23us) write_op.cc:276] Timestamp: P: 1769914543282660 usec, L: 0
0201 02:56:01.799443 (+ 213us) write_op.cc:270] Start()
0201 02:56:01.799463 (+ 20us) write_op.cc:276] Timestamp: P: 1769914543297096 usec, L: 0
0201 02:56:01.799651 (+ 188us) write_op.cc:270] Start()
0201 02:56:01.799672 (+ 21us) write_op.cc:276] Timestamp: P: 1769914543320367 usec, L: 0
0201 02:56:01.800155 (+ 483us) write_op.cc:270] Start()
0201 02:56:01.800178 (+ 23us) write_op.cc:276] Timestamp: P: 1769914543321123 usec, L: 0
0201 02:56:01.800374 (+ 196us) write_op.cc:270] Start()
0201 02:56:01.800396 (+ 22us) write_op.cc:276] Timestamp: P: 1769914543333064 usec, L: 0
0201 02:56:01.800603 (+ 207us) write_op.cc:270] Start()
0201 02:56:01.800624 (+ 21us) write_op.cc:276] Timestamp: P: 1769914543356511 usec, L: 0
0201 02:56:01.823938 (+ 23314us) write_op.cc:270] Start()
0201 02:56:01.823970 (+ 32us) write_op.cc:276] Timestamp: P: 1769914543413586 usec, L: 0
0201 02:56:01.859058 (+ 35088us) write_op.cc:270] Start()
0201 02:56:01.859085 (+ 27us) write_op.cc:276] Timestamp: P: 1769914543414666 usec, L: 0
0201 02:56:01.865791 (+ 6706us) write_op.cc:270] Start()
0201 02:56:01.865820 (+ 29us) write_op.cc:276] Timestamp: P: 1769914543415497 usec, L: 0
0201 02:56:01.868995 (+ 3175us) write_op.cc:270] Start()
0201 02:56:01.869016 (+ 21us) write_op.cc:276] Timestamp: P: 1769914543416180 usec, L: 0
0201 02:56:01.869215 (+ 199us) write_op.cc:270] Start()
0201 02:56:01.869231 (+ 16us) write_op.cc:276] Timestamp: P: 1769914543460285 usec, L: 0
0201 02:56:01.881588 (+ 12357us) write_op.cc:270] Start()
0201 02:56:01.881629 (+ 41us) write_op.cc:276] Timestamp: P: 1769914543469416 usec, L: 0
0201 02:56:01.881846 (+ 217us) write_op.cc:270] Start()
0201 02:56:01.881864 (+ 18us) write_op.cc:276] Timestamp: P: 1769914543471587 usec, L: 0
0201 02:56:01.882008 (+ 144us) write_op.cc:270] Start()
0201 02:56:01.882026 (+ 18us) write_op.cc:276] Timestamp: P: 1769914543473352 usec, L: 0
0201 02:56:01.882178 (+ 152us) write_op.cc:270] Start()
0201 02:56:01.882195 (+ 17us) write_op.cc:276] Timestamp: P: 1769914543503988 usec, L: 0
0201 02:56:01.882314 (+ 119us) write_op.cc:270] Start()
0201 02:56:01.882349 (+ 35us) write_op.cc:276] Timestamp: P: 1769914543532221 usec, L: 0
0201 02:56:01.882470 (+ 121us) write_op.cc:270] Start()
0201 02:56:01.882486 (+ 16us) write_op.cc:276] Timestamp: P: 1769914543532922 usec, L: 0
0201 02:56:01.882773 (+ 287us) write_op.cc:270] Start()
0201 02:56:01.882795 (+ 22us) write_op.cc:276] Timestamp: P: 1769914543536011 usec, L: 0
0201 02:56:01.882945 (+ 150us) write_op.cc:270] Start()
0201 02:56:01.882962 (+ 17us) write_op.cc:276] Timestamp: P: 1769914543574191 usec, L: 0
0201 02:56:01.886335 (+ 3373us) write_op.cc:270] Start()
0201 02:56:01.886365 (+ 30us) write_op.cc:276] Timestamp: P: 1769914543578381 usec, L: 0
0201 02:56:01.886565 (+ 200us) write_op.cc:270] Start()
0201 02:56:01.886593 (+ 28us) write_op.cc:276] Timestamp: P: 1769914543605688 usec, L: 0
0201 02:56:01.886788 (+ 195us) write_op.cc:270] Start()
0201 02:56:01.886809 (+ 21us) write_op.cc:276] Timestamp: P: 1769914543608586 usec, L: 0
0201 02:56:01.897300 (+ 10491us) write_op.cc:270] Start()
0201 02:56:01.897341 (+ 41us) write_op.cc:276] Timestamp: P: 1769914543621011 usec, L: 0
0201 02:56:01.897519 (+ 178us) write_op.cc:270] Start()
0201 02:56:01.897539 (+ 20us) write_op.cc:276] Timestamp: P: 1769914543624447 usec, L: 0
0201 02:56:01.897716 (+ 177us) write_op.cc:270] Start()
0201 02:56:01.897736 (+ 20us) write_op.cc:276] Timestamp: P: 1769914543657178 usec, L: 0
0201 02:56:01.897879 (+ 143us) write_op.cc:270] Start()
0201 02:56:01.897906 (+ 27us) write_op.cc:276] Timestamp: P: 1769914543658807 usec, L: 0
0201 02:56:01.898058 (+ 152us) write_op.cc:270] Start()
0201 02:56:01.898077 (+ 19us) write_op.cc:276] Timestamp: P: 1769914543678954 usec, L: 0
0201 02:56:01.903114 (+ 5037us) write_op.cc:270] Start()
0201 02:56:01.903151 (+ 37us) write_op.cc:276] Timestamp: P: 1769914543689262 usec, L: 0
0201 02:56:01.903384 (+ 233us) write_op.cc:270] Start()
0201 02:56:01.903421 (+ 37us) write_op.cc:276] Timestamp: P: 1769914543718528 usec, L: 0
0201 02:56:01.903628 (+ 207us) write_op.cc:270] Start()
0201 02:56:01.903659 (+ 31us) write_op.cc:276] Timestamp: P: 1769914543736980 usec, L: 0
0201 02:56:01.903799 (+ 140us) write_op.cc:270] Start()
0201 02:56:01.903824 (+ 25us) write_op.cc:276] Timestamp: P: 1769914543739485 usec, L: 0
0201 02:56:01.910020 (+ 6196us) write_op.cc:270] Start()
0201 02:56:01.910055 (+ 35us) write_op.cc:276] Timestamp: P: 1769914543749751 usec, L: 0
0201 02:56:01.935986 (+ 25931us) write_op.cc:270] Start()
0201 02:56:01.936015 (+ 29us) write_op.cc:276] Timestamp: P: 1769914543776109 usec, L: 0
0201 02:56:01.936252 (+ 237us) write_op.cc:270] Start()
0201 02:56:01.936276 (+ 24us) write_op.cc:276] Timestamp: P: 1769914543811551 usec, L: 0
0201 02:56:01.936443 (+ 167us) write_op.cc:270] Start()
0201 02:56:01.936463 (+ 20us) write_op.cc:276] Timestamp: P: 1769914543822488 usec, L: 0
0201 02:56:01.936651 (+ 188us) write_op.cc:270] Start()
0201 02:56:01.936673 (+ 22us) write_op.cc:276] Timestamp: P: 1769914543825362 usec, L: 0
0201 02:56:01.936836 (+ 163us) write_op.cc:270] Start()
0201 02:56:01.936857 (+ 21us) write_op.cc:276] Timestamp: P: 1769914543829763 usec, L: 0
0201 02:56:01.937017 (+ 160us) write_op.cc:270] Start()
0201 02:56:01.937037 (+ 20us) write_op.cc:276] Timestamp: P: 1769914543867514 usec, L: 0
0201 02:56:01.937199 (+ 162us) write_op.cc:270] Start()
0201 02:56:01.937219 (+ 20us) write_op.cc:276] Timestamp: P: 1769914543869040 usec, L: 0
0201 02:56:01.937362 (+ 143us) write_op.cc:270] Start()
0201 02:56:01.937382 (+ 20us) write_op.cc:276] Timestamp: P: 1769914543870182 usec, L: 0
0201 02:56:01.938410 (+ 1028us) write_op.cc:270] Start()
0201 02:56:01.938436 (+ 26us) write_op.cc:276] Timestamp: P: 1769914543895242 usec, L: 0
0201 02:56:01.938677 (+ 241us) write_op.cc:270] Start()
0201 02:56:01.938701 (+ 24us) write_op.cc:276] Timestamp: P: 1769914543929222 usec, L: 0
0201 02:56:01.938886 (+ 185us) write_op.cc:270] Start()
0201 02:56:01.938906 (+ 20us) write_op.cc:276] Timestamp: P: 1769914543930904 usec, L: 0
0201 02:56:01.939098 (+ 192us) write_op.cc:270] Start()
0201 02:56:01.939120 (+ 22us) write_op.cc:276] Timestamp: P: 1769914543937602 usec, L: 0
0201 02:56:01.939341 (+ 221us) write_op.cc:270] Start()
0201 02:56:01.939363 (+ 22us) write_op.cc:276] Timestamp: P: 1769914543968814 usec, L: 0
0201 02:56:01.939564 (+ 201us) write_op.cc:270] Start()
0201 02:56:01.939597 (+ 33us) write_op.cc:276] Timestamp: P: 1769914543986435 usec, L: 0
0201 02:56:01.939774 (+ 177us) write_op.cc:270] Start()
0201 02:56:01.939816 (+ 42us) write_op.cc:276] Timestamp: P: 1769914544016302 usec, L: 0
0201 02:56:01.942220 (+ 2404us) write_op.cc:270] Start()
0201 02:56:01.942247 (+ 27us) write_op.cc:276] Timestamp: P: 1769914544019289 usec, L: 0
0201 02:56:01.943517 (+ 1270us) write_op.cc:270] Start()
0201 02:56:01.943543 (+ 26us) write_op.cc:276] Timestamp: P: 1769914544030848 usec, L: 0
0201 02:56:01.948699 (+ 5156us) write_op.cc:270] Start()
0201 02:56:01.948730 (+ 31us) write_op.cc:276] Timestamp: P: 1769914544057235 usec, L: 0
0201 02:56:01.955398 (+ 6668us) write_op.cc:270] Start()
0201 02:56:01.955431 (+ 33us) write_op.cc:276] Timestamp: P: 1769914544058091 usec, L: 0
0201 02:56:01.969025 (+ 13594us) write_op.cc:270] Start()
0201 02:56:01.969057 (+ 32us) write_op.cc:276] Timestamp: P: 1769914544090552 usec, L: 0
0201 02:56:01.980319 (+ 11262us) write_op.cc:270] Start()
0201 02:56:01.980357 (+ 38us) write_op.cc:276] Timestamp: P: 1769914544096333 usec, L: 0
0201 02:56:01.980617 (+ 260us) write_op.cc:270] Start()
0201 02:56:01.980644 (+ 27us) write_op.cc:276] Timestamp: P: 1769914544097002 usec, L: 0
0201 02:56:01.991392 (+ 10748us) write_op.cc:270] Start()
0201 02:56:01.991423 (+ 31us) write_op.cc:276] Timestamp: P: 1769914544112517 usec, L: 0
0201 02:56:01.998866 (+ 7443us) write_op.cc:270] Start()
0201 02:56:01.998899 (+ 33us) write_op.cc:276] Timestamp: P: 1769914544141988 usec, L: 0
0201 02:56:01.999153 (+ 254us) write_op.cc:270] Start()
0201 02:56:01.999178 (+ 25us) write_op.cc:276] Timestamp: P: 1769914544155380 usec, L: 0
0201 02:56:02.000592 (+ 1414us) write_op.cc:270] Start()
0201 02:56:02.000620 (+ 28us) write_op.cc:276] Timestamp: P: 1769914544155995 usec, L: 0
0201 02:56:02.000814 (+ 194us) write_op.cc:270] Start()
0201 02:56:02.000837 (+ 23us) write_op.cc:276] Timestamp: P: 1769914544157141 usec, L: 0
0201 02:56:02.001011 (+ 174us) write_op.cc:270] Start()
0201 02:56:02.001032 (+ 21us) write_op.cc:276] Timestamp: P: 1769914544184486 usec, L: 0
0201 02:56:02.001222 (+ 190us) write_op.cc:270] Start()
0201 02:56:02.001243 (+ 21us) write_op.cc:276] Timestamp: P: 1769914544214530 usec, L: 0
0201 02:56:02.001422 (+ 179us) write_op.cc:270] Start()
0201 02:56:02.001443 (+ 21us) write_op.cc:276] Timestamp: P: 1769914544215347 usec, L: 0
0201 02:56:02.001959 (+ 516us) write_op.cc:270] Start()
0201 02:56:02.001986 (+ 27us) write_op.cc:276] Timestamp: P: 1769914544225771 usec, L: 0
0201 02:56:02.002204 (+ 218us) write_op.cc:270] Start()
0201 02:56:02.002226 (+ 22us) write_op.cc:276] Timestamp: P: 1769914544242116 usec, L: 0
0201 02:56:02.002453 (+ 227us) write_op.cc:270] Start()
0201 02:56:02.002475 (+ 22us) write_op.cc:276] Timestamp: P: 1769914544276710 usec, L: 0
0201 02:56:02.002725 (+ 250us) write_op.cc:270] Start()
0201 02:56:02.002747 (+ 22us) write_op.cc:276] Timestamp: P: 1769914544277441 usec, L: 0
0201 02:56:02.002939 (+ 192us) write_op.cc:270] Start()
0201 02:56:02.002960 (+ 21us) write_op.cc:276] Timestamp: P: 1769914544294931 usec, L: 0
0201 02:56:02.003203 (+ 243us) write_op.cc:270] Start()
0201 02:56:02.003226 (+ 23us) write_op.cc:276] Timestamp: P: 1769914544299772 usec, L: 0
0201 02:56:02.003431 (+ 205us) write_op.cc:270] Start()
0201 02:56:02.003453 (+ 22us) write_op.cc:276] Timestamp: P: 1769914544327981 usec, L: 0
0201 02:56:02.003664 (+ 211us) write_op.cc:270] Start()
0201 02:56:02.003687 (+ 23us) write_op.cc:276] Timestamp: P: 1769914544371461 usec, L: 0
0201 02:56:02.003901 (+ 214us) write_op.cc:270] Start()
0201 02:56:02.003930 (+ 29us) write_op.cc:276] Timestamp: P: 1769914544373855 usec, L: 0
0201 02:56:02.004271 (+ 341us) write_op.cc:270] Start()
0201 02:56:02.004305 (+ 34us) write_op.cc:276] Timestamp: P: 1769914544378157 usec, L: 0
0201 02:56:02.004505 (+ 200us) write_op.cc:270] Start()
0201 02:56:02.004533 (+ 28us) write_op.cc:276] Timestamp: P: 1769914544380581 usec, L: 0
0201 02:56:02.004722 (+ 189us) write_op.cc:270] Start()
0201 02:56:02.004742 (+ 20us) write_op.cc:276] Timestamp: P: 1769914544436189 usec, L: 0
0201 02:56:02.004927 (+ 185us) write_op.cc:270] Start()
0201 02:56:02.004946 (+ 19us) write_op.cc:276] Timestamp: P: 1769914544445281 usec, L: 0
0201 02:56:02.005186 (+ 240us) write_op.cc:270] Start()
0201 02:56:02.005209 (+ 23us) write_op.cc:276] Timestamp: P: 1769914544447317 usec, L: 0
0201 02:56:02.005403 (+ 194us) write_op.cc:270] Start()
0201 02:56:02.005424 (+ 21us) write_op.cc:276] Timestamp: P: 1769914544448933 usec, L: 0
0201 02:56:02.020174 (+ 14750us) write_op.cc:270] Start()
0201 02:56:02.020209 (+ 35us) write_op.cc:276] Timestamp: P: 1769914544487504 usec, L: 0
0201 02:56:02.029808 (+ 9599us) write_op.cc:270] Start()
0201 02:56:02.029839 (+ 31us) write_op.cc:276] Timestamp: P: 1769914544510344 usec, L: 0
0201 02:56:02.030097 (+ 258us) write_op.cc:270] Start()
0201 02:56:02.030122 (+ 25us) write_op.cc:276] Timestamp: P: 1769914544522304 usec, L: 0
0201 02:56:02.031265 (+ 1143us) write_op.cc:270] Start()
0201 02:56:02.031293 (+ 28us) write_op.cc:276] Timestamp: P: 1769914544540276 usec, L: 0
0201 02:56:02.049339 (+ 18046us) write_op.cc:270] Start()
0201 02:56:02.049369 (+ 30us) write_op.cc:276] Timestamp: P: 1769914544543339 usec, L: 0
0201 02:56:02.060804 (+ 11435us) write_op.cc:270] Start()
0201 02:56:02.069356 (+ 8552us) write_op.cc:276] Timestamp: P: 1769914544567850 usec, L: 0
0201 02:56:02.083293 (+ 13937us) write_op.cc:270] Start()
0201 02:56:02.083326 (+ 33us) write_op.cc:276] Timestamp: P: 1769914544595526 usec, L: 0
0201 02:56:02.087660 (+ 4334us) write_op.cc:270] Start()
0201 02:56:02.087686 (+ 26us) write_op.cc:276] Timestamp: P: 1769914544597137 usec, L: 0
0201 02:56:02.104176 (+ 16490us) write_op.cc:270] Start()
0201 02:56:02.104225 (+ 49us) write_op.cc:276] Timestamp: P: 1769914544611937 usec, L: 0
0201 02:56:02.104493 (+ 268us) write_op.cc:270] Start()
0201 02:56:02.104517 (+ 24us) write_op.cc:276] Timestamp: P: 1769914544621418 usec, L: 0
0201 02:56:02.104673 (+ 156us) write_op.cc:270] Start()
0201 02:56:02.104696 (+ 23us) write_op.cc:276] Timestamp: P: 1769914544644089 usec, L: 0
0201 02:56:02.105934 (+ 1238us) write_op.cc:270] Start()
0201 02:56:02.105960 (+ 26us) write_op.cc:276] Timestamp: P: 1769914544653153 usec, L: 0
0201 02:56:02.115437 (+ 9477us) write_op.cc:270] Start()
0201 02:56:02.115465 (+ 28us) write_op.cc:276] Timestamp: P: 1769914544680200 usec, L: 0
0201 02:56:02.122847 (+ 7382us) write_op.cc:270] Start()
0201 02:56:02.122877 (+ 30us) write_op.cc:276] Timestamp: P: 1769914544689660 usec, L: 0
0201 02:56:02.123103 (+ 226us) write_op.cc:270] Start()
0201 02:56:02.123126 (+ 23us) write_op.cc:276] Timestamp: P: 1769914544720574 usec, L: 0
0201 02:56:02.124154 (+ 1028us) write_op.cc:270] Start()
0201 02:56:02.124179 (+ 25us) write_op.cc:276] Timestamp: P: 1769914544721527 usec, L: 0
0201 02:56:02.124384 (+ 205us) write_op.cc:270] Start()
0201 02:56:02.124406 (+ 22us) write_op.cc:276] Timestamp: P: 1769914544723886 usec, L: 0
0201 02:56:02.124547 (+ 141us) write_op.cc:270] Start()
0201 02:56:02.124566 (+ 19us) write_op.cc:276] Timestamp: P: 1769914544757591 usec, L: 0
0201 02:56:02.124717 (+ 151us) write_op.cc:270] Start()
0201 02:56:02.124737 (+ 20us) write_op.cc:276] Timestamp: P: 1769914544773256 usec, L: 0
0201 02:56:02.124888 (+ 151us) write_op.cc:270] Start()
0201 02:56:02.124906 (+ 18us) write_op.cc:276] Timestamp: P: 1769914544800204 usec, L: 0
0201 02:56:02.125067 (+ 161us) write_op.cc:270] Start()
0201 02:56:02.125086 (+ 19us) write_op.cc:276] Timestamp: P: 1769914544820914 usec, L: 0
0201 02:56:02.125230 (+ 144us) write_op.cc:270] Start()
0201 02:56:02.125279 (+ 49us) write_op.cc:276] Timestamp: P: 1769914544821682 usec, L: 0
0201 02:56:02.125447 (+ 168us) write_op.cc:270] Start()
0201 02:56:02.125468 (+ 21us) write_op.cc:276] Timestamp: P: 1769914544822304 usec, L: 0
0201 02:56:02.138616 (+ 13148us) write_op.cc:270] Start()
0201 02:56:02.138679 (+ 63us) write_op.cc:276] Timestamp: P: 1769914544841904 usec, L: 0
0201 02:56:02.138888 (+ 209us) write_op.cc:270] Start()
0201 02:56:02.138914 (+ 26us) write_op.cc:276] Timestamp: P: 1769914544877951 usec, L: 0
0201 02:56:02.147556 (+ 8642us) write_op.cc:270] Start()
0201 02:56:02.147586 (+ 30us) write_op.cc:276] Timestamp: P: 1769914544883387 usec, L: 0
0201 02:56:02.149896 (+ 2310us) write_op.cc:270] Start()
0201 02:56:02.149929 (+ 33us) write_op.cc:276] Timestamp: P: 1769914544904377 usec, L: 0
0201 02:56:02.167511 (+ 17582us) write_op.cc:270] Start()
0201 02:56:02.167542 (+ 31us) write_op.cc:276] Timestamp: P: 1769914544931439 usec, L: 0
0201 02:56:02.167757 (+ 215us) write_op.cc:270] Start()
0201 02:56:02.167776 (+ 19us) write_op.cc:276] Timestamp: P: 1769914544933117 usec, L: 0
0201 02:56:02.167904 (+ 128us) write_op.cc:270] Start()
0201 02:56:02.167921 (+ 17us) write_op.cc:276] Timestamp: P: 1769914544949970 usec, L: 0
0201 02:56:02.168055 (+ 134us) write_op.cc:270] Start()
0201 02:56:02.168073 (+ 18us) write_op.cc:276] Timestamp: P: 1769914544978321 usec, L: 0
0201 02:56:02.184888 (+ 16815us) write_op.cc:270] Start()
0201 02:56:02.184949 (+ 61us) write_op.cc:276] Timestamp: P: 1769914545011158 usec, L: 0
0201 02:56:02.185227 (+ 278us) write_op.cc:270] Start()
0201 02:56:02.185278 (+ 51us) write_op.cc:276] Timestamp: P: 1769914545011918 usec, L: 0
0201 02:56:02.185462 (+ 184us) write_op.cc:270] Start()
0201 02:56:02.185484 (+ 22us) write_op.cc:276] Timestamp: P: 1769914545029667 usec, L: 0
0201 02:56:02.185660 (+ 176us) write_op.cc:270] Start()
0201 02:56:02.185683 (+ 23us) write_op.cc:276] Timestamp: P: 1769914545041286 usec, L: 0
0201 02:56:02.185842 (+ 159us) write_op.cc:270] Start()
0201 02:56:02.185863 (+ 21us) write_op.cc:276] Timestamp: P: 176991
I20260201 02:56:07.331001 15075 raft_consensus.cc:493] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 943634a8539f44a8969b8503616b09d6)
I20260201 02:56:07.331231 15075 raft_consensus.cc:515] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:56:07.331938 15075 leader_election.cc:290] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 943634a8539f44a8969b8503616b09d6 (127.13.170.2:41045), 74bc17a87c2342958617c01904a29dac (127.13.170.3:45403)
I20260201 02:56:07.333004 14301 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1abdef8b45334d908fa08ec613374a3b" candidate_uuid: "20beda53b20146fb90018bf4533dcd58" candidate_term: 3 candidate_status { last_received { term: 2 index: 1256 } } ignore_live_leader: false dest_uuid: "943634a8539f44a8969b8503616b09d6" is_pre_election: true
I20260201 02:56:07.333963 14433 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1abdef8b45334d908fa08ec613374a3b" candidate_uuid: "20beda53b20146fb90018bf4533dcd58" candidate_term: 3 candidate_status { last_received { term: 2 index: 1256 } } ignore_live_leader: false dest_uuid: "74bc17a87c2342958617c01904a29dac" is_pre_election: true
I20260201 02:56:07.334503 14892 leader_election.cc:304] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20beda53b20146fb90018bf4533dcd58; no voters: 74bc17a87c2342958617c01904a29dac, 943634a8539f44a8969b8503616b09d6
I20260201 02:56:07.339620 15075 raft_consensus.cc:2749] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260201 02:56:06.934265 14959 rpcz_store.cc:276] 0201 02:56:05.392857 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 02:56:05.393117 (+ 260us) service_pool.cc:225] Handling call
0201 02:56:05.427533 (+ 34416us) raft_consensus.cc:1471] Updating replica for 310 ops
0201 02:56:05.464458 (+ 36925us) raft_consensus.cc:1534] Early marking committed up to index 0
0201 02:56:05.464465 (+ 7us) raft_consensus.cc:1539] Triggering prepare for 310 ops
0201 02:56:05.464627 (+ 162us) write_op.cc:270] Start()
0201 02:56:05.464667 (+ 40us) write_op.cc:276] Timestamp: P: 1769914558422791 usec, L: 0
0201 02:56:05.464914 (+ 247us) write_op.cc:270] Start()
0201 02:56:05.464946 (+ 32us) write_op.cc:276] Timestamp: P: 1769914558425072 usec, L: 0
0201 02:56:05.465163 (+ 217us) write_op.cc:270] Start()
0201 02:56:05.465287 (+ 124us) write_op.cc:276] Timestamp: P: 1769914558437780 usec, L: 0
0201 02:56:05.511477 (+ 46190us) write_op.cc:270] Start()
0201 02:56:05.511505 (+ 28us) write_op.cc:276] Timestamp: P: 1769914558438545 usec, L: 0
0201 02:56:05.512184 (+ 679us) write_op.cc:270] Start()
0201 02:56:05.512214 (+ 30us) write_op.cc:276] Timestamp: P: 1769914558522503 usec, L: 0
0201 02:56:05.512836 (+ 622us) write_op.cc:270] Start()
0201 02:56:05.512861 (+ 25us) write_op.cc:276] Timestamp: P: 1769914558526216 usec, L: 0
0201 02:56:05.513461 (+ 600us) write_op.cc:270] Start()
0201 02:56:05.513510 (+ 49us) write_op.cc:276] Timestamp: P: 1769914558586825 usec, L: 0
0201 02:56:05.514117 (+ 607us) write_op.cc:270] Start()
0201 02:56:05.514143 (+ 26us) write_op.cc:276] Timestamp: P: 1769914558597564 usec, L: 0
0201 02:56:05.514880 (+ 737us) write_op.cc:270] Start()
0201 02:56:05.514903 (+ 23us) write_op.cc:276] Timestamp: P: 1769914558604769 usec, L: 0
0201 02:56:05.515616 (+ 713us) write_op.cc:270] Start()
0201 02:56:05.515640 (+ 24us) write_op.cc:276] Timestamp: P: 1769914558611999 usec, L: 0
0201 02:56:05.516227 (+ 587us) write_op.cc:270] Start()
0201 02:56:05.516251 (+ 24us) write_op.cc:276] Timestamp: P: 1769914558692339 usec, L: 0
0201 02:56:05.516823 (+ 572us) write_op.cc:270] Start()
0201 02:56:05.516846 (+ 23us) write_op.cc:276] Timestamp: P: 1769914558713262 usec, L: 0
0201 02:56:05.517457 (+ 611us) write_op.cc:270] Start()
0201 02:56:05.517481 (+ 24us) write_op.cc:276] Timestamp: P: 1769914558725760 usec, L: 0
0201 02:56:05.518214 (+ 733us) write_op.cc:270] Start()
0201 02:56:05.518239 (+ 25us) write_op.cc:276] Timestamp: P: 1769914558765554 usec, L: 0
0201 02:56:05.518974 (+ 735us) write_op.cc:270] Start()
0201 02:56:05.518999 (+ 25us) write_op.cc:276] Timestamp: P: 1769914558787201 usec, L: 0
0201 02:56:05.519591 (+ 592us) write_op.cc:270] Start()
0201 02:56:05.519617 (+ 26us) write_op.cc:276] Timestamp: P: 1769914558801433 usec, L: 0
0201 02:56:05.530719 (+ 11102us) write_op.cc:270] Start()
0201 02:56:05.530760 (+ 41us) write_op.cc:276] Timestamp: P: 1769914558821651 usec, L: 0
0201 02:56:05.531532 (+ 772us) write_op.cc:270] Start()
0201 02:56:05.531582 (+ 50us) write_op.cc:276] Timestamp: P: 1769914558844956 usec, L: 0
0201 02:56:05.532293 (+ 711us) write_op.cc:270] Start()
0201 02:56:05.532321 (+ 28us) write_op.cc:276] Timestamp: P: 1769914558864000 usec, L: 0
0201 02:56:05.540613 (+ 8292us) write_op.cc:270] Start()
0201 02:56:05.540647 (+ 34us) write_op.cc:276] Timestamp: P: 1769914558866741 usec, L: 0
0201 02:56:05.540915 (+ 268us) write_op.cc:270] Start()
0201 02:56:05.540959 (+ 44us) write_op.cc:276] Timestamp: P: 1769914558882352 usec, L: 0
0201 02:56:05.541174 (+ 215us) write_op.cc:270] Start()
0201 02:56:05.541197 (+ 23us) write_op.cc:276] Timestamp: P: 1769914558907064 usec, L: 0
0201 02:56:05.566750 (+ 25553us) write_op.cc:270] Start()
0201 02:56:05.566784 (+ 34us) write_op.cc:276] Timestamp: P: 1769914558936489 usec, L: 0
0201 02:56:05.567035 (+ 251us) write_op.cc:270] Start()
0201 02:56:05.567060 (+ 25us) write_op.cc:276] Timestamp: P: 1769914558937970 usec, L: 0
0201 02:56:05.568144 (+ 1084us) write_op.cc:270] Start()
0201 02:56:05.568166 (+ 22us) write_op.cc:276] Timestamp: P: 1769914558947971 usec, L: 0
0201 02:56:05.568700 (+ 534us) write_op.cc:270] Start()
0201 02:56:05.568727 (+ 27us) write_op.cc:276] Timestamp: P: 1769914558988169 usec, L: 0
0201 02:56:05.569324 (+ 597us) write_op.cc:270] Start()
0201 02:56:05.569348 (+ 24us) write_op.cc:276] Timestamp: P: 1769914559006066 usec, L: 0
0201 02:56:05.569977 (+ 629us) write_op.cc:270] Start()
0201 02:56:05.570001 (+ 24us) write_op.cc:276] Timestamp: P: 1769914559017821 usec, L: 0
0201 02:56:05.577623 (+ 7622us) write_op.cc:270] Start()
0201 02:56:05.577649 (+ 26us) write_op.cc:276] Timestamp: P: 1769914559023718 usec, L: 0
0201 02:56:05.577863 (+ 214us) write_op.cc:270] Start()
0201 02:56:05.577888 (+ 25us) write_op.cc:276] Timestamp: P: 1769914559056849 usec, L: 0
0201 02:56:05.579709 (+ 1821us) write_op.cc:270] Start()
0201 02:56:05.579738 (+ 29us) write_op.cc:276] Timestamp: P: 1769914559109252 usec, L: 0
0201 02:56:05.580299 (+ 561us) write_op.cc:270] Start()
0201 02:56:05.580318 (+ 19us) write_op.cc:276] Timestamp: P: 1769914559109827 usec, L: 0
0201 02:56:05.580529 (+ 211us) write_op.cc:270] Start()
0201 02:56:05.580549 (+ 20us) write_op.cc:276] Timestamp: P: 1769914559110365 usec, L: 0
0201 02:56:05.580763 (+ 214us) write_op.cc:270] Start()
0201 02:56:05.580785 (+ 22us) write_op.cc:276] Timestamp: P: 1769914559141200 usec, L: 0
0201 02:56:05.580975 (+ 190us) write_op.cc:270] Start()
0201 02:56:05.580996 (+ 21us) write_op.cc:276] Timestamp: P: 1769914559173933 usec, L: 0
0201 02:56:05.581265 (+ 269us) write_op.cc:270] Start()
0201 02:56:05.581287 (+ 22us) write_op.cc:276] Timestamp: P: 1769914559196600 usec, L: 0
0201 02:56:05.581476 (+ 189us) write_op.cc:270] Start()
0201 02:56:05.581505 (+ 29us) write_op.cc:276] Timestamp: P: 1769914559211888 usec, L: 0
0201 02:56:05.581724 (+ 219us) write_op.cc:270] Start()
0201 02:56:05.581744 (+ 20us) write_op.cc:276] Timestamp: P: 1769914559239933 usec, L: 0
0201 02:56:05.581944 (+ 200us) write_op.cc:270] Start()
0201 02:56:05.581965 (+ 21us) write_op.cc:276] Timestamp: P: 1769914559275239 usec, L: 0
0201 02:56:05.582152 (+ 187us) write_op.cc:270] Start()
0201 02:56:05.582172 (+ 20us) write_op.cc:276] Timestamp: P: 1769914559285834 usec, L: 0
0201 02:56:05.582348 (+ 176us) write_op.cc:270] Start()
0201 02:56:05.582367 (+ 19us) write_op.cc:276] Timestamp: P: 1769914559334265 usec, L: 0
0201 02:56:05.582578 (+ 211us) write_op.cc:270] Start()
0201 02:56:05.582599 (+ 21us) write_op.cc:276] Timestamp: P: 1769914559343153 usec, L: 0
0201 02:56:05.582803 (+ 204us) write_op.cc:270] Start()
0201 02:56:05.582824 (+ 21us) write_op.cc:276] Timestamp: P: 1769914559369244 usec, L: 0
0201 02:56:05.583016 (+ 192us) write_op.cc:270] Start()
0201 02:56:05.583037 (+ 21us) write_op.cc:276] Timestamp: P: 1769914559377048 usec, L: 0
0201 02:56:05.583220 (+ 183us) write_op.cc:270] Start()
0201 02:56:05.583241 (+ 21us) write_op.cc:276] Timestamp: P: 1769914559427687 usec, L: 0
0201 02:56:05.623609 (+ 40368us) write_op.cc:270] Start()
0201 02:56:05.623649 (+ 40us) write_op.cc:276] Timestamp: P: 1769914559451293 usec, L: 0
0201 02:56:05.624504 (+ 855us) write_op.cc:270] Start()
0201 02:56:05.624530 (+ 26us) write_op.cc:276] Timestamp: P: 1769914559477448 usec, L: 0
0201 02:56:05.625420 (+ 890us) write_op.cc:270] Start()
0201 02:56:05.625454 (+ 34us) write_op.cc:276] Timestamp: P: 1769914559492664 usec, L: 0
0201 02:56:05.630824 (+ 5370us) write_op.cc:270] Start()
0201 02:56:05.630854 (+ 30us) write_op.cc:276] Timestamp: P: 1769914559504617 usec, L: 0
0201 02:56:05.631909 (+ 1055us) write_op.cc:270] Start()
0201 02:56:05.631945 (+ 36us) write_op.cc:276] Timestamp: P: 1769914559541276 usec, L: 0
0201 02:56:05.640945 (+ 9000us) write_op.cc:270] Start()
0201 02:56:05.640974 (+ 29us) write_op.cc:276] Timestamp: P: 1769914559542999 usec, L: 0
0201 02:56:05.641176 (+ 202us) write_op.cc:270] Start()
0201 02:56:05.641201 (+ 25us) write_op.cc:276] Timestamp: P: 1769914559564097 usec, L: 0
0201 02:56:05.642259 (+ 1058us) write_op.cc:270] Start()
0201 02:56:05.642285 (+ 26us) write_op.cc:276] Timestamp: P: 1769914559589993 usec, L: 0
0201 02:56:05.643041 (+ 756us) write_op.cc:270] Start()
0201 02:56:05.643065 (+ 24us) write_op.cc:276] Timestamp: P: 1769914559590724 usec, L: 0
0201 02:56:05.643617 (+ 552us) write_op.cc:270] Start()
0201 02:56:05.643642 (+ 25us) write_op.cc:276] Timestamp: P: 1769914559617082 usec, L: 0
0201 02:56:05.645855 (+ 2213us) write_op.cc:270] Start()
0201 02:56:05.645878 (+ 23us) write_op.cc:276] Timestamp: P: 1769914559621216 usec, L: 0
0201 02:56:05.646434 (+ 556us) write_op.cc:270] Start()
0201 02:56:05.646465 (+ 31us) write_op.cc:276] Timestamp: P: 1769914559645419 usec, L: 0
0201 02:56:05.646643 (+ 178us) write_op.cc:270] Start()
0201 02:56:05.646686 (+ 43us) write_op.cc:276] Timestamp: P: 1769914559660880 usec, L: 0
0201 02:56:05.647578 (+ 892us) write_op.cc:270] Start()
0201 02:56:05.647606 (+ 28us) write_op.cc:276] Timestamp: P: 1769914559691945 usec, L: 0
0201 02:56:05.648265 (+ 659us) write_op.cc:270] Start()
0201 02:56:05.648302 (+ 37us) write_op.cc:276] Timestamp: P: 1769914559694057 usec, L: 0
0201 02:56:05.648935 (+ 633us) write_op.cc:270] Start()
0201 02:56:05.648958 (+ 23us) write_op.cc:276] Timestamp: P: 1769914559759336 usec, L: 0
0201 02:56:05.649097 (+ 139us) write_op.cc:270] Start()
0201 02:56:05.649114 (+ 17us) write_op.cc:276] Timestamp: P: 1769914559769313 usec, L: 0
0201 02:56:05.650572 (+ 1458us) write_op.cc:270] Start()
0201 02:56:05.650595 (+ 23us) write_op.cc:276] Timestamp: P: 1769914559772918 usec, L: 0
0201 02:56:05.670232 (+ 19637us) write_op.cc:270] Start()
0201 02:56:05.670259 (+ 27us) write_op.cc:276] Timestamp: P: 1769914559783809 usec, L: 0
0201 02:56:05.685802 (+ 15543us) write_op.cc:270] Start()
0201 02:56:05.685832 (+ 30us) write_op.cc:276] Timestamp: P: 1769914559829473 usec, L: 0
0201 02:56:05.686239 (+ 407us) write_op.cc:270] Start()
0201 02:56:05.686262 (+ 23us) write_op.cc:276] Timestamp: P: 1769914559847656 usec, L: 0
0201 02:56:05.686408 (+ 146us) write_op.cc:270] Start()
0201 02:56:05.686426 (+ 18us) write_op.cc:276] Timestamp: P: 1769914559855635 usec, L: 0
0201 02:56:05.686585 (+ 159us) write_op.cc:270] Start()
0201 02:56:05.686606 (+ 21us) write_op.cc:276] Timestamp: P: 1769914559880322 usec, L: 0
0201 02:56:05.686931 (+ 325us) write_op.cc:270] Start()
0201 02:56:05.686951 (+ 20us) write_op.cc:276] Timestamp: P: 1769914559917963 usec, L: 0
0201 02:56:05.697922 (+ 10971us) write_op.cc:270] Start()
0201 02:56:05.697951 (+ 29us) write_op.cc:276] Timestamp: P: 1769914559940785 usec, L: 0
0201 02:56:05.706949 (+ 8998us) write_op.cc:270] Start()
0201 02:56:05.707007 (+ 58us) write_op.cc:276] Timestamp: P: 1769914559946157 usec, L: 0
0201 02:56:05.707698 (+ 691us) write_op.cc:270] Start()
0201 02:56:05.707732 (+ 34us) write_op.cc:276] Timestamp: P: 1769914559981719 usec, L: 0
0201 02:56:05.740554 (+ 32822us) write_op.cc:270] Start()
0201 02:56:05.740589 (+ 35us) write_op.cc:276] Timestamp: P: 1769914560015222 usec, L: 0
0201 02:56:05.747989 (+ 7400us) write_op.cc:270] Start()
0201 02:56:05.748021 (+ 32us) write_op.cc:276] Timestamp: P: 1769914560022377 usec, L: 0
0201 02:56:05.748215 (+ 194us) write_op.cc:270] Start()
0201 02:56:05.748238 (+ 23us) write_op.cc:276] Timestamp: P: 1769914560073892 usec, L: 0
0201 02:56:05.755300 (+ 7062us) write_op.cc:270] Start()
0201 02:56:05.755327 (+ 27us) write_op.cc:276] Timestamp: P: 1769914560081863 usec, L: 0
0201 02:56:05.768231 (+ 12904us) write_op.cc:270] Start()
0201 02:56:05.768259 (+ 28us) write_op.cc:276] Timestamp: P: 1769914560086219 usec, L: 0
0201 02:56:05.773430 (+ 5171us) write_op.cc:270] Start()
0201 02:56:05.773456 (+ 26us) write_op.cc:276] Timestamp: P: 1769914560119060 usec, L: 0
0201 02:56:05.779170 (+ 5714us) write_op.cc:270] Start()
0201 02:56:05.779201 (+ 31us) write_op.cc:276] Timestamp: P: 1769914560178440 usec, L: 0
0201 02:56:05.795443 (+ 16242us) write_op.cc:270] Start()
0201 02:56:05.795475 (+ 32us) write_op.cc:276] Timestamp: P: 1769914560185067 usec, L: 0
0201 02:56:05.795701 (+ 226us) write_op.cc:270] Start()
0201 02:56:05.795723 (+ 22us) write_op.cc:276] Timestamp: P: 1769914560203898 usec, L: 0
0201 02:56:05.813334 (+ 17611us) write_op.cc:270] Start()
0201 02:56:05.813361 (+ 27us) write_op.cc:276] Timestamp: P: 1769914560212944 usec, L: 0
0201 02:56:05.819938 (+ 6577us) write_op.cc:270] Start()
0201 02:56:05.819971 (+ 33us) write_op.cc:276] Timestamp: P: 1769914560236452 usec, L: 0
0201 02:56:05.858691 (+ 38720us) write_op.cc:270] Start()
0201 02:56:05.858727 (+ 36us) write_op.cc:276] Timestamp: P: 1769914560276632 usec, L: 0
0201 02:56:05.858959 (+ 232us) write_op.cc:270] Start()
0201 02:56:05.858985 (+ 26us) write_op.cc:276] Timestamp: P: 1769914560289348 usec, L: 0
0201 02:56:05.859159 (+ 174us) write_op.cc:270] Start()
0201 02:56:05.859181 (+ 22us) write_op.cc:276] Timestamp: P: 1769914560290027 usec, L: 0
0201 02:56:05.863054 (+ 3873us) write_op.cc:270] Start()
0201 02:56:05.863082 (+ 28us) write_op.cc:276] Timestamp: P: 1769914560293344 usec, L: 0
0201 02:56:05.863300 (+ 218us) write_op.cc:270] Start()
0201 02:56:05.863324 (+ 24us) write_op.cc:276] Timestamp: P: 1769914560349957 usec, L: 0
0201 02:56:05.863505 (+ 181us) write_op.cc:270] Start()
0201 02:56:05.863528 (+ 23us) write_op.cc:276] Timestamp: P: 1769914560359613 usec, L: 0
0201 02:56:05.863685 (+ 157us) write_op.cc:270] Start()
0201 02:56:05.863704 (+ 19us) write_op.cc:276] Timestamp: P: 1769914560361336 usec, L: 0
0201 02:56:05.863835 (+ 131us) write_op.cc:270] Start()
0201 02:56:05.863857 (+ 22us) write_op.cc:276] Timestamp: P: 1769914560411995 usec, L: 0
0201 02:56:05.864019 (+ 162us) write_op.cc:270] Start()
0201 02:56:05.864042 (+ 23us) write_op.cc:276] Timestamp: P: 1769914560412659 usec, L: 0
0201 02:56:05.864179 (+ 137us) write_op.cc:270] Start()
0201 02:56:05.864196 (+ 17us) write_op.cc:276] Timestamp: P: 1769914560425049 usec, L: 0
0201 02:56:05.864341 (+ 145us) write_op.cc:270] Start()
0201 02:56:05.864361 (+ 20us) write_op.cc:276] Timestamp: P: 1769914560425673 usec, L: 0
0201 02:56:05.864508 (+ 147us) write_op.cc:270] Start()
0201 02:56:05.864530 (+ 22us) write_op.cc:276] Timestamp: P: 1769914560496940 usec, L: 0
0201 02:56:05.864681 (+ 151us) write_op.cc:270] Start()
0201 02:56:05.864703 (+ 22us) write_op.cc:276] Timestamp: P: 1769914560524616 usec, L: 0
0201 02:56:05.864872 (+ 169us) write_op.cc:270] Start()
0201 02:56:05.864892 (+ 20us) write_op.cc:276] Timestamp: P: 1769914560537513 usec, L: 0
0201 02:56:05.865055 (+ 163us) write_op.cc:270] Start()
0201 02:56:05.865075 (+ 20us) write_op.cc:276] Timestamp: P: 1769914560550577 usec, L: 0
0201 02:56:05.865223 (+ 148us) write_op.cc:270] Start()
0201 02:56:05.865243 (+ 20us) write_op.cc:276] Timestamp: P: 1769914560551365 usec, L: 0
0201 02:56:05.881724 (+ 16481us) write_op.cc:270] Start()
0201 02:56:05.881755 (+ 31us) write_op.cc:276] Timestamp: P: 1769914560587905 usec, L: 0
0201 02:56:05.881983 (+ 228us) write_op.cc:270] Start()
0201 02:56:05.882007 (+ 24us) write_op.cc:276] Timestamp: P: 1769914560592864 usec, L: 0
0201 02:56:05.882241 (+ 234us) write_op.cc:270] Start()
0201 02:56:05.882263 (+ 22us) write_op.cc:276] Timestamp: P: 1769914560610752 usec, L: 0
0201 02:56:05.882458 (+ 195us) write_op.cc:270] Start()
0201 02:56:05.882478 (+ 20us) write_op.cc:276] Timestamp: P: 1769914560613165 usec, L: 0
0201 02:56:05.883296 (+ 818us) write_op.cc:270] Start()
0201 02:56:05.883323 (+ 27us) write_op.cc:276] Timestamp: P: 1769914560660209 usec, L: 0
0201 02:56:05.886636 (+ 3313us) write_op.cc:270] Start()
0201 02:56:05.886686 (+ 50us) write_op.cc:276] Timestamp: P: 1769914560666014 usec, L: 0
0201 02:56:05.903515 (+ 16829us) write_op.cc:270] Start()
0201 02:56:05.903544 (+ 29us) write_op.cc:276] Timestamp: P: 1769914560696577 usec, L: 0
0201 02:56:05.909770 (+ 6226us) write_op.cc:270] Start()
0201 02:56:05.909794 (+ 24us) write_op.cc:276] Timestamp: P: 1769914560698178 usec, L: 0
0201 02:56:05.912465 (+ 2671us) write_op.cc:270] Start()
0201 02:56:05.912495 (+ 30us) write_op.cc:276] Timestamp: P: 1769914560761713 usec, L: 0
0201 02:56:05.914946 (+ 2451us) write_op.cc:270] Start()
0201 02:56:05.914972 (+ 26us) write_op.cc:276] Timestamp: P: 1769914560781386 usec, L: 0
0201 02:56:05.915179 (+ 207us) write_op.cc:270] Start()
0201 02:56:05.915199 (+ 20us) write_op.cc:276] Timestamp: P: 1769914560787828 usec, L: 0
0201 02:56:05.950555 (+ 35356us) write_op.cc:270] Start()
0201 02:56:05.950577 (+ 22us) write_op.cc:276] Timestamp: P: 1769914560794364 usec, L: 0
0201 02:56:05.956264 (+ 5687us) write_op.cc:270] Start()
0201 02:56:05.956292 (+ 28us) write_op.cc:276] Timestamp: P: 1769914560888179 usec, L: 0
0201 02:56:05.957273 (+ 981us) write_op.cc:270] Start()
0201 02:56:05.957300 (+ 27us) write_op.cc:276] Timestamp: P: 1769914560889879 usec, L: 0
0201 02:56:05.957512 (+ 212us) write_op.cc:270] Start()
0201 02:56:05.957535 (+ 23us) write_op.cc:276] Timestamp: P: 1769914560941467 usec, L: 0
0201 02:56:05.957704 (+ 169us) write_op.cc:270] Start()
0201 02:56:05.957725 (+ 21us) write_op.cc:276] Timestamp: P: 1769914560944984 usec, L: 0
0201 02:56:05.957926 (+ 201us) write_op.cc:270] Start()
0201 02:56:05.957945 (+ 19us) write_op.cc:276] Timestamp: P: 1769914560995856 usec, L: 0
0201 02:56:05.958115 (+ 170us) write_op.cc:270] Start()
0201 02:56:05.958135 (+ 20us) write_op.cc:276] Timestamp: P: 1769914561000765 usec, L: 0
0201 02:56:05.958339 (+ 204us) write_op.cc:270] Start()
0201 02:56:05.958361 (+ 22us) write_op.cc:276] Timestamp: P: 1769914561031730 usec, L: 0
0201 02:56:05.958539 (+ 178us) write_op.cc:270] Start()
0201 02:56:05.958581 (+ 42us) write_op.cc:276] Timestamp: P: 1769914561051273 usec, L: 0
0201 02:56:05.958782 (+ 201us) write_op.cc:270] Start()
0201 02:56:05.958805 (+ 23us) write_op.cc:276] Timestamp: P: 1769914561054891 usec, L: 0
0201 02:56:05.958983 (+ 178us) write_op.cc:270] Start()
0201 02:56:05.959004 (+ 21us) write_op.cc:276] Timestamp: P: 1769914561080980 usec, L: 0
0201 02:56:05.959154 (+ 150us) write_op.cc:270] Start()
0201 02:56:05.959174 (+ 20us) write_op.cc:276] Timestamp: P: 1769914561089260 usec, L: 0
0201 02:56:05.959350 (+ 176us) write_op.cc:270] Start()
0201 02:56:05.959375 (+ 25us) write_op.cc:276] Timestamp: P: 1769914561104264 usec, L: 0
0201 02:56:05.959572 (+ 197us) write_op.cc:270] Start()
0201 02:56:05.959595 (+ 23us) write_op.cc:276] Timestamp: P: 1769914561132456 usec, L: 0
0201 02:56:05.959784 (+ 189us) write_op.cc:270] Start()
0201 02:56:05.959805 (+ 21us) write_op.cc:276] Timestamp: P: 1769914561149903 usec, L: 0
0201 02:56:05.959974 (+ 169us) write_op.cc:270] Start()
0201 02:56:05.959995 (+ 21us) write_op.cc:276] Timestamp: P: 1769914561161890 usec, L: 0
0201 02:56:05.960161 (+ 166us) write_op.cc:270] Start()
0201 02:56:05.960183 (+ 22us) write_op.cc:276] Timestamp: P: 1769914561207019 usec, L: 0
0201 02:56:05.961688 (+ 1505us) write_op.cc:270] Start()
0201 02:56:05.961714 (+ 26us) write_op.cc:276] Timestamp: P: 1769914561207766 usec, L: 0
0201 02:56:05.961911 (+ 197us) write_op.cc:270] Start()
0201 02:56:05.961931 (+ 20us) write_op.cc:276] Timestamp: P: 1769914561226683 usec, L: 0
0201 02:56:05.962136 (+ 205us) write_op.cc:270] Start()
0201 02:56:05.962155 (+ 19us) write_op.cc:276] Timestamp: P: 1769914561233426 usec, L: 0
0201 02:56:05.962320 (+ 165us) write_op.cc:270] Start()
0201 02:56:05.962353 (+ 33us) write_op.cc:276] Timestamp: P: 1769914561252816 usec, L: 0
0201 02:56:05.962533 (+ 180us) write_op.cc:270] Start()
0201 02:56:05.962553 (+ 20us) write_op.cc:276] Timestamp: P: 1769914561283915 usec, L: 0
0201 02:56:05.962958 (+ 405us) write_op.cc:270] Start()
0201 02:56:05.962980 (+ 22us) write_op.cc:276] Timestamp: P: 1769914561299043 usec, L: 0
0201 02:56:05.963176 (+ 196us) write_op.cc:270] Start()
0201 02:56:05.963194 (+ 18us) write_op.cc:276] Timestamp: P: 1769914561301247 usec, L: 0
0201 02:56:05.963373 (+ 179us) write_op.cc:270] Start()
0201 02:56:05.963391 (+ 18us) write_op.cc:276] Timestamp: P: 1769914561310431 usec, L: 0
0201 02:56:05.963536 (+ 145us) write_op.cc:270] Start()
0201 02:56:05.963553 (+ 17us) write_op.cc:276] Timestamp: P: 1769914561359382 usec, L: 0
0201 02:56:05.963689 (+ 136us) write_op.cc:270] Start()
0201 02:56:05.963705 (+ 16us) write_op.cc:276] Timestamp: P: 1769914561364863 usec, L: 0
0201 02:56:05.986391 (+ 22686us) write_op.cc:270] Start()
0201 02:56:05.986415 (+ 24us) write_op.cc:276] Timestamp: P: 1769914561392182 usec, L: 0
0201 02:56:06.001811 (+ 15396us) write_op.cc:270] Start()
0201 02:56:06.001843 (+ 32us) write_op.cc:276] Timestamp: P: 1769914561392824 usec, L: 0
0201 02:56:06.013002 (+ 11159us) write_op.cc:270] Start()
0201 02:56:06.013044 (+ 42us) write_op.cc:276] Timestamp: P: 1769914561410748 usec, L: 0
0201 02:56:06.013262 (+ 218us) write_op.cc:270] Start()
0201 02:56:06.013286 (+ 24us) write_op.cc:276] Timestamp: P: 1769914561427071 usec, L: 0
0201 02:56:06.013474 (+ 188us) write_op.cc:270] Start()
0201 02:56:06.013496 (+ 22us) write_op.cc:276] Timestamp: P: 1769914561525856 usec, L: 0
0201 02:56:06.013648 (+ 152us) write_op.cc:270] Start()
0201 02:56:06.013671 (+ 23us) write_op.cc:276] Timestamp: P: 1769914561526585 usec, L: 0
0201 02:56:06.013813 (+ 142us) write_op.cc:270] Start()
0201 02:56:06.013833 (+ 20us) write_op.cc:276] Timestamp: P: 1769914561534733 usec, L: 0
0201 02:56:06.013996 (+ 163us) write_op.cc:270] Start()
0201 02:56:06.014017 (+ 21us) write_op.cc:276] Timestamp: P: 1769914561589667 usec, L: 0
0201 02:56:06.014183 (+ 166us) write_op.cc:270] Start()
0201 02:56:06.014203 (+ 20us) write_op.cc:276] Timestamp: P: 1769914561595409 usec, L: 0
0201 02:56:06.014378 (+ 175us) write_op.cc:270] Start()
0201 02:56:06.014403 (+ 25us) write_op.cc:276] Timestamp: P: 1769914561606362 usec, L: 0
0201 02:56:06.014558 (+ 155us) write_op.cc:270] Start()
0201 02:56:06.014579 (+ 21us) write_op.cc:276] Timestamp: P: 1769914561610254 usec, L: 0
0201 02:56:06.014753 (+ 174us) write_op.cc:270] Start()
0201 02:56:06.014778 (+ 25us) write_op.cc:276] Timestamp: P: 1769914561659607 usec, L: 0
0201 02:56:06.014911 (+ 133us) write_op.cc:270] Start()
0201 02:56:06.014929 (+ 18us) write_op.cc:276] Timestamp: P: 1769914561703591 usec, L: 0
0201 02:56:06.015044 (+ 115us) write_op.cc:270] Start()
0201 02:56:06.015059 (+ 15us) write_op.cc:276] Timestamp: P: 1769914561716536 usec, L: 0
0201 02:56:06.015183 (+ 124us) write_op.cc:270] Start()
0201 02:56:06.015200 (+ 17us) write_op.cc:276] Timestamp: P: 1769914561724075 usec, L: 0
0201 02:56:06.015331 (+ 131us) write_op.cc:270] Start()
0201 02:56:06.015348 (+ 17us) write_op.cc:276] Timestamp: P: 1769914561753321 usec, L: 0
0201 02:56:06.015488 (+ 140us) write_op.cc:270] Start()
0201 02:56:06.015505 (+ 17us) write_op.cc:276] Timestamp: P: 1769914561776914 usec, L: 0
0201 02:56:06.047832 (+ 32327us) write_op.cc:270] Start()
0201 02:56:06.047859 (+ 27us) write_op.cc:276] Timestamp: P: 1769914561794001 usec, L: 0
0201 02:56:06.048250 (+ 391us) write_op.cc:270] Start()
0201 02:56:06.048271 (+ 21us) write_op.cc:276] Timestamp: P: 1769914561799520 usec, L: 0
0201 02:56:06.087990 (+ 39719us) write_op.cc:270] Start()
0201 02:56:06.088027 (+ 37us) write_op.cc:276] Timestamp: P: 1769914561825077 usec, L: 0
0201 02:56:06.088297 (+ 270us) write_op.cc:270] Start()
0201 02:56:06.088323 (+ 26us) write_op.cc:276] Timestamp: P: 1769914561872975 usec, L: 0
0201 02:56:06.088475 (+ 152us) write_op.cc:270] Start()
0201 02:56:06.088492 (+ 17us) write_op.cc:276] Timestamp: P: 1769914561908927 usec, L: 0
0201 02:56:06.088607 (+ 115us) write_op.cc:270] Start()
0201 02:56:06.088623 (+ 16us) write_op.cc:276] Timestamp: P: 1769914561913955 usec, L: 0
0201 02:56:06.088732 (+ 109us) write_op.cc:270] Start()
0201 02:56:06.088747 (+ 15us) write_op.cc:276] Timestamp: P: 1769914561916612 usec, L: 0
0201 02:56:06.088874 (+ 127us) write_op.cc:270] Start()
0201 02:56:06.088891 (+ 17us) write_op.cc:276] Timestamp: P: 1769914561954981 usec, L: 0
0201 02:56:06.139770 (+ 50879us) write_op.cc:270] Start()
0201 02:56:06.139794 (+ 24us) write_op.cc:276] Timestamp: P: 1769914562023737 usec, L: 0
0201 02:56:06.140332 (+ 538us) write_op.cc:270] Start()
0201 02:56:06.140352 (+ 20us) write_op.cc:276] Timestamp: P: 1769914562030992 usec, L: 0
0201 02:56:06.140587 (+ 235us) write_op.cc:270] Start()
0201 02:56:06.140610 (+ 23us) write_op.cc:276] Timestamp: P: 1769914562032486 usec, L: 0
0201 02:56:06.141903 (+ 1293us) write_op.cc:270] Start()
0201 02:56:06.141925 (+ 22us) write_op.cc:276] Timestamp: P: 1769914562039051 usec, L: 0
0201 02:56:06.142460 (+ 535us) write_op.cc:270] Start()
0201 02:56:06.142481 (+ 21us) write_op.cc:276] Timestamp: P: 1769914562067505 usec, L: 0
0201 02:56:06.142971 (+ 490us) write_op.cc:270] Start()
0201 02:56:06.142993 (+ 22us) write_op.cc:276] Timestamp: P: 1769914562081416 usec, L: 0
0201 02:56:06.151281 (+ 8288us) write_op.cc:270] Start()
0201 02:56:06.151310 (+ 29us) write_op.cc:276] Timestamp: P: 1769914562105673 usec, L: 0
0201 02:56:06.151558 (+ 248us) write_op.cc:270] Start()
0201 02:56:06.151581 (+ 23us) write_op.cc:276] Timestamp: P: 1769914562116656 usec, L: 0
0201 02:56:06.156652 (+ 5071us) write_op.cc:270] Start()
0201 02:56:06.156673 (+ 21us) write_op.cc:276] Timestamp: P: 1769914562164828 usec, L: 0
0201 02:56:06.156922 (+ 249us) write_op.cc:270] Start()
0201 02:56:06.156945 (+ 23us) write_op.cc:276] Timestamp: P: 1769914562175273 usec, L: 0
0201 02:56:06.157361 (+ 416us) write_op.cc:270] Start()
0201 02:56:06.157385 (+ 24us) write_op.cc:276] Timestamp: P: 1769914562187656 usec, L: 0
0201 02:56:06.157800 (+ 415us) write_op.cc:270] Start()
0201 02:56:06.157820 (+ 20us) write_op.cc:276] Timestamp: P: 1769914562218442 usec, L: 0
0201 02:56:06.160883 (+ 3063us) write_op.cc:270] Start()
0201 02:56:06.160903 (+ 20us) write_op.cc:276] Timestamp: P: 1769914562246244 usec, L: 0
0201 02:56:06.161114 (+ 211us) write_op.cc:270] Start()
0201 02:56:06.161134 (+ 20us) write_op.cc:276] Timestamp: P: 1769914562251439 usec, L: 0
0201 02:56:06.161330 (+ 196us) write_op.cc:270] Start()
0201 02:56:06.161349 (+ 19us) write_op.cc:276] Timestamp: P: 1769914562281391 usec, L: 0
0201 02:56:06.162125 (+ 776us) write_op.cc:270] Start()
0201 02:56:06.162145 (+ 20us) write_op.cc:276] Timestamp: P: 1769914562313779 usec, L: 0
0201 02:56:06.163087 (+ 942us) write_op.cc:270] Start()
0201 02:56:06.163108 (+ 21us) write_op.cc:276] Timestamp: P: 1769914562357448 usec, L: 0
0201 02:56:06.163297 (+ 189us) write_op.cc:270] Start()
0201 02:56:06.163317 (+ 20us) write_op.cc:276] Timestamp: P: 1769914562358976 usec, L: 0
0201 02:56:06.164181 (+ 864us) write_op.cc:270] Start()
0201 02:56:06.164203 (+ 22us) write_op.cc:276] Timestamp: P: 1769914562381099 usec, L: 0
0201 02:56:06.164406 (+ 203us) write_op.cc:270] Start()
0201 02:56:06.164426 (+ 20us) write_op.cc:276] Timestamp: P: 1769914562395104 usec, L: 0
0201 02:56:06.173131 (+ 8705us) write_op.cc:270] Start()
0201 02:56:06.173162 (+ 31us) write_op.cc:276] Timestamp: P: 1769914562422696 usec, L: 0
0201 02:56:06.173549 (+ 387us) write_op.cc:270] Start()
0201 02:56:06.173577 (+ 28us) write_op.cc:276] Timestamp: P: 1769914562456109 usec, L: 0
0201 02:56:06.173753 (+ 176us) write_op.cc:270] Start()
0201 02:56:06.173782 (+ 29us) write_op.cc:276] Timestamp: P: 1769914562469695 usec, L: 0
0201 02:56:06.186467 (+ 12685us) write_op.cc:270] Start()
0201 02:56:06.186491 (+ 24us) write_op.cc:276] Timestamp: P: 1769914562507721 usec, L: 0
0201 02:56:06.186698 (+ 207us) write_op.cc:270] Start()
0201 02:56:06.186719 (+ 21us) write_op.cc:276] Timestamp: P: 1769914562517309 usec, L: 0
0201 02:56:06.203793 (+ 17074us) write_op.cc:270] Start()
0201 02:56:06.203816 (+ 23us) write_op.cc:276] Timestamp: P: 1769914562556819 usec, L: 0
0201 02:56:06.218453 (+ 14637us) write_op.cc:270] Start()
0201 02:56:06.218486 (+ 33us) write_op.cc:276] Timestamp: P: 1769914562604836 usec, L: 0
0201 02:56:06.224891 (+ 6405us) write_op.cc:270] Start()
0201 02:56:06.224923 (+ 32us) write_op.cc:276] Timestamp: P: 1769914562632543 usec, L: 0
0201 02:56:06.225179 (+ 256us) write_op.cc:270] Start()
0201 02:56:06.225206 (+ 27us) write_op.cc:276] Timestamp: P: 1769914562633456 usec, L: 0
0201 02:56:06.229936 (+ 4730us) write_op.cc:270] Start()
0201 02:56:06.229968 (+ 32us) write_op.cc:276] Timestamp: P: 1769914562662149 usec, L: 0
0201 02:56:06.249523 (+ 19555us) write_op.cc:270] Start()
0201 02:56:06.249553 (+ 30us) write_op.cc:276] Timestamp: P: 1769914562692654 usec, L: 0
0201 02:56:06.260972 (+ 11419us) write_op.cc:270] Start()
0201 02:56:06.261002 (+ 30us) write_op.cc:276] Timestamp: P: 1769914562719949 usec, L: 0
0201 02:56:06.265857 (+ 4855us) write_op.cc:270] Start()
0201 02:56:06.265901 (+ 44us) write_op.cc:276] Timestamp: P: 1769914562727732 usec, L: 0
0201 02:56:06.269902 (+ 4001us) write_op.cc:270] Start()
0201 02:56:06.269944 (+ 42us) write_op.cc:276] Timestamp: P: 1769914562756350 usec, L: 0
0201 02:56:06.274508 (+ 4564us) write_op.cc:270] Start()
0201 02:56:06.274533 (+ 25us) write_op.cc:276] Timestamp: P: 17699145
I20260201 02:56:07.826839 15075 raft_consensus.cc:493] T 535b6fc9826f436089318f329dad0f4d P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74bc17a87c2342958617c01904a29dac)
I20260201 02:56:07.827024 15075 raft_consensus.cc:515] T 535b6fc9826f436089318f329dad0f4d P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:56:07.879000 15075 leader_election.cc:290] T 535b6fc9826f436089318f329dad0f4d P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 943634a8539f44a8969b8503616b09d6 (127.13.170.2:41045), 74bc17a87c2342958617c01904a29dac (127.13.170.3:45403)
I20260201 02:56:07.955462 14300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "535b6fc9826f436089318f329dad0f4d" candidate_uuid: "20beda53b20146fb90018bf4533dcd58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1327 } } ignore_live_leader: false dest_uuid: "943634a8539f44a8969b8503616b09d6" is_pre_election: true
I20260201 02:56:08.001543 14430 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "535b6fc9826f436089318f329dad0f4d" candidate_uuid: "20beda53b20146fb90018bf4533dcd58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1327 } } ignore_live_leader: false dest_uuid: "74bc17a87c2342958617c01904a29dac" is_pre_election: true
I20260201 02:56:08.014947 15075 raft_consensus.cc:493] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 943634a8539f44a8969b8503616b09d6)
I20260201 02:56:08.015142 15075 raft_consensus.cc:515] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:56:08.015919 15075 leader_election.cc:290] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 943634a8539f44a8969b8503616b09d6 (127.13.170.2:41045), 74bc17a87c2342958617c01904a29dac (127.13.170.3:45403)
I20260201 02:56:08.021742 14301 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1abdef8b45334d908fa08ec613374a3b" candidate_uuid: "20beda53b20146fb90018bf4533dcd58" candidate_term: 3 candidate_status { last_received { term: 2 index: 1343 } } ignore_live_leader: false dest_uuid: "943634a8539f44a8969b8503616b09d6" is_pre_election: true
I20260201 02:56:08.042616 14892 leader_election.cc:304] T 535b6fc9826f436089318f329dad0f4d P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20beda53b20146fb90018bf4533dcd58; no voters: 74bc17a87c2342958617c01904a29dac, 943634a8539f44a8969b8503616b09d6
I20260201 02:56:08.051206 14433 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1abdef8b45334d908fa08ec613374a3b" candidate_uuid: "20beda53b20146fb90018bf4533dcd58" candidate_term: 3 candidate_status { last_received { term: 2 index: 1343 } } ignore_live_leader: false dest_uuid: "74bc17a87c2342958617c01904a29dac" is_pre_election: true
I20260201 02:56:08.078583 14892 leader_election.cc:304] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20beda53b20146fb90018bf4533dcd58; no voters: 74bc17a87c2342958617c01904a29dac, 943634a8539f44a8969b8503616b09d6
I20260201 02:56:08.079000 14960 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.13.170.3:46631 (request call id 588) took 3041 ms. Trace:
I20260201 02:56:08.080421 15094 raft_consensus.cc:2749] T 1abdef8b45334d908fa08ec613374a3b P 20beda53b20146fb90018bf4533dcd58 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260201 02:56:08.080658 15062 raft_consensus.cc:493] T 7b2f386887ef4ab0a692195c4f968c12 P 20beda53b20146fb90018bf4533dcd58 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 74bc17a87c2342958617c01904a29dac)
I20260201 02:56:08.080776 15062 raft_consensus.cc:515] T 7b2f386887ef4ab0a692195c4f968c12 P 20beda53b20146fb90018bf4533dcd58 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } }
I20260201 02:56:08.081494 15062 leader_election.cc:290] T 7b2f386887ef4ab0a692195c4f968c12 P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 943634a8539f44a8969b8503616b09d6 (127.13.170.2:41045), 74bc17a87c2342958617c01904a29dac (127.13.170.3:45403)
I20260201 02:56:08.082382 14921 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:33648 (request call id 39) took 1868 ms. Trace:
I20260201 02:56:08.082496 14921 rpcz_store.cc:276] 0201 02:56:06.213824 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 02:56:06.213902 (+ 78us) service_pool.cc:225] Handling call
0201 02:56:06.215737 (+ 1835us) spinlock_profiling.cc:243] Waited 1.24 ms on lock 0x61600001a254. stack: 00007f9743ab1a86 00007f9743ab1840 00007f9742a8c3ad 0000000000984f94 0000000000984f5d 000000000098492a 00007f974f96e2c0 00007f975381eb2f 00007f974dc43c36 00007f974dc43965 00007f974aa7455e 00007f974aa7343e 00007f974aa79675 00007f974aa79f9f 00007f974aa79dc8 0000000000a8970c
0201 02:56:06.934642 (+718905us) spinlock_profiling.cc:243] Waited 718 ms on lock 0x616000019c54. stack: 00007f9743ab1a86 00007f9743ab1840 00007f9742a8c3ad 0000000000984f94 0000000000984f5d 000000000098492a 00007f974f96e2c0 00007f975381eb2f 00007f974dc43c36 00007f974dc43965 00007f974aa7455e 00007f974aa7343e 00007f974aa79675 00007f974aa79f9f 00007f974aa79dc8 0000000000a8970c
0201 02:56:08.082010 (+1147368us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x61600001a854. stack: 00007f9743ab1a86 00007f9743ab1840 00007f9742a8c3ad 0000000000984f94 0000000000984f5d 000000000098492a 00007f974f96e2c0 00007f975381eb2f 00007f974dc43c36 00007f974dc43965 00007f974aa7455e 00007f974aa7343e 00007f974aa79675 00007f974aa79f9f 00007f974aa79dc8 0000000000a8970c
0201 02:56:08.082362 (+ 352us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4292320512}
I20260201 02:56:08.087555 15075 raft_consensus.cc:2749] T 535b6fc9826f436089318f329dad0f4d P 20beda53b20146fb90018bf4533dcd58 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 02:56:08.146365 14302 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b2f386887ef4ab0a692195c4f968c12" candidate_uuid: "20beda53b20146fb90018bf4533dcd58" candidate_term: 3 candidate_status { last_received { term: 2 index: 1237 } } ignore_live_leader: false dest_uuid: "943634a8539f44a8969b8503616b09d6" is_pre_election: true
I20260201 02:56:08.244586 14430 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b2f386887ef4ab0a692195c4f968c12" candidate_uuid: "20beda53b20146fb90018bf4533dcd58" candidate_term: 3 candidate_status { last_received { term: 2 index: 1237 } } ignore_live_leader: false dest_uuid: "74bc17a87c2342958617c01904a29dac" is_pre_election: true
I20260201 02:56:08.265713 14892 leader_election.cc:304] T 7b2f386887ef4ab0a692195c4f968c12 P 20beda53b20146fb90018bf4533dcd58 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20beda53b20146fb90018bf4533dcd58; no voters: 74bc17a87c2342958617c01904a29dac, 943634a8539f44a8969b8503616b09d6
I20260201 02:56:08.266069 15075 raft_consensus.cc:2749] T 7b2f386887ef4ab0a692195c4f968c12 P 20beda53b20146fb90018bf4533dcd58 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260201 02:56:08.080374 14960 rpcz_store.cc:276] 0201 02:56:05.037810 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 02:56:05.041370 (+ 3560us) service_pool.cc:225] Handling call
0201 02:56:05.305568 (+264198us) raft_consensus.cc:1471] Updating replica for 1068 ops
0201 02:56:05.643723 (+338155us) raft_consensus.cc:1534] Early marking committed up to index 0
0201 02:56:05.643728 (+ 5us) raft_consensus.cc:1539] Triggering prepare for 1068 ops
0201 02:56:05.643851 (+ 123us) write_op.cc:270] Start()
0201 02:56:05.643871 (+ 20us) write_op.cc:276] Timestamp: P: 1769914542017167 usec, L: 0
0201 02:56:05.644075 (+ 204us) write_op.cc:270] Start()
0201 02:56:05.644096 (+ 21us) write_op.cc:276] Timestamp: P: 1769914542034159 usec, L: 0
0201 02:56:05.644271 (+ 175us) write_op.cc:270] Start()
0201 02:56:05.644296 (+ 25us) write_op.cc:276] Timestamp: P: 1769914542038520 usec, L: 0
0201 02:56:05.644464 (+ 168us) write_op.cc:270] Start()
0201 02:56:05.644485 (+ 21us) write_op.cc:276] Timestamp: P: 1769914542047902 usec, L: 0
0201 02:56:05.654759 (+ 10274us) write_op.cc:270] Start()
0201 02:56:05.654791 (+ 32us) write_op.cc:276] Timestamp: P: 1769914542063565 usec, L: 0
0201 02:56:05.655003 (+ 212us) write_op.cc:270] Start()
0201 02:56:05.655028 (+ 25us) write_op.cc:276] Timestamp: P: 1769914542091188 usec, L: 0
0201 02:56:05.655214 (+ 186us) write_op.cc:270] Start()
0201 02:56:05.655258 (+ 44us) write_op.cc:276] Timestamp: P: 1769914542094246 usec, L: 0
0201 02:56:05.655427 (+ 169us) write_op.cc:270] Start()
0201 02:56:05.655448 (+ 21us) write_op.cc:276] Timestamp: P: 1769914542124283 usec, L: 0
0201 02:56:05.655620 (+ 172us) write_op.cc:270] Start()
0201 02:56:05.655647 (+ 27us) write_op.cc:276] Timestamp: P: 1769914542126410 usec, L: 0
0201 02:56:05.655786 (+ 139us) write_op.cc:270] Start()
0201 02:56:05.655806 (+ 20us) write_op.cc:276] Timestamp: P: 1769914542139186 usec, L: 0
0201 02:56:05.655950 (+ 144us) write_op.cc:270] Start()
0201 02:56:05.655971 (+ 21us) write_op.cc:276] Timestamp: P: 1769914542156057 usec, L: 0
0201 02:56:05.656106 (+ 135us) write_op.cc:270] Start()
0201 02:56:05.656125 (+ 19us) write_op.cc:276] Timestamp: P: 1769914542175147 usec, L: 0
0201 02:56:05.656320 (+ 195us) write_op.cc:270] Start()
0201 02:56:05.656341 (+ 21us) write_op.cc:276] Timestamp: P: 1769914542193315 usec, L: 0
0201 02:56:05.656491 (+ 150us) write_op.cc:270] Start()
0201 02:56:05.656510 (+ 19us) write_op.cc:276] Timestamp: P: 1769914542204709 usec, L: 0
0201 02:56:05.656642 (+ 132us) write_op.cc:270] Start()
0201 02:56:05.656662 (+ 20us) write_op.cc:276] Timestamp: P: 1769914542244118 usec, L: 0
0201 02:56:05.656798 (+ 136us) write_op.cc:270] Start()
0201 02:56:05.656818 (+ 20us) write_op.cc:276] Timestamp: P: 1769914542244831 usec, L: 0
0201 02:56:05.656980 (+ 162us) write_op.cc:270] Start()
0201 02:56:05.657007 (+ 27us) write_op.cc:276] Timestamp: P: 1769914542247214 usec, L: 0
0201 02:56:05.657153 (+ 146us) write_op.cc:270] Start()
0201 02:56:05.657182 (+ 29us) write_op.cc:276] Timestamp: P: 1769914542265585 usec, L: 0
0201 02:56:05.657326 (+ 144us) write_op.cc:270] Start()
0201 02:56:05.657345 (+ 19us) write_op.cc:276] Timestamp: P: 1769914542287721 usec, L: 0
0201 02:56:05.657482 (+ 137us) write_op.cc:270] Start()
0201 02:56:05.657504 (+ 22us) write_op.cc:276] Timestamp: P: 1769914542288401 usec, L: 0
0201 02:56:05.657677 (+ 173us) write_op.cc:270] Start()
0201 02:56:05.657698 (+ 21us) write_op.cc:276] Timestamp: P: 1769914542308675 usec, L: 0
0201 02:56:05.657838 (+ 140us) write_op.cc:270] Start()
0201 02:56:05.657859 (+ 21us) write_op.cc:276] Timestamp: P: 1769914542312506 usec, L: 0
0201 02:56:05.658046 (+ 187us) write_op.cc:270] Start()
0201 02:56:05.658066 (+ 20us) write_op.cc:276] Timestamp: P: 1769914542346328 usec, L: 0
0201 02:56:05.675758 (+ 17692us) write_op.cc:270] Start()
0201 02:56:05.675786 (+ 28us) write_op.cc:276] Timestamp: P: 1769914542355433 usec, L: 0
0201 02:56:05.691460 (+ 15674us) write_op.cc:270] Start()
0201 02:56:05.691499 (+ 39us) write_op.cc:276] Timestamp: P: 1769914542373765 usec, L: 0
0201 02:56:05.886711 (+195212us) write_op.cc:270] Start()
0201 02:56:05.886739 (+ 28us) write_op.cc:276] Timestamp: P: 1769914542385417 usec, L: 0
0201 02:56:05.906062 (+ 19323us) write_op.cc:270] Start()
0201 02:56:05.906091 (+ 29us) write_op.cc:276] Timestamp: P: 1769914542420248 usec, L: 0
0201 02:56:05.913237 (+ 7146us) write_op.cc:270] Start()
0201 02:56:05.922356 (+ 9119us) write_op.cc:276] Timestamp: P: 1769914542422756 usec, L: 0
0201 02:56:05.922577 (+ 221us) write_op.cc:270] Start()
0201 02:56:05.922601 (+ 24us) write_op.cc:276] Timestamp: P: 1769914542428758 usec, L: 0
0201 02:56:05.926353 (+ 3752us) write_op.cc:270] Start()
0201 02:56:05.926382 (+ 29us) write_op.cc:276] Timestamp: P: 1769914542446208 usec, L: 0
0201 02:56:05.926561 (+ 179us) write_op.cc:270] Start()
0201 02:56:05.926581 (+ 20us) write_op.cc:276] Timestamp: P: 1769914542472375 usec, L: 0
0201 02:56:05.926758 (+ 177us) write_op.cc:270] Start()
0201 02:56:05.926784 (+ 26us) write_op.cc:276] Timestamp: P: 1769914542487442 usec, L: 0
0201 02:56:05.926967 (+ 183us) write_op.cc:270] Start()
0201 02:56:05.926988 (+ 21us) write_op.cc:276] Timestamp: P: 1769914542509615 usec, L: 0
0201 02:56:05.927129 (+ 141us) write_op.cc:270] Start()
0201 02:56:05.927160 (+ 31us) write_op.cc:276] Timestamp: P: 1769914542516144 usec, L: 0
0201 02:56:05.935666 (+ 8506us) write_op.cc:270] Start()
0201 02:56:05.935753 (+ 87us) write_op.cc:276] Timestamp: P: 1769914542529245 usec, L: 0
0201 02:56:05.935976 (+ 223us) write_op.cc:270] Start()
0201 02:56:05.936001 (+ 25us) write_op.cc:276] Timestamp: P: 1769914542537815 usec, L: 0
0201 02:56:05.936143 (+ 142us) write_op.cc:270] Start()
0201 02:56:05.936174 (+ 31us) write_op.cc:276] Timestamp: P: 1769914542558759 usec, L: 0
0201 02:56:05.936883 (+ 709us) write_op.cc:270] Start()
0201 02:56:05.936907 (+ 24us) write_op.cc:276] Timestamp: P: 1769914542579297 usec, L: 0
0201 02:56:05.937075 (+ 168us) write_op.cc:270] Start()
0201 02:56:05.937095 (+ 20us) write_op.cc:276] Timestamp: P: 1769914542603954 usec, L: 0
0201 02:56:05.937258 (+ 163us) write_op.cc:270] Start()
0201 02:56:05.937278 (+ 20us) write_op.cc:276] Timestamp: P: 1769914542604883 usec, L: 0
0201 02:56:05.937410 (+ 132us) write_op.cc:270] Start()
0201 02:56:05.937428 (+ 18us) write_op.cc:276] Timestamp: P: 1769914542605653 usec, L: 0
0201 02:56:05.937578 (+ 150us) write_op.cc:270] Start()
0201 02:56:05.937596 (+ 18us) write_op.cc:276] Timestamp: P: 1769914542648925 usec, L: 0
0201 02:56:05.937741 (+ 145us) write_op.cc:270] Start()
0201 02:56:05.937758 (+ 17us) write_op.cc:276] Timestamp: P: 1769914542653739 usec, L: 0
0201 02:56:05.937882 (+ 124us) write_op.cc:270] Start()
0201 02:56:05.937935 (+ 53us) write_op.cc:276] Timestamp: P: 1769914542661229 usec, L: 0
0201 02:56:05.938087 (+ 152us) write_op.cc:270] Start()
0201 02:56:05.938106 (+ 19us) write_op.cc:276] Timestamp: P: 1769914542661846 usec, L: 0
0201 02:56:05.938258 (+ 152us) write_op.cc:270] Start()
0201 02:56:05.938279 (+ 21us) write_op.cc:276] Timestamp: P: 1769914542687557 usec, L: 0
0201 02:56:05.938417 (+ 138us) write_op.cc:270] Start()
0201 02:56:05.938435 (+ 18us) write_op.cc:276] Timestamp: P: 1769914542708765 usec, L: 0
0201 02:56:05.949070 (+ 10635us) write_op.cc:270] Start()
0201 02:56:05.949098 (+ 28us) write_op.cc:276] Timestamp: P: 1769914542709876 usec, L: 0
0201 02:56:05.949311 (+ 213us) write_op.cc:270] Start()
0201 02:56:05.949332 (+ 21us) write_op.cc:276] Timestamp: P: 1769914542730883 usec, L: 0
0201 02:56:05.949484 (+ 152us) write_op.cc:270] Start()
0201 02:56:05.949503 (+ 19us) write_op.cc:276] Timestamp: P: 1769914542754504 usec, L: 0
0201 02:56:05.949665 (+ 162us) write_op.cc:270] Start()
0201 02:56:05.949685 (+ 20us) write_op.cc:276] Timestamp: P: 1769914542761695 usec, L: 0
0201 02:56:05.949827 (+ 142us) write_op.cc:270] Start()
0201 02:56:05.949847 (+ 20us) write_op.cc:276] Timestamp: P: 1769914542784820 usec, L: 0
0201 02:56:05.950004 (+ 157us) write_op.cc:270] Start()
0201 02:56:05.950025 (+ 21us) write_op.cc:276] Timestamp: P: 1769914542797689 usec, L: 0
0201 02:56:05.950176 (+ 151us) write_op.cc:270] Start()
0201 02:56:05.950196 (+ 20us) write_op.cc:276] Timestamp: P: 1769914542812833 usec, L: 0
0201 02:56:05.950326 (+ 130us) write_op.cc:270] Start()
0201 02:56:05.950346 (+ 20us) write_op.cc:276] Timestamp: P: 1769914542839160 usec, L: 0
0201 02:56:05.953610 (+ 3264us) write_op.cc:270] Start()
0201 02:56:05.953639 (+ 29us) write_op.cc:276] Timestamp: P: 1769914542841983 usec, L: 0
0201 02:56:05.953831 (+ 192us) write_op.cc:270] Start()
0201 02:56:05.953852 (+ 21us) write_op.cc:276] Timestamp: P: 1769914542860532 usec, L: 0
0201 02:56:05.954044 (+ 192us) write_op.cc:270] Start()
0201 02:56:05.954064 (+ 20us) write_op.cc:276] Timestamp: P: 1769914542864117 usec, L: 0
0201 02:56:05.954221 (+ 157us) write_op.cc:270] Start()
0201 02:56:05.954242 (+ 21us) write_op.cc:276] Timestamp: P: 1769914542906114 usec, L: 0
0201 02:56:05.954384 (+ 142us) write_op.cc:270] Start()
0201 02:56:05.954457 (+ 73us) write_op.cc:276] Timestamp: P: 1769914542909584 usec, L: 0
0201 02:56:05.954615 (+ 158us) write_op.cc:270] Start()
0201 02:56:05.954635 (+ 20us) write_op.cc:276] Timestamp: P: 1769914542910560 usec, L: 0
0201 02:56:05.960879 (+ 6244us) write_op.cc:270] Start()
0201 02:56:05.960906 (+ 27us) write_op.cc:276] Timestamp: P: 1769914542941940 usec, L: 0
0201 02:56:05.961105 (+ 199us) write_op.cc:270] Start()
0201 02:56:05.961129 (+ 24us) write_op.cc:276] Timestamp: P: 1769914542948089 usec, L: 0
0201 02:56:05.963988 (+ 2859us) write_op.cc:270] Start()
0201 02:56:05.964015 (+ 27us) write_op.cc:276] Timestamp: P: 1769914542984022 usec, L: 0
0201 02:56:05.972238 (+ 8223us) write_op.cc:270] Start()
0201 02:56:05.972273 (+ 35us) write_op.cc:276] Timestamp: P: 1769914542995451 usec, L: 0
0201 02:56:05.972504 (+ 231us) write_op.cc:270] Start()
0201 02:56:05.972526 (+ 22us) write_op.cc:276] Timestamp: P: 1769914543007876 usec, L: 0
0201 02:56:05.975521 (+ 2995us) write_op.cc:270] Start()
0201 02:56:05.975543 (+ 22us) write_op.cc:276] Timestamp: P: 1769914543008767 usec, L: 0
0201 02:56:05.976265 (+ 722us) write_op.cc:270] Start()
0201 02:56:05.976288 (+ 23us) write_op.cc:276] Timestamp: P: 1769914543045419 usec, L: 0
0201 02:56:05.976488 (+ 200us) write_op.cc:270] Start()
0201 02:56:05.976510 (+ 22us) write_op.cc:276] Timestamp: P: 1769914543050755 usec, L: 0
0201 02:56:05.976650 (+ 140us) write_op.cc:270] Start()
0201 02:56:05.976670 (+ 20us) write_op.cc:276] Timestamp: P: 1769914543053836 usec, L: 0
0201 02:56:05.976824 (+ 154us) write_op.cc:270] Start()
0201 02:56:05.976847 (+ 23us) write_op.cc:276] Timestamp: P: 1769914543078366 usec, L: 0
0201 02:56:05.977011 (+ 164us) write_op.cc:270] Start()
0201 02:56:05.977031 (+ 20us) write_op.cc:276] Timestamp: P: 1769914543097099 usec, L: 0
0201 02:56:05.977177 (+ 146us) write_op.cc:270] Start()
0201 02:56:05.977196 (+ 19us) write_op.cc:276] Timestamp: P: 1769914543111662 usec, L: 0
0201 02:56:05.977358 (+ 162us) write_op.cc:270] Start()
0201 02:56:05.977380 (+ 22us) write_op.cc:276] Timestamp: P: 1769914543115274 usec, L: 0
0201 02:56:05.977557 (+ 177us) write_op.cc:270] Start()
0201 02:56:05.977579 (+ 22us) write_op.cc:276] Timestamp: P: 1769914543141611 usec, L: 0
0201 02:56:05.977785 (+ 206us) write_op.cc:270] Start()
0201 02:56:05.977808 (+ 23us) write_op.cc:276] Timestamp: P: 1769914543161170 usec, L: 0
0201 02:56:05.978011 (+ 203us) write_op.cc:270] Start()
0201 02:56:05.978034 (+ 23us) write_op.cc:276] Timestamp: P: 1769914543170395 usec, L: 0
0201 02:56:05.978199 (+ 165us) write_op.cc:270] Start()
0201 02:56:05.978219 (+ 20us) write_op.cc:276] Timestamp: P: 1769914543180646 usec, L: 0
0201 02:56:05.978428 (+ 209us) write_op.cc:270] Start()
0201 02:56:05.978473 (+ 45us) write_op.cc:276] Timestamp: P: 1769914543196894 usec, L: 0
0201 02:56:05.986014 (+ 7541us) write_op.cc:270] Start()
0201 02:56:05.986047 (+ 33us) write_op.cc:276] Timestamp: P: 1769914543208752 usec, L: 0
0201 02:56:06.007983 (+ 21936us) write_op.cc:270] Start()
0201 02:56:06.008015 (+ 32us) write_op.cc:276] Timestamp: P: 1769914543233275 usec, L: 0
0201 02:56:06.008443 (+ 428us) write_op.cc:270] Start()
0201 02:56:06.008465 (+ 22us) write_op.cc:276] Timestamp: P: 1769914543243718 usec, L: 0
0201 02:56:06.008606 (+ 141us) write_op.cc:270] Start()
0201 02:56:06.008625 (+ 19us) write_op.cc:276] Timestamp: P: 1769914543246396 usec, L: 0
0201 02:56:06.008750 (+ 125us) write_op.cc:270] Start()
0201 02:56:06.008766 (+ 16us) write_op.cc:276] Timestamp: P: 1769914543267237 usec, L: 0
0201 02:56:06.008900 (+ 134us) write_op.cc:270] Start()
0201 02:56:06.008916 (+ 16us) write_op.cc:276] Timestamp: P: 1769914543283984 usec, L: 0
0201 02:56:06.009033 (+ 117us) write_op.cc:270] Start()
0201 02:56:06.009052 (+ 19us) write_op.cc:276] Timestamp: P: 1769914543298055 usec, L: 0
0201 02:56:06.009164 (+ 112us) write_op.cc:270] Start()
0201 02:56:06.009179 (+ 15us) write_op.cc:276] Timestamp: P: 1769914543318269 usec, L: 0
0201 02:56:06.009314 (+ 135us) write_op.cc:270] Start()
0201 02:56:06.009331 (+ 17us) write_op.cc:276] Timestamp: P: 1769914543329895 usec, L: 0
0201 02:56:06.009456 (+ 125us) write_op.cc:270] Start()
0201 02:56:06.009472 (+ 16us) write_op.cc:276] Timestamp: P: 1769914543333041 usec, L: 0
0201 02:56:06.009589 (+ 117us) write_op.cc:270] Start()
0201 02:56:06.009605 (+ 16us) write_op.cc:276] Timestamp: P: 1769914543358702 usec, L: 0
0201 02:56:06.009744 (+ 139us) write_op.cc:270] Start()
0201 02:56:06.009762 (+ 18us) write_op.cc:276] Timestamp: P: 1769914543384410 usec, L: 0
0201 02:56:06.009900 (+ 138us) write_op.cc:270] Start()
0201 02:56:06.009917 (+ 17us) write_op.cc:276] Timestamp: P: 1769914543395182 usec, L: 0
0201 02:56:06.010029 (+ 112us) write_op.cc:270] Start()
0201 02:56:06.010046 (+ 17us) write_op.cc:276] Timestamp: P: 1769914543406114 usec, L: 0
0201 02:56:06.010173 (+ 127us) write_op.cc:270] Start()
0201 02:56:06.010190 (+ 17us) write_op.cc:276] Timestamp: P: 1769914543409581 usec, L: 0
0201 02:56:06.010322 (+ 132us) write_op.cc:270] Start()
0201 02:56:06.010341 (+ 19us) write_op.cc:276] Timestamp: P: 1769914543459477 usec, L: 0
0201 02:56:06.010733 (+ 392us) write_op.cc:270] Start()
0201 02:56:06.010767 (+ 34us) write_op.cc:276] Timestamp: P: 1769914543467646 usec, L: 0
0201 02:56:06.010990 (+ 223us) write_op.cc:270] Start()
0201 02:56:06.011017 (+ 27us) write_op.cc:276] Timestamp: P: 1769914543469468 usec, L: 0
0201 02:56:06.011144 (+ 127us) write_op.cc:270] Start()
0201 02:56:06.011161 (+ 17us) write_op.cc:276] Timestamp: P: 1769914543470818 usec, L: 0
0201 02:56:06.011297 (+ 136us) write_op.cc:270] Start()
0201 02:56:06.011313 (+ 16us) write_op.cc:276] Timestamp: P: 1769914543503663 usec, L: 0
0201 02:56:06.011446 (+ 133us) write_op.cc:270] Start()
0201 02:56:06.011462 (+ 16us) write_op.cc:276] Timestamp: P: 1769914543531491 usec, L: 0
0201 02:56:06.011596 (+ 134us) write_op.cc:270] Start()
0201 02:56:06.011619 (+ 23us) write_op.cc:276] Timestamp: P: 1769914543532476 usec, L: 0
0201 02:56:06.011786 (+ 167us) write_op.cc:270] Start()
0201 02:56:06.011806 (+ 20us) write_op.cc:276] Timestamp: P: 1769914543533892 usec, L: 0
0201 02:56:06.011935 (+ 129us) write_op.cc:270] Start()
0201 02:56:06.011953 (+ 18us) write_op.cc:276] Timestamp: P: 1769914543574494 usec, L: 0
0201 02:56:06.012080 (+ 127us) write_op.cc:270] Start()
0201 02:56:06.012097 (+ 17us) write_op.cc:276] Timestamp: P: 1769914543576432 usec, L: 0
0201 02:56:06.012219 (+ 122us) write_op.cc:270] Start()
0201 02:56:06.012235 (+ 16us) write_op.cc:276] Timestamp: P: 1769914543605637 usec, L: 0
0201 02:56:06.012361 (+ 126us) write_op.cc:270] Start()
0201 02:56:06.012377 (+ 16us) write_op.cc:276] Timestamp: P: 1769914543606944 usec, L: 0
0201 02:56:06.020812 (+ 8435us) write_op.cc:270] Start()
0201 02:56:06.020846 (+ 34us) write_op.cc:276] Timestamp: P: 1769914543620084 usec, L: 0
0201 02:56:06.021103 (+ 257us) write_op.cc:270] Start()
0201 02:56:06.021123 (+ 20us) write_op.cc:276] Timestamp: P: 1769914543622472 usec, L: 0
0201 02:56:06.047038 (+ 25915us) write_op.cc:270] Start()
0201 02:56:06.047070 (+ 32us) write_op.cc:276] Timestamp: P: 1769914543654538 usec, L: 0
0201 02:56:06.048048 (+ 978us) write_op.cc:270] Start()
0201 02:56:06.048068 (+ 20us) write_op.cc:276] Timestamp: P: 1769914543657084 usec, L: 0
0201 02:56:06.088511 (+ 40443us) write_op.cc:270] Start()
0201 02:56:06.088541 (+ 30us) write_op.cc:276] Timestamp: P: 1769914543681338 usec, L: 0
0201 02:56:06.088725 (+ 184us) write_op.cc:270] Start()
0201 02:56:06.088745 (+ 20us) write_op.cc:276] Timestamp: P: 1769914543684024 usec, L: 0
0201 02:56:06.088875 (+ 130us) write_op.cc:270] Start()
0201 02:56:06.088892 (+ 17us) write_op.cc:276] Timestamp: P: 1769914543709191 usec, L: 0
0201 02:56:06.089047 (+ 155us) write_op.cc:270] Start()
0201 02:56:06.089063 (+ 16us) write_op.cc:276] Timestamp: P: 1769914543736285 usec, L: 0
0201 02:56:06.089181 (+ 118us) write_op.cc:270] Start()
0201 02:56:06.089198 (+ 17us) write_op.cc:276] Timestamp: P: 1769914543738705 usec, L: 0
0201 02:56:06.089322 (+ 124us) write_op.cc:270] Start()
0201 02:56:06.089338 (+ 16us) write_op.cc:276] Timestamp: P: 1769914543751512 usec, L: 0
0201 02:56:06.089445 (+ 107us) write_op.cc:270] Start()
0201 02:56:06.089461 (+ 16us) write_op.cc:276] Timestamp: P: 1769914543775687 usec, L: 0
0201 02:56:06.089605 (+ 144us) write_op.cc:270] Start()
0201 02:56:06.089636 (+ 31us) write_op.cc:276] Timestamp: P: 1769914543803520 usec, L: 0
0201 02:56:06.089765 (+ 129us) write_op.cc:270] Start()
0201 02:56:06.089782 (+ 17us) write_op.cc:276] Timestamp: P: 1769914543804324 usec, L: 0
0201 02:56:06.089903 (+ 121us) write_op.cc:270] Start()
0201 02:56:06.089919 (+ 16us) write_op.cc:276] Timestamp: P: 1769914543808641 usec, L: 0
0201 02:56:06.090103 (+ 184us) write_op.cc:270] Start()
0201 02:56:06.090123 (+ 20us) write_op.cc:276] Timestamp: P: 1769914543826317 usec, L: 0
0201 02:56:06.090272 (+ 149us) write_op.cc:270] Start()
0201 02:56:06.090289 (+ 17us) write_op.cc:276] Timestamp: P: 1769914543868256 usec, L: 0
0201 02:56:06.090406 (+ 117us) write_op.cc:270] Start()
0201 02:56:06.090422 (+ 16us) write_op.cc:276] Timestamp: P: 1769914543871523 usec, L: 0
0201 02:56:06.090562 (+ 140us) write_op.cc:270] Start()
0201 02:56:06.090579 (+ 17us) write_op.cc:276] Timestamp: P: 1769914543872153 usec, L: 0
0201 02:56:06.090737 (+ 158us) write_op.cc:270] Start()
0201 02:56:06.090755 (+ 18us) write_op.cc:276] Timestamp: P: 1769914543885700 usec, L: 0
0201 02:56:06.090917 (+ 162us) write_op.cc:270] Start()
0201 02:56:06.090966 (+ 49us) write_op.cc:276] Timestamp: P: 1769914543924778 usec, L: 0
0201 02:56:06.091100 (+ 134us) write_op.cc:270] Start()
0201 02:56:06.091118 (+ 18us) write_op.cc:276] Timestamp: P: 1769914543931409 usec, L: 0
0201 02:56:06.091239 (+ 121us) write_op.cc:270] Start()
0201 02:56:06.091257 (+ 18us) write_op.cc:276] Timestamp: P: 1769914543938104 usec, L: 0
0201 02:56:06.091403 (+ 146us) write_op.cc:270] Start()
0201 02:56:06.091424 (+ 21us) write_op.cc:276] Timestamp: P: 1769914543966318 usec, L: 0
0201 02:56:06.091572 (+ 148us) write_op.cc:270] Start()
0201 02:56:06.091590 (+ 18us) write_op.cc:276] Timestamp: P: 1769914543984393 usec, L: 0
0201 02:56:06.091712 (+ 122us) write_op.cc:270] Start()
0201 02:56:06.091752 (+ 40us) write_op.cc:276] Timestamp: P: 1769914543994949 usec, L: 0
0201 02:56:06.091933 (+ 181us) write_op.cc:270] Start()
0201 02:56:06.091961 (+ 28us) write_op.cc:276] Timestamp: P: 1769914544017058 usec, L: 0
0201 02:56:06.092096 (+ 135us) write_op.cc:270] Start()
0201 02:56:06.092114 (+ 18us) write_op.cc:276] Timestamp: P: 1769914544026246 usec, L: 0
0201 02:56:06.092244 (+ 130us) write_op.cc:270] Start()
0201 02:56:06.092262 (+ 18us) write_op.cc:276] Timestamp: P: 1769914544053404 usec, L: 0
0201 02:56:06.092388 (+ 126us) write_op.cc:270] Start()
0201 02:56:06.092405 (+ 17us) write_op.cc:276] Timestamp: P: 1769914544057702 usec, L: 0
0201 02:56:06.092556 (+ 151us) write_op.cc:270] Start()
0201 02:56:06.092575 (+ 19us) write_op.cc:276] Timestamp: P: 1769914544090543 usec, L: 0
0201 02:56:06.092730 (+ 155us) write_op.cc:270] Start()
0201 02:56:06.092748 (+ 18us) write_op.cc:276] Timestamp: P: 1769914544091848 usec, L: 0
0201 02:56:06.092873 (+ 125us) write_op.cc:270] Start()
0201 02:56:06.092895 (+ 22us) write_op.cc:276] Timestamp: P: 1769914544095950 usec, L: 0
0201 02:56:06.093034 (+ 139us) write_op.cc:270] Start()
0201 02:56:06.093052 (+ 18us) write_op.cc:276] Timestamp: P: 1769914544096608 usec, L: 0
0201 02:56:06.093199 (+ 147us) write_op.cc:270] Start()
0201 02:56:06.093218 (+ 19us) write_op.cc:276] Timestamp: P: 1769914544143191 usec, L: 0
0201 02:56:06.093339 (+ 121us) write_op.cc:270] Start()
0201 02:56:06.093356 (+ 17us) write_op.cc:276] Timestamp: P: 1769914544144584 usec, L: 0
0201 02:56:06.093520 (+ 164us) write_op.cc:270] Start()
0201 02:56:06.093544 (+ 24us) write_op.cc:276] Timestamp: P: 1769914544145741 usec, L: 0
0201 02:56:06.093755 (+ 211us) write_op.cc:270] Start()
0201 02:56:06.093778 (+ 23us) write_op.cc:276] Timestamp: P: 1769914544158503 usec, L: 0
0201 02:56:06.094468 (+ 690us) write_op.cc:270] Start()
0201 02:56:06.094492 (+ 24us) write_op.cc:276] Timestamp: P: 1769914544177280 usec, L: 0
0201 02:56:06.128871 (+ 34379us) write_op.cc:270] Start()
0201 02:56:06.128901 (+ 30us) write_op.cc:276] Timestamp: P: 1769914544214295 usec, L: 0
0201 02:56:06.129168 (+ 267us) write_op.cc:270] Start()
0201 02:56:06.129190 (+ 22us) write_op.cc:276] Timestamp: P: 1769914544217045 usec, L: 0
0201 02:56:06.129392 (+ 202us) write_op.cc:270] Start()
0201 02:56:06.129413 (+ 21us) write_op.cc:276] Timestamp: P: 1769914544217923 usec, L: 0
0201 02:56:06.131300 (+ 1887us) write_op.cc:270] Start()
0201 02:56:06.131327 (+ 27us) write_op.cc:276] Timestamp: P: 1769914544242073 usec, L: 0
0201 02:56:06.131720 (+ 393us) write_op.cc:270] Start()
0201 02:56:06.131744 (+ 24us) write_op.cc:276] Timestamp: P: 1769914544277429 usec, L: 0
0201 02:56:06.131961 (+ 217us) write_op.cc:270] Start()
0201 02:56:06.131987 (+ 26us) write_op.cc:276] Timestamp: P: 1769914544279548 usec, L: 0
0201 02:56:06.132184 (+ 197us) write_op.cc:270] Start()
0201 02:56:06.132203 (+ 19us) write_op.cc:276] Timestamp: P: 1769914544287085 usec, L: 0
0201 02:56:06.132383 (+ 180us) write_op.cc:270] Start()
0201 02:56:06.132405 (+ 22us) write_op.cc:276] Timestamp: P: 1769914544294914 usec, L: 0
0201 02:56:06.135415 (+ 3010us) write_op.cc:270] Start()
0201 02:56:06.135438 (+ 23us) write_op.cc:276] Timestamp: P: 1769914544328929 usec, L: 0
0201 02:56:06.139105 (+ 3667us) write_op.cc:270] Start()
0201 02:56:06.139132 (+ 27us) write_op.cc:276] Timestamp: P: 1769914544348814 usec, L: 0
0201 02:56:06.139308 (+ 176us) write_op.cc:270] Start()
0201 02:56:06.139333 (+ 25us) write_op.cc:276] Timestamp: P: 1769914544374326 usec, L: 0
0201 02:56:06.140133 (+ 800us) write_op.cc:270] Start()
0201 02:56:06.140162 (+ 29us) write_op.cc:276] Timestamp: P: 1769914544376179 usec, L: 0
0201 02:56:06.141672 (+ 1510us) write_op.cc:270] Start()
0201 02:56:06.141694 (+ 22us) write_op.cc:276] Timestamp: P: 1769914544380007 usec, L: 0
0201 02:56:06.142236 (+ 542us) write_op.cc:270] Start()
0201 02:56:06.142261 (+ 25us) write_op.cc:276] Timestamp: P: 1769914544444436 usec, L: 0
0201 02:56:06.142705 (+ 444us) write_op.cc:270] Start()
0201 02:56:06.142727 (+ 22us) write_op.cc:276] Timestamp: P: 1769914544448045 usec, L: 0
0201 02:56:06.143200 (+ 473us) write_op.cc:270] Start()
0201 02:56:06.143222 (+ 22us) write_op.cc:276] Timestamp: P: 1769914544448785 usec, L: 0
0201 02:56:06.155471 (+ 12249us) write_op.cc:270] Start()
0201 02:56:06.155500 (+ 29us) write_op.cc:276] Timestamp: P: 1769914544449417 usec, L: 0
0201 02:56:06.155695 (+ 195us) write_op.cc:270] Start()
0201 02:56:06.155716 (+ 21us) write_op.cc:276] Timestamp: P: 1769914544488198 usec, L: 0
0201 02:56:06.156498 (+ 782us) write_op.cc:270] Start()
0201 02:56:06.156529 (+ 31us) write_op.cc:276] Timestamp: P: 1769914544509214 usec, L: 0
0201 02:56:06.157156 (+ 627us) write_op.cc:270] Start()
0201 02:56:06.157178 (+ 22us) write_op.cc:276] Timestamp: P: 1769914544521512 usec, L: 0
0201 02:56:06.157606 (+ 428us) write_op.cc:270] Start()
0201 02:56:06.157628 (+ 22us) write_op.cc:276] Timestamp: P: 1769914544540881 usec, L: 0
0201 02:56:06.158032 (+ 404us) write_op.cc:270] Start()
0201 02:56:06.158053 (+ 21us) write_op.cc:276] Timestamp: P: 1769914544544148 usec, L: 0
0201 02:56:06.160444 (+ 2391us) write_op.cc:270] Start()
0201 02:56:06.160512 (+ 68us) write_op.cc:276] Timestamp: P: 1769914544556341 usec, L: 0
0201 02:56:06.160724 (+ 212us) write_op.cc:270] Start()
0201 02:56:06.160745 (+ 21us) write_op.cc:276] Timestamp: P: 1769914544588185 usec, L: 0
0201 02:56:06.161809 (+ 1064us) write_op.cc:270] Start()
0201 02:56:06.161832 (+ 23us) write_op.cc:276] Timestamp: P: 1769914544590504 usec, L: 0
0201 02:56:06.162009 (+ 177us) write_op.cc:270] Start()
0201 02:56:06.162031 (+ 22us) write_op.cc:276] Timestamp: P: 1769914544591744 usec, L: 0
0201 02:56:06.162356 (+ 325us) write_op.cc:270] Start()
0201 02:56:06.162376 (+ 20us) write_op.cc:276] Timestamp: P: 1769914544622792 usec, L: 0
0201 02:56:06.162552 (+ 176us) write_op.cc:270] Start()
0201 02:56:06.162572 (+ 20us) write_op.cc:276] Timestamp: P: 1769914544650684 usec, L: 0
0201 02:56:06.162774 (+ 202us) write_op.cc:270] Start()
0201 02:56:06.162794 (+ 20us) write_op.cc:276] Timestamp: P: 1769914544654201 usec, L: 0
0201 02:56:06.164643 (+ 1849us) write_op.cc:270] Start()
0201 02:56:06.164665 (+ 22us) write_op.cc:276] Timestamp: P: 1769914544662175 usec, L: 0
0201 02:56:06.179021 (+ 14356us) write_op.cc:270] Start()
0201 02:56:06.179051 (+ 30us) write_op.cc:276] Timestamp: P: 1769914544688756 usec, L: 0
0201 02:56:06.179282 (+ 231us) write_op.cc:270] Start()
0201 02:56:06.179304 (+ 22us) write_op.cc:276] Timestamp: P: 1769914544718133 usec, L: 0
0201 02:56:06.179511 (+ 207us) write_op.cc:270] Start()
0201 02:56:06.179543 (+ 32us) write_op.cc:276] Timestamp: P: 1769914544722052 usec, L: 0
0201 02:56:06.179894 (+ 351us) write_op.cc:270] Start()
0201 02:56:06.179915 (+ 21us) write_op.cc:276] Timestamp: P: 1769914544725624 usec, L: 0
0201 02:56:06.180578 (+ 663us) write_op.cc:270] Start()
0201 02:56:06.180601 (+ 23us) write_op.cc:276] Timestamp: P: 1769914544756876 usec, L: 0
0201 02:56:06.180804 (+ 203us) write_op.cc:270] Start()
0201 02:56:06.180824 (+ 20us) write_op.cc:276] Timestamp: P: 1769914544771797 usec, L: 0
0201 02:56:06.192790 (+ 11966us) write_op.cc:270] Start()
0201 02:56:06.192817 (+ 27us) write_op.cc:276] Timestamp: P: 1769914544789186 usec, L: 0
0201 02:56:06.193290 (+ 473us) write_op.cc:270] Start()
0201 02:56:06.193313 (+ 23us) write_op.cc:276] Timestamp: P: 1769914544791908 usec, L: 0
0201 02:56:06.196869 (+ 3556us) write_op.cc:270] Start()
0201 02:56:06.196901 (+ 32us) write_op.cc:276] Timestamp: P: 1769914544821158 usec, L: 0
0201 02:56:06.197111 (+ 210us) write_op.cc:270] Start()
0201 02:56:06.197144 (+ 33us) write_op.cc:276] Timestamp: P: 1769914544821801 usec, L: 0
0201 02:56:06.197336 (+ 192us) write_op.cc:270] Start()
0201 02:56:06.197358 (+ 22us) write_op.cc:276] Timestamp: P: 1769914544840688 usec, L: 0
0201 02:56:06.197505 (+ 147us) write_op.cc:270] Start()
0201 02:56:06.197526 (+ 21us) write_op.cc:276] Timestamp: P: 1769914544873945 usec, L: 0
0201 02:56:06.197649 (+ 123us) write_op.cc:270] Start()
0201 02:56:06.197674 (+ 25us) write_op.cc:276] Timestamp: P: 1769914544882094 usec, L: 0
0201 02:56:06.197841 (+ 167us) write_op.cc:270] Start()
0201 02:56:06.197863 (+ 22us) write_op.cc:276] Timestamp: P: 1769914544903749 usec, L: 0
0201 02:56:06.198035 (+ 172us) write_op.cc:270] Start()
0201 02:56:06.198059 (+ 24us) write_op.cc:276] Timestamp: P: 1769914544926894 usec, L: 0
0201 02:56:06.198246 (+ 187us) write_op.cc:270] Start()
0201 02:56:06.198267 (+ 21us) write_op.cc:276] Timestamp: P: 1769914544934575 usec, L: 0
0201 02:56:06.198418 (+ 151us) write_op.cc:270] Start()
0201 02:56:06.198437 (+ 19us) write_op.cc:276] Timestamp: P: 1769914544950634 usec, L: 0
0201 02:56:06.198565 (+ 128us) write_op.cc:270] Start()
0201 02:56:06.198584 (+ 19us) write_op.cc:276] Timestamp: P: 1769914544985946 usec, L: 0
0201 02:56:06.198788 (+ 204us) write_op.cc:270] Start()
0201 02:56:06.198811 (+ 23us) write_op.cc:276] Timestamp: P: 1769914545030377 usec, L: 0
0201 02:56:06.200435 (+ 1624us) write_op.cc:270] Start()
0201 02:56:06.200463 (+ 28us) write_op.cc:276] Timestamp: P: 1769914545032497 usec, L: 0
0201 02:56:06.200648 (+ 185us) write_op.cc:270] Start()
0201 02:56:06.200670 (+ 22us) write_op.cc:276] Timestamp: P: 1769914545033185 usec, L: 0
0201 02:56:06.200822 (+ 152us) write_op.cc:270] Start()
0201 02:56:06.200844 (+ 22us) write_op.cc:276] Timestamp: P: 1769914545036230 usec, L: 0
0201 02:56:06.201003 (+ 159us) write_op.cc:270] Start()
0201 02:56:06.201024 (+ 21us) write_op.cc:276] Timestamp: P: 176991
W20260201 02:56:08.657303 15093 log.cc:927] Time spent T 7b2f386887ef4ab0a692195c4f968c12 P 20beda53b20146fb90018bf4533dcd58: Append to log took a long time: real 0.055s user 0.000s sys 0.000s
I20260201 02:56:09.462728 14806 ts_manager.cc:284] Unset tserver state for 20beda53b20146fb90018bf4533dcd58 from MAINTENANCE_MODE
I20260201 02:56:09.469429 14478 heartbeater.cc:507] Master 127.13.170.62:35377 requested a full tablet report, sending...
I20260201 02:56:09.472065 14348 heartbeater.cc:507] Master 127.13.170.62:35377 requested a full tablet report, sending...
I20260201 02:56:10.023077 14731 heartbeater.cc:507] Master 127.13.170.62:35377 requested a full tablet report, sending...
I20260201 02:56:10.098084 15022 heartbeater.cc:507] Master 127.13.170.62:35377 requested a full tablet report, sending...
I20260201 02:56:12.847611 14805 ts_manager.cc:295] Set tserver state for 20beda53b20146fb90018bf4533dcd58 to MAINTENANCE_MODE
I20260201 02:56:12.848413 13992 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-taskfoNO09/build/asan/bin/kudu pid 14874
I20260201 02:56:12.849864 15017 generic_service.cc:196] Checking for leaks (request via RPC)
I20260201 02:56:13.673305 13992 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskfoNO09/build/asan/bin/kudu with pid 14874
W20260201 02:56:13.790802 14238 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.13.170.1:36225 (error 108) [suppressed 21 similar messages]
W20260201 02:56:13.790846 14368 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.13.170.1:36225 (error 108) [suppressed 37 similar messages]
W20260201 02:56:13.845592 14238 consensus_peers.cc:597] T 7519edb327894747a21ff97e8a90f2f9 P 943634a8539f44a8969b8503616b09d6 -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260201 02:56:13.845815 14238 consensus_peers.cc:597] T 1abdef8b45334d908fa08ec613374a3b P 943634a8539f44a8969b8503616b09d6 -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260201 02:56:13.850612 14368 consensus_peers.cc:597] T af28911fb32b478b88b6779c6f0dc08f P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260201 02:56:13.850806 14368 consensus_peers.cc:597] T 9434d106c0374b5d928cc00f109846ce P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260201 02:56:13.850893 14368 consensus_peers.cc:597] T 535b6fc9826f436089318f329dad0f4d P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260201 02:56:13.850973 14368 consensus_peers.cc:597] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260201 02:56:14.259266 14368 consensus_peers.cc:597] T 535b6fc9826f436089318f329dad0f4d P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260201 02:56:14.287804 14368 consensus_peers.cc:597] T af28911fb32b478b88b6779c6f0dc08f P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260201 02:56:14.354796 14238 consensus_peers.cc:597] T 7519edb327894747a21ff97e8a90f2f9 P 943634a8539f44a8969b8503616b09d6 -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260201 02:56:14.354952 14238 consensus_peers.cc:597] T 1abdef8b45334d908fa08ec613374a3b P 943634a8539f44a8969b8503616b09d6 -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260201 02:56:14.370992 14368 consensus_peers.cc:597] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260201 02:56:14.392438 14368 consensus_peers.cc:597] T 9434d106c0374b5d928cc00f109846ce P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260201 02:56:14.764467 14238 consensus_peers.cc:597] T 1abdef8b45334d908fa08ec613374a3b P 943634a8539f44a8969b8503616b09d6 -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260201 02:56:14.785501 14368 consensus_peers.cc:597] T 535b6fc9826f436089318f329dad0f4d P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260201 02:56:14.796049 14368 consensus_peers.cc:597] T af28911fb32b478b88b6779c6f0dc08f P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260201 02:56:14.865253 15095 consensus_queue.cc:579] T 7519edb327894747a21ff97e8a90f2f9 P 943634a8539f44a8969b8503616b09d6 [LEADER]: Leader has been unable to successfully communicate with peer 20beda53b20146fb90018bf4533dcd58 for more than 2 seconds (2.015s)
W20260201 02:56:14.872658 14238 consensus_peers.cc:597] T 7519edb327894747a21ff97e8a90f2f9 P 943634a8539f44a8969b8503616b09d6 -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260201 02:56:14.885622 15136 consensus_queue.cc:579] T af28911fb32b478b88b6779c6f0dc08f P 74bc17a87c2342958617c01904a29dac [LEADER]: Leader has been unable to successfully communicate with peer 20beda53b20146fb90018bf4533dcd58 for more than 2 seconds (2.043s)
I20260201 02:56:14.899706 15136 consensus_queue.cc:579] T 535b6fc9826f436089318f329dad0f4d P 74bc17a87c2342958617c01904a29dac [LEADER]: Leader has been unable to successfully communicate with peer 20beda53b20146fb90018bf4533dcd58 for more than 2 seconds (2.013s)
I20260201 02:56:14.904863 15098 consensus_queue.cc:579] T 9434d106c0374b5d928cc00f109846ce P 74bc17a87c2342958617c01904a29dac [LEADER]: Leader has been unable to successfully communicate with peer 20beda53b20146fb90018bf4533dcd58 for more than 2 seconds (2.026s)
I20260201 02:56:14.917155 15135 consensus_queue.cc:579] T 1abdef8b45334d908fa08ec613374a3b P 943634a8539f44a8969b8503616b09d6 [LEADER]: Leader has been unable to successfully communicate with peer 20beda53b20146fb90018bf4533dcd58 for more than 2 seconds (2.063s)
W20260201 02:56:14.927543 14368 consensus_peers.cc:597] T 9434d106c0374b5d928cc00f109846ce P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260201 02:56:14.936123 15036 consensus_queue.cc:579] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac [LEADER]: Leader has been unable to successfully communicate with peer 20beda53b20146fb90018bf4533dcd58 for more than 2 seconds (2.057s)
W20260201 02:56:14.960673 14368 consensus_peers.cc:597] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260201 02:56:15.194994 14238 consensus_peers.cc:597] T 1abdef8b45334d908fa08ec613374a3b P 943634a8539f44a8969b8503616b09d6 -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260201 02:56:15.293872 14368 consensus_peers.cc:597] T af28911fb32b478b88b6779c6f0dc08f P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260201 02:56:15.321007 14368 consensus_peers.cc:597] T 535b6fc9826f436089318f329dad0f4d P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260201 02:56:15.390290 14238 consensus_peers.cc:597] T 7519edb327894747a21ff97e8a90f2f9 P 943634a8539f44a8969b8503616b09d6 -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260201 02:56:15.486176 14368 consensus_peers.cc:597] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260201 02:56:15.555104 14804 ts_manager.cc:284] Unset tserver state for 20beda53b20146fb90018bf4533dcd58 from MAINTENANCE_MODE
W20260201 02:56:15.556529 14368 consensus_peers.cc:597] T 9434d106c0374b5d928cc00f109846ce P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260201 02:56:15.725595 14238 consensus_peers.cc:597] T 1abdef8b45334d908fa08ec613374a3b P 943634a8539f44a8969b8503616b09d6 -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260201 02:56:15.806094 14368 consensus_peers.cc:597] T af28911fb32b478b88b6779c6f0dc08f P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260201 02:56:15.835547 14238 consensus_peers.cc:597] T 7519edb327894747a21ff97e8a90f2f9 P 943634a8539f44a8969b8503616b09d6 -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260201 02:56:15.914325 14368 consensus_peers.cc:597] T 535b6fc9826f436089318f329dad0f4d P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260201 02:56:15.930884 14348 heartbeater.cc:507] Master 127.13.170.62:35377 requested a full tablet report, sending...
I20260201 02:56:15.947716 14478 heartbeater.cc:507] Master 127.13.170.62:35377 requested a full tablet report, sending...
W20260201 02:56:15.988742 14368 consensus_peers.cc:597] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260201 02:56:16.012329 14302 consensus_queue.cc:237] T 1abdef8b45334d908fa08ec613374a3b P 943634a8539f44a8969b8503616b09d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1736, Committed index: 1736, Last appended: 2.1737, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 1738 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } } peers { permanent_uuid: "e5c7c83542c74b66b44ee29fdcc2a847" member_type: NON_VOTER last_known_addr { host: "127.13.170.4" port: 41583 } attrs { promote: true } }
I20260201 02:56:16.013761 14299 consensus_queue.cc:237] T 7519edb327894747a21ff97e8a90f2f9 P 943634a8539f44a8969b8503616b09d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1737, Committed index: 1737, Last appended: 1.1738, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 1739 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } } peers { permanent_uuid: "e5c7c83542c74b66b44ee29fdcc2a847" member_type: NON_VOTER last_known_addr { host: "127.13.170.4" port: 41583 } attrs { promote: true } }
I20260201 02:56:16.022004 14430 raft_consensus.cc:1275] T 7519edb327894747a21ff97e8a90f2f9 P 74bc17a87c2342958617c01904a29dac [term 1 FOLLOWER]: Refusing update from remote peer 943634a8539f44a8969b8503616b09d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1738. Preceding OpId from leader: term: 1 index: 1739. (index mismatch)
I20260201 02:56:16.023404 15095 consensus_queue.cc:1048] T 7519edb327894747a21ff97e8a90f2f9 P 943634a8539f44a8969b8503616b09d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1739, Last known committed idx: 1737, Time since last communication: 0.000s
I20260201 02:56:16.027026 14433 raft_consensus.cc:1275] T 1abdef8b45334d908fa08ec613374a3b P 74bc17a87c2342958617c01904a29dac [term 2 FOLLOWER]: Refusing update from remote peer 943634a8539f44a8969b8503616b09d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 1737. Preceding OpId from leader: term: 2 index: 1739. (index mismatch)
I20260201 02:56:16.027909 15095 consensus_queue.cc:1048] T 1abdef8b45334d908fa08ec613374a3b P 943634a8539f44a8969b8503616b09d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1738, Last known committed idx: 1736, Time since last communication: 0.000s
I20260201 02:56:16.029758 15135 raft_consensus.cc:2955] T 7519edb327894747a21ff97e8a90f2f9 P 943634a8539f44a8969b8503616b09d6 [term 1 LEADER]: Committing config change with OpId 1.1739: config changed from index -1 to 1739, NON_VOTER e5c7c83542c74b66b44ee29fdcc2a847 (127.13.170.4) added. New config: { opid_index: 1739 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } } peers { permanent_uuid: "e5c7c83542c74b66b44ee29fdcc2a847" member_type: NON_VOTER last_known_addr { host: "127.13.170.4" port: 41583 } attrs { promote: true } } }
W20260201 02:56:16.032608 14238 consensus_peers.cc:597] T 7519edb327894747a21ff97e8a90f2f9 P 943634a8539f44a8969b8503616b09d6 -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260201 02:56:16.032797 14238 consensus_peers.cc:597] T 1abdef8b45334d908fa08ec613374a3b P 943634a8539f44a8969b8503616b09d6 -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260201 02:56:16.035192 14431 consensus_queue.cc:237] T af28911fb32b478b88b6779c6f0dc08f P 74bc17a87c2342958617c01904a29dac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1736, Committed index: 1736, Last appended: 1.1738, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 1739 OBSOLETE_local: false peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "e5c7c83542c74b66b44ee29fdcc2a847" member_type: NON_VOTER last_known_addr { host: "127.13.170.4" port: 41583 } attrs { promote: true } }
I20260201 02:56:16.035321 14433 consensus_queue.cc:237] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1737, Committed index: 1737, Last appended: 2.1739, Last appended by leader: 169, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 1740 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } } peers { permanent_uuid: "e5c7c83542c74b66b44ee29fdcc2a847" member_type: NON_VOTER last_known_addr { host: "127.13.170.4" port: 41583 } attrs { promote: true } }
W20260201 02:56:16.038537 14236 consensus_peers.cc:597] T 7519edb327894747a21ff97e8a90f2f9 P 943634a8539f44a8969b8503616b09d6 -> Peer e5c7c83542c74b66b44ee29fdcc2a847 (127.13.170.4:41583): Couldn't send request to peer e5c7c83542c74b66b44ee29fdcc2a847. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7519edb327894747a21ff97e8a90f2f9. This is attempt 1: this message will repeat every 5th retry.
W20260201 02:56:16.039189 14236 consensus_peers.cc:597] T 1abdef8b45334d908fa08ec613374a3b P 943634a8539f44a8969b8503616b09d6 -> Peer e5c7c83542c74b66b44ee29fdcc2a847 (127.13.170.4:41583): Couldn't send request to peer e5c7c83542c74b66b44ee29fdcc2a847. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1abdef8b45334d908fa08ec613374a3b. This is attempt 1: this message will repeat every 5th retry.
I20260201 02:56:16.039587 14431 consensus_queue.cc:237] T 9434d106c0374b5d928cc00f109846ce P 74bc17a87c2342958617c01904a29dac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1737, Committed index: 1737, Last appended: 2.1739, Last appended by leader: 170, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 1740 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } } peers { permanent_uuid: "e5c7c83542c74b66b44ee29fdcc2a847" member_type: NON_VOTER last_known_addr { host: "127.13.170.4" port: 41583 } attrs { promote: true } }
I20260201 02:56:16.042112 14731 heartbeater.cc:507] Master 127.13.170.62:35377 requested a full tablet report, sending...
I20260201 02:56:16.042316 14431 consensus_queue.cc:237] T 535b6fc9826f436089318f329dad0f4d P 74bc17a87c2342958617c01904a29dac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1735, Committed index: 1735, Last appended: 1.1737, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 1738 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } } peers { permanent_uuid: "e5c7c83542c74b66b44ee29fdcc2a847" member_type: NON_VOTER last_known_addr { host: "127.13.170.4" port: 41583 } attrs { promote: true } }
I20260201 02:56:16.043741 14804 catalog_manager.cc:5654] T 7519edb327894747a21ff97e8a90f2f9 P 943634a8539f44a8969b8503616b09d6 reported cstate change: config changed from index -1 to 1739, NON_VOTER e5c7c83542c74b66b44ee29fdcc2a847 (127.13.170.4) added. New cstate: current_term: 1 leader_uuid: "943634a8539f44a8969b8503616b09d6" committed_config { opid_index: 1739 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5c7c83542c74b66b44ee29fdcc2a847" member_type: NON_VOTER last_known_addr { host: "127.13.170.4" port: 41583 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260201 02:56:16.045154 14303 raft_consensus.cc:1275] T 9434d106c0374b5d928cc00f109846ce P 943634a8539f44a8969b8503616b09d6 [term 2 FOLLOWER]: Refusing update from remote peer 74bc17a87c2342958617c01904a29dac: Log matching property violated. Preceding OpId in replica: term: 2 index: 1737. Preceding OpId from leader: term: 2 index: 1740. (index mismatch)
I20260201 02:56:16.045783 15074 consensus_queue.cc:1048] T 9434d106c0374b5d928cc00f109846ce P 74bc17a87c2342958617c01904a29dac [LEADER]: Connected to new peer: Peer: permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1740, Last known committed idx: 1737, Time since last communication: 0.000s
I20260201 02:56:16.045969 14300 raft_consensus.cc:1275] T 535b6fc9826f436089318f329dad0f4d P 943634a8539f44a8969b8503616b09d6 [term 1 FOLLOWER]: Refusing update from remote peer 74bc17a87c2342958617c01904a29dac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1735. Preceding OpId from leader: term: 1 index: 1738. (index mismatch)
I20260201 02:56:16.046722 14299 raft_consensus.cc:1275] T af28911fb32b478b88b6779c6f0dc08f P 943634a8539f44a8969b8503616b09d6 [term 1 FOLLOWER]: Refusing update from remote peer 74bc17a87c2342958617c01904a29dac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1736. Preceding OpId from leader: term: 1 index: 1739. (index mismatch)
I20260201 02:56:16.047276 15074 consensus_queue.cc:1048] T 535b6fc9826f436089318f329dad0f4d P 74bc17a87c2342958617c01904a29dac [LEADER]: Connected to new peer: Peer: permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1738, Last known committed idx: 1735, Time since last communication: 0.000s
I20260201 02:56:16.050981 14302 raft_consensus.cc:1275] T 7b2f386887ef4ab0a692195c4f968c12 P 943634a8539f44a8969b8503616b09d6 [term 2 FOLLOWER]: Refusing update from remote peer 74bc17a87c2342958617c01904a29dac: Log matching property violated. Preceding OpId in replica: term: 2 index: 1737. Preceding OpId from leader: term: 2 index: 1740. (index mismatch)
I20260201 02:56:16.056131 15095 raft_consensus.cc:2955] T 1abdef8b45334d908fa08ec613374a3b P 943634a8539f44a8969b8503616b09d6 [term 2 LEADER]: Committing config change with OpId 2.1738: config changed from index -1 to 1738, NON_VOTER e5c7c83542c74b66b44ee29fdcc2a847 (127.13.170.4) added. New config: { opid_index: 1738 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } } peers { permanent_uuid: "e5c7c83542c74b66b44ee29fdcc2a847" member_type: NON_VOTER last_known_addr { host: "127.13.170.4" port: 41583 } attrs { promote: true } } }
W20260201 02:56:16.058025 14366 consensus_peers.cc:597] T af28911fb32b478b88b6779c6f0dc08f P 74bc17a87c2342958617c01904a29dac -> Peer e5c7c83542c74b66b44ee29fdcc2a847 (127.13.170.4:41583): Couldn't send request to peer e5c7c83542c74b66b44ee29fdcc2a847. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: af28911fb32b478b88b6779c6f0dc08f. This is attempt 1: this message will repeat every 5th retry.
W20260201 02:56:16.058409 14366 consensus_peers.cc:597] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac -> Peer e5c7c83542c74b66b44ee29fdcc2a847 (127.13.170.4:41583): Couldn't send request to peer e5c7c83542c74b66b44ee29fdcc2a847. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7b2f386887ef4ab0a692195c4f968c12. This is attempt 1: this message will repeat every 5th retry.
I20260201 02:56:16.059765 14793 catalog_manager.cc:5167] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 7519edb327894747a21ff97e8a90f2f9 with cas_config_opid_index -1: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20260201 02:56:16.061141 14793 catalog_manager.cc:5167] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 1abdef8b45334d908fa08ec613374a3b with cas_config_opid_index -1: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
W20260201 02:56:16.061264 14366 consensus_peers.cc:597] T 535b6fc9826f436089318f329dad0f4d P 74bc17a87c2342958617c01904a29dac -> Peer e5c7c83542c74b66b44ee29fdcc2a847 (127.13.170.4:41583): Couldn't send request to peer e5c7c83542c74b66b44ee29fdcc2a847. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 535b6fc9826f436089318f329dad0f4d. This is attempt 1: this message will repeat every 5th retry.
W20260201 02:56:16.061472 14366 consensus_peers.cc:597] T 9434d106c0374b5d928cc00f109846ce P 74bc17a87c2342958617c01904a29dac -> Peer e5c7c83542c74b66b44ee29fdcc2a847 (127.13.170.4:41583): Couldn't send request to peer e5c7c83542c74b66b44ee29fdcc2a847. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9434d106c0374b5d928cc00f109846ce. This is attempt 1: this message will repeat every 5th retry.
I20260201 02:56:16.063810 15136 raft_consensus.cc:2955] T 9434d106c0374b5d928cc00f109846ce P 74bc17a87c2342958617c01904a29dac [term 2 LEADER]: Committing config change with OpId 2.1740: config changed from index -1 to 1740, NON_VOTER e5c7c83542c74b66b44ee29fdcc2a847 (127.13.170.4) added. New config: { opid_index: 1740 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } } peers { permanent_uuid: "e5c7c83542c74b66b44ee29fdcc2a847" member_type: NON_VOTER last_known_addr { host: "127.13.170.4" port: 41583 } attrs { promote: true } } }
I20260201 02:56:16.064529 15074 raft_consensus.cc:2955] T 535b6fc9826f436089318f329dad0f4d P 74bc17a87c2342958617c01904a29dac [term 1 LEADER]: Committing config change with OpId 1.1738: config changed from index -1 to 1738, NON_VOTER e5c7c83542c74b66b44ee29fdcc2a847 (127.13.170.4) added. New config: { opid_index: 1738 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } } peers { permanent_uuid: "e5c7c83542c74b66b44ee29fdcc2a847" member_type: NON_VOTER last_known_addr { host: "127.13.170.4" port: 41583 } attrs { promote: true } } }
I20260201 02:56:16.064857 14806 catalog_manager.cc:5654] T 1abdef8b45334d908fa08ec613374a3b P 943634a8539f44a8969b8503616b09d6 reported cstate change: config changed from index -1 to 1738, NON_VOTER e5c7c83542c74b66b44ee29fdcc2a847 (127.13.170.4) added. New cstate: current_term: 2 leader_uuid: "943634a8539f44a8969b8503616b09d6" committed_config { opid_index: 1738 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5c7c83542c74b66b44ee29fdcc2a847" member_type: NON_VOTER last_known_addr { host: "127.13.170.4" port: 41583 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260201 02:56:16.068737 14431 raft_consensus.cc:2955] T 1abdef8b45334d908fa08ec613374a3b P 74bc17a87c2342958617c01904a29dac [term 2 FOLLOWER]: Committing config change with OpId 2.1738: config changed from index -1 to 1738, NON_VOTER e5c7c83542c74b66b44ee29fdcc2a847 (127.13.170.4) added. New config: { opid_index: 1738 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } } peers { permanent_uuid: "e5c7c83542c74b66b44ee29fdcc2a847" member_type: NON_VOTER last_known_addr { host: "127.13.170.4" port: 41583 } attrs { promote: true } } }
I20260201 02:56:16.069850 15074 consensus_queue.cc:1048] T af28911fb32b478b88b6779c6f0dc08f P 74bc17a87c2342958617c01904a29dac [LEADER]: Connected to new peer: Peer: permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1739, Last known committed idx: 1736, Time since last communication: 0.000s
I20260201 02:56:16.070740 15074 consensus_queue.cc:1048] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac [LEADER]: Connected to new peer: Peer: permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1740, Last known committed idx: 1737, Time since last communication: 0.000s
W20260201 02:56:16.071120 14368 consensus_peers.cc:597] T af28911fb32b478b88b6779c6f0dc08f P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260201 02:56:16.071285 14368 consensus_peers.cc:597] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260201 02:56:16.071434 14368 consensus_peers.cc:597] T 535b6fc9826f436089318f329dad0f4d P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260201 02:56:16.071579 14368 consensus_peers.cc:597] T 9434d106c0374b5d928cc00f109846ce P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260201 02:56:16.072671 14804 catalog_manager.cc:5654] T 535b6fc9826f436089318f329dad0f4d P 74bc17a87c2342958617c01904a29dac reported cstate change: config changed from index -1 to 1738, NON_VOTER e5c7c83542c74b66b44ee29fdcc2a847 (127.13.170.4) added. New cstate: current_term: 1 leader_uuid: "74bc17a87c2342958617c01904a29dac" committed_config { opid_index: 1738 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5c7c83542c74b66b44ee29fdcc2a847" member_type: NON_VOTER last_known_addr { host: "127.13.170.4" port: 41583 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260201 02:56:16.075107 14302 raft_consensus.cc:2955] T 9434d106c0374b5d928cc00f109846ce P 943634a8539f44a8969b8503616b09d6 [term 2 FOLLOWER]: Committing config change with OpId 2.1740: config changed from index -1 to 1740, NON_VOTER e5c7c83542c74b66b44ee29fdcc2a847 (127.13.170.4) added. New config: { opid_index: 1740 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } } peers { permanent_uuid: "e5c7c83542c74b66b44ee29fdcc2a847" member_type: NON_VOTER last_known_addr { host: "127.13.170.4" port: 41583 } attrs { promote: true } } }
I20260201 02:56:16.063369 14430 raft_consensus.cc:2955] T 7519edb327894747a21ff97e8a90f2f9 P 74bc17a87c2342958617c01904a29dac [term 1 FOLLOWER]: Committing config change with OpId 1.1739: config changed from index -1 to 1739, NON_VOTER e5c7c83542c74b66b44ee29fdcc2a847 (127.13.170.4) added. New config: { opid_index: 1739 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } } peers { permanent_uuid: "e5c7c83542c74b66b44ee29fdcc2a847" member_type: NON_VOTER last_known_addr { host: "127.13.170.4" port: 41583 } attrs { promote: true } } }
I20260201 02:56:16.078601 14299 raft_consensus.cc:2955] T 535b6fc9826f436089318f329dad0f4d P 943634a8539f44a8969b8503616b09d6 [term 1 FOLLOWER]: Committing config change with OpId 1.1738: config changed from index -1 to 1738, NON_VOTER e5c7c83542c74b66b44ee29fdcc2a847 (127.13.170.4) added. New config: { opid_index: 1738 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } } peers { permanent_uuid: "e5c7c83542c74b66b44ee29fdcc2a847" member_type: NON_VOTER last_known_addr { host: "127.13.170.4" port: 41583 } attrs { promote: true } } }
I20260201 02:56:16.078500 14793 catalog_manager.cc:5167] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 535b6fc9826f436089318f329dad0f4d with cas_config_opid_index -1: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20260201 02:56:16.083756 14804 catalog_manager.cc:5654] T 9434d106c0374b5d928cc00f109846ce P 74bc17a87c2342958617c01904a29dac reported cstate change: config changed from index -1 to 1740, NON_VOTER e5c7c83542c74b66b44ee29fdcc2a847 (127.13.170.4) added. New cstate: current_term: 2 leader_uuid: "74bc17a87c2342958617c01904a29dac" committed_config { opid_index: 1740 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5c7c83542c74b66b44ee29fdcc2a847" member_type: NON_VOTER last_known_addr { host: "127.13.170.4" port: 41583 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260201 02:56:16.095330 14762 raft_consensus.cc:2955] T af28911fb32b478b88b6779c6f0dc08f P 74bc17a87c2342958617c01904a29dac [term 1 LEADER]: Committing config change with OpId 1.1739: config changed from index -1 to 1739, NON_VOTER e5c7c83542c74b66b44ee29fdcc2a847 (127.13.170.4) added. New config: { opid_index: 1739 OBSOLETE_local: false peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "e5c7c83542c74b66b44ee29fdcc2a847" member_type: NON_VOTER last_known_addr { host: "127.13.170.4" port: 41583 } attrs { promote: true } } }
I20260201 02:56:16.095423 15036 raft_consensus.cc:2955] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac [term 2 LEADER]: Committing config change with OpId 2.1740: config changed from index -1 to 1740, NON_VOTER e5c7c83542c74b66b44ee29fdcc2a847 (127.13.170.4) added. New config: { opid_index: 1740 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } } peers { permanent_uuid: "e5c7c83542c74b66b44ee29fdcc2a847" member_type: NON_VOTER last_known_addr { host: "127.13.170.4" port: 41583 } attrs { promote: true } } }
I20260201 02:56:16.101495 14303 raft_consensus.cc:2955] T af28911fb32b478b88b6779c6f0dc08f P 943634a8539f44a8969b8503616b09d6 [term 1 FOLLOWER]: Committing config change with OpId 1.1739: config changed from index -1 to 1739, NON_VOTER e5c7c83542c74b66b44ee29fdcc2a847 (127.13.170.4) added. New config: { opid_index: 1739 OBSOLETE_local: false peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "e5c7c83542c74b66b44ee29fdcc2a847" member_type: NON_VOTER last_known_addr { host: "127.13.170.4" port: 41583 } attrs { promote: true } } }
I20260201 02:56:16.107373 14806 catalog_manager.cc:5654] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac reported cstate change: config changed from index -1 to 1740, NON_VOTER e5c7c83542c74b66b44ee29fdcc2a847 (127.13.170.4) added. New cstate: current_term: 2 leader_uuid: "74bc17a87c2342958617c01904a29dac" committed_config { opid_index: 1740 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5c7c83542c74b66b44ee29fdcc2a847" member_type: NON_VOTER last_known_addr { host: "127.13.170.4" port: 41583 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260201 02:56:16.109215 14793 catalog_manager.cc:5167] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 9434d106c0374b5d928cc00f109846ce with cas_config_opid_index -1: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20260201 02:56:16.108359 14303 raft_consensus.cc:2955] T 7b2f386887ef4ab0a692195c4f968c12 P 943634a8539f44a8969b8503616b09d6 [term 2 FOLLOWER]: Committing config change with OpId 2.1740: config changed from index -1 to 1740, NON_VOTER e5c7c83542c74b66b44ee29fdcc2a847 (127.13.170.4) added. New config: { opid_index: 1740 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } } peers { permanent_uuid: "e5c7c83542c74b66b44ee29fdcc2a847" member_type: NON_VOTER last_known_addr { host: "127.13.170.4" port: 41583 } attrs { promote: true } } }
I20260201 02:56:16.114696 14793 catalog_manager.cc:5167] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 7b2f386887ef4ab0a692195c4f968c12 with cas_config_opid_index -1: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20260201 02:56:16.115044 14793 catalog_manager.cc:5167] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet af28911fb32b478b88b6779c6f0dc08f with cas_config_opid_index -1: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20260201 02:56:16.124401 14805 catalog_manager.cc:5654] T af28911fb32b478b88b6779c6f0dc08f P 74bc17a87c2342958617c01904a29dac reported cstate change: config changed from index -1 to 1739, NON_VOTER e5c7c83542c74b66b44ee29fdcc2a847 (127.13.170.4) added. New cstate: current_term: 1 leader_uuid: "74bc17a87c2342958617c01904a29dac" committed_config { opid_index: 1739 OBSOLETE_local: false peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5c7c83542c74b66b44ee29fdcc2a847" member_type: NON_VOTER last_known_addr { host: "127.13.170.4" port: 41583 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260201 02:56:16.186223 15152 ts_tablet_manager.cc:933] T 1abdef8b45334d908fa08ec613374a3b P e5c7c83542c74b66b44ee29fdcc2a847: Initiating tablet copy from peer 943634a8539f44a8969b8503616b09d6 (127.13.170.2:41045)
I20260201 02:56:16.186775 15157 ts_tablet_manager.cc:933] T 535b6fc9826f436089318f329dad0f4d P e5c7c83542c74b66b44ee29fdcc2a847: Initiating tablet copy from peer 74bc17a87c2342958617c01904a29dac (127.13.170.3:45403)
I20260201 02:56:16.186861 15156 ts_tablet_manager.cc:933] T 7b2f386887ef4ab0a692195c4f968c12 P e5c7c83542c74b66b44ee29fdcc2a847: Initiating tablet copy from peer 74bc17a87c2342958617c01904a29dac (127.13.170.3:45403)
I20260201 02:56:16.191026 15154 ts_tablet_manager.cc:933] T 7519edb327894747a21ff97e8a90f2f9 P e5c7c83542c74b66b44ee29fdcc2a847: Initiating tablet copy from peer 943634a8539f44a8969b8503616b09d6 (127.13.170.2:41045)
I20260201 02:56:16.191629 15155 ts_tablet_manager.cc:933] T 9434d106c0374b5d928cc00f109846ce P e5c7c83542c74b66b44ee29fdcc2a847: Initiating tablet copy from peer 74bc17a87c2342958617c01904a29dac (127.13.170.3:45403)
I20260201 02:56:16.196445 15156 tablet_copy_client.cc:323] T 7b2f386887ef4ab0a692195c4f968c12 P e5c7c83542c74b66b44ee29fdcc2a847: tablet copy: Beginning tablet copy session from remote peer at address 127.13.170.3:45403
I20260201 02:56:16.199131 15155 tablet_copy_client.cc:323] T 9434d106c0374b5d928cc00f109846ce P e5c7c83542c74b66b44ee29fdcc2a847: tablet copy: Beginning tablet copy session from remote peer at address 127.13.170.3:45403
I20260201 02:56:16.200426 15157 tablet_copy_client.cc:323] T 535b6fc9826f436089318f329dad0f4d P e5c7c83542c74b66b44ee29fdcc2a847: tablet copy: Beginning tablet copy session from remote peer at address 127.13.170.3:45403
I20260201 02:56:16.203755 15152 tablet_copy_client.cc:323] T 1abdef8b45334d908fa08ec613374a3b P e5c7c83542c74b66b44ee29fdcc2a847: tablet copy: Beginning tablet copy session from remote peer at address 127.13.170.2:41045
I20260201 02:56:16.220173 15154 tablet_copy_client.cc:323] T 7519edb327894747a21ff97e8a90f2f9 P e5c7c83542c74b66b44ee29fdcc2a847: tablet copy: Beginning tablet copy session from remote peer at address 127.13.170.2:41045
I20260201 02:56:16.222443 15153 ts_tablet_manager.cc:933] T af28911fb32b478b88b6779c6f0dc08f P e5c7c83542c74b66b44ee29fdcc2a847: Initiating tablet copy from peer 74bc17a87c2342958617c01904a29dac (127.13.170.3:45403)
I20260201 02:56:16.233453 14453 tablet_copy_service.cc:140] P 74bc17a87c2342958617c01904a29dac: Received BeginTabletCopySession request for tablet 9434d106c0374b5d928cc00f109846ce from peer e5c7c83542c74b66b44ee29fdcc2a847 ({username='slave'} at 127.13.170.4:60783)
I20260201 02:56:16.233737 14453 tablet_copy_service.cc:161] P 74bc17a87c2342958617c01904a29dac: Beginning new tablet copy session on tablet 9434d106c0374b5d928cc00f109846ce from peer e5c7c83542c74b66b44ee29fdcc2a847 at {username='slave'} at 127.13.170.4:60783: session id = e5c7c83542c74b66b44ee29fdcc2a847-9434d106c0374b5d928cc00f109846ce
I20260201 02:56:16.233678 14452 tablet_copy_service.cc:140] P 74bc17a87c2342958617c01904a29dac: Received BeginTabletCopySession request for tablet 535b6fc9826f436089318f329dad0f4d from peer e5c7c83542c74b66b44ee29fdcc2a847 ({username='slave'} at 127.13.170.4:60783)
I20260201 02:56:16.234537 14452 tablet_copy_service.cc:161] P 74bc17a87c2342958617c01904a29dac: Beginning new tablet copy session on tablet 535b6fc9826f436089318f329dad0f4d from peer e5c7c83542c74b66b44ee29fdcc2a847 at {username='slave'} at 127.13.170.4:60783: session id = e5c7c83542c74b66b44ee29fdcc2a847-535b6fc9826f436089318f329dad0f4d
I20260201 02:56:16.237989 14453 tablet_copy_source_session.cc:215] T 9434d106c0374b5d928cc00f109846ce P 74bc17a87c2342958617c01904a29dac: Tablet Copy: opened 0 blocks and 1 log segments
I20260201 02:56:16.238801 14451 tablet_copy_service.cc:140] P 74bc17a87c2342958617c01904a29dac: Received BeginTabletCopySession request for tablet 7b2f386887ef4ab0a692195c4f968c12 from peer e5c7c83542c74b66b44ee29fdcc2a847 ({username='slave'} at 127.13.170.4:60783)
I20260201 02:56:16.239019 14451 tablet_copy_service.cc:161] P 74bc17a87c2342958617c01904a29dac: Beginning new tablet copy session on tablet 7b2f386887ef4ab0a692195c4f968c12 from peer e5c7c83542c74b66b44ee29fdcc2a847 at {username='slave'} at 127.13.170.4:60783: session id = e5c7c83542c74b66b44ee29fdcc2a847-7b2f386887ef4ab0a692195c4f968c12
I20260201 02:56:16.241767 14452 tablet_copy_source_session.cc:215] T 535b6fc9826f436089318f329dad0f4d P 74bc17a87c2342958617c01904a29dac: Tablet Copy: opened 0 blocks and 1 log segments
I20260201 02:56:16.242110 14451 tablet_copy_source_session.cc:215] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac: Tablet Copy: opened 0 blocks and 1 log segments
I20260201 02:56:16.255540 14323 tablet_copy_service.cc:140] P 943634a8539f44a8969b8503616b09d6: Received BeginTabletCopySession request for tablet 1abdef8b45334d908fa08ec613374a3b from peer e5c7c83542c74b66b44ee29fdcc2a847 ({username='slave'} at 127.13.170.4:57503)
I20260201 02:56:16.255868 14323 tablet_copy_service.cc:161] P 943634a8539f44a8969b8503616b09d6: Beginning new tablet copy session on tablet 1abdef8b45334d908fa08ec613374a3b from peer e5c7c83542c74b66b44ee29fdcc2a847 at {username='slave'} at 127.13.170.4:57503: session id = e5c7c83542c74b66b44ee29fdcc2a847-1abdef8b45334d908fa08ec613374a3b
I20260201 02:56:16.256425 15153 tablet_copy_client.cc:323] T af28911fb32b478b88b6779c6f0dc08f P e5c7c83542c74b66b44ee29fdcc2a847: tablet copy: Beginning tablet copy session from remote peer at address 127.13.170.3:45403
I20260201 02:56:16.257961 14322 tablet_copy_service.cc:140] P 943634a8539f44a8969b8503616b09d6: Received BeginTabletCopySession request for tablet 7519edb327894747a21ff97e8a90f2f9 from peer e5c7c83542c74b66b44ee29fdcc2a847 ({username='slave'} at 127.13.170.4:57503)
I20260201 02:56:16.258172 14322 tablet_copy_service.cc:161] P 943634a8539f44a8969b8503616b09d6: Beginning new tablet copy session on tablet 7519edb327894747a21ff97e8a90f2f9 from peer e5c7c83542c74b66b44ee29fdcc2a847 at {username='slave'} at 127.13.170.4:57503: session id = e5c7c83542c74b66b44ee29fdcc2a847-7519edb327894747a21ff97e8a90f2f9
I20260201 02:56:16.259847 14323 tablet_copy_source_session.cc:215] T 1abdef8b45334d908fa08ec613374a3b P 943634a8539f44a8969b8503616b09d6: Tablet Copy: opened 0 blocks and 1 log segments
I20260201 02:56:16.261211 14322 tablet_copy_source_session.cc:215] T 7519edb327894747a21ff97e8a90f2f9 P 943634a8539f44a8969b8503616b09d6: Tablet Copy: opened 0 blocks and 1 log segments
I20260201 02:56:16.269088 15154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7519edb327894747a21ff97e8a90f2f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 02:56:16.270028 15152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1abdef8b45334d908fa08ec613374a3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 02:56:16.275477 15157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 535b6fc9826f436089318f329dad0f4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 02:56:16.279621 15156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b2f386887ef4ab0a692195c4f968c12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 02:56:16.280068 15155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9434d106c0374b5d928cc00f109846ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 02:56:16.294072 15157 tablet_copy_client.cc:806] T 535b6fc9826f436089318f329dad0f4d P e5c7c83542c74b66b44ee29fdcc2a847: tablet copy: Starting download of 0 data blocks...
I20260201 02:56:16.294626 15157 tablet_copy_client.cc:670] T 535b6fc9826f436089318f329dad0f4d P e5c7c83542c74b66b44ee29fdcc2a847: tablet copy: Starting download of 1 WAL segments...
I20260201 02:56:16.295890 15155 tablet_copy_client.cc:806] T 9434d106c0374b5d928cc00f109846ce P e5c7c83542c74b66b44ee29fdcc2a847: tablet copy: Starting download of 0 data blocks...
I20260201 02:56:16.296226 15155 tablet_copy_client.cc:670] T 9434d106c0374b5d928cc00f109846ce P e5c7c83542c74b66b44ee29fdcc2a847: tablet copy: Starting download of 1 WAL segments...
I20260201 02:56:16.300555 15152 tablet_copy_client.cc:806] T 1abdef8b45334d908fa08ec613374a3b P e5c7c83542c74b66b44ee29fdcc2a847: tablet copy: Starting download of 0 data blocks...
I20260201 02:56:16.301031 15152 tablet_copy_client.cc:670] T 1abdef8b45334d908fa08ec613374a3b P e5c7c83542c74b66b44ee29fdcc2a847: tablet copy: Starting download of 1 WAL segments...
I20260201 02:56:16.301582 14453 tablet_copy_service.cc:140] P 74bc17a87c2342958617c01904a29dac: Received BeginTabletCopySession request for tablet af28911fb32b478b88b6779c6f0dc08f from peer e5c7c83542c74b66b44ee29fdcc2a847 ({username='slave'} at 127.13.170.4:60783)
I20260201 02:56:16.302148 14453 tablet_copy_service.cc:161] P 74bc17a87c2342958617c01904a29dac: Beginning new tablet copy session on tablet af28911fb32b478b88b6779c6f0dc08f from peer e5c7c83542c74b66b44ee29fdcc2a847 at {username='slave'} at 127.13.170.4:60783: session id = e5c7c83542c74b66b44ee29fdcc2a847-af28911fb32b478b88b6779c6f0dc08f
I20260201 02:56:16.306102 15156 tablet_copy_client.cc:806] T 7b2f386887ef4ab0a692195c4f968c12 P e5c7c83542c74b66b44ee29fdcc2a847: tablet copy: Starting download of 0 data blocks...
I20260201 02:56:16.307592 15156 tablet_copy_client.cc:670] T 7b2f386887ef4ab0a692195c4f968c12 P e5c7c83542c74b66b44ee29fdcc2a847: tablet copy: Starting download of 1 WAL segments...
I20260201 02:56:16.309891 15154 tablet_copy_client.cc:806] T 7519edb327894747a21ff97e8a90f2f9 P e5c7c83542c74b66b44ee29fdcc2a847: tablet copy: Starting download of 0 data blocks...
I20260201 02:56:16.310197 15154 tablet_copy_client.cc:670] T 7519edb327894747a21ff97e8a90f2f9 P e5c7c83542c74b66b44ee29fdcc2a847: tablet copy: Starting download of 1 WAL segments...
I20260201 02:56:16.322486 14453 tablet_copy_source_session.cc:215] T af28911fb32b478b88b6779c6f0dc08f P 74bc17a87c2342958617c01904a29dac: Tablet Copy: opened 0 blocks and 1 log segments
I20260201 02:56:16.324280 15154 tablet_copy_client.cc:538] T 7519edb327894747a21ff97e8a90f2f9 P e5c7c83542c74b66b44ee29fdcc2a847: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260201 02:56:16.326617 15152 tablet_copy_client.cc:538] T 1abdef8b45334d908fa08ec613374a3b P e5c7c83542c74b66b44ee29fdcc2a847: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260201 02:56:16.333253 15152 tablet_bootstrap.cc:492] T 1abdef8b45334d908fa08ec613374a3b P e5c7c83542c74b66b44ee29fdcc2a847: Bootstrap starting.
I20260201 02:56:16.336838 15155 tablet_copy_client.cc:538] T 9434d106c0374b5d928cc00f109846ce P e5c7c83542c74b66b44ee29fdcc2a847: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260201 02:56:16.342945 15155 tablet_bootstrap.cc:492] T 9434d106c0374b5d928cc00f109846ce P e5c7c83542c74b66b44ee29fdcc2a847: Bootstrap starting.
I20260201 02:56:16.346382 15154 tablet_bootstrap.cc:492] T 7519edb327894747a21ff97e8a90f2f9 P e5c7c83542c74b66b44ee29fdcc2a847: Bootstrap starting.
I20260201 02:56:16.351670 15153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af28911fb32b478b88b6779c6f0dc08f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 02:56:16.353264 15157 tablet_copy_client.cc:538] T 535b6fc9826f436089318f329dad0f4d P e5c7c83542c74b66b44ee29fdcc2a847: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260201 02:56:16.371273 15156 tablet_copy_client.cc:538] T 7b2f386887ef4ab0a692195c4f968c12 P e5c7c83542c74b66b44ee29fdcc2a847: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260201 02:56:16.377482 15157 tablet_bootstrap.cc:492] T 535b6fc9826f436089318f329dad0f4d P e5c7c83542c74b66b44ee29fdcc2a847: Bootstrap starting.
I20260201 02:56:16.379892 15156 tablet_bootstrap.cc:492] T 7b2f386887ef4ab0a692195c4f968c12 P e5c7c83542c74b66b44ee29fdcc2a847: Bootstrap starting.
I20260201 02:56:16.383893 15153 tablet_copy_client.cc:806] T af28911fb32b478b88b6779c6f0dc08f P e5c7c83542c74b66b44ee29fdcc2a847: tablet copy: Starting download of 0 data blocks...
I20260201 02:56:16.391692 15153 tablet_copy_client.cc:670] T af28911fb32b478b88b6779c6f0dc08f P e5c7c83542c74b66b44ee29fdcc2a847: tablet copy: Starting download of 1 WAL segments...
I20260201 02:56:16.413156 15153 tablet_copy_client.cc:538] T af28911fb32b478b88b6779c6f0dc08f P e5c7c83542c74b66b44ee29fdcc2a847: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260201 02:56:16.417510 15153 tablet_bootstrap.cc:492] T af28911fb32b478b88b6779c6f0dc08f P e5c7c83542c74b66b44ee29fdcc2a847: Bootstrap starting.
I20260201 02:56:16.458513 13992 meta_cache.cc:1510] marking tablet server 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225) as failed
W20260201 02:56:16.458772 13992 meta_cache.cc:302] tablet 535b6fc9826f436089318f329dad0f4d: replica 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225) has failed: Network error: TS failed: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111)
W20260201 02:56:16.528239 14238 consensus_peers.cc:597] T 7519edb327894747a21ff97e8a90f2f9 P 943634a8539f44a8969b8503616b09d6 -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260201 02:56:16.535627 14368 consensus_peers.cc:597] T af28911fb32b478b88b6779c6f0dc08f P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260201 02:56:16.541311 14238 consensus_peers.cc:597] T 1abdef8b45334d908fa08ec613374a3b P 943634a8539f44a8969b8503616b09d6 -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260201 02:56:16.578173 14368 consensus_peers.cc:597] T 9434d106c0374b5d928cc00f109846ce P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260201 02:56:16.578461 14368 consensus_peers.cc:597] T 535b6fc9826f436089318f329dad0f4d P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260201 02:56:16.579334 14368 consensus_peers.cc:597] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260201 02:56:16.712241 14236 consensus_peers.cc:597] T 1abdef8b45334d908fa08ec613374a3b P 943634a8539f44a8969b8503616b09d6 -> Peer e5c7c83542c74b66b44ee29fdcc2a847 (127.13.170.4:41583): Couldn't send request to peer e5c7c83542c74b66b44ee29fdcc2a847. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
W20260201 02:56:16.716710 14366 consensus_peers.cc:597] T 9434d106c0374b5d928cc00f109846ce P 74bc17a87c2342958617c01904a29dac -> Peer e5c7c83542c74b66b44ee29fdcc2a847 (127.13.170.4:41583): Couldn't send request to peer e5c7c83542c74b66b44ee29fdcc2a847. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
W20260201 02:56:16.767196 14366 consensus_peers.cc:597] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac -> Peer e5c7c83542c74b66b44ee29fdcc2a847 (127.13.170.4:41583): Couldn't send request to peer e5c7c83542c74b66b44ee29fdcc2a847. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
W20260201 02:56:16.807508 14236 consensus_peers.cc:597] T 7519edb327894747a21ff97e8a90f2f9 P 943634a8539f44a8969b8503616b09d6 -> Peer e5c7c83542c74b66b44ee29fdcc2a847 (127.13.170.4:41583): Couldn't send request to peer e5c7c83542c74b66b44ee29fdcc2a847. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
W20260201 02:56:16.808485 14366 consensus_peers.cc:597] T 535b6fc9826f436089318f329dad0f4d P 74bc17a87c2342958617c01904a29dac -> Peer e5c7c83542c74b66b44ee29fdcc2a847 (127.13.170.4:41583): Couldn't send request to peer e5c7c83542c74b66b44ee29fdcc2a847. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
W20260201 02:56:16.840902 14366 consensus_peers.cc:597] T af28911fb32b478b88b6779c6f0dc08f P 74bc17a87c2342958617c01904a29dac -> Peer e5c7c83542c74b66b44ee29fdcc2a847 (127.13.170.4:41583): Couldn't send request to peer e5c7c83542c74b66b44ee29fdcc2a847. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
W20260201 02:56:17.024164 14238 consensus_peers.cc:597] T 1abdef8b45334d908fa08ec613374a3b P 943634a8539f44a8969b8503616b09d6 -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260201 02:56:17.030812 14238 consensus_peers.cc:597] T 7519edb327894747a21ff97e8a90f2f9 P 943634a8539f44a8969b8503616b09d6 -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260201 02:56:17.046975 14368 consensus_peers.cc:597] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260201 02:56:17.048206 14368 consensus_peers.cc:597] T 535b6fc9826f436089318f329dad0f4d P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260201 02:56:17.061883 14368 consensus_peers.cc:597] T af28911fb32b478b88b6779c6f0dc08f P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260201 02:56:17.068646 13992 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-taskfoNO09/build/asan/bin/kudu pid 14221
I20260201 02:56:17.069957 14343 generic_service.cc:196] Checking for leaks (request via RPC)
W20260201 02:56:17.105669 14368 consensus_peers.cc:597] T 9434d106c0374b5d928cc00f109846ce P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260201 02:56:17.227056 14366 consensus_peers.cc:597] T 9434d106c0374b5d928cc00f109846ce P 74bc17a87c2342958617c01904a29dac -> Peer e5c7c83542c74b66b44ee29fdcc2a847 (127.13.170.4:41583): Couldn't send request to peer e5c7c83542c74b66b44ee29fdcc2a847. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
W20260201 02:56:17.305888 14366 consensus_peers.cc:597] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac -> Peer e5c7c83542c74b66b44ee29fdcc2a847 (127.13.170.4:41583): Couldn't send request to peer e5c7c83542c74b66b44ee29fdcc2a847. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
W20260201 02:56:17.311260 14366 consensus_peers.cc:597] T 535b6fc9826f436089318f329dad0f4d P 74bc17a87c2342958617c01904a29dac -> Peer e5c7c83542c74b66b44ee29fdcc2a847 (127.13.170.4:41583): Couldn't send request to peer e5c7c83542c74b66b44ee29fdcc2a847. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
W20260201 02:56:17.312180 14366 consensus_peers.cc:597] T af28911fb32b478b88b6779c6f0dc08f P 74bc17a87c2342958617c01904a29dac -> Peer e5c7c83542c74b66b44ee29fdcc2a847 (127.13.170.4:41583): Couldn't send request to peer e5c7c83542c74b66b44ee29fdcc2a847. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
I20260201 02:56:17.353561 15074 raft_consensus.cc:493] T 7519edb327894747a21ff97e8a90f2f9 P 74bc17a87c2342958617c01904a29dac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 943634a8539f44a8969b8503616b09d6)
I20260201 02:56:17.353790 15074 raft_consensus.cc:515] T 7519edb327894747a21ff97e8a90f2f9 P 74bc17a87c2342958617c01904a29dac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 1739 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } } peers { permanent_uuid: "e5c7c83542c74b66b44ee29fdcc2a847" member_type: NON_VOTER last_known_addr { host: "127.13.170.4" port: 41583 } attrs { promote: true } }
I20260201 02:56:17.354583 15074 leader_election.cc:290] T 7519edb327894747a21ff97e8a90f2f9 P 74bc17a87c2342958617c01904a29dac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225), 943634a8539f44a8969b8503616b09d6 (127.13.170.2:41045)
W20260201 02:56:17.356781 14368 leader_election.cc:336] T 7519edb327894747a21ff97e8a90f2f9 P 74bc17a87c2342958617c01904a29dac [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111)
I20260201 02:56:17.374091 15074 raft_consensus.cc:493] T 1abdef8b45334d908fa08ec613374a3b P 74bc17a87c2342958617c01904a29dac [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 943634a8539f44a8969b8503616b09d6)
I20260201 02:56:17.374308 15074 raft_consensus.cc:515] T 1abdef8b45334d908fa08ec613374a3b P 74bc17a87c2342958617c01904a29dac [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 1738 OBSOLETE_local: false peers { permanent_uuid: "20beda53b20146fb90018bf4533dcd58" member_type: VOTER last_known_addr { host: "127.13.170.1" port: 36225 } } peers { permanent_uuid: "943634a8539f44a8969b8503616b09d6" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 41045 } } peers { permanent_uuid: "74bc17a87c2342958617c01904a29dac" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 45403 } } peers { permanent_uuid: "e5c7c83542c74b66b44ee29fdcc2a847" member_type: NON_VOTER last_known_addr { host: "127.13.170.4" port: 41583 } attrs { promote: true } }
I20260201 02:56:17.375120 15074 leader_election.cc:290] T 1abdef8b45334d908fa08ec613374a3b P 74bc17a87c2342958617c01904a29dac [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225), 943634a8539f44a8969b8503616b09d6 (127.13.170.2:41045)
W20260201 02:56:17.377275 14368 leader_election.cc:336] T 1abdef8b45334d908fa08ec613374a3b P 74bc17a87c2342958617c01904a29dac [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111)
I20260201 02:56:17.525214 15155 log.cc:826] T 9434d106c0374b5d928cc00f109846ce P e5c7c83542c74b66b44ee29fdcc2a847: Log is configured to *not* fsync() on all Append() calls
W20260201 02:56:17.545538 14368 consensus_peers.cc:597] T af28911fb32b478b88b6779c6f0dc08f P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260201 02:56:17.547755 14368 consensus_peers.cc:597] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260201 02:56:17.558495 14368 consensus_peers.cc:597] T 535b6fc9826f436089318f329dad0f4d P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260201 02:56:17.578397 14368 consensus_peers.cc:597] T 9434d106c0374b5d928cc00f109846ce P 74bc17a87c2342958617c01904a29dac -> Peer 20beda53b20146fb90018bf4533dcd58 (127.13.170.1:36225): Couldn't send request to peer 20beda53b20146fb90018bf4533dcd58. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.1:36225: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260201 02:56:17.653172 13992 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskfoNO09/build/asan/bin/kudu with pid 14221
W20260201 02:56:17.726843 14366 consensus_peers.cc:597] T 9434d106c0374b5d928cc00f109846ce P 74bc17a87c2342958617c01904a29dac -> Peer e5c7c83542c74b66b44ee29fdcc2a847 (127.13.170.4:41583): Couldn't send request to peer e5c7c83542c74b66b44ee29fdcc2a847. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 16: this message will repeat every 5th retry.
W20260201 02:56:17.741143 14369 connection.cc:537] client connection to 127.13.170.2:41045 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260201 02:56:17.743376 15151 negotiation.cc:337] Failed RPC negotiation. Trace:
0201 02:56:17.741844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.170.2:41045 (local address 127.13.170.3:44129)
0201 02:56:17.742030 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0201 02:56:17.742060 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0201 02:56:17.742198 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0201 02:56:17.742463 (+ 265us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.170.2:41045: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":84}
W20260201 02:56:17.743999 14369 consensus_peers.cc:597] T 535b6fc9826f436089318f329dad0f4d P 74bc17a87c2342958617c01904a29dac -> Peer 943634a8539f44a8969b8503616b09d6 (127.13.170.2:41045): Couldn't send request to peer 943634a8539f44a8969b8503616b09d6. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.2:41045: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107). This is attempt 1: this message will repeat every 5th retry.
W20260201 02:56:17.744113 14369 consensus_peers.cc:597] T 7b2f386887ef4ab0a692195c4f968c12 P 74bc17a87c2342958617c01904a29dac -> Peer 943634a8539f44a8969b8503616b09d6 (127.13.170.2:41045): Couldn't send request to peer 943634a8539f44a8969b8503616b09d6. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.2:41045: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107). This is attempt 1: this message will repeat every 5th retry.
W20260201 02:56:17.744184 14369 consensus_peers.cc:597] T 9434d106c0374b5d928cc00f109846ce P 74bc17a87c2342958617c01904a29dac -> Peer 943634a8539f44a8969b8503616b09d6 (127.13.170.2:41045): Couldn't send request to peer 943634a8539f44a8969b8503616b09d6. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.2:41045: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107). This is attempt 1: this message will repeat every 5th retry.
W20260201 02:56:17.744244 14369 consensus_peers.cc:597] T af28911fb32b478b88b6779c6f0dc08f P 74bc17a87c2342958617c01904a29dac -> Peer 943634a8539f44a8969b8503616b09d6 (127.13.170.2:41045): Couldn't send request to peer 943634a8539f44a8969b8503616b09d6. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.2:41045: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107). This is attempt 1: this message will repeat every 5th retry.
W20260201 02:56:17.744313 14369 leader_election.cc:336] T 1abdef8b45334d908fa08ec613374a3b P 74bc17a87c2342958617c01904a29dac [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 943634a8539f44a8969b8503616b09d6 (127.13.170.2:41045): Network error: Client connection negotiation failed: client connection to 127.13.170.2:41045: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260201 02:56:17.744431 14369 leader_election.cc:304] T 1abdef8b45334d908fa08ec613374a3b P 74bc17a87c2342958617c01904a29dac [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74bc17a87c2342958617c01904a29dac; no voters: 20beda53b20146fb90018bf4533dcd58, 943634a8539f44a8969b8503616b09d6
I20260201 02:56:17.744728 15097 raft_consensus.cc:2749] T 1abdef8b45334d908fa08ec613374a3b P 74bc17a87c2342958617c01904a29dac [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260201 02:56:17.744829 14369 leader_election.cc:336] T 7519edb327894747a21ff97e8a90f2f9 P 74bc17a87c2342958617c01904a29dac [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 943634a8539f44a8969b8503616b09d6 (127.13.170.2:41045): Network error: Client connection negotiation failed: client connection to 127.13.170.2:41045: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260201 02:56:17.744949 14369 leader_election.cc:304] T 7519edb327894747a21ff97e8a90f2f9 P 74bc17a87c2342958617c01904a29dac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74bc17a87c2342958617c01904a29dac; no voters: 20beda53b20146fb90018bf4533dcd58, 943634a8539f44a8969b8503616b09d6
I20260201 02:56:17.745180 15097 raft_consensus.cc:2749] T 7519edb327894747a21ff97e8a90f2f9 P 74bc17a87c2342958617c01904a29dac [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 02:56:17.746066 13992 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-taskfoNO09/build/asan/bin/kudu pid 14351
I20260201 02:56:17.747249 14473 generic_service.cc:196] Checking for leaks (request via RPC)
I20260201 02:56:18.300777 15074 consensus_queue.cc:579] T 9434d106c0374b5d928cc00f109846ce P 74bc17a87c2342958617c01904a29dac [LEADER]: Leader has been unable to successfully communicate with peer 20beda53b20146fb90018bf4533dcd58 for more than 2 seconds (2.261s)
I20260201 02:56:18.321327 13992 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskfoNO09/build/asan/bin/kudu with pid 14351
I20260201 02:56:18.482828 13992 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-taskfoNO09/build/asan/bin/kudu pid 14546
I20260201 02:56:18.484359 14726 generic_service.cc:196] Checking for leaks (request via RPC)
I20260201 02:56:18.688426 13992 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskfoNO09/build/asan/bin/kudu with pid 14546
I20260201 02:56:18.720577 13992 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-taskfoNO09/build/asan/bin/kudu pid 14774
I20260201 02:56:18.721769 14836 generic_service.cc:196] Checking for leaks (request via RPC)
I20260201 02:56:18.834919 13992 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskfoNO09/build/asan/bin/kudu with pid 14774
2026-02-01T02:56:18Z chronyd exiting
[ OK ] MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate (44695 ms)
[----------] 1 test from MaintenanceModeRF3ITest (44695 ms total)
[----------] 1 test from RollingRestartArgs/RollingRestartITest
[ RUN ] RollingRestartArgs/RollingRestartITest.TestWorkloads/4
2026-02-01T02:56:18Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-02-01T02:56:18Z Disabled control of system clock
I20260201 02:56:18.939039 13992 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskfoNO09/build/asan/bin/kudu
/tmp/dist-test-taskfoNO09/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.170.62:35815
--webserver_interface=127.13.170.62
--webserver_port=0
--builtin_ntp_servers=127.13.170.20:35371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.170.62:35815
--location_mapping_cmd=/tmp/dist-test-taskfoNO09/build/asan/bin/testdata/assign-location.py --state_store=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/location-assignment.state --map /L0:4
--master_client_location_assignment_enabled=false with env {}
W20260201 02:56:19.303720 15198 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260201 02:56:19.304075 15198 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260201 02:56:19.304147 15198 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260201 02:56:19.312974 15198 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260201 02:56:19.313099 15198 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260201 02:56:19.313158 15198 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260201 02:56:19.313199 15198 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260201 02:56:19.323578 15198 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.170.20:35371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/master-0/wal
--location_mapping_cmd=/tmp/dist-test-taskfoNO09/build/asan/bin/testdata/assign-location.py --state_store=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/location-assignment.state --map /L0:4
--ipki_ca_key_size=768
--master_addresses=127.13.170.62:35815
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.170.62:35815
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.170.62
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 3722ed49c19ce54c7feae2fa944e32b1d4ed8d2d
build type FASTDEBUG
built by None at 01 Feb 2026 02:43:22 UTC on 24a791456cd2
build id 10288
ASAN enabled
I20260201 02:56:19.325333 15198 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260201 02:56:19.327359 15198 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 02:56:19.336591 15203 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 02:56:19.336544 15204 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 02:56:19.336930 15206 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 02:56:19.338171 15198 server_base.cc:1060] running on GCE node
I20260201 02:56:19.339192 15198 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260201 02:56:19.341025 15198 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260201 02:56:19.342291 15198 hybrid_clock.cc:648] HybridClock initialized: now 1769914579342257 us; error 73 us; skew 500 ppm
I20260201 02:56:19.342768 15198 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 02:56:19.345252 15198 webserver.cc:492] Webserver started at http://127.13.170.62:45725/ using document root <none> and password file <none>
I20260201 02:56:19.346107 15198 fs_manager.cc:362] Metadata directory not provided
I20260201 02:56:19.346256 15198 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 02:56:19.346637 15198 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 02:56:19.349344 15198 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/master-0/data/instance:
uuid: "936e978e585041e5b3d8b711226a40eb"
format_stamp: "Formatted at 2026-02-01 02:56:19 on dist-test-slave-4krj"
I20260201 02:56:19.350236 15198 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/master-0/wal/instance:
uuid: "936e978e585041e5b3d8b711226a40eb"
format_stamp: "Formatted at 2026-02-01 02:56:19 on dist-test-slave-4krj"
I20260201 02:56:19.356428 15198 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.008s sys 0.001s
I20260201 02:56:19.360775 15212 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 02:56:19.362355 15198 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260201 02:56:19.362596 15198 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/master-0/data,/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/master-0/wal
uuid: "936e978e585041e5b3d8b711226a40eb"
format_stamp: "Formatted at 2026-02-01 02:56:19 on dist-test-slave-4krj"
I20260201 02:56:19.362948 15198 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 02:56:19.382861 15198 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 02:56:19.383867 15198 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260201 02:56:19.384195 15198 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 02:56:19.406349 15263 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.170.62:35815 every 8 connection(s)
I20260201 02:56:19.406343 15198 rpc_server.cc:307] RPC server started. Bound to: 127.13.170.62:35815
I20260201 02:56:19.408097 15198 server_base.cc:1192] Dumped server information to /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/master-0/data/info.pb
I20260201 02:56:19.412731 15264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 02:56:19.418521 13992 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskfoNO09/build/asan/bin/kudu as pid 15198
I20260201 02:56:19.418819 13992 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/master-0/wal/instance
I20260201 02:56:19.424551 15264 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 936e978e585041e5b3d8b711226a40eb: Bootstrap starting.
I20260201 02:56:19.428186 15264 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 936e978e585041e5b3d8b711226a40eb: Neither blocks nor log segments found. Creating new log.
I20260201 02:56:19.429380 15264 log.cc:826] T 00000000000000000000000000000000 P 936e978e585041e5b3d8b711226a40eb: Log is configured to *not* fsync() on all Append() calls
I20260201 02:56:19.432879 15264 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 936e978e585041e5b3d8b711226a40eb: No bootstrap required, opened a new log
I20260201 02:56:19.438910 15264 raft_consensus.cc:359] T 00000000000000000000000000000000 P 936e978e585041e5b3d8b711226a40eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "936e978e585041e5b3d8b711226a40eb" member_type: VOTER last_known_addr { host: "127.13.170.62" port: 35815 } }
I20260201 02:56:19.439297 15264 raft_consensus.cc:385] T 00000000000000000000000000000000 P 936e978e585041e5b3d8b711226a40eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 02:56:19.439378 15264 raft_consensus.cc:740] T 00000000000000000000000000000000 P 936e978e585041e5b3d8b711226a40eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936e978e585041e5b3d8b711226a40eb, State: Initialized, Role: FOLLOWER
I20260201 02:56:19.439939 15264 consensus_queue.cc:260] T 00000000000000000000000000000000 P 936e978e585041e5b3d8b711226a40eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "936e978e585041e5b3d8b711226a40eb" member_type: VOTER last_known_addr { host: "127.13.170.62" port: 35815 } }
I20260201 02:56:19.440132 15264 raft_consensus.cc:399] T 00000000000000000000000000000000 P 936e978e585041e5b3d8b711226a40eb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260201 02:56:19.440232 15264 raft_consensus.cc:493] T 00000000000000000000000000000000 P 936e978e585041e5b3d8b711226a40eb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260201 02:56:19.440356 15264 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 936e978e585041e5b3d8b711226a40eb [term 0 FOLLOWER]: Advancing to term 1
I20260201 02:56:19.442797 15264 raft_consensus.cc:515] T 00000000000000000000000000000000 P 936e978e585041e5b3d8b711226a40eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "936e978e585041e5b3d8b711226a40eb" member_type: VOTER last_known_addr { host: "127.13.170.62" port: 35815 } }
I20260201 02:56:19.443313 15264 leader_election.cc:304] T 00000000000000000000000000000000 P 936e978e585041e5b3d8b711226a40eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 936e978e585041e5b3d8b711226a40eb; no voters:
I20260201 02:56:19.443885 15264 leader_election.cc:290] T 00000000000000000000000000000000 P 936e978e585041e5b3d8b711226a40eb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260201 02:56:19.444042 15269 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 936e978e585041e5b3d8b711226a40eb [term 1 FOLLOWER]: Leader election won for term 1
I20260201 02:56:19.445226 15269 raft_consensus.cc:697] T 00000000000000000000000000000000 P 936e978e585041e5b3d8b711226a40eb [term 1 LEADER]: Becoming Leader. State: Replica: 936e978e585041e5b3d8b711226a40eb, State: Running, Role: LEADER
I20260201 02:56:19.445842 15269 consensus_queue.cc:237] T 00000000000000000000000000000000 P 936e978e585041e5b3d8b711226a40eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "936e978e585041e5b3d8b711226a40eb" member_type: VOTER last_known_addr { host: "127.13.170.62" port: 35815 } }
I20260201 02:56:19.446372 15264 sys_catalog.cc:565] T 00000000000000000000000000000000 P 936e978e585041e5b3d8b711226a40eb [sys.catalog]: configured and running, proceeding with master startup.
I20260201 02:56:19.449151 15271 sys_catalog.cc:455] T 00000000000000000000000000000000 P 936e978e585041e5b3d8b711226a40eb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 936e978e585041e5b3d8b711226a40eb. Latest consensus state: current_term: 1 leader_uuid: "936e978e585041e5b3d8b711226a40eb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "936e978e585041e5b3d8b711226a40eb" member_type: VOTER last_known_addr { host: "127.13.170.62" port: 35815 } } }
I20260201 02:56:19.449108 15270 sys_catalog.cc:455] T 00000000000000000000000000000000 P 936e978e585041e5b3d8b711226a40eb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "936e978e585041e5b3d8b711226a40eb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "936e978e585041e5b3d8b711226a40eb" member_type: VOTER last_known_addr { host: "127.13.170.62" port: 35815 } } }
I20260201 02:56:19.449534 15271 sys_catalog.cc:458] T 00000000000000000000000000000000 P 936e978e585041e5b3d8b711226a40eb [sys.catalog]: This master's current role is: LEADER
I20260201 02:56:19.449584 15270 sys_catalog.cc:458] T 00000000000000000000000000000000 P 936e978e585041e5b3d8b711226a40eb [sys.catalog]: This master's current role is: LEADER
I20260201 02:56:19.453626 15278 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260201 02:56:19.458911 15278 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260201 02:56:19.473527 15278 catalog_manager.cc:1357] Generated new cluster ID: cdadcbd3619044eea444434a09a25a57
I20260201 02:56:19.473677 15278 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260201 02:56:19.488840 15278 catalog_manager.cc:1380] Generated new certificate authority record
I20260201 02:56:19.490468 15278 catalog_manager.cc:1514] Loading token signing keys...
I20260201 02:56:19.500423 15278 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 936e978e585041e5b3d8b711226a40eb: Generated new TSK 0
I20260201 02:56:19.501399 15278 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260201 02:56:19.517328 13992 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskfoNO09/build/asan/bin/kudu
/tmp/dist-test-taskfoNO09/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.170.1:0
--local_ip_for_outbound_sockets=127.13.170.1
--webserver_interface=127.13.170.1
--webserver_port=0
--tserver_master_addrs=127.13.170.62:35815
--builtin_ntp_servers=127.13.170.20:35371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
W20260201 02:56:19.891359 15288 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260201 02:56:19.891754 15288 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260201 02:56:19.891907 15288 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260201 02:56:19.900847 15288 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260201 02:56:19.901134 15288 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.170.1
I20260201 02:56:19.911648 15288 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.170.20:35371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.170.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.170.1
--webserver_port=0
--tserver_master_addrs=127.13.170.62:35815
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.170.1
--log_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3722ed49c19ce54c7feae2fa944e32b1d4ed8d2d
build type FASTDEBUG
built by None at 01 Feb 2026 02:43:22 UTC on 24a791456cd2
build id 10288
ASAN enabled
I20260201 02:56:19.913396 15288 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260201 02:56:19.915340 15288 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 02:56:19.925483 15293 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 02:56:19.925510 15294 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 02:56:19.926170 15296 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 02:56:19.926476 15288 server_base.cc:1060] running on GCE node
I20260201 02:56:19.927273 15288 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260201 02:56:19.928660 15288 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260201 02:56:19.929967 15288 hybrid_clock.cc:648] HybridClock initialized: now 1769914579929895 us; error 88 us; skew 500 ppm
I20260201 02:56:19.930326 15288 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 02:56:19.933032 15288 webserver.cc:492] Webserver started at http://127.13.170.1:35425/ using document root <none> and password file <none>
I20260201 02:56:19.933897 15288 fs_manager.cc:362] Metadata directory not provided
I20260201 02:56:19.934047 15288 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 02:56:19.934442 15288 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 02:56:19.937055 15288 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-0/data/instance:
uuid: "f4dd4e7188e44b518d7df7246414a2d6"
format_stamp: "Formatted at 2026-02-01 02:56:19 on dist-test-slave-4krj"
I20260201 02:56:19.937891 15288 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-0/wal/instance:
uuid: "f4dd4e7188e44b518d7df7246414a2d6"
format_stamp: "Formatted at 2026-02-01 02:56:19 on dist-test-slave-4krj"
I20260201 02:56:19.943898 15288 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260201 02:56:19.948001 15302 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 02:56:19.949520 15288 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260201 02:56:19.949738 15288 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-0/data,/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-0/wal
uuid: "f4dd4e7188e44b518d7df7246414a2d6"
format_stamp: "Formatted at 2026-02-01 02:56:19 on dist-test-slave-4krj"
I20260201 02:56:19.949972 15288 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 02:56:19.976051 15288 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 02:56:19.977072 15288 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260201 02:56:19.977401 15288 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 02:56:19.978523 15288 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260201 02:56:19.980502 15288 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260201 02:56:19.980643 15288 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260201 02:56:19.980783 15288 ts_tablet_manager.cc:616] Registered 0 tablets
I20260201 02:56:19.980877 15288 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260201 02:56:20.017836 15288 rpc_server.cc:307] RPC server started. Bound to: 127.13.170.1:41937
I20260201 02:56:20.017946 15414 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.170.1:41937 every 8 connection(s)
I20260201 02:56:20.019477 15288 server_base.cc:1192] Dumped server information to /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-0/data/info.pb
I20260201 02:56:20.020835 13992 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskfoNO09/build/asan/bin/kudu as pid 15288
I20260201 02:56:20.021062 13992 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-0/wal/instance
I20260201 02:56:20.024758 13992 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskfoNO09/build/asan/bin/kudu
/tmp/dist-test-taskfoNO09/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.170.2:0
--local_ip_for_outbound_sockets=127.13.170.2
--webserver_interface=127.13.170.2
--webserver_port=0
--tserver_master_addrs=127.13.170.62:35815
--builtin_ntp_servers=127.13.170.20:35371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
I20260201 02:56:20.036608 15415 heartbeater.cc:344] Connected to a master server at 127.13.170.62:35815
I20260201 02:56:20.037063 15415 heartbeater.cc:461] Registering TS with master...
I20260201 02:56:20.037979 15415 heartbeater.cc:507] Master 127.13.170.62:35815 requested a full tablet report, sending...
I20260201 02:56:20.101159 15229 ts_manager.cc:194] Registered new tserver with Master: f4dd4e7188e44b518d7df7246414a2d6 (127.13.170.1:41937)
I20260201 02:56:20.103953 15229 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.13.170.1:43955
W20260201 02:56:20.406185 15419 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260201 02:56:20.406625 15419 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260201 02:56:20.406786 15419 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260201 02:56:20.420576 15419 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260201 02:56:20.420876 15419 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.170.2
I20260201 02:56:20.435762 15419 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.170.20:35371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.170.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.170.2
--webserver_port=0
--tserver_master_addrs=127.13.170.62:35815
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.170.2
--log_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3722ed49c19ce54c7feae2fa944e32b1d4ed8d2d
build type FASTDEBUG
built by None at 01 Feb 2026 02:43:22 UTC on 24a791456cd2
build id 10288
ASAN enabled
I20260201 02:56:20.437403 15419 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260201 02:56:20.439458 15419 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 02:56:20.451211 15425 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 02:56:20.451650 15426 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 02:56:20.452006 15428 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 02:56:20.452517 15419 server_base.cc:1060] running on GCE node
I20260201 02:56:20.453271 15419 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260201 02:56:20.454371 15419 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260201 02:56:20.455597 15419 hybrid_clock.cc:648] HybridClock initialized: now 1769914580455520 us; error 78 us; skew 500 ppm
I20260201 02:56:20.456066 15419 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 02:56:20.458530 15419 webserver.cc:492] Webserver started at http://127.13.170.2:44123/ using document root <none> and password file <none>
I20260201 02:56:20.459517 15419 fs_manager.cc:362] Metadata directory not provided
I20260201 02:56:20.459663 15419 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 02:56:20.460081 15419 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 02:56:20.464150 15419 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-1/data/instance:
uuid: "7c282a4e4a074f7cb7fada1519e23c9b"
format_stamp: "Formatted at 2026-02-01 02:56:20 on dist-test-slave-4krj"
I20260201 02:56:20.465646 15419 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-1/wal/instance:
uuid: "7c282a4e4a074f7cb7fada1519e23c9b"
format_stamp: "Formatted at 2026-02-01 02:56:20 on dist-test-slave-4krj"
I20260201 02:56:20.474011 15419 fs_manager.cc:696] Time spent creating directory manager: real 0.008s user 0.002s sys 0.008s
I20260201 02:56:20.478832 15434 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 02:56:20.480968 15419 fs_manager.cc:730] Time spent opening block manager: real 0.005s user 0.003s sys 0.000s
I20260201 02:56:20.481237 15419 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-1/data,/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-1/wal
uuid: "7c282a4e4a074f7cb7fada1519e23c9b"
format_stamp: "Formatted at 2026-02-01 02:56:20 on dist-test-slave-4krj"
I20260201 02:56:20.481506 15419 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 02:56:20.509929 15419 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 02:56:20.511003 15419 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260201 02:56:20.511312 15419 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 02:56:20.512394 15419 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260201 02:56:20.514263 15419 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260201 02:56:20.514360 15419 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260201 02:56:20.514528 15419 ts_tablet_manager.cc:616] Registered 0 tablets
I20260201 02:56:20.514614 15419 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260201 02:56:20.550868 15419 rpc_server.cc:307] RPC server started. Bound to: 127.13.170.2:36827
I20260201 02:56:20.550976 15546 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.170.2:36827 every 8 connection(s)
I20260201 02:56:20.552469 15419 server_base.cc:1192] Dumped server information to /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-1/data/info.pb
I20260201 02:56:20.558887 13992 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskfoNO09/build/asan/bin/kudu as pid 15419
I20260201 02:56:20.559072 13992 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-1/wal/instance
I20260201 02:56:20.562546 13992 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskfoNO09/build/asan/bin/kudu
/tmp/dist-test-taskfoNO09/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.170.3:0
--local_ip_for_outbound_sockets=127.13.170.3
--webserver_interface=127.13.170.3
--webserver_port=0
--tserver_master_addrs=127.13.170.62:35815
--builtin_ntp_servers=127.13.170.20:35371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
I20260201 02:56:20.567901 15547 heartbeater.cc:344] Connected to a master server at 127.13.170.62:35815
I20260201 02:56:20.568338 15547 heartbeater.cc:461] Registering TS with master...
I20260201 02:56:20.569340 15547 heartbeater.cc:507] Master 127.13.170.62:35815 requested a full tablet report, sending...
I20260201 02:56:20.619684 15229 ts_manager.cc:194] Registered new tserver with Master: 7c282a4e4a074f7cb7fada1519e23c9b (127.13.170.2:36827)
I20260201 02:56:20.621044 15229 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.13.170.2:54205
W20260201 02:56:20.937034 15551 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260201 02:56:20.937443 15551 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260201 02:56:20.937585 15551 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260201 02:56:20.946281 15551 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260201 02:56:20.946493 15551 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.170.3
I20260201 02:56:20.957041 15551 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.170.20:35371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.170.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.170.3
--webserver_port=0
--tserver_master_addrs=127.13.170.62:35815
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.170.3
--log_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3722ed49c19ce54c7feae2fa944e32b1d4ed8d2d
build type FASTDEBUG
built by None at 01 Feb 2026 02:43:22 UTC on 24a791456cd2
build id 10288
ASAN enabled
I20260201 02:56:20.958922 15551 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260201 02:56:20.960927 15551 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 02:56:20.972136 15557 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 02:56:20.972330 15558 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 02:56:20.972905 15560 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 02:56:20.974396 15551 server_base.cc:1060] running on GCE node
I20260201 02:56:20.975219 15551 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260201 02:56:20.976337 15551 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260201 02:56:20.977592 15551 hybrid_clock.cc:648] HybridClock initialized: now 1769914580977521 us; error 70 us; skew 500 ppm
I20260201 02:56:20.977952 15551 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 02:56:20.980893 15551 webserver.cc:492] Webserver started at http://127.13.170.3:40805/ using document root <none> and password file <none>
I20260201 02:56:20.981820 15551 fs_manager.cc:362] Metadata directory not provided
I20260201 02:56:20.981978 15551 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 02:56:20.982393 15551 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 02:56:20.985128 15551 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-2/data/instance:
uuid: "d74315e006374d648477a8e6109e44a7"
format_stamp: "Formatted at 2026-02-01 02:56:20 on dist-test-slave-4krj"
I20260201 02:56:20.986112 15551 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-2/wal/instance:
uuid: "d74315e006374d648477a8e6109e44a7"
format_stamp: "Formatted at 2026-02-01 02:56:20 on dist-test-slave-4krj"
I20260201 02:56:20.992903 15551 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.009s sys 0.000s
I20260201 02:56:20.997243 15566 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 02:56:20.998924 15551 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260201 02:56:20.999148 15551 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-2/data,/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-2/wal
uuid: "d74315e006374d648477a8e6109e44a7"
format_stamp: "Formatted at 2026-02-01 02:56:20 on dist-test-slave-4krj"
I20260201 02:56:20.999390 15551 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 02:56:21.038407 15551 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 02:56:21.039480 15551 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260201 02:56:21.039810 15551 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 02:56:21.040817 15551 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260201 02:56:21.042696 15551 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260201 02:56:21.042842 15551 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260201 02:56:21.042990 15551 ts_tablet_manager.cc:616] Registered 0 tablets
I20260201 02:56:21.043088 15551 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260201 02:56:21.081723 15551 rpc_server.cc:307] RPC server started. Bound to: 127.13.170.3:41669
I20260201 02:56:21.081791 15678 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.170.3:41669 every 8 connection(s)
I20260201 02:56:21.083487 15551 server_base.cc:1192] Dumped server information to /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-2/data/info.pb
I20260201 02:56:21.091361 13992 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskfoNO09/build/asan/bin/kudu as pid 15551
I20260201 02:56:21.091584 13992 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-2/wal/instance
I20260201 02:56:21.095495 13992 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskfoNO09/build/asan/bin/kudu
/tmp/dist-test-taskfoNO09/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.170.4:0
--local_ip_for_outbound_sockets=127.13.170.4
--webserver_interface=127.13.170.4
--webserver_port=0
--tserver_master_addrs=127.13.170.62:35815
--builtin_ntp_servers=127.13.170.20:35371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
I20260201 02:56:21.099020 15679 heartbeater.cc:344] Connected to a master server at 127.13.170.62:35815
I20260201 02:56:21.099463 15679 heartbeater.cc:461] Registering TS with master...
I20260201 02:56:21.100602 15679 heartbeater.cc:507] Master 127.13.170.62:35815 requested a full tablet report, sending...
I20260201 02:56:21.107692 15415 heartbeater.cc:499] Master 127.13.170.62:35815 was elected leader, sending a full tablet report...
I20260201 02:56:21.150055 15229 ts_manager.cc:194] Registered new tserver with Master: d74315e006374d648477a8e6109e44a7 (127.13.170.3:41669)
I20260201 02:56:21.151397 15229 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.13.170.3:49589
W20260201 02:56:21.474334 15683 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260201 02:56:21.474974 15683 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260201 02:56:21.475157 15683 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260201 02:56:21.486897 15683 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260201 02:56:21.487097 15683 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.170.4
I20260201 02:56:21.498050 15683 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.170.20:35371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.170.4:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-3/data/info.pb
--webserver_interface=127.13.170.4
--webserver_port=0
--tserver_master_addrs=127.13.170.62:35815
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.170.4
--log_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-3/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3722ed49c19ce54c7feae2fa944e32b1d4ed8d2d
build type FASTDEBUG
built by None at 01 Feb 2026 02:43:22 UTC on 24a791456cd2
build id 10288
ASAN enabled
I20260201 02:56:21.499842 15683 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260201 02:56:21.501766 15683 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 02:56:21.512598 15692 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 02:56:21.512471 15689 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 02:56:21.512495 15690 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 02:56:21.513645 15683 server_base.cc:1060] running on GCE node
I20260201 02:56:21.514302 15683 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260201 02:56:21.515408 15683 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260201 02:56:21.516670 15683 hybrid_clock.cc:648] HybridClock initialized: now 1769914581516609 us; error 57 us; skew 500 ppm
I20260201 02:56:21.517024 15683 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 02:56:21.519470 15683 webserver.cc:492] Webserver started at http://127.13.170.4:34937/ using document root <none> and password file <none>
I20260201 02:56:21.520303 15683 fs_manager.cc:362] Metadata directory not provided
I20260201 02:56:21.520454 15683 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 02:56:21.520859 15683 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 02:56:21.523551 15683 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-3/data/instance:
uuid: "94d535b533b04887be4fac8a82a48cb1"
format_stamp: "Formatted at 2026-02-01 02:56:21 on dist-test-slave-4krj"
I20260201 02:56:21.524389 15683 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-3/wal/instance:
uuid: "94d535b533b04887be4fac8a82a48cb1"
format_stamp: "Formatted at 2026-02-01 02:56:21 on dist-test-slave-4krj"
I20260201 02:56:21.530522 15683 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.002s sys 0.005s
I20260201 02:56:21.534412 15698 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 02:56:21.535944 15683 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260201 02:56:21.536160 15683 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-3/data,/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-3/wal
uuid: "94d535b533b04887be4fac8a82a48cb1"
format_stamp: "Formatted at 2026-02-01 02:56:21 on dist-test-slave-4krj"
I20260201 02:56:21.536401 15683 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-3/wal
metadata directory: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-3/wal
1 data directories: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 02:56:21.576130 15683 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 02:56:21.577140 15683 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260201 02:56:21.577482 15683 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 02:56:21.578549 15683 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260201 02:56:21.580425 15683 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260201 02:56:21.580575 15683 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260201 02:56:21.580718 15683 ts_tablet_manager.cc:616] Registered 0 tablets
I20260201 02:56:21.580811 15683 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260201 02:56:21.618721 15683 rpc_server.cc:307] RPC server started. Bound to: 127.13.170.4:46319
I20260201 02:56:21.618830 15810 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.170.4:46319 every 8 connection(s)
I20260201 02:56:21.620340 15683 server_base.cc:1192] Dumped server information to /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-3/data/info.pb
I20260201 02:56:21.624506 15547 heartbeater.cc:499] Master 127.13.170.62:35815 was elected leader, sending a full tablet report...
I20260201 02:56:21.629190 13992 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskfoNO09/build/asan/bin/kudu as pid 15683
I20260201 02:56:21.629392 13992 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-3/wal/instance
I20260201 02:56:21.640182 15811 heartbeater.cc:344] Connected to a master server at 127.13.170.62:35815
I20260201 02:56:21.640618 15811 heartbeater.cc:461] Registering TS with master...
I20260201 02:56:21.641531 15811 heartbeater.cc:507] Master 127.13.170.62:35815 requested a full tablet report, sending...
I20260201 02:56:21.695361 15229 ts_manager.cc:194] Registered new tserver with Master: 94d535b533b04887be4fac8a82a48cb1 (127.13.170.4:46319)
I20260201 02:56:21.696290 15229 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.13.170.4:53981
I20260201 02:56:21.707218 13992 external_mini_cluster.cc:949] 4 TS(s) registered with all masters
I20260201 02:56:21.747912 15229 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52168:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260201 02:56:21.785826 15746 tablet_service.cc:1505] Processing CreateTablet for tablet 0faa3d899dba409fa6df255630da23e4 (DEFAULT_TABLE table=test-workload [id=785b07714e6044a5aad8be9f57fda149]), partition=RANGE (key) PARTITION UNBOUNDED
I20260201 02:56:21.787725 15746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0faa3d899dba409fa6df255630da23e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 02:56:21.788311 15482 tablet_service.cc:1505] Processing CreateTablet for tablet 0faa3d899dba409fa6df255630da23e4 (DEFAULT_TABLE table=test-workload [id=785b07714e6044a5aad8be9f57fda149]), partition=RANGE (key) PARTITION UNBOUNDED
I20260201 02:56:21.788106 15614 tablet_service.cc:1505] Processing CreateTablet for tablet 0faa3d899dba409fa6df255630da23e4 (DEFAULT_TABLE table=test-workload [id=785b07714e6044a5aad8be9f57fda149]), partition=RANGE (key) PARTITION UNBOUNDED
I20260201 02:56:21.789742 15614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0faa3d899dba409fa6df255630da23e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 02:56:21.789767 15482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0faa3d899dba409fa6df255630da23e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 02:56:21.802052 15836 tablet_bootstrap.cc:492] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b: Bootstrap starting.
I20260201 02:56:21.806711 15838 tablet_bootstrap.cc:492] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7: Bootstrap starting.
I20260201 02:56:21.807581 15836 tablet_bootstrap.cc:654] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b: Neither blocks nor log segments found. Creating new log.
I20260201 02:56:21.809599 15836 log.cc:826] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b: Log is configured to *not* fsync() on all Append() calls
I20260201 02:56:21.811311 15838 tablet_bootstrap.cc:654] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7: Neither blocks nor log segments found. Creating new log.
I20260201 02:56:21.813118 15838 log.cc:826] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7: Log is configured to *not* fsync() on all Append() calls
I20260201 02:56:21.818614 15836 tablet_bootstrap.cc:492] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b: No bootstrap required, opened a new log
I20260201 02:56:21.819278 15836 ts_tablet_manager.cc:1403] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b: Time spent bootstrapping tablet: real 0.018s user 0.008s sys 0.007s
I20260201 02:56:21.819919 15837 tablet_bootstrap.cc:492] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1: Bootstrap starting.
I20260201 02:56:21.824733 15837 tablet_bootstrap.cc:654] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1: Neither blocks nor log segments found. Creating new log.
I20260201 02:56:21.825448 15836 raft_consensus.cc:359] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d535b533b04887be4fac8a82a48cb1" member_type: VOTER last_known_addr { host: "127.13.170.4" port: 46319 } } peers { permanent_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 36827 } } peers { permanent_uuid: "d74315e006374d648477a8e6109e44a7" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 41669 } }
I20260201 02:56:21.825803 15838 tablet_bootstrap.cc:492] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7: No bootstrap required, opened a new log
I20260201 02:56:21.825944 15836 raft_consensus.cc:385] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 02:56:21.826087 15836 raft_consensus.cc:740] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c282a4e4a074f7cb7fada1519e23c9b, State: Initialized, Role: FOLLOWER
I20260201 02:56:21.826195 15838 ts_tablet_manager.cc:1403] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7: Time spent bootstrapping tablet: real 0.020s user 0.007s sys 0.010s
I20260201 02:56:21.826182 15837 log.cc:826] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1: Log is configured to *not* fsync() on all Append() calls
I20260201 02:56:21.826927 15836 consensus_queue.cc:260] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d535b533b04887be4fac8a82a48cb1" member_type: VOTER last_known_addr { host: "127.13.170.4" port: 46319 } } peers { permanent_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 36827 } } peers { permanent_uuid: "d74315e006374d648477a8e6109e44a7" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 41669 } }
I20260201 02:56:21.833695 15836 ts_tablet_manager.cc:1434] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b: Time spent starting tablet: real 0.014s user 0.004s sys 0.008s
I20260201 02:56:21.836246 15837 tablet_bootstrap.cc:492] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1: No bootstrap required, opened a new log
I20260201 02:56:21.836063 15838 raft_consensus.cc:359] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d535b533b04887be4fac8a82a48cb1" member_type: VOTER last_known_addr { host: "127.13.170.4" port: 46319 } } peers { permanent_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 36827 } } peers { permanent_uuid: "d74315e006374d648477a8e6109e44a7" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 41669 } }
I20260201 02:56:21.836571 15838 raft_consensus.cc:385] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 02:56:21.836596 15837 ts_tablet_manager.cc:1403] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1: Time spent bootstrapping tablet: real 0.017s user 0.004s sys 0.009s
I20260201 02:56:21.836702 15838 raft_consensus.cc:740] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d74315e006374d648477a8e6109e44a7, State: Initialized, Role: FOLLOWER
I20260201 02:56:21.837409 15838 consensus_queue.cc:260] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d535b533b04887be4fac8a82a48cb1" member_type: VOTER last_known_addr { host: "127.13.170.4" port: 46319 } } peers { permanent_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 36827 } } peers { permanent_uuid: "d74315e006374d648477a8e6109e44a7" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 41669 } }
I20260201 02:56:21.839104 15838 ts_tablet_manager.cc:1434] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7: Time spent starting tablet: real 0.013s user 0.012s sys 0.001s
I20260201 02:56:21.839406 15679 heartbeater.cc:499] Master 127.13.170.62:35815 was elected leader, sending a full tablet report...
I20260201 02:56:21.844075 15837 raft_consensus.cc:359] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d535b533b04887be4fac8a82a48cb1" member_type: VOTER last_known_addr { host: "127.13.170.4" port: 46319 } } peers { permanent_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 36827 } } peers { permanent_uuid: "d74315e006374d648477a8e6109e44a7" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 41669 } }
I20260201 02:56:21.844614 15837 raft_consensus.cc:385] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 02:56:21.844749 15837 raft_consensus.cc:740] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94d535b533b04887be4fac8a82a48cb1, State: Initialized, Role: FOLLOWER
I20260201 02:56:21.845515 15837 consensus_queue.cc:260] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d535b533b04887be4fac8a82a48cb1" member_type: VOTER last_known_addr { host: "127.13.170.4" port: 46319 } } peers { permanent_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 36827 } } peers { permanent_uuid: "d74315e006374d648477a8e6109e44a7" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 41669 } }
I20260201 02:56:21.845705 15842 raft_consensus.cc:493] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 02:56:21.846221 15842 raft_consensus.cc:515] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d535b533b04887be4fac8a82a48cb1" member_type: VOTER last_known_addr { host: "127.13.170.4" port: 46319 } } peers { permanent_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 36827 } } peers { permanent_uuid: "d74315e006374d648477a8e6109e44a7" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 41669 } }
I20260201 02:56:21.846899 15811 heartbeater.cc:499] Master 127.13.170.62:35815 was elected leader, sending a full tablet report...
I20260201 02:56:21.847747 15837 ts_tablet_manager.cc:1434] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1: Time spent starting tablet: real 0.011s user 0.011s sys 0.001s
I20260201 02:56:21.850255 15842 leader_election.cc:290] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94d535b533b04887be4fac8a82a48cb1 (127.13.170.4:46319), d74315e006374d648477a8e6109e44a7 (127.13.170.3:41669)
I20260201 02:56:21.859889 15634 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0faa3d899dba409fa6df255630da23e4" candidate_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d74315e006374d648477a8e6109e44a7" is_pre_election: true
I20260201 02:56:21.860425 15634 raft_consensus.cc:2468] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c282a4e4a074f7cb7fada1519e23c9b in term 0.
I20260201 02:56:21.861176 15436 leader_election.cc:304] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c282a4e4a074f7cb7fada1519e23c9b, d74315e006374d648477a8e6109e44a7; no voters:
I20260201 02:56:21.861292 15766 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0faa3d899dba409fa6df255630da23e4" candidate_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94d535b533b04887be4fac8a82a48cb1" is_pre_election: true
I20260201 02:56:21.861706 15842 raft_consensus.cc:2804] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 02:56:21.861869 15842 raft_consensus.cc:493] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 02:56:21.861871 15766 raft_consensus.cc:2468] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c282a4e4a074f7cb7fada1519e23c9b in term 0.
I20260201 02:56:21.861964 15842 raft_consensus.cc:3060] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [term 0 FOLLOWER]: Advancing to term 1
I20260201 02:56:21.864449 15842 raft_consensus.cc:515] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d535b533b04887be4fac8a82a48cb1" member_type: VOTER last_known_addr { host: "127.13.170.4" port: 46319 } } peers { permanent_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 36827 } } peers { permanent_uuid: "d74315e006374d648477a8e6109e44a7" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 41669 } }
I20260201 02:56:21.865231 15842 leader_election.cc:290] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [CANDIDATE]: Term 1 election: Requested vote from peers 94d535b533b04887be4fac8a82a48cb1 (127.13.170.4:46319), d74315e006374d648477a8e6109e44a7 (127.13.170.3:41669)
I20260201 02:56:21.865854 15766 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0faa3d899dba409fa6df255630da23e4" candidate_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94d535b533b04887be4fac8a82a48cb1"
I20260201 02:56:21.866063 15634 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0faa3d899dba409fa6df255630da23e4" candidate_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d74315e006374d648477a8e6109e44a7"
I20260201 02:56:21.866118 15766 raft_consensus.cc:3060] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 0 FOLLOWER]: Advancing to term 1
I20260201 02:56:21.866303 15634 raft_consensus.cc:3060] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [term 0 FOLLOWER]: Advancing to term 1
I20260201 02:56:21.870050 15766 raft_consensus.cc:2468] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c282a4e4a074f7cb7fada1519e23c9b in term 1.
I20260201 02:56:21.870050 15634 raft_consensus.cc:2468] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c282a4e4a074f7cb7fada1519e23c9b in term 1.
I20260201 02:56:21.870868 15438 leader_election.cc:304] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c282a4e4a074f7cb7fada1519e23c9b, 94d535b533b04887be4fac8a82a48cb1; no voters:
I20260201 02:56:21.871445 15842 raft_consensus.cc:2804] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [term 1 FOLLOWER]: Leader election won for term 1
I20260201 02:56:21.872179 15842 raft_consensus.cc:697] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [term 1 LEADER]: Becoming Leader. State: Replica: 7c282a4e4a074f7cb7fada1519e23c9b, State: Running, Role: LEADER
W20260201 02:56:21.872377 15812 tablet.cc:2378] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260201 02:56:21.872849 15842 consensus_queue.cc:237] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d535b533b04887be4fac8a82a48cb1" member_type: VOTER last_known_addr { host: "127.13.170.4" port: 46319 } } peers { permanent_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 36827 } } peers { permanent_uuid: "d74315e006374d648477a8e6109e44a7" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 41669 } }
I20260201 02:56:21.879691 15229 catalog_manager.cc:5654] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c282a4e4a074f7cb7fada1519e23c9b (127.13.170.2). New cstate: current_term: 1 leader_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d535b533b04887be4fac8a82a48cb1" member_type: VOTER last_known_addr { host: "127.13.170.4" port: 46319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 36827 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d74315e006374d648477a8e6109e44a7" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 41669 } health_report { overall_health: UNKNOWN } } }
I20260201 02:56:21.913722 13992 maintenance_mode-itest.cc:745] Restarting batch of 4 tservers: 94d535b533b04887be4fac8a82a48cb1,7c282a4e4a074f7cb7fada1519e23c9b,f4dd4e7188e44b518d7df7246414a2d6,d74315e006374d648477a8e6109e44a7
I20260201 02:56:21.959558 15842 consensus_queue.cc:1048] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "94d535b533b04887be4fac8a82a48cb1" member_type: VOTER last_known_addr { host: "127.13.170.4" port: 46319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260201 02:56:22.002689 15842 consensus_queue.cc:1048] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d74315e006374d648477a8e6109e44a7" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 41669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 02:56:23.260485 15224 ts_manager.cc:295] Set tserver state for 94d535b533b04887be4fac8a82a48cb1 to MAINTENANCE_MODE
I20260201 02:56:23.268283 15227 ts_manager.cc:295] Set tserver state for 7c282a4e4a074f7cb7fada1519e23c9b to MAINTENANCE_MODE
W20260201 02:56:23.298349 15436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.170.3:41669, user_credentials={real_user=slave}} blocked reactor thread for 54360.2us
I20260201 02:56:23.994514 15227 ts_manager.cc:295] Set tserver state for d74315e006374d648477a8e6109e44a7 to MAINTENANCE_MODE
I20260201 02:56:24.429697 15227 ts_manager.cc:295] Set tserver state for f4dd4e7188e44b518d7df7246414a2d6 to MAINTENANCE_MODE
I20260201 02:56:24.818120 15482 tablet_service.cc:1460] Tablet server 7c282a4e4a074f7cb7fada1519e23c9b set to quiescing
I20260201 02:56:24.818423 15482 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260201 02:56:24.829800 15874 raft_consensus.cc:993] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b: : Instructing follower d74315e006374d648477a8e6109e44a7 to start an election
I20260201 02:56:24.829988 15874 raft_consensus.cc:1081] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [term 1 LEADER]: Signalling peer d74315e006374d648477a8e6109e44a7 to start an election
I20260201 02:56:24.830567 15874 raft_consensus.cc:993] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b: : Instructing follower 94d535b533b04887be4fac8a82a48cb1 to start an election
I20260201 02:56:24.830724 15874 raft_consensus.cc:1081] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [term 1 LEADER]: Signalling peer 94d535b533b04887be4fac8a82a48cb1 to start an election
I20260201 02:56:24.832193 15765 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "0faa3d899dba409fa6df255630da23e4"
dest_uuid: "94d535b533b04887be4fac8a82a48cb1"
from {username='slave'} at 127.13.170.2:60231
I20260201 02:56:24.832533 15765 raft_consensus.cc:493] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 02:56:24.832690 15765 raft_consensus.cc:3060] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 1 FOLLOWER]: Advancing to term 2
I20260201 02:56:24.835078 15634 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "0faa3d899dba409fa6df255630da23e4"
dest_uuid: "d74315e006374d648477a8e6109e44a7"
from {username='slave'} at 127.13.170.2:37209
I20260201 02:56:24.835425 15634 raft_consensus.cc:493] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 02:56:24.835577 15634 raft_consensus.cc:3060] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [term 1 FOLLOWER]: Advancing to term 2
I20260201 02:56:24.840230 15765 raft_consensus.cc:515] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d535b533b04887be4fac8a82a48cb1" member_type: VOTER last_known_addr { host: "127.13.170.4" port: 46319 } } peers { permanent_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 36827 } } peers { permanent_uuid: "d74315e006374d648477a8e6109e44a7" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 41669 } }
I20260201 02:56:24.841912 15634 raft_consensus.cc:515] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d535b533b04887be4fac8a82a48cb1" member_type: VOTER last_known_addr { host: "127.13.170.4" port: 46319 } } peers { permanent_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 36827 } } peers { permanent_uuid: "d74315e006374d648477a8e6109e44a7" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 41669 } }
I20260201 02:56:24.862164 15502 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0faa3d899dba409fa6df255630da23e4" candidate_uuid: "d74315e006374d648477a8e6109e44a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 106 } } ignore_live_leader: true dest_uuid: "7c282a4e4a074f7cb7fada1519e23c9b"
I20260201 02:56:24.870155 15502 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0faa3d899dba409fa6df255630da23e4" candidate_uuid: "94d535b533b04887be4fac8a82a48cb1" candidate_term: 2 candidate_status { last_received { term: 1 index: 106 } } ignore_live_leader: true dest_uuid: "7c282a4e4a074f7cb7fada1519e23c9b"
I20260201 02:56:24.876437 15765 leader_election.cc:290] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [CANDIDATE]: Term 2 election: Requested vote from peers 7c282a4e4a074f7cb7fada1519e23c9b (127.13.170.2:36827), d74315e006374d648477a8e6109e44a7 (127.13.170.3:41669)
I20260201 02:56:24.878767 15634 leader_election.cc:290] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [CANDIDATE]: Term 2 election: Requested vote from peers 94d535b533b04887be4fac8a82a48cb1 (127.13.170.4:46319), 7c282a4e4a074f7cb7fada1519e23c9b (127.13.170.2:36827)
I20260201 02:56:24.887742 15634 raft_consensus.cc:1240] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [term 2 FOLLOWER]: Rejecting Update request from peer 7c282a4e4a074f7cb7fada1519e23c9b for earlier term 1. Current term is 2. Ops: [1.107-1.107]
I20260201 02:56:24.888662 15842 consensus_queue.cc:1059] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d74315e006374d648477a8e6109e44a7" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 41669 }, Status: INVALID_TERM, Last received: 1.106, Next index: 107, Last known committed idx: 106, Time since last communication: 0.000s
I20260201 02:56:24.889091 15842 raft_consensus.cc:3055] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [term 1 LEADER]: Stepping down as leader of term 1
I20260201 02:56:24.889184 15842 raft_consensus.cc:740] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7c282a4e4a074f7cb7fada1519e23c9b, State: Running, Role: LEADER
I20260201 02:56:24.889535 15842 consensus_queue.cc:260] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 106, Committed index: 106, Last appended: 1.108, Last appended by leader: 108, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d535b533b04887be4fac8a82a48cb1" member_type: VOTER last_known_addr { host: "127.13.170.4" port: 46319 } } peers { permanent_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 36827 } } peers { permanent_uuid: "d74315e006374d648477a8e6109e44a7" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 41669 } }
I20260201 02:56:24.890053 15842 raft_consensus.cc:3060] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [term 1 FOLLOWER]: Advancing to term 2
W20260201 02:56:24.907157 15865 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60874: Illegal state: Cannot assign timestamp to op. Tablet is not in leader mode. Last heard from a leader: 0.020s ago.
I20260201 02:56:24.912364 15765 raft_consensus.cc:1240] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 2 FOLLOWER]: Rejecting Update request from peer 7c282a4e4a074f7cb7fada1519e23c9b for earlier term 1. Current term is 2. Ops: [1.107-1.107]
I20260201 02:56:24.917533 15634 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0faa3d899dba409fa6df255630da23e4" candidate_uuid: "94d535b533b04887be4fac8a82a48cb1" candidate_term: 2 candidate_status { last_received { term: 1 index: 106 } } ignore_live_leader: true dest_uuid: "d74315e006374d648477a8e6109e44a7"
I20260201 02:56:24.918005 15634 raft_consensus.cc:2393] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 94d535b533b04887be4fac8a82a48cb1 in current term 2: Already voted for candidate d74315e006374d648477a8e6109e44a7 in this term.
I20260201 02:56:24.920143 15700 leader_election.cc:304] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94d535b533b04887be4fac8a82a48cb1; no voters: 7c282a4e4a074f7cb7fada1519e23c9b, d74315e006374d648477a8e6109e44a7
I20260201 02:56:24.957743 15961 raft_consensus.cc:2749] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260201 02:56:24.960160 15765 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0faa3d899dba409fa6df255630da23e4" candidate_uuid: "d74315e006374d648477a8e6109e44a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 106 } } ignore_live_leader: true dest_uuid: "94d535b533b04887be4fac8a82a48cb1"
I20260201 02:56:24.960906 15765 raft_consensus.cc:2393] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d74315e006374d648477a8e6109e44a7 in current term 2: Already voted for candidate 94d535b533b04887be4fac8a82a48cb1 in this term.
I20260201 02:56:24.961931 15570 leader_election.cc:304] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d74315e006374d648477a8e6109e44a7; no voters: 7c282a4e4a074f7cb7fada1519e23c9b, 94d535b533b04887be4fac8a82a48cb1
W20260201 02:56:24.972558 15726 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42104: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
I20260201 02:56:24.975150 15963 raft_consensus.cc:2749] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260201 02:56:24.983726 15593 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44996: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:24.992183 15461 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60874: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:56:25.003166 15726 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42104: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:56:25.013159 15594 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44996: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:25.026212 15461 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60874: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:56:25.037953 15726 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42104: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:56:25.048902 15593 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44996: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:25.068248 15461 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60874: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:56:25.082917 15726 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42104: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:56:25.102082 15593 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44996: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:25.120908 15461 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60874: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:56:25.136471 15726 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42104: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
I20260201 02:56:25.140785 15746 tablet_service.cc:1460] Tablet server 94d535b533b04887be4fac8a82a48cb1 set to quiescing
I20260201 02:56:25.141258 15746 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
W20260201 02:56:25.153683 15589 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44996: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:25.158032 15939 raft_consensus.cc:670] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b: failed to trigger leader election: Illegal state: leader elections are disabled
W20260201 02:56:25.174242 15461 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60874: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:56:25.195672 15726 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42104: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:56:25.215762 15589 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44996: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:25.239562 15461 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60874: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:56:25.264358 15726 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42104: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:56:25.289160 15592 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44996: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:25.301879 15961 raft_consensus.cc:670] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1: failed to trigger leader election: Illegal state: leader elections are disabled
W20260201 02:56:25.317167 15461 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60874: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:56:25.344208 15726 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42104: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:56:25.370555 15592 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44996: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
I20260201 02:56:25.373652 15614 tablet_service.cc:1460] Tablet server d74315e006374d648477a8e6109e44a7 set to quiescing
I20260201 02:56:25.373942 15614 tablet_service.cc:1467] Tablet server has 0 leaders and 1 scanners
W20260201 02:56:25.400144 15461 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60874: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:56:25.422927 15963 raft_consensus.cc:670] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7: failed to trigger leader election: Illegal state: leader elections are disabled
W20260201 02:56:25.430399 15726 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42104: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:56:25.462786 15594 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44996: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:25.497697 15461 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60874: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:56:25.528064 15726 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42104: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
I20260201 02:56:25.553692 15350 tablet_service.cc:1460] Tablet server f4dd4e7188e44b518d7df7246414a2d6 set to quiescing
I20260201 02:56:25.553944 15350 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
W20260201 02:56:25.559729 15594 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44996: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:25.598066 15461 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60874: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:56:25.632870 15726 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42104: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:56:25.671435 15594 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44996: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:25.711685 15461 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60874: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:56:25.751338 15726 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42104: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:56:25.788636 15594 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44996: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:25.831135 15461 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60874: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:56:25.872948 15726 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42104: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:56:25.915311 15594 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44996: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:25.961221 15461 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60874: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:56:26.003635 15726 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42104: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:56:26.048365 15594 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44996: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:26.095652 15461 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60874: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:56:26.141314 15726 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42104: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:56:26.190356 15594 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44996: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:26.244442 15461 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60874: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:56:26.292992 15726 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42104: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:56:26.344617 15594 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44996: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:26.399416 15461 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60874: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:56:26.454016 15726 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42104: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:56:26.507761 15594 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44996: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:26.565475 15461 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60874: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
I20260201 02:56:26.602164 15482 tablet_service.cc:1460] Tablet server 7c282a4e4a074f7cb7fada1519e23c9b set to quiescing
I20260201 02:56:26.602411 15482 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
W20260201 02:56:26.623284 15726 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42104: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:56:26.680943 15594 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44996: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:26.740768 15461 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60874: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:56:26.802029 15726 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42104: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:56:26.864651 15594 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44996: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:26.926880 15461 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60874: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
I20260201 02:56:26.933975 15614 tablet_service.cc:1460] Tablet server d74315e006374d648477a8e6109e44a7 set to quiescing
I20260201 02:56:26.934268 15614 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
W20260201 02:56:26.989341 15726 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42104: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:56:27.052299 15594 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44996: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
I20260201 02:56:27.075410 13992 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-taskfoNO09/build/asan/bin/kudu pid 15683
I20260201 02:56:27.083210 15806 generic_service.cc:196] Checking for leaks (request via RPC)
W20260201 02:56:27.117623 15461 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60874: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:56:27.188957 15726 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42104: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
I20260201 02:56:27.189659 13992 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskfoNO09/build/asan/bin/kudu with pid 15683
I20260201 02:56:27.211478 13992 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskfoNO09/build/asan/bin/kudu
/tmp/dist-test-taskfoNO09/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.170.4:46319
--local_ip_for_outbound_sockets=127.13.170.4
--tserver_master_addrs=127.13.170.62:35815
--webserver_port=34937
--webserver_interface=127.13.170.4
--builtin_ntp_servers=127.13.170.20:35371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
W20260201 02:56:27.257531 15594 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44996: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:27.325390 15461 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60874: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:56:27.395092 15824 meta_cache.cc:302] tablet 0faa3d899dba409fa6df255630da23e4: replica 94d535b533b04887be4fac8a82a48cb1 (127.13.170.4:46319) has failed: Network error: Client connection negotiation failed: client connection to 127.13.170.4:46319: connect: Connection refused (error 111)
W20260201 02:56:27.465718 15594 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44996: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:27.536653 15461 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60874: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:56:27.592547 16022 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260201 02:56:27.592928 16022 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260201 02:56:27.593163 16022 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260201 02:56:27.603096 16022 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260201 02:56:27.603332 16022 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.170.4
I20260201 02:56:27.614243 16022 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.170.20:35371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.170.4:46319
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-3/data/info.pb
--webserver_interface=127.13.170.4
--webserver_port=34937
--tserver_master_addrs=127.13.170.62:35815
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.170.4
--log_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-3/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3722ed49c19ce54c7feae2fa944e32b1d4ed8d2d
build type FASTDEBUG
built by None at 01 Feb 2026 02:43:22 UTC on 24a791456cd2
build id 10288
ASAN enabled
I20260201 02:56:27.616006 16022 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260201 02:56:27.617952 16022 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 02:56:27.629305 16029 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 02:56:27.629334 16028 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 02:56:27.630553 16031 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 02:56:27.631094 16022 server_base.cc:1060] running on GCE node
I20260201 02:56:27.631814 16022 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260201 02:56:27.633117 16022 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260201 02:56:27.634387 16022 hybrid_clock.cc:648] HybridClock initialized: now 1769914587634334 us; error 43 us; skew 500 ppm
I20260201 02:56:27.634836 16022 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 02:56:27.637368 16022 webserver.cc:492] Webserver started at http://127.13.170.4:34937/ using document root <none> and password file <none>
I20260201 02:56:27.638236 16022 fs_manager.cc:362] Metadata directory not provided
I20260201 02:56:27.638386 16022 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 02:56:27.644558 16022 fs_manager.cc:714] Time spent opening directory manager: real 0.004s user 0.001s sys 0.003s
I20260201 02:56:27.648515 16037 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 02:56:27.650334 16022 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260201 02:56:27.650521 16022 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-3/data,/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-3/wal
uuid: "94d535b533b04887be4fac8a82a48cb1"
format_stamp: "Formatted at 2026-02-01 02:56:21 on dist-test-slave-4krj"
I20260201 02:56:27.651613 16022 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-3/wal
metadata directory: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-3/wal
1 data directories: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 02:56:27.671171 16022 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 02:56:27.672317 16022 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260201 02:56:27.672686 16022 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 02:56:27.673825 16022 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
W20260201 02:56:27.675815 15594 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44996: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
I20260201 02:56:27.676712 16044 ts_tablet_manager.cc:548] Loading tablet metadata (0/1 complete)
I20260201 02:56:27.683565 16022 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260201 02:56:27.683722 16022 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.008s user 0.000s sys 0.001s
I20260201 02:56:27.683940 16022 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260201 02:56:27.687491 16022 ts_tablet_manager.cc:616] Registered 1 tablets
I20260201 02:56:27.687680 16022 ts_tablet_manager.cc:595] Time spent register tablets: real 0.004s user 0.003s sys 0.000s
I20260201 02:56:27.688148 16044 tablet_bootstrap.cc:492] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1: Bootstrap starting.
I20260201 02:56:27.737279 16022 rpc_server.cc:307] RPC server started. Bound to: 127.13.170.4:46319
I20260201 02:56:27.737327 16150 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.170.4:46319 every 8 connection(s)
I20260201 02:56:27.739126 16022 server_base.cc:1192] Dumped server information to /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-3/data/info.pb
I20260201 02:56:27.744532 13992 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskfoNO09/build/asan/bin/kudu as pid 16022
I20260201 02:56:27.744793 13992 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-taskfoNO09/build/asan/bin/kudu pid 15419
W20260201 02:56:27.749624 15461 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60874: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
I20260201 02:56:27.757220 16044 log.cc:826] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1: Log is configured to *not* fsync() on all Append() calls
I20260201 02:56:27.761812 16151 heartbeater.cc:344] Connected to a master server at 127.13.170.62:35815
I20260201 02:56:27.762256 16151 heartbeater.cc:461] Registering TS with master...
I20260201 02:56:27.763491 16151 heartbeater.cc:507] Master 127.13.170.62:35815 requested a full tablet report, sending...
I20260201 02:56:27.767095 15227 ts_manager.cc:194] Re-registered known tserver with Master: 94d535b533b04887be4fac8a82a48cb1 (127.13.170.4:46319)
I20260201 02:56:27.768409 15227 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.13.170.4:36713
I20260201 02:56:27.769953 15542 generic_service.cc:196] Checking for leaks (request via RPC)
I20260201 02:56:27.885064 13992 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskfoNO09/build/asan/bin/kudu with pid 15419
I20260201 02:56:27.906723 13992 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskfoNO09/build/asan/bin/kudu
/tmp/dist-test-taskfoNO09/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.170.2:36827
--local_ip_for_outbound_sockets=127.13.170.2
--tserver_master_addrs=127.13.170.62:35815
--webserver_port=44123
--webserver_interface=127.13.170.2
--builtin_ntp_servers=127.13.170.20:35371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
W20260201 02:56:27.919667 15594 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44996: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:27.920166 15593 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44996: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:27.920547 15592 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44996: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:27.945190 15592 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44996: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:27.954229 15592 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44996: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
I20260201 02:56:27.963368 15853 meta_cache.cc:1510] marking tablet server 7c282a4e4a074f7cb7fada1519e23c9b (127.13.170.2:36827) as failed
W20260201 02:56:28.003054 15592 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44996: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:28.016845 15592 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44996: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:28.056687 15592 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44996: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:28.066144 15592 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44996: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
I20260201 02:56:28.080752 16044 tablet_bootstrap.cc:492] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1: Bootstrap replayed 1/1 log segments. Stats: ops{read=106 overwritten=0 applied=106 ignored=0} inserts{seen=5250 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 02:56:28.081372 16044 tablet_bootstrap.cc:492] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1: Bootstrap complete.
I20260201 02:56:28.082825 16044 ts_tablet_manager.cc:1403] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1: Time spent bootstrapping tablet: real 0.395s user 0.371s sys 0.020s
I20260201 02:56:28.088295 16044 raft_consensus.cc:359] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d535b533b04887be4fac8a82a48cb1" member_type: VOTER last_known_addr { host: "127.13.170.4" port: 46319 } } peers { permanent_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 36827 } } peers { permanent_uuid: "d74315e006374d648477a8e6109e44a7" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 41669 } }
I20260201 02:56:28.089157 16044 raft_consensus.cc:740] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94d535b533b04887be4fac8a82a48cb1, State: Initialized, Role: FOLLOWER
I20260201 02:56:28.089927 16044 consensus_queue.cc:260] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 106, Last appended: 1.106, Last appended by leader: 106, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d535b533b04887be4fac8a82a48cb1" member_type: VOTER last_known_addr { host: "127.13.170.4" port: 46319 } } peers { permanent_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 36827 } } peers { permanent_uuid: "d74315e006374d648477a8e6109e44a7" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 41669 } }
I20260201 02:56:28.091202 16151 heartbeater.cc:499] Master 127.13.170.62:35815 was elected leader, sending a full tablet report...
I20260201 02:56:28.091998 16044 ts_tablet_manager.cc:1434] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1: Time spent starting tablet: real 0.009s user 0.008s sys 0.000s
W20260201 02:56:28.098176 16066 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42140: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:56:28.107677 16066 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42140: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:56:28.119339 15592 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44996: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:28.131002 15592 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44996: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:28.156679 15592 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44996: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:28.164758 16066 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42140: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:56:28.177322 16066 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42140: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:56:28.188766 15592 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44996: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:28.200119 15592 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44996: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:28.239156 16066 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42140: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:56:28.249130 16066 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42140: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:56:28.266803 15592 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44996: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:28.275171 15592 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44996: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:28.316170 16160 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260201 02:56:28.316550 16160 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260201 02:56:28.316699 16160 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260201 02:56:28.321753 16066 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42140: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:56:28.322992 16065 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42140: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:56:28.326272 16160 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260201 02:56:28.326516 16160 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.170.2
W20260201 02:56:28.332696 16065 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42140: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
I20260201 02:56:28.337713 16160 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.170.20:35371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.170.2:36827
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.170.2
--webserver_port=44123
--tserver_master_addrs=127.13.170.62:35815
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.170.2
--log_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3722ed49c19ce54c7feae2fa944e32b1d4ed8d2d
build type FASTDEBUG
built by None at 01 Feb 2026 02:43:22 UTC on 24a791456cd2
build id 10288
ASAN enabled
I20260201 02:56:28.339543 16160 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260201 02:56:28.341550 16160 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260201 02:56:28.343256 16161 raft_consensus.cc:493] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 02:56:28.343530 16161 raft_consensus.cc:515] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d535b533b04887be4fac8a82a48cb1" member_type: VOTER last_known_addr { host: "127.13.170.4" port: 46319 } } peers { permanent_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 36827 } } peers { permanent_uuid: "d74315e006374d648477a8e6109e44a7" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 41669 } }
I20260201 02:56:28.345491 16161 leader_election.cc:290] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7c282a4e4a074f7cb7fada1519e23c9b (127.13.170.2:36827), d74315e006374d648477a8e6109e44a7 (127.13.170.3:41669)
W20260201 02:56:28.346764 16038 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.170.2:36827: connect: Connection refused (error 111)
W20260201 02:56:28.353742 15592 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44996: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:28.356510 16038 leader_election.cc:336] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7c282a4e4a074f7cb7fada1519e23c9b (127.13.170.2:36827): Network error: Client connection negotiation failed: client connection to 127.13.170.2:36827: connect: Connection refused (error 111)
W20260201 02:56:28.359921 16170 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 02:56:28.360019 16173 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 02:56:28.359925 16171 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 02:56:28.361055 15634 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0faa3d899dba409fa6df255630da23e4" candidate_uuid: "94d535b533b04887be4fac8a82a48cb1" candidate_term: 3 candidate_status { last_received { term: 1 index: 106 } } ignore_live_leader: false dest_uuid: "d74315e006374d648477a8e6109e44a7" is_pre_election: true
I20260201 02:56:28.361361 15634 raft_consensus.cc:2468] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94d535b533b04887be4fac8a82a48cb1 in term 2.
I20260201 02:56:28.362295 16160 server_base.cc:1060] running on GCE node
I20260201 02:56:28.362254 16039 leader_election.cc:304] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 94d535b533b04887be4fac8a82a48cb1, d74315e006374d648477a8e6109e44a7; no voters: 7c282a4e4a074f7cb7fada1519e23c9b
W20260201 02:56:28.362517 15592 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44996: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
I20260201 02:56:28.363042 16161 raft_consensus.cc:2804] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 02:56:28.363205 16161 raft_consensus.cc:493] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 02:56:28.363232 16160 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260201 02:56:28.363324 16161 raft_consensus.cc:3060] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 2 FOLLOWER]: Advancing to term 3
I20260201 02:56:28.364343 16160 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260201 02:56:28.365656 16160 hybrid_clock.cc:648] HybridClock initialized: now 1769914588365590 us; error 56 us; skew 500 ppm
I20260201 02:56:28.366036 16160 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 02:56:28.367426 16161 raft_consensus.cc:515] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d535b533b04887be4fac8a82a48cb1" member_type: VOTER last_known_addr { host: "127.13.170.4" port: 46319 } } peers { permanent_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 36827 } } peers { permanent_uuid: "d74315e006374d648477a8e6109e44a7" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 41669 } }
I20260201 02:56:28.368268 16161 leader_election.cc:290] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [CANDIDATE]: Term 3 election: Requested vote from peers 7c282a4e4a074f7cb7fada1519e23c9b (127.13.170.2:36827), d74315e006374d648477a8e6109e44a7 (127.13.170.3:41669)
I20260201 02:56:28.368810 16160 webserver.cc:492] Webserver started at http://127.13.170.2:44123/ using document root <none> and password file <none>
I20260201 02:56:28.369102 15634 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0faa3d899dba409fa6df255630da23e4" candidate_uuid: "94d535b533b04887be4fac8a82a48cb1" candidate_term: 3 candidate_status { last_received { term: 1 index: 106 } } ignore_live_leader: false dest_uuid: "d74315e006374d648477a8e6109e44a7"
I20260201 02:56:28.369343 15634 raft_consensus.cc:3060] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [term 2 FOLLOWER]: Advancing to term 3
W20260201 02:56:28.369628 16038 leader_election.cc:336] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 7c282a4e4a074f7cb7fada1519e23c9b (127.13.170.2:36827): Network error: Client connection negotiation failed: client connection to 127.13.170.2:36827: connect: Connection refused (error 111)
I20260201 02:56:28.369921 16160 fs_manager.cc:362] Metadata directory not provided
I20260201 02:56:28.370069 16160 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 02:56:28.371526 15634 raft_consensus.cc:2468] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94d535b533b04887be4fac8a82a48cb1 in term 3.
I20260201 02:56:28.372044 16039 leader_election.cc:304] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 94d535b533b04887be4fac8a82a48cb1, d74315e006374d648477a8e6109e44a7; no voters: 7c282a4e4a074f7cb7fada1519e23c9b
I20260201 02:56:28.372390 16161 raft_consensus.cc:2804] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 3 FOLLOWER]: Leader election won for term 3
I20260201 02:56:28.372928 16161 raft_consensus.cc:697] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 3 LEADER]: Becoming Leader. State: Replica: 94d535b533b04887be4fac8a82a48cb1, State: Running, Role: LEADER
I20260201 02:56:28.373507 16161 consensus_queue.cc:237] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 106, Committed index: 106, Last appended: 1.106, Last appended by leader: 106, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d535b533b04887be4fac8a82a48cb1" member_type: VOTER last_known_addr { host: "127.13.170.4" port: 46319 } } peers { permanent_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 36827 } } peers { permanent_uuid: "d74315e006374d648477a8e6109e44a7" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 41669 } }
I20260201 02:56:28.376757 16160 fs_manager.cc:714] Time spent opening directory manager: real 0.004s user 0.002s sys 0.002s
I20260201 02:56:28.378479 15227 catalog_manager.cc:5654] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 reported cstate change: term changed from 1 to 3, leader changed from 7c282a4e4a074f7cb7fada1519e23c9b (127.13.170.2) to 94d535b533b04887be4fac8a82a48cb1 (127.13.170.4). New cstate: current_term: 3 leader_uuid: "94d535b533b04887be4fac8a82a48cb1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d535b533b04887be4fac8a82a48cb1" member_type: VOTER last_known_addr { host: "127.13.170.4" port: 46319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 36827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d74315e006374d648477a8e6109e44a7" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 41669 } health_report { overall_health: UNKNOWN } } }
I20260201 02:56:28.380419 16181 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 02:56:28.382404 16160 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260201 02:56:28.382598 16160 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-1/data,/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-1/wal
uuid: "7c282a4e4a074f7cb7fada1519e23c9b"
format_stamp: "Formatted at 2026-02-01 02:56:20 on dist-test-slave-4krj"
I20260201 02:56:28.383685 16160 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 02:56:28.397158 15634 raft_consensus.cc:1275] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [term 3 FOLLOWER]: Refusing update from remote peer 94d535b533b04887be4fac8a82a48cb1: Log matching property violated. Preceding OpId in replica: term: 1 index: 106. Preceding OpId from leader: term: 3 index: 108. (index mismatch)
W20260201 02:56:28.397994 16038 consensus_peers.cc:597] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 -> Peer 7c282a4e4a074f7cb7fada1519e23c9b (127.13.170.2:36827): Couldn't send request to peer 7c282a4e4a074f7cb7fada1519e23c9b. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.2:36827: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260201 02:56:28.398089 16161 consensus_queue.cc:1048] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d74315e006374d648477a8e6109e44a7" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 41669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 107, Last known committed idx: 106, Time since last communication: 0.000s
I20260201 02:56:28.400714 16160 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 02:56:28.401952 16160 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260201 02:56:28.402297 16160 kserver.cc:163] Server-wide thread pool size limit: 3276
W20260201 02:56:28.403043 15821 meta_cache.cc:302] tablet 0faa3d899dba409fa6df255630da23e4: replica 7c282a4e4a074f7cb7fada1519e23c9b (127.13.170.2:36827) has failed: Network error: Client connection negotiation failed: client connection to 127.13.170.2:36827: connect: Connection refused (error 111)
I20260201 02:56:28.405097 16190 mvcc.cc:204] Tried to move back new op lower bound from 7249570154065870848 to 7249570153982468096. Current Snapshot: MvccSnapshot[applied={T|T < 7249570154065870848}]
I20260201 02:56:28.424734 16160 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260201 02:56:28.457288 16197 ts_tablet_manager.cc:548] Loading tablet metadata (0/1 complete)
I20260201 02:56:28.465018 16160 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260201 02:56:28.465157 16160 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.022s user 0.006s sys 0.008s
I20260201 02:56:28.465305 16160 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260201 02:56:28.470510 16197 tablet_bootstrap.cc:492] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b: Bootstrap starting.
I20260201 02:56:28.475850 16160 ts_tablet_manager.cc:616] Registered 1 tablets
I20260201 02:56:28.476063 16160 ts_tablet_manager.cc:595] Time spent register tablets: real 0.011s user 0.005s sys 0.000s
W20260201 02:56:28.485415 15592 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44996: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:28.491228 15592 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44996: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:28.498807 15592 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44996: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
I20260201 02:56:28.562438 16197 log.cc:826] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b: Log is configured to *not* fsync() on all Append() calls
I20260201 02:56:28.856190 16160 rpc_server.cc:307] RPC server started. Bound to: 127.13.170.2:36827
I20260201 02:56:28.856282 16309 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.170.2:36827 every 8 connection(s)
I20260201 02:56:28.858453 16160 server_base.cc:1192] Dumped server information to /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-1/data/info.pb
I20260201 02:56:28.861675 13992 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskfoNO09/build/asan/bin/kudu as pid 16160
I20260201 02:56:28.861922 13992 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-taskfoNO09/build/asan/bin/kudu pid 15288
I20260201 02:56:28.945935 15410 generic_service.cc:196] Checking for leaks (request via RPC)
I20260201 02:56:28.965243 16310 heartbeater.cc:344] Connected to a master server at 127.13.170.62:35815
I20260201 02:56:28.966920 16310 heartbeater.cc:461] Registering TS with master...
I20260201 02:56:28.968194 16310 heartbeater.cc:507] Master 127.13.170.62:35815 requested a full tablet report, sending...
I20260201 02:56:28.971818 15227 ts_manager.cc:194] Re-registered known tserver with Master: 7c282a4e4a074f7cb7fada1519e23c9b (127.13.170.2:36827)
I20260201 02:56:28.973361 15227 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.13.170.2:58987
W20260201 02:56:28.985602 16038 consensus_peers.cc:597] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 -> Peer 7c282a4e4a074f7cb7fada1519e23c9b (127.13.170.2:36827): Couldn't send request to peer 7c282a4e4a074f7cb7fada1519e23c9b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
I20260201 02:56:29.118330 16197 tablet_bootstrap.cc:492] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b: Bootstrap replayed 1/1 log segments. Stats: ops{read=108 overwritten=0 applied=106 ignored=0} inserts{seen=5250 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 2 replicates
I20260201 02:56:29.119253 16197 tablet_bootstrap.cc:492] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b: Bootstrap complete.
I20260201 02:56:29.120967 16197 ts_tablet_manager.cc:1403] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b: Time spent bootstrapping tablet: real 0.651s user 0.502s sys 0.090s
I20260201 02:56:29.127527 16197 raft_consensus.cc:359] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [term 2 FOLLOWER]: Replica starting. Triggering 2 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d535b533b04887be4fac8a82a48cb1" member_type: VOTER last_known_addr { host: "127.13.170.4" port: 46319 } } peers { permanent_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 36827 } } peers { permanent_uuid: "d74315e006374d648477a8e6109e44a7" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 41669 } }
I20260201 02:56:29.139374 16197 raft_consensus.cc:740] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c282a4e4a074f7cb7fada1519e23c9b, State: Initialized, Role: FOLLOWER
I20260201 02:56:29.140347 16197 consensus_queue.cc:260] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 106, Last appended: 1.108, Last appended by leader: 108, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d535b533b04887be4fac8a82a48cb1" member_type: VOTER last_known_addr { host: "127.13.170.4" port: 46319 } } peers { permanent_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 36827 } } peers { permanent_uuid: "d74315e006374d648477a8e6109e44a7" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 41669 } }
I20260201 02:56:29.141618 16310 heartbeater.cc:499] Master 127.13.170.62:35815 was elected leader, sending a full tablet report...
I20260201 02:56:29.142377 16197 ts_tablet_manager.cc:1434] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b: Time spent starting tablet: real 0.021s user 0.020s sys 0.001s
I20260201 02:56:29.164695 16261 raft_consensus.cc:3060] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [term 2 FOLLOWER]: Advancing to term 3
I20260201 02:56:29.170446 16261 pending_rounds.cc:85] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b: Aborting all ops after (but not including) 106
I20260201 02:56:29.170667 16261 pending_rounds.cc:107] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b: Aborting uncommitted WRITE_OP operation due to leader change: 1.107
I20260201 02:56:29.171622 16261 pending_rounds.cc:107] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b: Aborting uncommitted WRITE_OP operation due to leader change: 1.108
I20260201 02:56:29.190816 13992 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskfoNO09/build/asan/bin/kudu with pid 15288
I20260201 02:56:29.233484 13992 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskfoNO09/build/asan/bin/kudu
/tmp/dist-test-taskfoNO09/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.170.1:41937
--local_ip_for_outbound_sockets=127.13.170.1
--tserver_master_addrs=127.13.170.62:35815
--webserver_port=35425
--webserver_interface=127.13.170.1
--builtin_ntp_servers=127.13.170.20:35371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
I20260201 02:56:29.299757 16319 mvcc.cc:204] Tried to move back new op lower bound from 7249570157153050624 to 7249570153982468096. Current Snapshot: MvccSnapshot[applied={T|T < 7249570155273412608}]
W20260201 02:56:29.497004 15852 scanner-internal.cc:458] Time spent opening tablet: real 4.074s user 0.008s sys 0.000s
W20260201 02:56:29.506470 15854 scanner-internal.cc:458] Time spent opening tablet: real 4.063s user 0.008s sys 0.000s
W20260201 02:56:29.582368 15853 scanner-internal.cc:458] Time spent opening tablet: real 4.042s user 0.009s sys 0.000s
W20260201 02:56:29.847863 16324 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260201 02:56:29.848455 16324 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260201 02:56:29.848665 16324 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260201 02:56:29.862936 16324 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260201 02:56:29.863286 16324 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.170.1
I20260201 02:56:29.879958 16324 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.170.20:35371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.170.1:41937
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.170.1
--webserver_port=35425
--tserver_master_addrs=127.13.170.62:35815
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.170.1
--log_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3722ed49c19ce54c7feae2fa944e32b1d4ed8d2d
build type FASTDEBUG
built by None at 01 Feb 2026 02:43:22 UTC on 24a791456cd2
build id 10288
ASAN enabled
I20260201 02:56:29.882450 16324 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260201 02:56:29.885015 16324 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 02:56:29.910161 16332 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 02:56:29.917402 16333 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 02:56:29.931226 16336 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 02:56:29.931598 16324 server_base.cc:1060] running on GCE node
I20260201 02:56:29.934098 16324 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260201 02:56:29.942677 16324 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260201 02:56:29.949867 16324 hybrid_clock.cc:648] HybridClock initialized: now 1769914589949724 us; error 130 us; skew 500 ppm
I20260201 02:56:29.950433 16324 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 02:56:29.991060 16324 webserver.cc:492] Webserver started at http://127.13.170.1:35425/ using document root <none> and password file <none>
I20260201 02:56:29.992468 16324 fs_manager.cc:362] Metadata directory not provided
I20260201 02:56:29.992715 16324 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 02:56:30.013356 16324 fs_manager.cc:714] Time spent opening directory manager: real 0.014s user 0.003s sys 0.001s
I20260201 02:56:30.034021 16341 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 02:56:30.036728 16324 fs_manager.cc:730] Time spent opening block manager: real 0.021s user 0.003s sys 0.004s
I20260201 02:56:30.037055 16324 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-0/data,/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-0/wal
uuid: "f4dd4e7188e44b518d7df7246414a2d6"
format_stamp: "Formatted at 2026-02-01 02:56:19 on dist-test-slave-4krj"
I20260201 02:56:30.038205 16324 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 02:56:30.143374 16324 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 02:56:30.145542 16324 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260201 02:56:30.146203 16324 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 02:56:30.154587 16324 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260201 02:56:30.171798 16324 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260201 02:56:30.172015 16324 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260201 02:56:30.172206 16324 ts_tablet_manager.cc:616] Registered 0 tablets
I20260201 02:56:30.172309 16324 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260201 02:56:31.416388 16459 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.170.1:41937 every 8 connection(s)
I20260201 02:56:31.421100 16324 rpc_server.cc:307] RPC server started. Bound to: 127.13.170.1:41937
I20260201 02:56:31.423138 16324 server_base.cc:1192] Dumped server information to /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-0/data/info.pb
I20260201 02:56:31.432662 13992 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskfoNO09/build/asan/bin/kudu as pid 16324
I20260201 02:56:31.432896 13992 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-taskfoNO09/build/asan/bin/kudu pid 15551
I20260201 02:56:31.475268 16460 heartbeater.cc:344] Connected to a master server at 127.13.170.62:35815
I20260201 02:56:31.475767 16460 heartbeater.cc:461] Registering TS with master...
I20260201 02:56:31.477093 16460 heartbeater.cc:507] Master 127.13.170.62:35815 requested a full tablet report, sending...
I20260201 02:56:31.480093 15227 ts_manager.cc:194] Re-registered known tserver with Master: f4dd4e7188e44b518d7df7246414a2d6 (127.13.170.1:41937)
I20260201 02:56:31.481302 15227 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.13.170.1:53927
I20260201 02:56:31.503109 15674 generic_service.cc:196] Checking for leaks (request via RPC)
I20260201 02:56:31.782174 13992 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskfoNO09/build/asan/bin/kudu with pid 15551
I20260201 02:56:31.887116 13992 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskfoNO09/build/asan/bin/kudu
/tmp/dist-test-taskfoNO09/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.170.3:41669
--local_ip_for_outbound_sockets=127.13.170.3
--tserver_master_addrs=127.13.170.62:35815
--webserver_port=40805
--webserver_interface=127.13.170.3
--builtin_ntp_servers=127.13.170.20:35371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
W20260201 02:56:31.916790 16039 consensus_peers.cc:597] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 -> Peer d74315e006374d648477a8e6109e44a7 (127.13.170.3:41669): Couldn't send request to peer d74315e006374d648477a8e6109e44a7. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.3:41669: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260201 02:56:31.982355 15854 meta_cache.cc:1510] marking tablet server d74315e006374d648477a8e6109e44a7 (127.13.170.3:41669) as failed
W20260201 02:56:31.982597 15854 meta_cache.cc:302] tablet 0faa3d899dba409fa6df255630da23e4: replica d74315e006374d648477a8e6109e44a7 (127.13.170.3:41669) has failed: Network error: TS failed: Client connection negotiation failed: client connection to 127.13.170.3:41669: connect: Connection refused (error 111)
W20260201 02:56:32.411741 16039 consensus_peers.cc:597] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 -> Peer d74315e006374d648477a8e6109e44a7 (127.13.170.3:41669): Couldn't send request to peer d74315e006374d648477a8e6109e44a7. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.3:41669: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260201 02:56:32.454563 16468 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260201 02:56:32.455085 16468 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260201 02:56:32.455245 16468 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260201 02:56:32.469187 16468 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260201 02:56:32.469465 16468 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.170.3
I20260201 02:56:32.485138 16468 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.170.20:35371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.170.3:41669
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.170.3
--webserver_port=40805
--tserver_master_addrs=127.13.170.62:35815
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.170.3
--log_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3722ed49c19ce54c7feae2fa944e32b1d4ed8d2d
build type FASTDEBUG
built by None at 01 Feb 2026 02:43:22 UTC on 24a791456cd2
build id 10288
ASAN enabled
I20260201 02:56:32.485479 16460 heartbeater.cc:499] Master 127.13.170.62:35815 was elected leader, sending a full tablet report...
I20260201 02:56:32.487536 16468 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260201 02:56:32.490080 16468 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 02:56:32.510430 16478 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 02:56:32.515975 16479 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 02:56:32.516743 16481 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 02:56:32.521781 16468 server_base.cc:1060] running on GCE node
I20260201 02:56:32.522745 16468 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260201 02:56:32.524338 16468 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260201 02:56:32.525631 16468 hybrid_clock.cc:648] HybridClock initialized: now 1769914592525577 us; error 42 us; skew 500 ppm
I20260201 02:56:32.526027 16468 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 02:56:32.539137 16468 webserver.cc:492] Webserver started at http://127.13.170.3:40805/ using document root <none> and password file <none>
I20260201 02:56:32.540376 16468 fs_manager.cc:362] Metadata directory not provided
I20260201 02:56:32.540599 16468 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 02:56:32.562276 16468 fs_manager.cc:714] Time spent opening directory manager: real 0.018s user 0.003s sys 0.005s
I20260201 02:56:32.572850 16487 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 02:56:32.589784 16468 fs_manager.cc:730] Time spent opening block manager: real 0.024s user 0.002s sys 0.001s
I20260201 02:56:32.595335 16468 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-2/data,/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-2/wal
uuid: "d74315e006374d648477a8e6109e44a7"
format_stamp: "Formatted at 2026-02-01 02:56:20 on dist-test-slave-4krj"
I20260201 02:56:32.596809 16468 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 02:56:32.652720 16468 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 02:56:32.654500 16468 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260201 02:56:32.654983 16468 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 02:56:32.667086 16468 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260201 02:56:32.695689 16494 ts_tablet_manager.cc:548] Loading tablet metadata (0/1 complete)
I20260201 02:56:32.706923 16468 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260201 02:56:32.707126 16468 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.030s user 0.011s sys 0.008s
I20260201 02:56:32.708010 16468 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260201 02:56:32.712671 16468 ts_tablet_manager.cc:616] Registered 1 tablets
I20260201 02:56:32.714290 16468 ts_tablet_manager.cc:595] Time spent register tablets: real 0.006s user 0.001s sys 0.004s
I20260201 02:56:32.714318 16494 tablet_bootstrap.cc:492] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7: Bootstrap starting.
I20260201 02:56:32.933794 16494 log.cc:826] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7: Log is configured to *not* fsync() on all Append() calls
W20260201 02:56:32.960685 16039 consensus_peers.cc:597] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 -> Peer d74315e006374d648477a8e6109e44a7 (127.13.170.3:41669): Couldn't send request to peer d74315e006374d648477a8e6109e44a7. Status: Network error: Client connection negotiation failed: client connection to 127.13.170.3:41669: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260201 02:56:33.143085 16602 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.170.3:41669 every 8 connection(s)
I20260201 02:56:33.144935 16468 rpc_server.cc:307] RPC server started. Bound to: 127.13.170.3:41669
I20260201 02:56:33.148574 13992 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskfoNO09/build/asan/bin/kudu as pid 16468
I20260201 02:56:33.149888 16468 server_base.cc:1192] Dumped server information to /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-2/data/info.pb
I20260201 02:56:33.345719 16603 heartbeater.cc:344] Connected to a master server at 127.13.170.62:35815
I20260201 02:56:33.346896 16603 heartbeater.cc:461] Registering TS with master...
I20260201 02:56:33.362257 16603 heartbeater.cc:507] Master 127.13.170.62:35815 requested a full tablet report, sending...
I20260201 02:56:33.368467 15227 ts_manager.cc:194] Re-registered known tserver with Master: d74315e006374d648477a8e6109e44a7 (127.13.170.3:41669)
I20260201 02:56:33.370151 15227 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.13.170.3:49043
W20260201 02:56:33.544943 16039 consensus_peers.cc:597] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 -> Peer d74315e006374d648477a8e6109e44a7 (127.13.170.3:41669): Couldn't send request to peer d74315e006374d648477a8e6109e44a7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 16: this message will repeat every 5th retry.
W20260201 02:56:34.037767 16039 consensus_peers.cc:597] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 -> Peer d74315e006374d648477a8e6109e44a7 (127.13.170.3:41669): Couldn't send request to peer d74315e006374d648477a8e6109e44a7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 21: this message will repeat every 5th retry.
I20260201 02:56:34.374043 16603 heartbeater.cc:499] Master 127.13.170.62:35815 was elected leader, sending a full tablet report...
I20260201 02:56:34.407558 16244 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260201 02:56:34.511497 16538 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260201 02:56:34.529099 16086 tablet_service.cc:1467] Tablet server has 1 leaders and 3 scanners
W20260201 02:56:34.542714 16039 consensus_peers.cc:597] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 -> Peer d74315e006374d648477a8e6109e44a7 (127.13.170.3:41669): Couldn't send request to peer d74315e006374d648477a8e6109e44a7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 26: this message will repeat every 5th retry.
I20260201 02:56:34.574858 16392 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260201 02:56:34.914587 16494 tablet_bootstrap.cc:492] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7: Bootstrap replayed 1/1 log segments. Stats: ops{read=359 overwritten=0 applied=358 ignored=0} inserts{seen=17800 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260201 02:56:34.915733 16494 tablet_bootstrap.cc:492] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7: Bootstrap complete.
I20260201 02:56:34.918639 16494 ts_tablet_manager.cc:1403] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7: Time spent bootstrapping tablet: real 2.206s user 1.653s sys 0.138s
I20260201 02:56:34.924893 16494 raft_consensus.cc:359] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [term 3 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d535b533b04887be4fac8a82a48cb1" member_type: VOTER last_known_addr { host: "127.13.170.4" port: 46319 } } peers { permanent_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 36827 } } peers { permanent_uuid: "d74315e006374d648477a8e6109e44a7" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 41669 } }
I20260201 02:56:34.975648 16494 raft_consensus.cc:740] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: d74315e006374d648477a8e6109e44a7, State: Initialized, Role: FOLLOWER
I20260201 02:56:34.976648 16494 consensus_queue.cc:260] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 358, Last appended: 3.359, Last appended by leader: 359, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d535b533b04887be4fac8a82a48cb1" member_type: VOTER last_known_addr { host: "127.13.170.4" port: 46319 } } peers { permanent_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 36827 } } peers { permanent_uuid: "d74315e006374d648477a8e6109e44a7" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 41669 } }
I20260201 02:56:35.001973 16494 ts_tablet_manager.cc:1434] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7: Time spent starting tablet: real 0.082s user 0.026s sys 0.024s
I20260201 02:56:41.232301 16086 tablet_service.cc:1467] Tablet server has 1 leaders and 3 scanners
I20260201 02:56:41.234059 16244 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260201 02:56:41.284320 16538 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260201 02:56:41.329526 16392 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260201 02:56:43.046953 15227 ts_manager.cc:284] Unset tserver state for 7c282a4e4a074f7cb7fada1519e23c9b from MAINTENANCE_MODE
I20260201 02:56:43.054615 15224 ts_manager.cc:284] Unset tserver state for 94d535b533b04887be4fac8a82a48cb1 from MAINTENANCE_MODE
I20260201 02:56:43.271837 16603 heartbeater.cc:507] Master 127.13.170.62:35815 requested a full tablet report, sending...
I20260201 02:56:43.275244 16151 heartbeater.cc:507] Master 127.13.170.62:35815 requested a full tablet report, sending...
I20260201 02:56:43.322481 16310 heartbeater.cc:507] Master 127.13.170.62:35815 requested a full tablet report, sending...
I20260201 02:56:43.514150 16460 heartbeater.cc:507] Master 127.13.170.62:35815 requested a full tablet report, sending...
I20260201 02:56:43.839789 15227 ts_manager.cc:284] Unset tserver state for f4dd4e7188e44b518d7df7246414a2d6 from MAINTENANCE_MODE
I20260201 02:56:43.864009 15227 ts_manager.cc:284] Unset tserver state for d74315e006374d648477a8e6109e44a7 from MAINTENANCE_MODE
W20260201 02:56:43.897127 15824 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.13.170.4:46319, user_credentials={real_user=slave}} blocked reactor thread for 45550.2us
I20260201 02:56:44.281836 16603 heartbeater.cc:507] Master 127.13.170.62:35815 requested a full tablet report, sending...
I20260201 02:56:44.285246 16151 heartbeater.cc:507] Master 127.13.170.62:35815 requested a full tablet report, sending...
I20260201 02:56:44.329910 16310 heartbeater.cc:507] Master 127.13.170.62:35815 requested a full tablet report, sending...
I20260201 02:56:44.522830 16460 heartbeater.cc:507] Master 127.13.170.62:35815 requested a full tablet report, sending...
I20260201 02:56:45.699986 15227 ts_manager.cc:295] Set tserver state for 94d535b533b04887be4fac8a82a48cb1 to MAINTENANCE_MODE
I20260201 02:56:45.709513 15229 ts_manager.cc:295] Set tserver state for f4dd4e7188e44b518d7df7246414a2d6 to MAINTENANCE_MODE
I20260201 02:56:45.985983 15229 ts_manager.cc:295] Set tserver state for d74315e006374d648477a8e6109e44a7 to MAINTENANCE_MODE
I20260201 02:56:46.196297 15229 ts_manager.cc:295] Set tserver state for 7c282a4e4a074f7cb7fada1519e23c9b to MAINTENANCE_MODE
I20260201 02:56:47.699458 16086 tablet_service.cc:1460] Tablet server 94d535b533b04887be4fac8a82a48cb1 set to quiescing
I20260201 02:56:47.699707 16086 tablet_service.cc:1467] Tablet server has 1 leaders and 3 scanners
I20260201 02:56:47.704941 16660 raft_consensus.cc:993] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1: : Instructing follower d74315e006374d648477a8e6109e44a7 to start an election
I20260201 02:56:47.705118 16660 raft_consensus.cc:1081] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 3 LEADER]: Signalling peer d74315e006374d648477a8e6109e44a7 to start an election
I20260201 02:56:47.710127 16764 raft_consensus.cc:993] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1: : Instructing follower d74315e006374d648477a8e6109e44a7 to start an election
I20260201 02:56:47.710290 16764 raft_consensus.cc:1081] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 3 LEADER]: Signalling peer d74315e006374d648477a8e6109e44a7 to start an election
I20260201 02:56:47.710492 16764 raft_consensus.cc:993] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1: : Instructing follower 7c282a4e4a074f7cb7fada1519e23c9b to start an election
I20260201 02:56:47.710583 16764 raft_consensus.cc:1081] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 3 LEADER]: Signalling peer 7c282a4e4a074f7cb7fada1519e23c9b to start an election
I20260201 02:56:47.711587 16557 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "0faa3d899dba409fa6df255630da23e4"
dest_uuid: "d74315e006374d648477a8e6109e44a7"
from {username='slave'} at 127.13.170.4:52335
I20260201 02:56:47.711983 16557 raft_consensus.cc:493] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 02:56:47.712332 16557 raft_consensus.cc:3060] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [term 3 FOLLOWER]: Advancing to term 4
I20260201 02:56:47.713636 16261 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "0faa3d899dba409fa6df255630da23e4"
dest_uuid: "7c282a4e4a074f7cb7fada1519e23c9b"
from {username='slave'} at 127.13.170.4:39219
I20260201 02:56:47.713927 16261 raft_consensus.cc:493] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 02:56:47.714120 16261 raft_consensus.cc:3060] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [term 3 FOLLOWER]: Advancing to term 4
I20260201 02:56:47.715186 16558 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "0faa3d899dba409fa6df255630da23e4"
dest_uuid: "d74315e006374d648477a8e6109e44a7"
from {username='slave'} at 127.13.170.4:52335
I20260201 02:56:47.717414 16261 raft_consensus.cc:515] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d535b533b04887be4fac8a82a48cb1" member_type: VOTER last_known_addr { host: "127.13.170.4" port: 46319 } } peers { permanent_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 36827 } } peers { permanent_uuid: "d74315e006374d648477a8e6109e44a7" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 41669 } }
I20260201 02:56:47.718395 16557 raft_consensus.cc:515] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d535b533b04887be4fac8a82a48cb1" member_type: VOTER last_known_addr { host: "127.13.170.4" port: 46319 } } peers { permanent_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 36827 } } peers { permanent_uuid: "d74315e006374d648477a8e6109e44a7" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 41669 } }
I20260201 02:56:47.718910 16558 raft_consensus.cc:493] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 02:56:47.719058 16558 raft_consensus.cc:3060] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [term 4 FOLLOWER]: Advancing to term 5
I20260201 02:56:47.721879 16558 raft_consensus.cc:515] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d535b533b04887be4fac8a82a48cb1" member_type: VOTER last_known_addr { host: "127.13.170.4" port: 46319 } } peers { permanent_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 36827 } } peers { permanent_uuid: "d74315e006374d648477a8e6109e44a7" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 41669 } }
I20260201 02:56:47.722995 16703 raft_consensus.cc:993] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1: : Instructing follower 7c282a4e4a074f7cb7fada1519e23c9b to start an election
I20260201 02:56:47.723130 16703 raft_consensus.cc:1081] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 3 LEADER]: Signalling peer 7c282a4e4a074f7cb7fada1519e23c9b to start an election
I20260201 02:56:47.726372 16558 leader_election.cc:290] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [CANDIDATE]: Term 5 election: Requested vote from peers 94d535b533b04887be4fac8a82a48cb1 (127.13.170.4:46319), 7c282a4e4a074f7cb7fada1519e23c9b (127.13.170.2:36827)
I20260201 02:56:47.729219 16265 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "0faa3d899dba409fa6df255630da23e4"
dest_uuid: "7c282a4e4a074f7cb7fada1519e23c9b"
from {username='slave'} at 127.13.170.4:39219
I20260201 02:56:47.729521 16265 raft_consensus.cc:493] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 02:56:47.729676 16265 raft_consensus.cc:3060] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [term 4 FOLLOWER]: Advancing to term 5
I20260201 02:56:47.733755 16265 raft_consensus.cc:515] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d535b533b04887be4fac8a82a48cb1" member_type: VOTER last_known_addr { host: "127.13.170.4" port: 46319 } } peers { permanent_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 36827 } } peers { permanent_uuid: "d74315e006374d648477a8e6109e44a7" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 41669 } }
I20260201 02:56:47.734968 16265 leader_election.cc:290] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [CANDIDATE]: Term 5 election: Requested vote from peers 94d535b533b04887be4fac8a82a48cb1 (127.13.170.4:46319), d74315e006374d648477a8e6109e44a7 (127.13.170.3:41669)
I20260201 02:56:47.737139 16261 leader_election.cc:290] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [CANDIDATE]: Term 4 election: Requested vote from peers 94d535b533b04887be4fac8a82a48cb1 (127.13.170.4:46319), d74315e006374d648477a8e6109e44a7 (127.13.170.3:41669)
I20260201 02:56:47.737637 16557 leader_election.cc:290] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [CANDIDATE]: Term 4 election: Requested vote from peers 94d535b533b04887be4fac8a82a48cb1 (127.13.170.4:46319), 7c282a4e4a074f7cb7fada1519e23c9b (127.13.170.2:36827)
I20260201 02:56:47.746697 16557 raft_consensus.cc:1240] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [term 5 FOLLOWER]: Rejecting Update request from peer 94d535b533b04887be4fac8a82a48cb1 for earlier term 3. Current term is 5. Ops: [3.1692-3.1692]
I20260201 02:56:47.748238 16764 consensus_queue.cc:1059] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d74315e006374d648477a8e6109e44a7" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 41669 }, Status: INVALID_TERM, Last received: 3.1691, Next index: 1692, Last known committed idx: 1691, Time since last communication: 0.000s
I20260201 02:56:47.750451 16660 raft_consensus.cc:3055] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 3 LEADER]: Stepping down as leader of term 3
I20260201 02:56:47.750552 16660 raft_consensus.cc:740] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 94d535b533b04887be4fac8a82a48cb1, State: Running, Role: LEADER
I20260201 02:56:47.750934 16660 consensus_queue.cc:260] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1691, Committed index: 1691, Last appended: 3.1693, Last appended by leader: 1693, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d535b533b04887be4fac8a82a48cb1" member_type: VOTER last_known_addr { host: "127.13.170.4" port: 46319 } } peers { permanent_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 36827 } } peers { permanent_uuid: "d74315e006374d648477a8e6109e44a7" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 41669 } }
I20260201 02:56:47.751596 16660 raft_consensus.cc:3060] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 3 FOLLOWER]: Advancing to term 5
I20260201 02:56:47.756696 16265 raft_consensus.cc:1240] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [term 5 FOLLOWER]: Rejecting Update request from peer 94d535b533b04887be4fac8a82a48cb1 for earlier term 3. Current term is 5. Ops: [3.1692-3.1692]
I20260201 02:56:47.773442 16557 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0faa3d899dba409fa6df255630da23e4" candidate_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" candidate_term: 4 candidate_status { last_received { term: 3 index: 1691 } } ignore_live_leader: true dest_uuid: "d74315e006374d648477a8e6109e44a7"
I20260201 02:56:47.774024 16557 raft_consensus.cc:2368] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c282a4e4a074f7cb7fada1519e23c9b for earlier term 4. Current term is 5.
I20260201 02:56:47.774931 16557 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0faa3d899dba409fa6df255630da23e4" candidate_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" candidate_term: 5 candidate_status { last_received { term: 3 index: 1691 } } ignore_live_leader: true dest_uuid: "d74315e006374d648477a8e6109e44a7"
I20260201 02:56:47.775324 16557 raft_consensus.cc:2393] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c282a4e4a074f7cb7fada1519e23c9b in current term 5: Already voted for candidate d74315e006374d648477a8e6109e44a7 in this term.
I20260201 02:56:47.776479 16187 leader_election.cc:400] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [CANDIDATE]: Term 4 election: Vote denied by peer d74315e006374d648477a8e6109e44a7 (127.13.170.3:41669) with higher term. Message: Invalid argument: T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c282a4e4a074f7cb7fada1519e23c9b for earlier term 4. Current term is 5.
I20260201 02:56:47.776623 16187 leader_election.cc:403] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260201 02:56:47.778259 16106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0faa3d899dba409fa6df255630da23e4" candidate_uuid: "d74315e006374d648477a8e6109e44a7" candidate_term: 5 candidate_status { last_received { term: 3 index: 1691 } } ignore_live_leader: true dest_uuid: "94d535b533b04887be4fac8a82a48cb1"
I20260201 02:56:47.778793 16106 raft_consensus.cc:2410] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d74315e006374d648477a8e6109e44a7 for term 5 because replica has last-logged OpId of term: 3 index: 1693, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 1691.
I20260201 02:56:47.778915 16105 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0faa3d899dba409fa6df255630da23e4" candidate_uuid: "d74315e006374d648477a8e6109e44a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 1691 } } ignore_live_leader: true dest_uuid: "94d535b533b04887be4fac8a82a48cb1"
I20260201 02:56:47.779122 16105 raft_consensus.cc:2368] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d74315e006374d648477a8e6109e44a7 for earlier term 4. Current term is 5.
I20260201 02:56:47.780172 16491 leader_election.cc:400] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [CANDIDATE]: Term 4 election: Vote denied by peer 94d535b533b04887be4fac8a82a48cb1 (127.13.170.4:46319) with higher term. Message: Invalid argument: T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d74315e006374d648477a8e6109e44a7 for earlier term 4. Current term is 5.
I20260201 02:56:47.780296 16491 leader_election.cc:403] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
W20260201 02:56:47.779973 16065 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42140: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
I20260201 02:56:47.787961 16105 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0faa3d899dba409fa6df255630da23e4" candidate_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" candidate_term: 4 candidate_status { last_received { term: 3 index: 1691 } } ignore_live_leader: true dest_uuid: "94d535b533b04887be4fac8a82a48cb1"
I20260201 02:56:47.788064 16106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0faa3d899dba409fa6df255630da23e4" candidate_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" candidate_term: 5 candidate_status { last_received { term: 3 index: 1691 } } ignore_live_leader: true dest_uuid: "94d535b533b04887be4fac8a82a48cb1"
I20260201 02:56:47.788283 16105 raft_consensus.cc:2368] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c282a4e4a074f7cb7fada1519e23c9b for earlier term 4. Current term is 5.
I20260201 02:56:47.788887 16189 leader_election.cc:304] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c282a4e4a074f7cb7fada1519e23c9b; no voters: 94d535b533b04887be4fac8a82a48cb1, d74315e006374d648477a8e6109e44a7
I20260201 02:56:47.810137 16850 raft_consensus.cc:2749] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer d74315e006374d648477a8e6109e44a7 (127.13.170.3:41669) with higher term. Message: Invalid argument: T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c282a4e4a074f7cb7fada1519e23c9b for earlier term 4. Current term is 5.
I20260201 02:56:47.811259 16851 raft_consensus.cc:2749] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 94d535b533b04887be4fac8a82a48cb1 (127.13.170.4:46319) with higher term. Message: Invalid argument: T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d74315e006374d648477a8e6109e44a7 for earlier term 4. Current term is 5.
I20260201 02:56:47.816884 16850 raft_consensus.cc:2749] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260201 02:56:47.818077 16261 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0faa3d899dba409fa6df255630da23e4" candidate_uuid: "d74315e006374d648477a8e6109e44a7" candidate_term: 5 candidate_status { last_received { term: 3 index: 1691 } } ignore_live_leader: true dest_uuid: "7c282a4e4a074f7cb7fada1519e23c9b"
I20260201 02:56:47.818080 16265 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0faa3d899dba409fa6df255630da23e4" candidate_uuid: "d74315e006374d648477a8e6109e44a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 1691 } } ignore_live_leader: true dest_uuid: "7c282a4e4a074f7cb7fada1519e23c9b"
I20260201 02:56:47.819144 16261 raft_consensus.cc:2393] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d74315e006374d648477a8e6109e44a7 in current term 5: Already voted for candidate 7c282a4e4a074f7cb7fada1519e23c9b in this term.
I20260201 02:56:47.820290 16488 leader_election.cc:304] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d74315e006374d648477a8e6109e44a7; no voters: 7c282a4e4a074f7cb7fada1519e23c9b, 94d535b533b04887be4fac8a82a48cb1
I20260201 02:56:47.821122 16851 raft_consensus.cc:2749] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260201 02:56:47.831741 16189 leader_election.cc:400] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [CANDIDATE]: Term 4 election: Vote denied by peer 94d535b533b04887be4fac8a82a48cb1 (127.13.170.4:46319) with higher term. Message: Invalid argument: T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c282a4e4a074f7cb7fada1519e23c9b for earlier term 4. Current term is 5.
W20260201 02:56:47.863085 16222 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42434: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:56:47.877889 16064 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42140: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:56:47.885130 16222 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42434: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:56:47.903988 16518 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36450: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:47.916921 16062 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42140: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:56:47.933143 16222 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42434: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:56:47.947602 16518 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36450: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:47.961494 16064 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42140: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:56:47.976862 16222 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42434: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:56:47.993237 16518 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36450: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
I20260201 02:56:48.007513 16244 tablet_service.cc:1460] Tablet server 7c282a4e4a074f7cb7fada1519e23c9b set to quiescing
I20260201 02:56:48.007782 16244 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
W20260201 02:56:48.013839 16065 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42140: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:56:48.023576 16660 raft_consensus.cc:670] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1: failed to trigger leader election: Illegal state: leader elections are disabled
W20260201 02:56:48.032773 16222 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42434: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:56:48.050002 16518 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36450: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:48.070933 16064 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42140: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:56:48.091040 16222 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42434: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:56:48.110176 16518 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36450: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:48.141400 16061 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42140: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:56:48.168525 16222 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42434: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:56:48.199625 16518 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36450: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:48.230882 16064 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42140: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:56:48.248493 16854 raft_consensus.cc:670] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b: failed to trigger leader election: Illegal state: leader elections are disabled
W20260201 02:56:48.265647 16222 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42434: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
I20260201 02:56:48.292050 16392 tablet_service.cc:1460] Tablet server f4dd4e7188e44b518d7df7246414a2d6 set to quiescing
I20260201 02:56:48.292328 16392 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
W20260201 02:56:48.293437 16518 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36450: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:48.328276 16064 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42140: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:56:48.359714 16222 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42434: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
I20260201 02:56:48.385387 16538 tablet_service.cc:1460] Tablet server d74315e006374d648477a8e6109e44a7 set to quiescing
I20260201 02:56:48.385663 16538 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
W20260201 02:56:48.389734 16518 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36450: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:48.428896 16064 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42140: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:56:48.452195 16884 raft_consensus.cc:670] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7: failed to trigger leader election: Illegal state: leader elections are disabled
W20260201 02:56:48.462890 16222 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42434: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:56:48.495410 16518 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36450: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:48.530776 16062 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42140: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:56:48.569555 16222 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42434: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:56:48.606140 16518 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36450: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:48.646432 16062 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42140: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:56:48.686182 16222 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42434: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:56:48.726743 16518 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36450: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:48.769562 16063 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42140: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:56:48.811638 16222 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42434: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:56:48.851933 16518 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36450: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:48.895794 16064 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42140: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:56:48.937251 16222 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42434: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:56:48.979396 16518 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36450: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:49.028481 16061 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42140: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:56:49.078172 16222 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42434: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:56:49.127041 16518 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36450: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:49.186097 16062 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42140: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:56:49.236636 16222 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42434: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:56:49.285566 16518 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36450: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:49.341151 16063 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42140: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:56:49.394323 16222 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42434: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:56:49.446581 16518 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36450: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:49.504743 16064 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42140: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:56:49.560487 16222 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42434: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:56:49.616235 16518 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36450: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:49.675660 16063 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42140: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
I20260201 02:56:49.722944 16086 tablet_service.cc:1460] Tablet server 94d535b533b04887be4fac8a82a48cb1 set to quiescing
I20260201 02:56:49.723315 16086 tablet_service.cc:1467] Tablet server has 0 leaders and 1 scanners
W20260201 02:56:49.736754 16222 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42434: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:56:49.795925 16518 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36450: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:49.856264 16061 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42140: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:56:49.915619 16222 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42434: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:56:49.979365 16518 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36450: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:50.047065 16061 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42140: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:56:50.110394 16222 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42434: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:56:50.176023 16518 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36450: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:50.245405 16061 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42140: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:56:50.312085 16222 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42434: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:56:50.380636 16518 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36450: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:50.454505 16061 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42140: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:56:50.526051 16222 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42434: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:56:50.595629 16518 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36450: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:50.668053 16061 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42140: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:56:50.743659 16222 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42434: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:56:50.819177 16518 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36450: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:50.897832 16061 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42140: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:56:50.974483 16222 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42434: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:56:51.052191 16518 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36450: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:51.133592 16061 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42140: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:56:51.214326 16222 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42434: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:56:51.293282 16518 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36450: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
I20260201 02:56:51.303026 16086 tablet_service.cc:1460] Tablet server 94d535b533b04887be4fac8a82a48cb1 set to quiescing
I20260201 02:56:51.303297 16086 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
W20260201 02:56:51.374709 16061 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42140: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
I20260201 02:56:51.442626 13992 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-taskfoNO09/build/asan/bin/kudu pid 16022
I20260201 02:56:51.449985 16146 generic_service.cc:196] Checking for leaks (request via RPC)
W20260201 02:56:51.456660 16222 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42434: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:56:51.542493 16518 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36450: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
I20260201 02:56:51.649024 13992 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskfoNO09/build/asan/bin/kudu with pid 16022
W20260201 02:56:51.649017 16061 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42140: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:56:51.698374 15824 meta_cache.cc:302] tablet 0faa3d899dba409fa6df255630da23e4: replica 94d535b533b04887be4fac8a82a48cb1 (127.13.170.4:46319) has failed: Network error: recv got EOF from 127.13.170.4:46319 (error 108)
I20260201 02:56:51.699029 13992 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskfoNO09/build/asan/bin/kudu
/tmp/dist-test-taskfoNO09/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.170.4:46319
--local_ip_for_outbound_sockets=127.13.170.4
--tserver_master_addrs=127.13.170.62:35815
--webserver_port=34937
--webserver_interface=127.13.170.4
--builtin_ntp_servers=127.13.170.20:35371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
W20260201 02:56:51.712180 16222 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42434: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:56:51.712217 16221 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42434: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:56:51.718027 16518 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36450: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:51.720924 16518 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36450: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:51.736168 16221 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42434: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:56:51.747596 16518 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36450: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:51.749290 16518 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36450: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:51.759902 16221 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42434: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:56:51.769951 16221 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42434: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:56:51.781764 16221 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42434: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:56:51.783354 16518 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36450: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:51.785785 16518 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36450: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:51.795135 16518 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36450: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:51.823563 16221 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42434: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:56:51.825429 16221 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42434: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:56:51.839854 16518 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36450: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:51.841187 16517 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36450: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:51.873355 16221 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42434: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:56:51.877714 16221 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42434: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:56:51.896153 16221 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42434: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:56:51.898134 16517 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36450: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:51.917098 16517 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36450: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:51.937573 16221 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42434: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:56:51.965101 16221 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42434: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:56:51.985592 16517 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36450: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:51.986143 16518 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36450: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:52.034737 16221 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42434: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:56:52.038964 16221 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42434: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:56:52.050698 16221 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42434: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:56:52.063095 16518 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36450: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:52.067436 16518 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36450: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:52.116658 16912 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260201 02:56:52.117069 16912 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260201 02:56:52.117215 16912 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260201 02:56:52.128435 16912 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
I20260201 02:56:52.128433 15854 meta_cache.cc:1510] marking tablet server 94d535b533b04887be4fac8a82a48cb1 (127.13.170.4:46319) as failed
W20260201 02:56:52.128716 16912 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.170.4
I20260201 02:56:52.140760 16912 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.170.20:35371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.170.4:46319
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-3/data/info.pb
--webserver_interface=127.13.170.4
--webserver_port=34937
--tserver_master_addrs=127.13.170.62:35815
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.170.4
--log_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-3/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3722ed49c19ce54c7feae2fa944e32b1d4ed8d2d
build type FASTDEBUG
built by None at 01 Feb 2026 02:43:22 UTC on 24a791456cd2
build id 10288
ASAN enabled
I20260201 02:56:52.142549 16912 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260201 02:56:52.144594 16912 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 02:56:52.152658 16221 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42434: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:56:52.154903 16221 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42434: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:56:52.157008 16919 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 02:56:52.157132 16918 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 02:56:52.158716 16921 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 02:56:52.160141 16912 server_base.cc:1060] running on GCE node
I20260201 02:56:52.161096 16912 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260201 02:56:52.162218 16912 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260201 02:56:52.163552 16912 hybrid_clock.cc:648] HybridClock initialized: now 1769914612163482 us; error 70 us; skew 500 ppm
I20260201 02:56:52.164093 16912 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 02:56:52.168562 16912 webserver.cc:492] Webserver started at http://127.13.170.4:34937/ using document root <none> and password file <none>
I20260201 02:56:52.169509 16912 fs_manager.cc:362] Metadata directory not provided
I20260201 02:56:52.169715 16912 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 02:56:52.176592 16912 fs_manager.cc:714] Time spent opening directory manager: real 0.004s user 0.000s sys 0.004s
I20260201 02:56:52.180420 16927 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 02:56:52.182045 16912 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260201 02:56:52.182276 16912 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-3/data,/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-3/wal
uuid: "94d535b533b04887be4fac8a82a48cb1"
format_stamp: "Formatted at 2026-02-01 02:56:21 on dist-test-slave-4krj"
I20260201 02:56:52.183183 16912 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-3/wal
metadata directory: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-3/wal
1 data directories: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260201 02:56:52.185339 16518 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36450: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:52.186344 16518 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36450: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
I20260201 02:56:52.202342 16912 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 02:56:52.203295 16912 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260201 02:56:52.203572 16912 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 02:56:52.204567 16912 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260201 02:56:52.206884 16934 ts_tablet_manager.cc:548] Loading tablet metadata (0/1 complete)
I20260201 02:56:52.213723 16912 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260201 02:56:52.213886 16912 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.007s user 0.001s sys 0.000s
I20260201 02:56:52.214016 16912 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260201 02:56:52.217836 16912 ts_tablet_manager.cc:616] Registered 1 tablets
I20260201 02:56:52.217988 16912 ts_tablet_manager.cc:595] Time spent register tablets: real 0.004s user 0.001s sys 0.000s
I20260201 02:56:52.218916 16934 tablet_bootstrap.cc:492] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1: Bootstrap starting.
W20260201 02:56:52.228505 16518 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36450: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:52.251091 16517 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36450: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:52.251148 16518 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36450: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
I20260201 02:56:52.271318 16912 rpc_server.cc:307] RPC server started. Bound to: 127.13.170.4:46319
I20260201 02:56:52.271366 17040 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.170.4:46319 every 8 connection(s)
I20260201 02:56:52.273054 16912 server_base.cc:1192] Dumped server information to /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-3/data/info.pb
I20260201 02:56:52.280165 13992 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskfoNO09/build/asan/bin/kudu as pid 16912
I20260201 02:56:52.280462 13992 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-taskfoNO09/build/asan/bin/kudu pid 16160
W20260201 02:56:52.283012 16221 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42434: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:56:52.285421 16221 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42434: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
I20260201 02:56:52.292963 17041 heartbeater.cc:344] Connected to a master server at 127.13.170.62:35815
I20260201 02:56:52.293411 17041 heartbeater.cc:461] Registering TS with master...
I20260201 02:56:52.294642 17041 heartbeater.cc:507] Master 127.13.170.62:35815 requested a full tablet report, sending...
I20260201 02:56:52.295365 16304 generic_service.cc:196] Checking for leaks (request via RPC)
I20260201 02:56:52.298141 15229 ts_manager.cc:194] Re-registered known tserver with Master: 94d535b533b04887be4fac8a82a48cb1 (127.13.170.4:46319)
I20260201 02:56:52.299825 15229 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.13.170.4:40127
I20260201 02:56:52.492372 13992 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskfoNO09/build/asan/bin/kudu with pid 16160
W20260201 02:56:52.546211 15821 connection.cc:537] client connection to 127.13.170.2:36827 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260201 02:56:52.546857 15853 meta_cache.cc:1510] marking tablet server 7c282a4e4a074f7cb7fada1519e23c9b (127.13.170.2:36827) as failed
W20260201 02:56:52.546906 15215 connection.cc:537] server connection from 127.13.170.2:58987 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260201 02:56:52.547250 13992 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskfoNO09/build/asan/bin/kudu
/tmp/dist-test-taskfoNO09/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.170.2:36827
--local_ip_for_outbound_sockets=127.13.170.2
--tserver_master_addrs=127.13.170.62:35815
--webserver_port=44123
--webserver_interface=127.13.170.2
--builtin_ntp_servers=127.13.170.20:35371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
W20260201 02:56:52.585078 16518 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36450: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:52.619660 16518 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36450: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:52.699254 16518 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36450: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:52.701645 16518 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36450: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:52.736447 16518 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36450: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
I20260201 02:56:52.753715 16934 log.cc:826] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1: Log is configured to *not* fsync() on all Append() calls
W20260201 02:56:52.784569 15821 meta_cache.cc:302] tablet 0faa3d899dba409fa6df255630da23e4: replica 7c282a4e4a074f7cb7fada1519e23c9b (127.13.170.2:36827) has failed: Network error: Client connection negotiation failed: client connection to 127.13.170.2:36827: connect: Connection refused (error 111)
W20260201 02:56:52.827847 16518 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36450: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:52.829429 16518 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36450: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:52.935304 16518 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36450: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:52.948660 17049 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260201 02:56:52.949079 17049 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260201 02:56:52.949223 17049 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260201 02:56:52.958369 17049 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260201 02:56:52.958685 17049 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.170.2
W20260201 02:56:52.964305 16518 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36450: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
I20260201 02:56:52.971171 17049 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.170.20:35371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.170.2:36827
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.170.2
--webserver_port=44123
--tserver_master_addrs=127.13.170.62:35815
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.170.2
--log_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3722ed49c19ce54c7feae2fa944e32b1d4ed8d2d
build type FASTDEBUG
built by None at 01 Feb 2026 02:43:22 UTC on 24a791456cd2
build id 10288
ASAN enabled
I20260201 02:56:52.972888 17049 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260201 02:56:52.974895 17049 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 02:56:52.985561 17056 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 02:56:52.985536 17055 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 02:56:52.986757 17058 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 02:56:52.988368 17049 server_base.cc:1060] running on GCE node
I20260201 02:56:52.989145 17049 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260201 02:56:52.990358 17049 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260201 02:56:52.991593 17049 hybrid_clock.cc:648] HybridClock initialized: now 1769914612991530 us; error 61 us; skew 500 ppm
I20260201 02:56:52.991955 17049 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 02:56:52.994457 17049 webserver.cc:492] Webserver started at http://127.13.170.2:44123/ using document root <none> and password file <none>
I20260201 02:56:52.995385 17049 fs_manager.cc:362] Metadata directory not provided
I20260201 02:56:52.995494 17049 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 02:56:53.001964 17049 fs_manager.cc:714] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260201 02:56:53.005715 17064 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 02:56:53.007467 17049 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260201 02:56:53.007686 17049 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-1/data,/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-1/wal
uuid: "7c282a4e4a074f7cb7fada1519e23c9b"
format_stamp: "Formatted at 2026-02-01 02:56:20 on dist-test-slave-4krj"
I20260201 02:56:53.008625 17049 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 02:56:53.039793 17049 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 02:56:53.040745 17049 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260201 02:56:53.041105 17049 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 02:56:53.042305 17049 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260201 02:56:53.044787 17071 ts_tablet_manager.cc:548] Loading tablet metadata (0/1 complete)
I20260201 02:56:53.051278 17049 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260201 02:56:53.051384 17049 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.007s user 0.001s sys 0.000s
I20260201 02:56:53.051537 17049 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260201 02:56:53.054771 17049 ts_tablet_manager.cc:616] Registered 1 tablets
I20260201 02:56:53.054925 17049 ts_tablet_manager.cc:595] Time spent register tablets: real 0.003s user 0.000s sys 0.003s
I20260201 02:56:53.055414 17071 tablet_bootstrap.cc:492] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b: Bootstrap starting.
W20260201 02:56:53.105979 16518 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36450: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
I20260201 02:56:53.136509 17177 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.170.2:36827 every 8 connection(s)
I20260201 02:56:53.138921 17049 rpc_server.cc:307] RPC server started. Bound to: 127.13.170.2:36827
I20260201 02:56:53.141551 17049 server_base.cc:1192] Dumped server information to /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-1/data/info.pb
I20260201 02:56:53.144079 13992 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskfoNO09/build/asan/bin/kudu as pid 17049
I20260201 02:56:53.144307 13992 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-taskfoNO09/build/asan/bin/kudu pid 16324
I20260201 02:56:53.201993 17179 heartbeater.cc:344] Connected to a master server at 127.13.170.62:35815
I20260201 02:56:53.202455 17179 heartbeater.cc:461] Registering TS with master...
I20260201 02:56:53.202476 16454 generic_service.cc:196] Checking for leaks (request via RPC)
I20260201 02:56:53.203904 17179 heartbeater.cc:507] Master 127.13.170.62:35815 requested a full tablet report, sending...
I20260201 02:56:53.207644 15224 ts_manager.cc:194] Re-registered known tserver with Master: 7c282a4e4a074f7cb7fada1519e23c9b (127.13.170.2:36827)
I20260201 02:56:53.209493 15224 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.13.170.2:47339
W20260201 02:56:53.231343 16518 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36450: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:53.276683 16518 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36450: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
I20260201 02:56:53.304103 17041 heartbeater.cc:499] Master 127.13.170.62:35815 was elected leader, sending a full tablet report...
I20260201 02:56:53.312542 13992 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskfoNO09/build/asan/bin/kudu with pid 16324
I20260201 02:56:53.334875 13992 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskfoNO09/build/asan/bin/kudu
/tmp/dist-test-taskfoNO09/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.170.1:41937
--local_ip_for_outbound_sockets=127.13.170.1
--tserver_master_addrs=127.13.170.62:35815
--webserver_port=35425
--webserver_interface=127.13.170.1
--builtin_ntp_servers=127.13.170.20:35371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
W20260201 02:56:53.348855 16518 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36450: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:53.350972 16518 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36450: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:53.519196 16518 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36450: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:53.573597 16518 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36450: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:53.588436 16518 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36450: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:53.694345 16518 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36450: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:53.750183 17186 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260201 02:56:53.750583 17186 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260201 02:56:53.750780 17186 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260201 02:56:53.759336 16518 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36450: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:53.761690 17186 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260201 02:56:53.761965 17186 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.170.1
I20260201 02:56:53.773582 17186 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.170.20:35371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.170.1:41937
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.170.1
--webserver_port=35425
--tserver_master_addrs=127.13.170.62:35815
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.170.1
--log_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3722ed49c19ce54c7feae2fa944e32b1d4ed8d2d
build type FASTDEBUG
built by None at 01 Feb 2026 02:43:22 UTC on 24a791456cd2
build id 10288
ASAN enabled
I20260201 02:56:53.775390 17186 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260201 02:56:53.777460 17186 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 02:56:53.788182 17191 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 02:56:53.789582 17192 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 02:56:53.795073 17186 server_base.cc:1060] running on GCE node
W20260201 02:56:53.795539 17194 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 02:56:53.796339 17186 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260201 02:56:53.797608 17186 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260201 02:56:53.798831 17186 hybrid_clock.cc:648] HybridClock initialized: now 1769914613798760 us; error 63 us; skew 500 ppm
I20260201 02:56:53.799181 17186 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 02:56:53.801862 17186 webserver.cc:492] Webserver started at http://127.13.170.1:35425/ using document root <none> and password file <none>
I20260201 02:56:53.802950 17186 fs_manager.cc:362] Metadata directory not provided
I20260201 02:56:53.803090 17186 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
W20260201 02:56:53.803961 16518 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36450: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
I20260201 02:56:53.809996 17186 fs_manager.cc:714] Time spent opening directory manager: real 0.004s user 0.000s sys 0.004s
I20260201 02:56:53.813455 17200 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 02:56:53.815160 17186 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260201 02:56:53.815455 17186 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-0/data,/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-0/wal
uuid: "f4dd4e7188e44b518d7df7246414a2d6"
format_stamp: "Formatted at 2026-02-01 02:56:19 on dist-test-slave-4krj"
I20260201 02:56:53.816238 17186 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 02:56:53.817132 17071 log.cc:826] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b: Log is configured to *not* fsync() on all Append() calls
I20260201 02:56:53.861675 17186 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 02:56:53.862715 17186 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260201 02:56:53.863059 17186 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 02:56:53.864151 17186 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260201 02:56:53.866020 17186 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260201 02:56:53.866124 17186 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260201 02:56:53.866266 17186 ts_tablet_manager.cc:616] Registered 0 tablets
I20260201 02:56:53.866344 17186 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
W20260201 02:56:53.884532 16517 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36450: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:56:53.884630 16518 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36450: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
I20260201 02:56:53.927187 17186 rpc_server.cc:307] RPC server started. Bound to: 127.13.170.1:41937
I20260201 02:56:53.927199 17313 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.170.1:41937 every 8 connection(s)
I20260201 02:56:53.928846 17186 server_base.cc:1192] Dumped server information to /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-0/data/info.pb
I20260201 02:56:53.936350 13992 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskfoNO09/build/asan/bin/kudu as pid 17186
I20260201 02:56:53.936628 13992 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-taskfoNO09/build/asan/bin/kudu pid 16468
I20260201 02:56:53.955916 16597 generic_service.cc:196] Checking for leaks (request via RPC)
I20260201 02:56:53.972648 17314 heartbeater.cc:344] Connected to a master server at 127.13.170.62:35815
I20260201 02:56:53.973111 17314 heartbeater.cc:461] Registering TS with master...
I20260201 02:56:53.974459 17314 heartbeater.cc:507] Master 127.13.170.62:35815 requested a full tablet report, sending...
I20260201 02:56:53.976907 15224 ts_manager.cc:194] Re-registered known tserver with Master: f4dd4e7188e44b518d7df7246414a2d6 (127.13.170.1:41937)
I20260201 02:56:53.978451 15224 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.13.170.1:46137
I20260201 02:56:54.198343 13992 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskfoNO09/build/asan/bin/kudu with pid 16468
I20260201 02:56:54.213827 17179 heartbeater.cc:499] Master 127.13.170.62:35815 was elected leader, sending a full tablet report...
I20260201 02:56:54.243126 15853 meta_cache.cc:1510] marking tablet server d74315e006374d648477a8e6109e44a7 (127.13.170.3:41669) as failed
I20260201 02:56:54.243818 13992 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskfoNO09/build/asan/bin/kudu
/tmp/dist-test-taskfoNO09/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.170.3:41669
--local_ip_for_outbound_sockets=127.13.170.3
--tserver_master_addrs=127.13.170.62:35815
--webserver_port=40805
--webserver_interface=127.13.170.3
--builtin_ntp_servers=127.13.170.20:35371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
W20260201 02:56:54.243130 15822 meta_cache.cc:302] tablet 0faa3d899dba409fa6df255630da23e4: replica d74315e006374d648477a8e6109e44a7 (127.13.170.3:41669) has failed: Network error: recv got EOF from 127.13.170.3:41669 (error 108)
W20260201 02:56:54.669165 17321 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260201 02:56:54.669600 17321 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260201 02:56:54.669765 17321 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260201 02:56:54.679857 17321 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260201 02:56:54.680160 17321 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.170.3
I20260201 02:56:54.692409 17321 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.170.20:35371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.170.3:41669
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.170.3
--webserver_port=40805
--tserver_master_addrs=127.13.170.62:35815
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.170.3
--log_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3722ed49c19ce54c7feae2fa944e32b1d4ed8d2d
build type FASTDEBUG
built by None at 01 Feb 2026 02:43:22 UTC on 24a791456cd2
build id 10288
ASAN enabled
I20260201 02:56:54.695004 17321 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260201 02:56:54.697765 17321 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 02:56:54.709112 17327 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 02:56:54.716682 17330 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 02:56:54.717500 17328 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 02:56:54.719019 17321 server_base.cc:1060] running on GCE node
I20260201 02:56:54.719784 17321 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260201 02:56:54.721037 17321 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260201 02:56:54.722290 17321 hybrid_clock.cc:648] HybridClock initialized: now 1769914614722217 us; error 71 us; skew 500 ppm
I20260201 02:56:54.722860 17321 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 02:56:54.728030 17321 webserver.cc:492] Webserver started at http://127.13.170.3:40805/ using document root <none> and password file <none>
I20260201 02:56:54.728933 17321 fs_manager.cc:362] Metadata directory not provided
I20260201 02:56:54.729090 17321 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 02:56:54.735622 17321 fs_manager.cc:714] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260201 02:56:54.739054 17336 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 02:56:54.740785 17321 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.002s sys 0.002s
I20260201 02:56:54.741005 17321 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-2/data,/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-2/wal
uuid: "d74315e006374d648477a8e6109e44a7"
format_stamp: "Formatted at 2026-02-01 02:56:20 on dist-test-slave-4krj"
I20260201 02:56:54.741780 17321 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 02:56:54.761312 17321 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 02:56:54.762245 17321 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260201 02:56:54.762566 17321 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 02:56:54.769698 17321 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260201 02:56:54.773224 17343 ts_tablet_manager.cc:548] Loading tablet metadata (0/1 complete)
I20260201 02:56:54.780063 17321 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260201 02:56:54.780210 17321 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.008s user 0.000s sys 0.001s
I20260201 02:56:54.780381 17321 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260201 02:56:54.783704 17321 ts_tablet_manager.cc:616] Registered 1 tablets
I20260201 02:56:54.783898 17321 ts_tablet_manager.cc:595] Time spent register tablets: real 0.004s user 0.003s sys 0.000s
I20260201 02:56:54.784438 17343 tablet_bootstrap.cc:492] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7: Bootstrap starting.
I20260201 02:56:54.983575 17314 heartbeater.cc:499] Master 127.13.170.62:35815 was elected leader, sending a full tablet report...
I20260201 02:56:55.577239 17449 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.170.3:41669 every 8 connection(s)
I20260201 02:56:55.577690 17321 rpc_server.cc:307] RPC server started. Bound to: 127.13.170.3:41669
I20260201 02:56:55.579953 17321 server_base.cc:1192] Dumped server information to /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-2/data/info.pb
I20260201 02:56:55.587481 13992 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskfoNO09/build/asan/bin/kudu as pid 17321
I20260201 02:56:55.653710 17450 heartbeater.cc:344] Connected to a master server at 127.13.170.62:35815
I20260201 02:56:55.654129 17450 heartbeater.cc:461] Registering TS with master...
I20260201 02:56:55.655426 17450 heartbeater.cc:507] Master 127.13.170.62:35815 requested a full tablet report, sending...
I20260201 02:56:55.658576 15224 ts_manager.cc:194] Re-registered known tserver with Master: d74315e006374d648477a8e6109e44a7 (127.13.170.3:41669)
I20260201 02:56:55.660179 15224 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.13.170.3:40153
I20260201 02:56:55.791596 17343 log.cc:826] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7: Log is configured to *not* fsync() on all Append() calls
I20260201 02:56:56.618752 16976 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260201 02:56:56.631494 17113 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260201 02:56:56.663460 17450 heartbeater.cc:499] Master 127.13.170.62:35815 was elected leader, sending a full tablet report...
I20260201 02:56:56.693773 17385 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260201 02:56:56.738010 17249 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260201 02:56:57.760788 16934 tablet_bootstrap.cc:492] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1: Bootstrap replaying log segment 1/1 (2.05M/2.93M this segment, stats: ops{read=1187 overwritten=0 applied=1187 ignored=0} inserts{seen=59250 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0)
I20260201 02:56:58.825759 17071 tablet_bootstrap.cc:492] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b: Bootstrap replaying log segment 1/1 (2.16M/2.81M this segment, stats: ops{read=1305 overwritten=2 applied=1302 ignored=0} inserts{seen=65000 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0)
I20260201 02:56:59.883399 16934 tablet_bootstrap.cc:492] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1693 overwritten=0 applied=1691 ignored=0} inserts{seen=84450 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 2 replicates
I20260201 02:56:59.884333 16934 tablet_bootstrap.cc:492] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1: Bootstrap complete.
I20260201 02:56:59.886454 16934 ts_tablet_manager.cc:1403] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1: Time spent bootstrapping tablet: real 7.668s user 7.025s sys 0.428s
I20260201 02:56:59.894332 16934 raft_consensus.cc:359] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 5 FOLLOWER]: Replica starting. Triggering 2 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d535b533b04887be4fac8a82a48cb1" member_type: VOTER last_known_addr { host: "127.13.170.4" port: 46319 } } peers { permanent_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 36827 } } peers { permanent_uuid: "d74315e006374d648477a8e6109e44a7" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 41669 } }
I20260201 02:56:59.898600 16934 raft_consensus.cc:740] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 5 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94d535b533b04887be4fac8a82a48cb1, State: Initialized, Role: FOLLOWER
I20260201 02:56:59.899667 16934 consensus_queue.cc:260] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1691, Last appended: 3.1693, Last appended by leader: 1693, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d535b533b04887be4fac8a82a48cb1" member_type: VOTER last_known_addr { host: "127.13.170.4" port: 46319 } } peers { permanent_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 36827 } } peers { permanent_uuid: "d74315e006374d648477a8e6109e44a7" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 41669 } }
I20260201 02:56:59.902593 16934 ts_tablet_manager.cc:1434] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1: Time spent starting tablet: real 0.016s user 0.015s sys 0.003s
W20260201 02:56:59.921312 16956 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54542: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
I20260201 02:56:59.923135 17071 tablet_bootstrap.cc:492] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1693 overwritten=2 applied=1691 ignored=0} inserts{seen=84450 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 02:56:59.923830 17071 tablet_bootstrap.cc:492] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b: Bootstrap complete.
I20260201 02:56:59.925417 17071 ts_tablet_manager.cc:1403] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b: Time spent bootstrapping tablet: real 6.871s user 6.243s sys 0.428s
I20260201 02:56:59.932274 17071 raft_consensus.cc:359] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [term 5 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d535b533b04887be4fac8a82a48cb1" member_type: VOTER last_known_addr { host: "127.13.170.4" port: 46319 } } peers { permanent_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 36827 } } peers { permanent_uuid: "d74315e006374d648477a8e6109e44a7" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 41669 } }
I20260201 02:56:59.932999 17071 raft_consensus.cc:740] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [term 5 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c282a4e4a074f7cb7fada1519e23c9b, State: Initialized, Role: FOLLOWER
I20260201 02:56:59.933735 17071 consensus_queue.cc:260] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1691, Last appended: 3.1691, Last appended by leader: 1691, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d535b533b04887be4fac8a82a48cb1" member_type: VOTER last_known_addr { host: "127.13.170.4" port: 46319 } } peers { permanent_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 36827 } } peers { permanent_uuid: "d74315e006374d648477a8e6109e44a7" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 41669 } }
I20260201 02:56:59.935659 17071 ts_tablet_manager.cc:1434] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b: Time spent starting tablet: real 0.010s user 0.012s sys 0.000s
W20260201 02:57:00.062168 17091 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42532: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:57:00.068495 17091 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42532: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
I20260201 02:57:00.184868 17492 raft_consensus.cc:493] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 02:57:00.185205 17492 raft_consensus.cc:515] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d535b533b04887be4fac8a82a48cb1" member_type: VOTER last_known_addr { host: "127.13.170.4" port: 46319 } } peers { permanent_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 36827 } } peers { permanent_uuid: "d74315e006374d648477a8e6109e44a7" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 41669 } }
I20260201 02:57:00.187440 17492 leader_election.cc:290] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7c282a4e4a074f7cb7fada1519e23c9b (127.13.170.2:36827), d74315e006374d648477a8e6109e44a7 (127.13.170.3:41669)
I20260201 02:57:00.197417 17131 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0faa3d899dba409fa6df255630da23e4" candidate_uuid: "94d535b533b04887be4fac8a82a48cb1" candidate_term: 6 candidate_status { last_received { term: 3 index: 1693 } } ignore_live_leader: false dest_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" is_pre_election: true
I20260201 02:57:00.197993 17131 raft_consensus.cc:2468] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94d535b533b04887be4fac8a82a48cb1 in term 5.
I20260201 02:57:00.198757 16928 leader_election.cc:304] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c282a4e4a074f7cb7fada1519e23c9b, 94d535b533b04887be4fac8a82a48cb1; no voters:
I20260201 02:57:00.199247 17492 raft_consensus.cc:2804] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260201 02:57:00.199432 17492 raft_consensus.cc:493] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 02:57:00.199548 17492 raft_consensus.cc:3060] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 5 FOLLOWER]: Advancing to term 6
I20260201 02:57:00.197504 17405 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0faa3d899dba409fa6df255630da23e4" candidate_uuid: "94d535b533b04887be4fac8a82a48cb1" candidate_term: 6 candidate_status { last_received { term: 3 index: 1693 } } ignore_live_leader: false dest_uuid: "d74315e006374d648477a8e6109e44a7" is_pre_election: true
W20260201 02:57:00.200989 16929 leader_election.cc:343] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [CANDIDATE]: Term 6 pre-election: Tablet error from VoteRequest() call to peer d74315e006374d648477a8e6109e44a7 (127.13.170.3:41669): Illegal state: must be running to vote when last-logged opid is not known
I20260201 02:57:00.204591 17492 raft_consensus.cc:515] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d535b533b04887be4fac8a82a48cb1" member_type: VOTER last_known_addr { host: "127.13.170.4" port: 46319 } } peers { permanent_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 36827 } } peers { permanent_uuid: "d74315e006374d648477a8e6109e44a7" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 41669 } }
I20260201 02:57:00.205421 17492 leader_election.cc:290] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [CANDIDATE]: Term 6 election: Requested vote from peers 7c282a4e4a074f7cb7fada1519e23c9b (127.13.170.2:36827), d74315e006374d648477a8e6109e44a7 (127.13.170.3:41669)
I20260201 02:57:00.205966 17405 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0faa3d899dba409fa6df255630da23e4" candidate_uuid: "94d535b533b04887be4fac8a82a48cb1" candidate_term: 6 candidate_status { last_received { term: 3 index: 1693 } } ignore_live_leader: false dest_uuid: "d74315e006374d648477a8e6109e44a7"
I20260201 02:57:00.206013 17131 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0faa3d899dba409fa6df255630da23e4" candidate_uuid: "94d535b533b04887be4fac8a82a48cb1" candidate_term: 6 candidate_status { last_received { term: 3 index: 1693 } } ignore_live_leader: false dest_uuid: "7c282a4e4a074f7cb7fada1519e23c9b"
I20260201 02:57:00.206228 17131 raft_consensus.cc:3060] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [term 5 FOLLOWER]: Advancing to term 6
W20260201 02:57:00.206559 16929 leader_election.cc:343] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [CANDIDATE]: Term 6 election: Tablet error from VoteRequest() call to peer d74315e006374d648477a8e6109e44a7 (127.13.170.3:41669): Illegal state: must be running to vote when last-logged opid is not known
I20260201 02:57:00.211390 17131 raft_consensus.cc:2468] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94d535b533b04887be4fac8a82a48cb1 in term 6.
I20260201 02:57:00.212034 16928 leader_election.cc:304] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c282a4e4a074f7cb7fada1519e23c9b, 94d535b533b04887be4fac8a82a48cb1; no voters: d74315e006374d648477a8e6109e44a7
I20260201 02:57:00.212508 17492 raft_consensus.cc:2804] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 6 FOLLOWER]: Leader election won for term 6
I20260201 02:57:00.213091 17492 raft_consensus.cc:697] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 6 LEADER]: Becoming Leader. State: Replica: 94d535b533b04887be4fac8a82a48cb1, State: Running, Role: LEADER
I20260201 02:57:00.213740 17492 consensus_queue.cc:237] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1691, Committed index: 1691, Last appended: 3.1693, Last appended by leader: 1693, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d535b533b04887be4fac8a82a48cb1" member_type: VOTER last_known_addr { host: "127.13.170.4" port: 46319 } } peers { permanent_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 36827 } } peers { permanent_uuid: "d74315e006374d648477a8e6109e44a7" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 41669 } }
I20260201 02:57:00.218972 15224 catalog_manager.cc:5654] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "94d535b533b04887be4fac8a82a48cb1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d535b533b04887be4fac8a82a48cb1" member_type: VOTER last_known_addr { host: "127.13.170.4" port: 46319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 36827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d74315e006374d648477a8e6109e44a7" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 41669 } health_report { overall_health: UNKNOWN } } }
I20260201 02:57:00.332804 17131 raft_consensus.cc:1275] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [term 6 FOLLOWER]: Refusing update from remote peer 94d535b533b04887be4fac8a82a48cb1: Log matching property violated. Preceding OpId in replica: term: 3 index: 1691. Preceding OpId from leader: term: 6 index: 1694. (index mismatch)
I20260201 02:57:00.333904 17492 consensus_queue.cc:1048] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 36827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1694, Last known committed idx: 1691, Time since last communication: 0.000s
W20260201 02:57:00.340392 16929 consensus_peers.cc:597] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 -> Peer d74315e006374d648477a8e6109e44a7 (127.13.170.3:41669): Couldn't send request to peer d74315e006374d648477a8e6109e44a7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260201 02:57:00.801095 17343 tablet_bootstrap.cc:492] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7: Bootstrap replaying log segment 1/1 (2.00M/2.81M this segment, stats: ops{read=1218 overwritten=0 applied=1217 ignored=0} inserts{seen=60750 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0)
W20260201 02:57:00.822332 16929 consensus_peers.cc:597] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 -> Peer d74315e006374d648477a8e6109e44a7 (127.13.170.3:41669): Couldn't send request to peer d74315e006374d648477a8e6109e44a7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
I20260201 02:57:00.902279 15852 scanner-internal.cc:172] Scan of tablet 0faa3d899dba409fa6df255630da23e4 at d74315e006374d648477a8e6109e44a7 (127.13.170.3:41669) deadline exceeded after 10.000s
W20260201 02:57:00.902669 15852 scanner-internal.cc:458] Time spent opening tablet: real 11.268s user 0.011s sys 0.001s
I20260201 02:57:01.104223 15854 scanner-internal.cc:172] Scan of tablet 0faa3d899dba409fa6df255630da23e4 at d74315e006374d648477a8e6109e44a7 (127.13.170.3:41669) deadline exceeded after 10.000s
W20260201 02:57:01.104445 15854 scanner-internal.cc:458] Time spent opening tablet: real 11.397s user 0.013s sys 0.000s
W20260201 02:57:01.362720 16929 consensus_peers.cc:597] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 -> Peer d74315e006374d648477a8e6109e44a7 (127.13.170.3:41669): Couldn't send request to peer d74315e006374d648477a8e6109e44a7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
I20260201 02:57:01.475936 15853 scanner-internal.cc:172] Scan of tablet 0faa3d899dba409fa6df255630da23e4 at d74315e006374d648477a8e6109e44a7 (127.13.170.3:41669) deadline exceeded after 10.000s
W20260201 02:57:01.476208 15853 scanner-internal.cc:458] Time spent opening tablet: real 11.484s user 0.015s sys 0.001s
W20260201 02:57:01.837319 16929 consensus_peers.cc:597] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 -> Peer d74315e006374d648477a8e6109e44a7 (127.13.170.3:41669): Couldn't send request to peer d74315e006374d648477a8e6109e44a7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 16: this message will repeat every 5th retry.
W20260201 02:57:02.390617 16929 consensus_peers.cc:597] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 -> Peer d74315e006374d648477a8e6109e44a7 (127.13.170.3:41669): Couldn't send request to peer d74315e006374d648477a8e6109e44a7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 21: this message will repeat every 5th retry.
W20260201 02:57:02.810540 16929 consensus_peers.cc:597] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 -> Peer d74315e006374d648477a8e6109e44a7 (127.13.170.3:41669): Couldn't send request to peer d74315e006374d648477a8e6109e44a7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 26: this message will repeat every 5th retry.
I20260201 02:57:03.007155 17343 tablet_bootstrap.cc:492] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1691 overwritten=0 applied=1691 ignored=0} inserts{seen=84450 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 02:57:03.008232 17343 tablet_bootstrap.cc:492] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7: Bootstrap complete.
I20260201 02:57:03.010569 17343 ts_tablet_manager.cc:1403] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7: Time spent bootstrapping tablet: real 8.227s user 7.416s sys 0.473s
I20260201 02:57:03.014704 17343 raft_consensus.cc:359] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [term 5 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d535b533b04887be4fac8a82a48cb1" member_type: VOTER last_known_addr { host: "127.13.170.4" port: 46319 } } peers { permanent_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 36827 } } peers { permanent_uuid: "d74315e006374d648477a8e6109e44a7" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 41669 } }
I20260201 02:57:03.015938 17343 raft_consensus.cc:740] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [term 5 FOLLOWER]: Becoming Follower/Learner. State: Replica: d74315e006374d648477a8e6109e44a7, State: Initialized, Role: FOLLOWER
I20260201 02:57:03.016944 17343 consensus_queue.cc:260] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1691, Last appended: 3.1691, Last appended by leader: 1691, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d535b533b04887be4fac8a82a48cb1" member_type: VOTER last_known_addr { host: "127.13.170.4" port: 46319 } } peers { permanent_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 36827 } } peers { permanent_uuid: "d74315e006374d648477a8e6109e44a7" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 41669 } }
I20260201 02:57:03.025858 17343 ts_tablet_manager.cc:1434] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7: Time spent starting tablet: real 0.015s user 0.009s sys 0.004s
I20260201 02:57:03.041165 17405 raft_consensus.cc:3060] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [term 5 FOLLOWER]: Advancing to term 6
I20260201 02:57:03.049180 17405 raft_consensus.cc:1275] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [term 6 FOLLOWER]: Refusing update from remote peer 94d535b533b04887be4fac8a82a48cb1: Log matching property violated. Preceding OpId in replica: term: 3 index: 1691. Preceding OpId from leader: term: 3 index: 1693. (index mismatch)
I20260201 02:57:03.057888 17492 consensus_queue.cc:1050] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [LEADER]: Got LMP mismatch error from peer: Peer: permanent_uuid: "d74315e006374d648477a8e6109e44a7" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 41669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1694, Last known committed idx: 1691, Time since last communication: 0.000s
I20260201 02:57:03.143086 16976 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260201 02:57:03.143303 17113 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260201 02:57:03.156605 17249 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260201 02:57:03.384392 17385 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260201 02:57:03.402963 17542 raft_consensus.cc:493] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 94d535b533b04887be4fac8a82a48cb1)
I20260201 02:57:03.405349 17542 raft_consensus.cc:515] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d535b533b04887be4fac8a82a48cb1" member_type: VOTER last_known_addr { host: "127.13.170.4" port: 46319 } } peers { permanent_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 36827 } } peers { permanent_uuid: "d74315e006374d648477a8e6109e44a7" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 41669 } }
I20260201 02:57:03.424109 17542 leader_election.cc:290] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 94d535b533b04887be4fac8a82a48cb1 (127.13.170.4:46319), 7c282a4e4a074f7cb7fada1519e23c9b (127.13.170.2:36827)
I20260201 02:57:03.462314 16996 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0faa3d899dba409fa6df255630da23e4" candidate_uuid: "d74315e006374d648477a8e6109e44a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 2007 } } ignore_live_leader: false dest_uuid: "94d535b533b04887be4fac8a82a48cb1" is_pre_election: true
I20260201 02:57:03.483830 17131 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0faa3d899dba409fa6df255630da23e4" candidate_uuid: "d74315e006374d648477a8e6109e44a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 2007 } } ignore_live_leader: false dest_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" is_pre_election: true
I20260201 02:57:03.484534 17337 leader_election.cc:304] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d74315e006374d648477a8e6109e44a7; no voters: 7c282a4e4a074f7cb7fada1519e23c9b, 94d535b533b04887be4fac8a82a48cb1
I20260201 02:57:03.485119 17542 raft_consensus.cc:2749] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260201 02:57:04.068789 17554 mvcc.cc:204] Tried to move back new op lower bound from 7249570296021770240 to 7249570284400783360. Current Snapshot: MvccSnapshot[applied={T|T < 7249570295985938432}]
I20260201 02:57:05.203816 15224 ts_manager.cc:284] Unset tserver state for f4dd4e7188e44b518d7df7246414a2d6 from MAINTENANCE_MODE
I20260201 02:57:05.308626 15224 ts_manager.cc:284] Unset tserver state for 94d535b533b04887be4fac8a82a48cb1 from MAINTENANCE_MODE
I20260201 02:57:05.315505 15224 ts_manager.cc:284] Unset tserver state for 7c282a4e4a074f7cb7fada1519e23c9b from MAINTENANCE_MODE
I20260201 02:57:05.391587 17450 heartbeater.cc:507] Master 127.13.170.62:35815 requested a full tablet report, sending...
I20260201 02:57:05.398231 17179 heartbeater.cc:507] Master 127.13.170.62:35815 requested a full tablet report, sending...
I20260201 02:57:05.403059 17041 heartbeater.cc:507] Master 127.13.170.62:35815 requested a full tablet report, sending...
I20260201 02:57:05.699359 15224 ts_manager.cc:284] Unset tserver state for d74315e006374d648477a8e6109e44a7 from MAINTENANCE_MODE
I20260201 02:57:06.011337 17314 heartbeater.cc:507] Master 127.13.170.62:35815 requested a full tablet report, sending...
I20260201 02:57:06.403438 17450 heartbeater.cc:507] Master 127.13.170.62:35815 requested a full tablet report, sending...
I20260201 02:57:06.404889 17179 heartbeater.cc:507] Master 127.13.170.62:35815 requested a full tablet report, sending...
I20260201 02:57:06.407898 17041 heartbeater.cc:507] Master 127.13.170.62:35815 requested a full tablet report, sending...
I20260201 02:57:07.269060 15224 ts_manager.cc:295] Set tserver state for 94d535b533b04887be4fac8a82a48cb1 to MAINTENANCE_MODE
I20260201 02:57:07.285807 15229 ts_manager.cc:295] Set tserver state for d74315e006374d648477a8e6109e44a7 to MAINTENANCE_MODE
I20260201 02:57:07.355480 15229 ts_manager.cc:295] Set tserver state for 7c282a4e4a074f7cb7fada1519e23c9b to MAINTENANCE_MODE
I20260201 02:57:08.639063 15229 ts_manager.cc:295] Set tserver state for f4dd4e7188e44b518d7df7246414a2d6 to MAINTENANCE_MODE
I20260201 02:57:08.712248 17113 tablet_service.cc:1460] Tablet server 7c282a4e4a074f7cb7fada1519e23c9b set to quiescing
I20260201 02:57:08.712522 17113 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260201 02:57:08.894910 16976 tablet_service.cc:1460] Tablet server 94d535b533b04887be4fac8a82a48cb1 set to quiescing
I20260201 02:57:08.895321 16976 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260201 02:57:08.919806 17498 raft_consensus.cc:993] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1: : Instructing follower d74315e006374d648477a8e6109e44a7 to start an election
I20260201 02:57:08.920019 17498 raft_consensus.cc:1081] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 6 LEADER]: Signalling peer d74315e006374d648477a8e6109e44a7 to start an election
I20260201 02:57:08.928646 17404 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "0faa3d899dba409fa6df255630da23e4"
dest_uuid: "d74315e006374d648477a8e6109e44a7"
from {username='slave'} at 127.13.170.4:52235
I20260201 02:57:08.929085 17404 raft_consensus.cc:493] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 02:57:08.929258 17404 raft_consensus.cc:3060] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [term 6 FOLLOWER]: Advancing to term 7
I20260201 02:57:08.933501 17404 raft_consensus.cc:515] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d535b533b04887be4fac8a82a48cb1" member_type: VOTER last_known_addr { host: "127.13.170.4" port: 46319 } } peers { permanent_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 36827 } } peers { permanent_uuid: "d74315e006374d648477a8e6109e44a7" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 41669 } }
I20260201 02:57:08.934528 17510 raft_consensus.cc:993] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1: : Instructing follower d74315e006374d648477a8e6109e44a7 to start an election
I20260201 02:57:08.934736 17510 raft_consensus.cc:1081] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 6 LEADER]: Signalling peer d74315e006374d648477a8e6109e44a7 to start an election
I20260201 02:57:08.935650 17405 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "0faa3d899dba409fa6df255630da23e4"
dest_uuid: "d74315e006374d648477a8e6109e44a7"
from {username='slave'} at 127.13.170.4:52235
I20260201 02:57:08.965116 17403 raft_consensus.cc:1240] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [term 7 FOLLOWER]: Rejecting Update request from peer 94d535b533b04887be4fac8a82a48cb1 for earlier term 6. Current term is 7. Ops: [6.2403-6.2403]
I20260201 02:57:08.965802 17405 raft_consensus.cc:493] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 02:57:08.965955 17405 raft_consensus.cc:3060] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [term 7 FOLLOWER]: Advancing to term 8
I20260201 02:57:08.968744 17405 raft_consensus.cc:515] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d535b533b04887be4fac8a82a48cb1" member_type: VOTER last_known_addr { host: "127.13.170.4" port: 46319 } } peers { permanent_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 36827 } } peers { permanent_uuid: "d74315e006374d648477a8e6109e44a7" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 41669 } }
I20260201 02:57:08.970855 17405 leader_election.cc:290] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [CANDIDATE]: Term 8 election: Requested vote from peers 94d535b533b04887be4fac8a82a48cb1 (127.13.170.4:46319), 7c282a4e4a074f7cb7fada1519e23c9b (127.13.170.2:36827)
I20260201 02:57:08.970979 16996 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0faa3d899dba409fa6df255630da23e4" candidate_uuid: "d74315e006374d648477a8e6109e44a7" candidate_term: 8 candidate_status { last_received { term: 6 index: 2402 } } ignore_live_leader: true dest_uuid: "94d535b533b04887be4fac8a82a48cb1"
I20260201 02:57:08.971272 16996 raft_consensus.cc:3055] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 6 LEADER]: Stepping down as leader of term 6
I20260201 02:57:08.971369 16996 raft_consensus.cc:740] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 94d535b533b04887be4fac8a82a48cb1, State: Running, Role: LEADER
I20260201 02:57:08.971799 16996 consensus_queue.cc:260] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2404, Committed index: 2404, Last appended: 6.2405, Last appended by leader: 2405, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d535b533b04887be4fac8a82a48cb1" member_type: VOTER last_known_addr { host: "127.13.170.4" port: 46319 } } peers { permanent_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 36827 } } peers { permanent_uuid: "d74315e006374d648477a8e6109e44a7" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 41669 } }
I20260201 02:57:08.972174 17498 consensus_queue.cc:1059] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d74315e006374d648477a8e6109e44a7" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 41669 }, Status: INVALID_TERM, Last received: 6.2402, Next index: 2403, Last known committed idx: 2402, Time since last communication: 0.000s
I20260201 02:57:08.972652 16996 raft_consensus.cc:3060] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 6 FOLLOWER]: Advancing to term 8
I20260201 02:57:08.972790 17132 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0faa3d899dba409fa6df255630da23e4" candidate_uuid: "d74315e006374d648477a8e6109e44a7" candidate_term: 8 candidate_status { last_received { term: 6 index: 2402 } } ignore_live_leader: true dest_uuid: "7c282a4e4a074f7cb7fada1519e23c9b"
I20260201 02:57:08.974155 16995 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0faa3d899dba409fa6df255630da23e4" candidate_uuid: "d74315e006374d648477a8e6109e44a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 2402 } } ignore_live_leader: true dest_uuid: "94d535b533b04887be4fac8a82a48cb1"
I20260201 02:57:08.974460 17404 leader_election.cc:290] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [CANDIDATE]: Term 7 election: Requested vote from peers 94d535b533b04887be4fac8a82a48cb1 (127.13.170.4:46319), 7c282a4e4a074f7cb7fada1519e23c9b (127.13.170.2:36827)
I20260201 02:57:08.975229 17131 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0faa3d899dba409fa6df255630da23e4" candidate_uuid: "d74315e006374d648477a8e6109e44a7" candidate_term: 7 candidate_status { last_received { term: 6 index: 2402 } } ignore_live_leader: true dest_uuid: "7c282a4e4a074f7cb7fada1519e23c9b"
I20260201 02:57:08.975492 17131 raft_consensus.cc:3060] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [term 6 FOLLOWER]: Advancing to term 7
I20260201 02:57:08.977656 16996 raft_consensus.cc:2410] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d74315e006374d648477a8e6109e44a7 for term 8 because replica has last-logged OpId of term: 6 index: 2405, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 2402.
I20260201 02:57:08.978610 17340 leader_election.cc:304] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d74315e006374d648477a8e6109e44a7; no voters: 7c282a4e4a074f7cb7fada1519e23c9b, 94d535b533b04887be4fac8a82a48cb1
I20260201 02:57:08.979148 17131 raft_consensus.cc:2410] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d74315e006374d648477a8e6109e44a7 for term 7 because replica has last-logged OpId of term: 6 index: 2405, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 2402.
I20260201 02:57:08.979737 17337 leader_election.cc:304] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d74315e006374d648477a8e6109e44a7; no voters: 7c282a4e4a074f7cb7fada1519e23c9b, 94d535b533b04887be4fac8a82a48cb1
I20260201 02:57:08.990080 17721 raft_consensus.cc:2749] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260201 02:57:08.991824 16954 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54542: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
I20260201 02:57:08.994877 17721 raft_consensus.cc:2749] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260201 02:57:08.998540 17091 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42532: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:57:09.002065 17091 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42532: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:57:09.004989 17365 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44994: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:57:09.007145 17365 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44994: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:57:09.012203 16954 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54542: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:57:09.017551 16954 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54542: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:57:09.022068 16954 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54542: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:57:09.025552 17091 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42532: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:57:09.028829 17091 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42532: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:57:09.035331 17365 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44994: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:57:09.037429 17365 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44994: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
I20260201 02:57:09.044395 17385 tablet_service.cc:1460] Tablet server d74315e006374d648477a8e6109e44a7 set to quiescing
I20260201 02:57:09.044648 17385 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
W20260201 02:57:09.046969 16954 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54542: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:57:09.051649 16954 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54542: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:57:09.061964 17091 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42532: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:57:09.063968 17091 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42532: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:57:09.077306 17365 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44994: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:57:09.078338 17365 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44994: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:57:09.091559 16954 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54542: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:57:09.094280 16954 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54542: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:57:09.108103 17091 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42532: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:57:09.112036 17091 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42532: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:57:09.126600 17365 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44994: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:57:09.128666 17365 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44994: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:57:09.145620 16954 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54542: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:57:09.145933 16956 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54542: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:57:09.164489 17091 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42532: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:57:09.165576 17092 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42532: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:57:09.182212 17365 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44994: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:57:09.183063 17364 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44994: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:57:09.203516 16956 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54542: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:57:09.205760 16956 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54542: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:57:09.224558 17092 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42532: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:57:09.225406 17091 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42532: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:57:09.244598 17364 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44994: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:57:09.245368 17492 raft_consensus.cc:670] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1: failed to trigger leader election: Illegal state: leader elections are disabled
W20260201 02:57:09.246714 17364 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44994: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:57:09.268005 16956 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54542: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:57:09.270134 17731 raft_consensus.cc:670] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b: failed to trigger leader election: Illegal state: leader elections are disabled
W20260201 02:57:09.271250 16956 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54542: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:57:09.293710 17091 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42532: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:57:09.296893 17091 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42532: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:57:09.318203 17364 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44994: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:57:09.322548 17364 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44994: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:57:09.348207 16956 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54542: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:57:09.350137 16956 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54542: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:57:09.376638 17091 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42532: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:57:09.377677 17091 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42532: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:57:09.405828 17364 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44994: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:57:09.407317 17364 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44994: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
I20260201 02:57:09.430584 17249 tablet_service.cc:1460] Tablet server f4dd4e7188e44b518d7df7246414a2d6 set to quiescing
I20260201 02:57:09.430918 17249 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
W20260201 02:57:09.434371 16956 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54542: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:57:09.438496 16956 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54542: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:57:09.464053 17091 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42532: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:57:09.469409 17091 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42532: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:57:09.493036 17364 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44994: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:57:09.501377 17364 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44994: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:57:09.528867 16956 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54542: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:57:09.536033 16956 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54542: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:57:09.562242 17091 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42532: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:57:09.569753 17091 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42532: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:57:09.595276 17364 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44994: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:57:09.604662 17364 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44994: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:57:09.633101 16956 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54542: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:57:09.643548 16956 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54542: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:57:09.668973 17743 raft_consensus.cc:670] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7: failed to trigger leader election: Illegal state: leader elections are disabled
W20260201 02:57:09.669728 17091 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42532: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:57:09.678200 17091 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42532: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:57:09.706743 17364 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44994: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:57:09.716724 17364 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44994: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:57:09.744306 16956 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54542: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:57:09.757644 16956 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54542: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:57:09.781113 17091 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42532: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:57:09.795660 17091 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42532: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:57:09.820926 17364 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44994: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:57:09.835553 17364 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44994: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:57:09.865803 16956 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54542: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:57:09.880345 16956 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54542: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:57:09.907876 17091 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42532: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:57:09.924414 17091 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42532: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:57:09.952777 17364 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44994: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:57:09.965333 17364 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44994: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:57:09.999758 16956 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54542: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:57:10.010874 16956 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54542: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:57:10.045455 17091 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42532: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:57:10.055902 17091 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42532: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:57:10.089051 17364 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44994: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:57:10.099753 17364 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44994: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:57:10.136924 16956 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54542: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:57:10.149031 16956 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54542: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:57:10.183888 17091 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42532: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:57:10.195091 17091 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42532: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:57:10.234694 17364 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44994: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:57:10.244134 17364 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44994: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:57:10.284803 16956 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54542: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:57:10.296348 16956 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54542: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:57:10.338044 17091 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42532: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:57:10.349653 17091 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42532: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:57:10.388087 17364 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44994: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:57:10.400556 17364 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44994: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:57:10.442957 16956 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54542: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:57:10.456962 16956 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54542: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:57:10.496446 17091 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42532: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:57:10.509025 17091 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42532: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
I20260201 02:57:10.530900 16976 tablet_service.cc:1460] Tablet server 94d535b533b04887be4fac8a82a48cb1 set to quiescing
I20260201 02:57:10.531175 16976 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
W20260201 02:57:10.553682 17364 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44994: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:57:10.562148 17364 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44994: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:57:10.611977 16956 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54542: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:57:10.618099 16956 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54542: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
I20260201 02:57:10.623286 13992 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-taskfoNO09/build/asan/bin/kudu pid 16912
I20260201 02:57:10.631018 17035 generic_service.cc:196] Checking for leaks (request via RPC)
W20260201 02:57:10.670631 17091 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42532: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:57:10.674124 17091 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42532: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:57:10.731249 17365 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44994: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:57:10.731249 17364 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44994: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
I20260201 02:57:10.898762 13992 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskfoNO09/build/asan/bin/kudu with pid 16912
W20260201 02:57:10.941286 15824 meta_cache.cc:302] tablet 0faa3d899dba409fa6df255630da23e4: replica 94d535b533b04887be4fac8a82a48cb1 (127.13.170.4:46319) has failed: Network error: recv got EOF from 127.13.170.4:46319 (error 108)
I20260201 02:57:10.942179 13992 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskfoNO09/build/asan/bin/kudu
/tmp/dist-test-taskfoNO09/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.170.4:46319
--local_ip_for_outbound_sockets=127.13.170.4
--tserver_master_addrs=127.13.170.62:35815
--webserver_port=34937
--webserver_interface=127.13.170.4
--builtin_ntp_servers=127.13.170.20:35371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
W20260201 02:57:11.001665 17091 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42532: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:57:11.001618 17092 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42532: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:57:11.064550 17364 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44994: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:57:11.064631 17365 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44994: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:57:11.189150 17091 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42532: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:57:11.190207 17092 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42532: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:57:11.252473 17364 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44994: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:57:11.255896 17364 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44994: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:57:11.326049 17758 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260201 02:57:11.326439 17758 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260201 02:57:11.326586 17758 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260201 02:57:11.335390 17758 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260201 02:57:11.335661 17758 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.170.4
I20260201 02:57:11.345993 17758 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.170.20:35371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.170.4:46319
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-3/data/info.pb
--webserver_interface=127.13.170.4
--webserver_port=34937
--tserver_master_addrs=127.13.170.62:35815
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.170.4
--log_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-3/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3722ed49c19ce54c7feae2fa944e32b1d4ed8d2d
build type FASTDEBUG
built by None at 01 Feb 2026 02:43:22 UTC on 24a791456cd2
build id 10288
ASAN enabled
I20260201 02:57:11.347931 17758 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260201 02:57:11.349910 17758 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 02:57:11.361339 17765 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 02:57:11.361250 17767 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 02:57:11.361304 17764 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 02:57:11.361832 17758 server_base.cc:1060] running on GCE node
I20260201 02:57:11.362912 17758 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260201 02:57:11.363957 17758 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260201 02:57:11.365173 17758 hybrid_clock.cc:648] HybridClock initialized: now 1769914631365108 us; error 60 us; skew 500 ppm
I20260201 02:57:11.365505 17758 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 02:57:11.368122 17758 webserver.cc:492] Webserver started at http://127.13.170.4:34937/ using document root <none> and password file <none>
I20260201 02:57:11.369078 17758 fs_manager.cc:362] Metadata directory not provided
I20260201 02:57:11.369182 17758 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 02:57:11.375527 17758 fs_manager.cc:714] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260201 02:57:11.379094 17773 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 02:57:11.380708 17758 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260201 02:57:11.380923 17758 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-3/data,/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-3/wal
uuid: "94d535b533b04887be4fac8a82a48cb1"
format_stamp: "Formatted at 2026-02-01 02:56:21 on dist-test-slave-4krj"
I20260201 02:57:11.381728 17758 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-3/wal
metadata directory: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-3/wal
1 data directories: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260201 02:57:11.383033 17092 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42532: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:57:11.385242 17092 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42532: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
I20260201 02:57:11.413475 17758 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 02:57:11.414369 17758 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260201 02:57:11.414642 17758 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 02:57:11.415774 17758 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260201 02:57:11.418074 17780 ts_tablet_manager.cc:548] Loading tablet metadata (0/1 complete)
I20260201 02:57:11.424868 17758 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260201 02:57:11.424978 17758 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.007s user 0.001s sys 0.000s
I20260201 02:57:11.425143 17758 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260201 02:57:11.428442 17758 ts_tablet_manager.cc:616] Registered 1 tablets
I20260201 02:57:11.428578 17758 ts_tablet_manager.cc:595] Time spent register tablets: real 0.003s user 0.000s sys 0.002s
I20260201 02:57:11.429335 17780 tablet_bootstrap.cc:492] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1: Bootstrap starting.
W20260201 02:57:11.450492 17364 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44994: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:57:11.452574 17364 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44994: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
I20260201 02:57:11.512482 17758 rpc_server.cc:307] RPC server started. Bound to: 127.13.170.4:46319
I20260201 02:57:11.512645 17886 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.170.4:46319 every 8 connection(s)
I20260201 02:57:11.514703 17758 server_base.cc:1192] Dumped server information to /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-3/data/info.pb
I20260201 02:57:11.521261 13992 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskfoNO09/build/asan/bin/kudu as pid 17758
I20260201 02:57:11.521607 13992 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-taskfoNO09/build/asan/bin/kudu pid 17049
I20260201 02:57:11.542090 17173 generic_service.cc:196] Checking for leaks (request via RPC)
I20260201 02:57:11.543629 17887 heartbeater.cc:344] Connected to a master server at 127.13.170.62:35815
I20260201 02:57:11.544078 17887 heartbeater.cc:461] Registering TS with master...
I20260201 02:57:11.545338 17887 heartbeater.cc:507] Master 127.13.170.62:35815 requested a full tablet report, sending...
I20260201 02:57:11.551352 15229 ts_manager.cc:194] Re-registered known tserver with Master: 94d535b533b04887be4fac8a82a48cb1 (127.13.170.4:46319)
I20260201 02:57:11.552603 15229 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.13.170.4:59903
W20260201 02:57:11.810495 17092 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42532: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:57:11.811295 17091 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42532: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
I20260201 02:57:11.811782 13992 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskfoNO09/build/asan/bin/kudu with pid 17049
I20260201 02:57:11.858907 13992 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskfoNO09/build/asan/bin/kudu
/tmp/dist-test-taskfoNO09/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.170.2:36827
--local_ip_for_outbound_sockets=127.13.170.2
--tserver_master_addrs=127.13.170.62:35815
--webserver_port=44123
--webserver_interface=127.13.170.2
--builtin_ntp_servers=127.13.170.20:35371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
W20260201 02:57:11.879396 17364 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44994: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:57:11.879438 17365 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44994: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:57:11.882302 17364 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44994: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:57:11.913105 17364 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44994: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:57:11.953394 15821 meta_cache.cc:302] tablet 0faa3d899dba409fa6df255630da23e4: replica 7c282a4e4a074f7cb7fada1519e23c9b (127.13.170.2:36827) has failed: Network error: Client connection negotiation failed: client connection to 127.13.170.2:36827: connect: Connection refused (error 111)
W20260201 02:57:11.965616 17364 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44994: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:57:12.015558 17364 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44994: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:57:12.021531 17364 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44994: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:57:12.023692 17364 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44994: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:57:12.076449 17364 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44994: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
I20260201 02:57:12.141196 17780 log.cc:826] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1: Log is configured to *not* fsync() on all Append() calls
W20260201 02:57:12.146415 17364 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44994: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:57:12.167558 17364 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44994: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:57:12.223472 17364 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44994: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:57:12.265758 17895 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260201 02:57:12.266091 17895 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260201 02:57:12.266285 17895 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260201 02:57:12.275368 17895 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260201 02:57:12.275625 17895 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.170.2
I20260201 02:57:12.290206 17895 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.170.20:35371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.170.2:36827
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.170.2
--webserver_port=44123
--tserver_master_addrs=127.13.170.62:35815
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.170.2
--log_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3722ed49c19ce54c7feae2fa944e32b1d4ed8d2d
build type FASTDEBUG
built by None at 01 Feb 2026 02:43:22 UTC on 24a791456cd2
build id 10288
ASAN enabled
I20260201 02:57:12.292517 17895 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260201 02:57:12.294831 17895 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 02:57:12.307260 17901 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 02:57:12.307991 17902 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 02:57:12.309319 17905 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 02:57:12.311014 17364 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44994: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
I20260201 02:57:12.314668 17895 server_base.cc:1060] running on GCE node
I20260201 02:57:12.315436 17895 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260201 02:57:12.316603 17895 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260201 02:57:12.317888 17895 hybrid_clock.cc:648] HybridClock initialized: now 1769914632317822 us; error 55 us; skew 500 ppm
I20260201 02:57:12.318348 17895 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 02:57:12.321658 17895 webserver.cc:492] Webserver started at http://127.13.170.2:44123/ using document root <none> and password file <none>
I20260201 02:57:12.322883 17895 fs_manager.cc:362] Metadata directory not provided
I20260201 02:57:12.323086 17895 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
W20260201 02:57:12.324622 17364 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44994: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:57:12.324625 17365 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44994: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
I20260201 02:57:12.331497 17895 fs_manager.cc:714] Time spent opening directory manager: real 0.005s user 0.005s sys 0.000s
I20260201 02:57:12.335907 17910 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 02:57:12.344233 17895 fs_manager.cc:730] Time spent opening block manager: real 0.011s user 0.000s sys 0.003s
I20260201 02:57:12.344498 17895 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-1/data,/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-1/wal
uuid: "7c282a4e4a074f7cb7fada1519e23c9b"
format_stamp: "Formatted at 2026-02-01 02:56:20 on dist-test-slave-4krj"
I20260201 02:57:12.345621 17895 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 02:57:12.370128 17895 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 02:57:12.371356 17895 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260201 02:57:12.371716 17895 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 02:57:12.373008 17895 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260201 02:57:12.375885 17917 ts_tablet_manager.cc:548] Loading tablet metadata (0/1 complete)
I20260201 02:57:12.382341 17895 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260201 02:57:12.382494 17895 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.007s user 0.000s sys 0.001s
I20260201 02:57:12.382688 17895 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260201 02:57:12.387288 17895 ts_tablet_manager.cc:616] Registered 1 tablets
I20260201 02:57:12.387432 17895 ts_tablet_manager.cc:595] Time spent register tablets: real 0.005s user 0.004s sys 0.001s
I20260201 02:57:12.388207 17917 tablet_bootstrap.cc:492] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b: Bootstrap starting.
W20260201 02:57:12.403563 17365 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44994: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
I20260201 02:57:12.483274 17895 rpc_server.cc:307] RPC server started. Bound to: 127.13.170.2:36827
I20260201 02:57:12.483340 18023 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.170.2:36827 every 8 connection(s)
I20260201 02:57:12.485805 17895 server_base.cc:1192] Dumped server information to /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-1/data/info.pb
I20260201 02:57:12.488216 13992 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskfoNO09/build/asan/bin/kudu as pid 17895
I20260201 02:57:12.488492 13992 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-taskfoNO09/build/asan/bin/kudu pid 17186
W20260201 02:57:12.511757 17365 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44994: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
I20260201 02:57:12.522835 17309 generic_service.cc:196] Checking for leaks (request via RPC)
I20260201 02:57:12.531309 18024 heartbeater.cc:344] Connected to a master server at 127.13.170.62:35815
I20260201 02:57:12.531806 18024 heartbeater.cc:461] Registering TS with master...
I20260201 02:57:12.533061 18024 heartbeater.cc:507] Master 127.13.170.62:35815 requested a full tablet report, sending...
I20260201 02:57:12.536094 15229 ts_manager.cc:194] Re-registered known tserver with Master: 7c282a4e4a074f7cb7fada1519e23c9b (127.13.170.2:36827)
I20260201 02:57:12.537734 15229 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.13.170.2:60023
I20260201 02:57:12.556309 17887 heartbeater.cc:499] Master 127.13.170.62:35815 was elected leader, sending a full tablet report...
W20260201 02:57:12.643271 17365 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44994: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
I20260201 02:57:12.674993 13992 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskfoNO09/build/asan/bin/kudu with pid 17186
W20260201 02:57:12.684418 17364 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44994: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:57:12.689471 17365 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44994: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
I20260201 02:57:12.703641 13992 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskfoNO09/build/asan/bin/kudu
/tmp/dist-test-taskfoNO09/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.170.1:41937
--local_ip_for_outbound_sockets=127.13.170.1
--tserver_master_addrs=127.13.170.62:35815
--webserver_port=35425
--webserver_interface=127.13.170.1
--builtin_ntp_servers=127.13.170.20:35371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
W20260201 02:57:12.772590 17365 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44994: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:57:12.904973 17365 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44994: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:57:12.936771 17364 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44994: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:57:12.937920 17365 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44994: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:57:13.050153 17365 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44994: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:57:13.197146 17365 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44994: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:57:13.199656 17364 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44994: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:57:13.200780 17365 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44994: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:57:13.253005 18032 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260201 02:57:13.253572 18032 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260201 02:57:13.253731 18032 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260201 02:57:13.268565 18032 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260201 02:57:13.268867 18032 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.170.1
I20260201 02:57:13.286109 18032 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.170.20:35371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.170.1:41937
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.170.1
--webserver_port=35425
--tserver_master_addrs=127.13.170.62:35815
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.170.1
--log_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3722ed49c19ce54c7feae2fa944e32b1d4ed8d2d
build type FASTDEBUG
built by None at 01 Feb 2026 02:43:22 UTC on 24a791456cd2
build id 10288
ASAN enabled
I20260201 02:57:13.288559 18032 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260201 02:57:13.291306 18032 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 02:57:13.306859 18037 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 02:57:13.311092 18038 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 02:57:13.315914 18040 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 02:57:13.316769 18032 server_base.cc:1060] running on GCE node
I20260201 02:57:13.317565 18032 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260201 02:57:13.318843 18032 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260201 02:57:13.320180 18032 hybrid_clock.cc:648] HybridClock initialized: now 1769914633320111 us; error 71 us; skew 500 ppm
I20260201 02:57:13.320559 18032 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 02:57:13.323262 18032 webserver.cc:492] Webserver started at http://127.13.170.1:35425/ using document root <none> and password file <none>
I20260201 02:57:13.324136 18032 fs_manager.cc:362] Metadata directory not provided
I20260201 02:57:13.324293 18032 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 02:57:13.330989 18032 fs_manager.cc:714] Time spent opening directory manager: real 0.004s user 0.007s sys 0.000s
I20260201 02:57:13.334221 18046 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 02:57:13.335865 18032 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260201 02:57:13.336083 18032 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-0/data,/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-0/wal
uuid: "f4dd4e7188e44b518d7df7246414a2d6"
format_stamp: "Formatted at 2026-02-01 02:56:19 on dist-test-slave-4krj"
I20260201 02:57:13.336856 18032 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260201 02:57:13.355247 17365 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44994: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
I20260201 02:57:13.363760 18032 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 02:57:13.365170 18032 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260201 02:57:13.365491 18032 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 02:57:13.366681 18032 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260201 02:57:13.368711 18032 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260201 02:57:13.368821 18032 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260201 02:57:13.368991 18032 ts_tablet_manager.cc:616] Registered 0 tablets
I20260201 02:57:13.369123 18032 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
W20260201 02:57:13.377789 17365 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44994: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:57:13.382270 17365 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44994: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
I20260201 02:57:13.392040 17917 log.cc:826] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b: Log is configured to *not* fsync() on all Append() calls
I20260201 02:57:13.461493 18032 rpc_server.cc:307] RPC server started. Bound to: 127.13.170.1:41937
I20260201 02:57:13.461544 18159 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.170.1:41937 every 8 connection(s)
I20260201 02:57:13.463693 18032 server_base.cc:1192] Dumped server information to /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-0/data/info.pb
I20260201 02:57:13.474371 13992 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskfoNO09/build/asan/bin/kudu as pid 18032
I20260201 02:57:13.474669 13992 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-taskfoNO09/build/asan/bin/kudu pid 17321
W20260201 02:57:13.520860 17365 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44994: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
I20260201 02:57:13.532639 17444 generic_service.cc:196] Checking for leaks (request via RPC)
I20260201 02:57:13.535909 18160 heartbeater.cc:344] Connected to a master server at 127.13.170.62:35815
I20260201 02:57:13.536386 18160 heartbeater.cc:461] Registering TS with master...
I20260201 02:57:13.537567 18160 heartbeater.cc:507] Master 127.13.170.62:35815 requested a full tablet report, sending...
I20260201 02:57:13.539686 15229 ts_manager.cc:194] Re-registered known tserver with Master: f4dd4e7188e44b518d7df7246414a2d6 (127.13.170.1:41937)
I20260201 02:57:13.540788 15229 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.13.170.1:44447
I20260201 02:57:13.540961 18024 heartbeater.cc:499] Master 127.13.170.62:35815 was elected leader, sending a full tablet report...
W20260201 02:57:13.949910 17365 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44994: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:57:13.951972 17364 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44994: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
W20260201 02:57:13.953287 17365 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44994: Illegal state: replica d74315e006374d648477a8e6109e44a7 is not leader of this config: current role FOLLOWER
I20260201 02:57:13.955042 13992 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskfoNO09/build/asan/bin/kudu with pid 17321
I20260201 02:57:14.083789 13992 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskfoNO09/build/asan/bin/kudu
/tmp/dist-test-taskfoNO09/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.170.3:41669
--local_ip_for_outbound_sockets=127.13.170.3
--tserver_master_addrs=127.13.170.62:35815
--webserver_port=40805
--webserver_interface=127.13.170.3
--builtin_ntp_servers=127.13.170.20:35371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
W20260201 02:57:14.154904 15822 meta_cache.cc:302] tablet 0faa3d899dba409fa6df255630da23e4: replica d74315e006374d648477a8e6109e44a7 (127.13.170.3:41669) has failed: Network error: Client connection negotiation failed: client connection to 127.13.170.3:41669: connect: Connection refused (error 111)
I20260201 02:57:14.546360 18160 heartbeater.cc:499] Master 127.13.170.62:35815 was elected leader, sending a full tablet report...
W20260201 02:57:14.595072 18167 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260201 02:57:14.595525 18167 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260201 02:57:14.595717 18167 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260201 02:57:14.605034 18167 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260201 02:57:14.605312 18167 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.170.3
I20260201 02:57:14.616961 18167 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.170.20:35371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.170.3:41669
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.170.3
--webserver_port=40805
--tserver_master_addrs=127.13.170.62:35815
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.170.3
--log_dir=/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3722ed49c19ce54c7feae2fa944e32b1d4ed8d2d
build type FASTDEBUG
built by None at 01 Feb 2026 02:43:22 UTC on 24a791456cd2
build id 10288
ASAN enabled
I20260201 02:57:14.618898 18167 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260201 02:57:14.621074 18167 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 02:57:14.638321 18173 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 02:57:14.639468 18174 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 02:57:14.648470 18176 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 02:57:14.648960 18167 server_base.cc:1060] running on GCE node
I20260201 02:57:14.649783 18167 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260201 02:57:14.651543 18167 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260201 02:57:14.652793 18167 hybrid_clock.cc:648] HybridClock initialized: now 1769914634652720 us; error 71 us; skew 500 ppm
I20260201 02:57:14.653255 18167 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 02:57:14.656086 18167 webserver.cc:492] Webserver started at http://127.13.170.3:40805/ using document root <none> and password file <none>
I20260201 02:57:14.656956 18167 fs_manager.cc:362] Metadata directory not provided
I20260201 02:57:14.657109 18167 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 02:57:14.663576 18167 fs_manager.cc:714] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260201 02:57:14.667135 18182 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 02:57:14.669056 18167 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260201 02:57:14.669291 18167 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-2/data,/tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-2/wal
uuid: "d74315e006374d648477a8e6109e44a7"
format_stamp: "Formatted at 2026-02-01 02:56:20 on dist-test-slave-4krj"
I20260201 02:57:14.670163 18167 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 02:57:14.691519 18167 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 02:57:14.692529 18167 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260201 02:57:14.692878 18167 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 02:57:14.695147 18167 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260201 02:57:14.697788 18189 ts_tablet_manager.cc:548] Loading tablet metadata (0/1 complete)
I20260201 02:57:14.704599 18167 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260201 02:57:14.704753 18167 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.007s user 0.001s sys 0.000s
I20260201 02:57:14.704911 18167 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260201 02:57:14.708748 18167 ts_tablet_manager.cc:616] Registered 1 tablets
I20260201 02:57:14.708916 18167 ts_tablet_manager.cc:595] Time spent register tablets: real 0.004s user 0.003s sys 0.000s
I20260201 02:57:14.709590 18189 tablet_bootstrap.cc:492] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7: Bootstrap starting.
W20260201 02:57:15.249429 15822 meta_cache.cc:302] tablet 0faa3d899dba409fa6df255630da23e4: replica d74315e006374d648477a8e6109e44a7 (127.13.170.3:41669) has failed: Network error: Client connection negotiation failed: client connection to 127.13.170.3:41669: connect: Connection refused (error 111)
I20260201 02:57:15.435439 18295 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.170.3:41669 every 8 connection(s)
I20260201 02:57:15.435808 18167 rpc_server.cc:307] RPC server started. Bound to: 127.13.170.3:41669
I20260201 02:57:15.438045 18167 server_base.cc:1192] Dumped server information to /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0/minicluster-data/ts-2/data/info.pb
I20260201 02:57:15.447300 13992 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskfoNO09/build/asan/bin/kudu as pid 18167
I20260201 02:57:15.511184 18296 heartbeater.cc:344] Connected to a master server at 127.13.170.62:35815
I20260201 02:57:15.511628 18296 heartbeater.cc:461] Registering TS with master...
I20260201 02:57:15.514940 18296 heartbeater.cc:507] Master 127.13.170.62:35815 requested a full tablet report, sending...
I20260201 02:57:15.518242 15224 ts_manager.cc:194] Re-registered known tserver with Master: d74315e006374d648477a8e6109e44a7 (127.13.170.3:41669)
I20260201 02:57:15.519927 15224 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.13.170.3:35739
I20260201 02:57:16.223892 18189 log.cc:826] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7: Log is configured to *not* fsync() on all Append() calls
I20260201 02:57:16.428936 18095 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260201 02:57:16.429937 18231 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260201 02:57:16.441576 17822 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260201 02:57:16.477962 17959 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260201 02:57:16.524729 18296 heartbeater.cc:499] Master 127.13.170.62:35815 was elected leader, sending a full tablet report...
I20260201 02:57:17.144492 17780 tablet_bootstrap.cc:492] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1: Bootstrap replaying log segment 1/1 (2.23M/4.16M this segment, stats: ops{read=1290 overwritten=0 applied=1289 ignored=0} inserts{seen=64350 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0)
I20260201 02:57:18.398530 17917 tablet_bootstrap.cc:492] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b: Bootstrap replaying log segment 1/1 (2.12M/4.14M this segment, stats: ops{read=1226 overwritten=2 applied=1223 ignored=0} inserts{seen=61050 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0)
I20260201 02:57:20.272944 17780 tablet_bootstrap.cc:492] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1: Bootstrap replayed 1/1 log segments. Stats: ops{read=2405 overwritten=0 applied=2404 ignored=0} inserts{seen=120050 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260201 02:57:20.273732 17780 tablet_bootstrap.cc:492] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1: Bootstrap complete.
I20260201 02:57:20.275525 17780 ts_tablet_manager.cc:1403] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1: Time spent bootstrapping tablet: real 8.847s user 7.984s sys 0.550s
I20260201 02:57:20.281716 17780 raft_consensus.cc:359] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 8 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d535b533b04887be4fac8a82a48cb1" member_type: VOTER last_known_addr { host: "127.13.170.4" port: 46319 } } peers { permanent_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 36827 } } peers { permanent_uuid: "d74315e006374d648477a8e6109e44a7" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 41669 } }
I20260201 02:57:20.285090 17780 raft_consensus.cc:740] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 8 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94d535b533b04887be4fac8a82a48cb1, State: Initialized, Role: FOLLOWER
I20260201 02:57:20.286222 17780 consensus_queue.cc:260] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2404, Last appended: 6.2405, Last appended by leader: 2405, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d535b533b04887be4fac8a82a48cb1" member_type: VOTER last_known_addr { host: "127.13.170.4" port: 46319 } } peers { permanent_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 36827 } } peers { permanent_uuid: "d74315e006374d648477a8e6109e44a7" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 41669 } }
I20260201 02:57:20.288501 17780 ts_tablet_manager.cc:1434] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1: Time spent starting tablet: real 0.013s user 0.011s sys 0.000s
W20260201 02:57:20.350592 17802 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43324: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
I20260201 02:57:20.589530 18339 raft_consensus.cc:493] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 02:57:20.589851 18339 raft_consensus.cc:515] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d535b533b04887be4fac8a82a48cb1" member_type: VOTER last_known_addr { host: "127.13.170.4" port: 46319 } } peers { permanent_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 36827 } } peers { permanent_uuid: "d74315e006374d648477a8e6109e44a7" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 41669 } }
I20260201 02:57:20.597684 18339 leader_election.cc:290] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7c282a4e4a074f7cb7fada1519e23c9b (127.13.170.2:36827), d74315e006374d648477a8e6109e44a7 (127.13.170.3:41669)
I20260201 02:57:20.616511 18251 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0faa3d899dba409fa6df255630da23e4" candidate_uuid: "94d535b533b04887be4fac8a82a48cb1" candidate_term: 9 candidate_status { last_received { term: 6 index: 2405 } } ignore_live_leader: false dest_uuid: "d74315e006374d648477a8e6109e44a7" is_pre_election: true
W20260201 02:57:20.620064 17775 leader_election.cc:343] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [CANDIDATE]: Term 9 pre-election: Tablet error from VoteRequest() call to peer d74315e006374d648477a8e6109e44a7 (127.13.170.3:41669): Illegal state: must be running to vote when last-logged opid is not known
I20260201 02:57:20.618330 17979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0faa3d899dba409fa6df255630da23e4" candidate_uuid: "94d535b533b04887be4fac8a82a48cb1" candidate_term: 9 candidate_status { last_received { term: 6 index: 2405 } } ignore_live_leader: false dest_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" is_pre_election: true
W20260201 02:57:20.621788 17774 leader_election.cc:343] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [CANDIDATE]: Term 9 pre-election: Tablet error from VoteRequest() call to peer 7c282a4e4a074f7cb7fada1519e23c9b (127.13.170.2:36827): Illegal state: must be running to vote when last-logged opid is not known
I20260201 02:57:20.621968 17774 leader_election.cc:304] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94d535b533b04887be4fac8a82a48cb1; no voters: 7c282a4e4a074f7cb7fada1519e23c9b, d74315e006374d648477a8e6109e44a7
I20260201 02:57:20.622466 18339 raft_consensus.cc:2749] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260201 02:57:20.664937 17802 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43324: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:57:20.797087 17802 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43324: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
I20260201 02:57:21.018154 18339 raft_consensus.cc:493] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 02:57:21.018388 18339 raft_consensus.cc:515] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d535b533b04887be4fac8a82a48cb1" member_type: VOTER last_known_addr { host: "127.13.170.4" port: 46319 } } peers { permanent_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 36827 } } peers { permanent_uuid: "d74315e006374d648477a8e6109e44a7" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 41669 } }
I20260201 02:57:21.019197 18339 leader_election.cc:290] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7c282a4e4a074f7cb7fada1519e23c9b (127.13.170.2:36827), d74315e006374d648477a8e6109e44a7 (127.13.170.3:41669)
I20260201 02:57:21.019829 18251 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0faa3d899dba409fa6df255630da23e4" candidate_uuid: "94d535b533b04887be4fac8a82a48cb1" candidate_term: 9 candidate_status { last_received { term: 6 index: 2405 } } ignore_live_leader: false dest_uuid: "d74315e006374d648477a8e6109e44a7" is_pre_election: true
I20260201 02:57:21.020087 17979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0faa3d899dba409fa6df255630da23e4" candidate_uuid: "94d535b533b04887be4fac8a82a48cb1" candidate_term: 9 candidate_status { last_received { term: 6 index: 2405 } } ignore_live_leader: false dest_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" is_pre_election: true
W20260201 02:57:21.020488 17775 leader_election.cc:343] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [CANDIDATE]: Term 9 pre-election: Tablet error from VoteRequest() call to peer d74315e006374d648477a8e6109e44a7 (127.13.170.3:41669): Illegal state: must be running to vote when last-logged opid is not known
W20260201 02:57:21.020748 17774 leader_election.cc:343] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [CANDIDATE]: Term 9 pre-election: Tablet error from VoteRequest() call to peer 7c282a4e4a074f7cb7fada1519e23c9b (127.13.170.2:36827): Illegal state: must be running to vote when last-logged opid is not known
I20260201 02:57:21.020887 17774 leader_election.cc:304] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94d535b533b04887be4fac8a82a48cb1; no voters: 7c282a4e4a074f7cb7fada1519e23c9b, d74315e006374d648477a8e6109e44a7
I20260201 02:57:21.021176 18339 raft_consensus.cc:2749] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260201 02:57:21.111968 17802 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43324: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
I20260201 02:57:21.230973 18189 tablet_bootstrap.cc:492] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7: Bootstrap replaying log segment 1/1 (2.27M/4.04M this segment, stats: ops{read=1314 overwritten=0 applied=1313 ignored=0} inserts{seen=65550 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0)
W20260201 02:57:21.254195 17802 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43324: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:57:21.567020 17802 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43324: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
I20260201 02:57:21.591504 18344 raft_consensus.cc:493] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 02:57:21.591730 18344 raft_consensus.cc:515] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d535b533b04887be4fac8a82a48cb1" member_type: VOTER last_known_addr { host: "127.13.170.4" port: 46319 } } peers { permanent_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 36827 } } peers { permanent_uuid: "d74315e006374d648477a8e6109e44a7" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 41669 } }
I20260201 02:57:21.592530 18344 leader_election.cc:290] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7c282a4e4a074f7cb7fada1519e23c9b (127.13.170.2:36827), d74315e006374d648477a8e6109e44a7 (127.13.170.3:41669)
I20260201 02:57:21.593070 17979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0faa3d899dba409fa6df255630da23e4" candidate_uuid: "94d535b533b04887be4fac8a82a48cb1" candidate_term: 9 candidate_status { last_received { term: 6 index: 2405 } } ignore_live_leader: false dest_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" is_pre_election: true
I20260201 02:57:21.593298 18251 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0faa3d899dba409fa6df255630da23e4" candidate_uuid: "94d535b533b04887be4fac8a82a48cb1" candidate_term: 9 candidate_status { last_received { term: 6 index: 2405 } } ignore_live_leader: false dest_uuid: "d74315e006374d648477a8e6109e44a7" is_pre_election: true
W20260201 02:57:21.593730 17774 leader_election.cc:343] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [CANDIDATE]: Term 9 pre-election: Tablet error from VoteRequest() call to peer 7c282a4e4a074f7cb7fada1519e23c9b (127.13.170.2:36827): Illegal state: must be running to vote when last-logged opid is not known
W20260201 02:57:21.593904 17775 leader_election.cc:343] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [CANDIDATE]: Term 9 pre-election: Tablet error from VoteRequest() call to peer d74315e006374d648477a8e6109e44a7 (127.13.170.3:41669): Illegal state: must be running to vote when last-logged opid is not known
I20260201 02:57:21.594033 17775 leader_election.cc:304] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94d535b533b04887be4fac8a82a48cb1; no voters: 7c282a4e4a074f7cb7fada1519e23c9b, d74315e006374d648477a8e6109e44a7
I20260201 02:57:21.594332 18344 raft_consensus.cc:2749] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260201 02:57:21.717521 17802 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43324: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
I20260201 02:57:21.908227 18344 raft_consensus.cc:493] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 02:57:21.908445 18344 raft_consensus.cc:515] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d535b533b04887be4fac8a82a48cb1" member_type: VOTER last_known_addr { host: "127.13.170.4" port: 46319 } } peers { permanent_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 36827 } } peers { permanent_uuid: "d74315e006374d648477a8e6109e44a7" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 41669 } }
I20260201 02:57:21.909170 18344 leader_election.cc:290] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7c282a4e4a074f7cb7fada1519e23c9b (127.13.170.2:36827), d74315e006374d648477a8e6109e44a7 (127.13.170.3:41669)
I20260201 02:57:21.910000 18251 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0faa3d899dba409fa6df255630da23e4" candidate_uuid: "94d535b533b04887be4fac8a82a48cb1" candidate_term: 9 candidate_status { last_received { term: 6 index: 2405 } } ignore_live_leader: false dest_uuid: "d74315e006374d648477a8e6109e44a7" is_pre_election: true
I20260201 02:57:21.911020 17979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0faa3d899dba409fa6df255630da23e4" candidate_uuid: "94d535b533b04887be4fac8a82a48cb1" candidate_term: 9 candidate_status { last_received { term: 6 index: 2405 } } ignore_live_leader: false dest_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" is_pre_election: true
W20260201 02:57:21.911727 17775 leader_election.cc:343] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [CANDIDATE]: Term 9 pre-election: Tablet error from VoteRequest() call to peer d74315e006374d648477a8e6109e44a7 (127.13.170.3:41669): Illegal state: must be running to vote when last-logged opid is not known
W20260201 02:57:21.912325 17774 leader_election.cc:343] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [CANDIDATE]: Term 9 pre-election: Tablet error from VoteRequest() call to peer 7c282a4e4a074f7cb7fada1519e23c9b (127.13.170.2:36827): Illegal state: must be running to vote when last-logged opid is not known
I20260201 02:57:21.912472 17774 leader_election.cc:304] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94d535b533b04887be4fac8a82a48cb1; no voters: 7c282a4e4a074f7cb7fada1519e23c9b, d74315e006374d648477a8e6109e44a7
I20260201 02:57:21.912971 18344 raft_consensus.cc:2749] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260201 02:57:22.032608 17802 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43324: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:57:22.183688 17802 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43324: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
W20260201 02:57:22.504858 17802 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43324: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
I20260201 02:57:22.560504 17959 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260201 02:57:22.574491 17822 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260201 02:57:22.586333 18095 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260201 02:57:22.628278 18231 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
W20260201 02:57:22.663656 17802 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43324: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
I20260201 02:57:22.695416 17917 tablet_bootstrap.cc:492] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2407 overwritten=2 applied=2404 ignored=0} inserts{seen=120050 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260201 02:57:22.696228 17917 tablet_bootstrap.cc:492] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b: Bootstrap complete.
I20260201 02:57:22.698060 17917 ts_tablet_manager.cc:1403] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b: Time spent bootstrapping tablet: real 10.311s user 9.508s sys 0.571s
I20260201 02:57:22.702965 17917 raft_consensus.cc:359] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [term 7 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d535b533b04887be4fac8a82a48cb1" member_type: VOTER last_known_addr { host: "127.13.170.4" port: 46319 } } peers { permanent_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 36827 } } peers { permanent_uuid: "d74315e006374d648477a8e6109e44a7" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 41669 } }
I20260201 02:57:22.706517 17917 raft_consensus.cc:740] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [term 7 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c282a4e4a074f7cb7fada1519e23c9b, State: Initialized, Role: FOLLOWER
I20260201 02:57:22.707528 17917 consensus_queue.cc:260] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2404, Last appended: 6.2405, Last appended by leader: 2405, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d535b533b04887be4fac8a82a48cb1" member_type: VOTER last_known_addr { host: "127.13.170.4" port: 46319 } } peers { permanent_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 36827 } } peers { permanent_uuid: "d74315e006374d648477a8e6109e44a7" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 41669 } }
I20260201 02:57:22.712195 17917 ts_tablet_manager.cc:1434] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b: Time spent starting tablet: real 0.014s user 0.009s sys 0.007s
W20260201 02:57:22.826839 17938 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:47758: Illegal state: replica 7c282a4e4a074f7cb7fada1519e23c9b is not leader of this config: current role FOLLOWER
W20260201 02:57:22.990931 17802 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43324: Illegal state: replica 94d535b533b04887be4fac8a82a48cb1 is not leader of this config: current role FOLLOWER
I20260201 02:57:23.048426 18379 raft_consensus.cc:493] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 02:57:23.048736 18379 raft_consensus.cc:515] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d535b533b04887be4fac8a82a48cb1" member_type: VOTER last_known_addr { host: "127.13.170.4" port: 46319 } } peers { permanent_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 36827 } } peers { permanent_uuid: "d74315e006374d648477a8e6109e44a7" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 41669 } }
I20260201 02:57:23.050601 18379 leader_election.cc:290] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 94d535b533b04887be4fac8a82a48cb1 (127.13.170.4:46319), d74315e006374d648477a8e6109e44a7 (127.13.170.3:41669)
I20260201 02:57:23.059128 17842 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0faa3d899dba409fa6df255630da23e4" candidate_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" candidate_term: 8 candidate_status { last_received { term: 6 index: 2405 } } ignore_live_leader: false dest_uuid: "94d535b533b04887be4fac8a82a48cb1" is_pre_election: true
I20260201 02:57:23.059321 18251 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0faa3d899dba409fa6df255630da23e4" candidate_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" candidate_term: 8 candidate_status { last_received { term: 6 index: 2405 } } ignore_live_leader: false dest_uuid: "d74315e006374d648477a8e6109e44a7" is_pre_election: true
I20260201 02:57:23.059578 17842 raft_consensus.cc:2468] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c282a4e4a074f7cb7fada1519e23c9b in term 8.
W20260201 02:57:23.060034 17912 leader_election.cc:343] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [CANDIDATE]: Term 8 pre-election: Tablet error from VoteRequest() call to peer d74315e006374d648477a8e6109e44a7 (127.13.170.3:41669): Illegal state: must be running to vote when last-logged opid is not known
I20260201 02:57:23.060379 17914 leader_election.cc:304] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c282a4e4a074f7cb7fada1519e23c9b, 94d535b533b04887be4fac8a82a48cb1; no voters: d74315e006374d648477a8e6109e44a7
I20260201 02:57:23.060773 18379 raft_consensus.cc:2804] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260201 02:57:23.060940 18379 raft_consensus.cc:493] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 02:57:23.061053 18379 raft_consensus.cc:3060] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [term 7 FOLLOWER]: Advancing to term 8
I20260201 02:57:23.064402 18379 raft_consensus.cc:515] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d535b533b04887be4fac8a82a48cb1" member_type: VOTER last_known_addr { host: "127.13.170.4" port: 46319 } } peers { permanent_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 36827 } } peers { permanent_uuid: "d74315e006374d648477a8e6109e44a7" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 41669 } }
I20260201 02:57:23.065141 18379 leader_election.cc:290] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [CANDIDATE]: Term 8 election: Requested vote from peers 94d535b533b04887be4fac8a82a48cb1 (127.13.170.4:46319), d74315e006374d648477a8e6109e44a7 (127.13.170.3:41669)
I20260201 02:57:23.065737 18251 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0faa3d899dba409fa6df255630da23e4" candidate_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" candidate_term: 8 candidate_status { last_received { term: 6 index: 2405 } } ignore_live_leader: false dest_uuid: "d74315e006374d648477a8e6109e44a7"
I20260201 02:57:23.065724 17842 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0faa3d899dba409fa6df255630da23e4" candidate_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" candidate_term: 8 candidate_status { last_received { term: 6 index: 2405 } } ignore_live_leader: false dest_uuid: "94d535b533b04887be4fac8a82a48cb1"
W20260201 02:57:23.066284 17912 leader_election.cc:343] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [CANDIDATE]: Term 8 election: Tablet error from VoteRequest() call to peer d74315e006374d648477a8e6109e44a7 (127.13.170.3:41669): Illegal state: must be running to vote when last-logged opid is not known
I20260201 02:57:23.069473 17842 raft_consensus.cc:2468] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c282a4e4a074f7cb7fada1519e23c9b in term 8.
I20260201 02:57:23.070083 17914 leader_election.cc:304] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c282a4e4a074f7cb7fada1519e23c9b, 94d535b533b04887be4fac8a82a48cb1; no voters: d74315e006374d648477a8e6109e44a7
I20260201 02:57:23.070465 18379 raft_consensus.cc:2804] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [term 8 FOLLOWER]: Leader election won for term 8
I20260201 02:57:23.070966 18379 raft_consensus.cc:697] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [term 8 LEADER]: Becoming Leader. State: Replica: 7c282a4e4a074f7cb7fada1519e23c9b, State: Running, Role: LEADER
I20260201 02:57:23.071902 18379 consensus_queue.cc:237] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2404, Committed index: 2404, Last appended: 6.2405, Last appended by leader: 2405, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d535b533b04887be4fac8a82a48cb1" member_type: VOTER last_known_addr { host: "127.13.170.4" port: 46319 } } peers { permanent_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 36827 } } peers { permanent_uuid: "d74315e006374d648477a8e6109e44a7" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 41669 } }
I20260201 02:57:23.077167 15224 catalog_manager.cc:5654] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b reported cstate change: term changed from 6 to 8, leader changed from 94d535b533b04887be4fac8a82a48cb1 (127.13.170.4) to 7c282a4e4a074f7cb7fada1519e23c9b (127.13.170.2). New cstate: current_term: 8 leader_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d535b533b04887be4fac8a82a48cb1" member_type: VOTER last_known_addr { host: "127.13.170.4" port: 46319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 36827 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d74315e006374d648477a8e6109e44a7" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 41669 } health_report { overall_health: UNKNOWN } } }
W20260201 02:57:23.155975 17912 consensus_peers.cc:597] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b -> Peer d74315e006374d648477a8e6109e44a7 (127.13.170.3:41669): Couldn't send request to peer d74315e006374d648477a8e6109e44a7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260201 02:57:23.156119 17842 raft_consensus.cc:1275] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 8 FOLLOWER]: Refusing update from remote peer 7c282a4e4a074f7cb7fada1519e23c9b: Log matching property violated. Preceding OpId in replica: term: 6 index: 2405. Preceding OpId from leader: term: 8 index: 2407. (index mismatch)
I20260201 02:57:23.157078 18383 consensus_queue.cc:1048] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "94d535b533b04887be4fac8a82a48cb1" member_type: VOTER last_known_addr { host: "127.13.170.4" port: 46319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2406, Last known committed idx: 2404, Time since last communication: 0.000s
I20260201 02:57:23.166155 18378 mvcc.cc:204] Tried to move back new op lower bound from 7249570378356047872 to 7249570378026352640. Current Snapshot: MvccSnapshot[applied={T|T < 7249570320235896832}]
I20260201 02:57:23.179050 18393 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:43324 (ReqId={client: 3533124365ac409bb3649a8dc6b230f0, seq_no=2401, attempt_no=122}) took 2829 ms. Trace:
I20260201 02:57:23.179266 18393 rpcz_store.cc:276] 0201 02:57:20.349258 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 02:57:20.349352 (+ 94us) service_pool.cc:225] Handling call
0201 02:57:23.178972 (+2829620us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260201 02:57:23.180441 18390 mvcc.cc:204] Tried to move back new op lower bound from 7249570378356047872 to 7249570378026352640. Current Snapshot: MvccSnapshot[applied={T|T < 7249570378356047872}]
W20260201 02:57:23.672472 17912 consensus_peers.cc:597] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b -> Peer d74315e006374d648477a8e6109e44a7 (127.13.170.3:41669): Couldn't send request to peer d74315e006374d648477a8e6109e44a7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
W20260201 02:57:24.157999 17912 consensus_peers.cc:597] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b -> Peer d74315e006374d648477a8e6109e44a7 (127.13.170.3:41669): Couldn't send request to peer d74315e006374d648477a8e6109e44a7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
W20260201 02:57:24.724970 17912 consensus_peers.cc:597] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b -> Peer d74315e006374d648477a8e6109e44a7 (127.13.170.3:41669): Couldn't send request to peer d74315e006374d648477a8e6109e44a7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 16: this message will repeat every 5th retry.
I20260201 02:57:25.073959 18189 tablet_bootstrap.cc:492] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2402 overwritten=0 applied=2402 ignored=0} inserts{seen=119950 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 02:57:25.074832 18189 tablet_bootstrap.cc:492] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7: Bootstrap complete.
I20260201 02:57:25.076975 18189 ts_tablet_manager.cc:1403] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7: Time spent bootstrapping tablet: real 10.368s user 9.326s sys 0.627s
I20260201 02:57:25.082134 18189 raft_consensus.cc:359] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [term 8 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d535b533b04887be4fac8a82a48cb1" member_type: VOTER last_known_addr { host: "127.13.170.4" port: 46319 } } peers { permanent_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 36827 } } peers { permanent_uuid: "d74315e006374d648477a8e6109e44a7" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 41669 } }
I20260201 02:57:25.083178 18189 raft_consensus.cc:740] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [term 8 FOLLOWER]: Becoming Follower/Learner. State: Replica: d74315e006374d648477a8e6109e44a7, State: Initialized, Role: FOLLOWER
I20260201 02:57:25.084059 18189 consensus_queue.cc:260] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2402, Last appended: 6.2402, Last appended by leader: 2402, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d535b533b04887be4fac8a82a48cb1" member_type: VOTER last_known_addr { host: "127.13.170.4" port: 46319 } } peers { permanent_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 36827 } } peers { permanent_uuid: "d74315e006374d648477a8e6109e44a7" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 41669 } }
I20260201 02:57:25.090095 18189 ts_tablet_manager.cc:1434] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7: Time spent starting tablet: real 0.013s user 0.014s sys 0.000s
I20260201 02:57:25.150841 18251 raft_consensus.cc:1275] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [term 8 FOLLOWER]: Refusing update from remote peer 7c282a4e4a074f7cb7fada1519e23c9b: Log matching property violated. Preceding OpId in replica: term: 6 index: 2402. Preceding OpId from leader: term: 6 index: 2405. (index mismatch)
I20260201 02:57:25.156253 18383 consensus_queue.cc:1050] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [LEADER]: Got LMP mismatch error from peer: Peer: permanent_uuid: "d74315e006374d648477a8e6109e44a7" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 41669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2406, Last known committed idx: 2402, Time since last communication: 0.000s
I20260201 02:57:25.772956 18403 mvcc.cc:204] Tried to move back new op lower bound from 7249570386534678528 to 7249570378026352640. Current Snapshot: MvccSnapshot[applied={T|T < 7249570386534678528}]
I20260201 02:57:28.985384 18231 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260201 02:57:28.985384 17822 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260201 02:57:28.999408 17959 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260201 02:57:29.028420 18095 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260201 02:57:30.383993 15224 ts_manager.cc:284] Unset tserver state for 94d535b533b04887be4fac8a82a48cb1 from MAINTENANCE_MODE
I20260201 02:57:30.413730 18296 heartbeater.cc:507] Master 127.13.170.62:35815 requested a full tablet report, sending...
I20260201 02:57:30.434685 18024 heartbeater.cc:507] Master 127.13.170.62:35815 requested a full tablet report, sending...
I20260201 02:57:30.458253 15229 ts_manager.cc:284] Unset tserver state for 7c282a4e4a074f7cb7fada1519e23c9b from MAINTENANCE_MODE
I20260201 02:57:30.589644 18160 heartbeater.cc:507] Master 127.13.170.62:35815 requested a full tablet report, sending...
I20260201 02:57:30.700325 15224 ts_manager.cc:284] Unset tserver state for f4dd4e7188e44b518d7df7246414a2d6 from MAINTENANCE_MODE
I20260201 02:57:30.731560 15224 ts_manager.cc:284] Unset tserver state for d74315e006374d648477a8e6109e44a7 from MAINTENANCE_MODE
I20260201 02:57:31.217585 17887 heartbeater.cc:507] Master 127.13.170.62:35815 requested a full tablet report, sending...
I20260201 02:57:31.427300 18296 heartbeater.cc:507] Master 127.13.170.62:35815 requested a full tablet report, sending...
I20260201 02:57:31.462095 18024 heartbeater.cc:507] Master 127.13.170.62:35815 requested a full tablet report, sending...
I20260201 02:57:31.594718 18160 heartbeater.cc:507] Master 127.13.170.62:35815 requested a full tablet report, sending...
/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/integration-tests/maintenance_mode-itest.cc:750: Failure
Value of: s.ok()
Actual: true
Expected: false
/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/test_util.cc:403: Failure
Failed
Timed out waiting for assertion to pass.
I20260201 02:57:32.217036 13992 external_mini_cluster-itest-base.cc:80] Found fatal failure
I20260201 02:57:32.217316 13992 external_mini_cluster-itest-base.cc:86] Attempting to dump stacks of TS 0 with UUID f4dd4e7188e44b518d7df7246414a2d6 and pid 18032
************************ BEGIN STACKS **************************
[New LWP 18033]
[New LWP 18034]
[New LWP 18035]
[New LWP 18036]
[New LWP 18042]
[New LWP 18043]
[New LWP 18044]
[New LWP 18047]
[New LWP 18048]
[New LWP 18049]
[New LWP 18050]
[New LWP 18051]
[New LWP 18052]
[New LWP 18053]
[New LWP 18054]
[New LWP 18055]
[New LWP 18056]
[New LWP 18057]
[New LWP 18058]
[New LWP 18059]
[New LWP 18060]
[New LWP 18061]
[New LWP 18062]
[New LWP 18063]
[New LWP 18064]
[New LWP 18065]
[New LWP 18066]
[New LWP 18067]
[New LWP 18068]
[New LWP 18069]
[New LWP 18070]
[New LWP 18071]
[New LWP 18072]
[New LWP 18073]
[New LWP 18074]
[New LWP 18075]
[New LWP 18076]
[New LWP 18077]
[New LWP 18079]
[New LWP 18080]
[New LWP 18081]
[New LWP 18082]
[New LWP 18083]
[New LWP 18084]
[New LWP 18085]
[New LWP 18086]
[New LWP 18087]
[New LWP 18088]
[New LWP 18089]
[New LWP 18090]
[New LWP 18091]
[New LWP 18092]
[New LWP 18093]
[New LWP 18094]
[New LWP 18095]
[New LWP 18096]
[New LWP 18097]
[New LWP 18098]
[New LWP 18099]
[New LWP 18100]
[New LWP 18101]
[New LWP 18102]
[New LWP 18103]
[New LWP 18104]
[New LWP 18105]
[New LWP 18106]
[New LWP 18107]
[New LWP 18108]
[New LWP 18109]
[New LWP 18110]
[New LWP 18111]
[New LWP 18112]
[New LWP 18113]
[New LWP 18114]
[New LWP 18115]
[New LWP 18116]
[New LWP 18117]
[New LWP 18118]
[New LWP 18119]
[New LWP 18120]
[New LWP 18121]
[New LWP 18122]
[New LWP 18123]
[New LWP 18124]
[New LWP 18125]
[New LWP 18126]
[New LWP 18127]
[New LWP 18128]
[New LWP 18129]
[New LWP 18130]
[New LWP 18131]
[New LWP 18132]
[New LWP 18133]
[New LWP 18134]
[New LWP 18135]
[New LWP 18136]
[New LWP 18137]
[New LWP 18138]
[New LWP 18139]
[New LWP 18140]
[New LWP 18141]
[New LWP 18142]
[New LWP 18143]
[New LWP 18144]
[New LWP 18145]
[New LWP 18146]
[New LWP 18147]
[New LWP 18148]
[New LWP 18149]
[New LWP 18150]
[New LWP 18151]
[New LWP 18152]
[New LWP 18153]
[New LWP 18154]
[New LWP 18155]
[New LWP 18156]
[New LWP 18157]
[New LWP 18158]
[New LWP 18159]
[New LWP 18160]
[New LWP 18163]
Cannot access memory at address 0x2074736e6f633c7a
Cannot access memory at address 0x2074736e6f633c72
Cannot access memory at address 0x2074736e6f633c7a
Cannot access memory at address 0x2074736e6f633c7a
Cannot access memory at address 0x2074736e6f633c72
0x00007fb58cd91d50 in ?? ()
Id Target Id Frame
* 1 LWP 18032 "kudu" 0x00007fb58cd91d50 in ?? ()
2 LWP 18033 "kudu" 0x00007fb58cd8dfb9 in ?? ()
3 LWP 18034 "kudu" 0x00007fb58cd8dfb9 in ?? ()
4 LWP 18035 "kudu" 0x00007fb58cd8dfb9 in ?? ()
5 LWP 18036 "kernel-watcher-" 0x00007fb58cd8dfb9 in ?? ()
6 LWP 18042 "ntp client-1804" 0x00007fb58cd919e2 in ?? ()
7 LWP 18043 "file cache-evic" 0x00007fb58cd8dfb9 in ?? ()
8 LWP 18044 "sq_acceptor" 0x00007fb5858a9cb9 in ?? ()
9 LWP 18047 "rpc reactor-180" 0x00007fb5858b6a47 in ?? ()
10 LWP 18048 "rpc reactor-180" 0x00007fb5858b6a47 in ?? ()
11 LWP 18049 "rpc reactor-180" 0x00007fb5858b6a47 in ?? ()
12 LWP 18050 "rpc reactor-180" 0x00007fb5858b6a47 in ?? ()
13 LWP 18051 "MaintenanceMgr " 0x00007fb58cd8dad3 in ?? ()
14 LWP 18052 "txn-status-mana" 0x00007fb58cd8dfb9 in ?? ()
15 LWP 18053 "collect_and_rem" 0x00007fb58cd8dfb9 in ?? ()
16 LWP 18054 "tc-session-exp-" 0x00007fb58cd8dfb9 in ?? ()
17 LWP 18055 "rpc worker-1805" 0x00007fb58cd8dad3 in ?? ()
18 LWP 18056 "rpc worker-1805" 0x00007fb58cd8dad3 in ?? ()
19 LWP 18057 "rpc worker-1805" 0x00007fb58cd8dad3 in ?? ()
20 LWP 18058 "rpc worker-1805" 0x00007fb58cd8dad3 in ?? ()
21 LWP 18059 "rpc worker-1805" 0x00007fb58cd8dad3 in ?? ()
22 LWP 18060 "rpc worker-1806" 0x00007fb58cd8dad3 in ?? ()
23 LWP 18061 "rpc worker-1806" 0x00007fb58cd8dad3 in ?? ()
24 LWP 18062 "rpc worker-1806" 0x00007fb58cd8dad3 in ?? ()
25 LWP 18063 "rpc worker-1806" 0x00007fb58cd8dad3 in ?? ()
26 LWP 18064 "rpc worker-1806" 0x00007fb58cd8dad3 in ?? ()
27 LWP 18065 "rpc worker-1806" 0x00007fb58cd8dad3 in ?? ()
28 LWP 18066 "rpc worker-1806" 0x00007fb58cd8dad3 in ?? ()
29 LWP 18067 "rpc worker-1806" 0x00007fb58cd8dad3 in ?? ()
30 LWP 18068 "rpc worker-1806" 0x00007fb58cd8dad3 in ?? ()
31 LWP 18069 "rpc worker-1806" 0x00007fb58cd8dad3 in ?? ()
32 LWP 18070 "rpc worker-1807" 0x00007fb58cd8dad3 in ?? ()
33 LWP 18071 "rpc worker-1807" 0x00007fb58cd8dad3 in ?? ()
34 LWP 18072 "rpc worker-1807" 0x00007fb58cd8dad3 in ?? ()
35 LWP 18073 "rpc worker-1807" 0x00007fb58cd8dad3 in ?? ()
36 LWP 18074 "rpc worker-1807" 0x00007fb58cd8dad3 in ?? ()
37 LWP 18075 "rpc worker-1807" 0x00007fb58cd8dad3 in ?? ()
38 LWP 18076 "rpc worker-1807" 0x00007fb58cd8dad3 in ?? ()
39 LWP 18077 "rpc worker-1807" 0x00007fb58cd8dad3 in ?? ()
40 LWP 18079 "rpc worker-1807" 0x00007fb58cd8dad3 in ?? ()
41 LWP 18080 "rpc worker-1808" 0x00007fb58cd8dad3 in ?? ()
42 LWP 18081 "rpc worker-1808" 0x00007fb58cd8dad3 in ?? ()
43 LWP 18082 "rpc worker-1808" 0x00007fb58cd8dad3 in ?? ()
44 LWP 18083 "rpc worker-1808" 0x00007fb58cd8dad3 in ?? ()
45 LWP 18084 "rpc worker-1808" 0x00007fb58cd8dad3 in ?? ()
46 LWP 18085 "rpc worker-1808" 0x00007fb58cd8dad3 in ?? ()
47 LWP 18086 "rpc worker-1808" 0x00007fb58cd8dad3 in ?? ()
48 LWP 18087 "rpc worker-1808" 0x00007fb58cd8dad3 in ?? ()
49 LWP 18088 "rpc worker-1808" 0x00007fb58cd8dad3 in ?? ()
50 LWP 18089 "rpc worker-1808" 0x00007fb58cd8dad3 in ?? ()
51 LWP 18090 "rpc worker-1809" 0x00007fb58cd8dad3 in ?? ()
52 LWP 18091 "rpc worker-1809" 0x00007fb58cd8dad3 in ?? ()
53 LWP 18092 "rpc worker-1809" 0x00007fb58cd8dad3 in ?? ()
54 LWP 18093 "rpc worker-1809" 0x00007fb58cd8dad3 in ?? ()
55 LWP 18094 "rpc worker-1809" 0x00007fb58cd8dad3 in ?? ()
56 LWP 18095 "rpc worker-1809" 0x00007fb58cd8dad3 in ?? ()
57 LWP 18096 "rpc worker-1809" 0x00007fb58cd8dad3 in ?? ()
58 LWP 18097 "rpc worker-1809" 0x00007fb58cd8dad3 in ?? ()
59 LWP 18098 "rpc worker-1809" 0x00007fb58cd8dad3 in ?? ()
60 LWP 18099 "rpc worker-1809" 0x00007fb58cd8dad3 in ?? ()
61 LWP 18100 "rpc worker-1810" 0x00007fb58cd8dad3 in ?? ()
62 LWP 18101 "rpc worker-1810" 0x00007fb58cd8dad3 in ?? ()
63 LWP 18102 "rpc worker-1810" 0x00007fb58cd8dad3 in ?? ()
64 LWP 18103 "rpc worker-1810" 0x00007fb58cd8dad3 in ?? ()
65 LWP 18104 "rpc worker-1810" 0x00007fb58cd8dad3 in ?? ()
66 LWP 18105 "rpc worker-1810" 0x00007fb58cd8dad3 in ?? ()
67 LWP 18106 "rpc worker-1810" 0x00007fb58cd8dad3 in ?? ()
68 LWP 18107 "rpc worker-1810" 0x00007fb58cd8dad3 in ?? ()
69 LWP 18108 "rpc worker-1810" 0x00007fb58cd8dad3 in ?? ()
70 LWP 18109 "rpc worker-1810" 0x00007fb58cd8dad3 in ?? ()
71 LWP 18110 "rpc worker-1811" 0x00007fb58cd8dad3 in ?? ()
72 LWP 18111 "rpc worker-1811" 0x00007fb58cd8dad3 in ?? ()
73 LWP 18112 "rpc worker-1811" 0x00007fb58cd8dad3 in ?? ()
74 LWP 18113 "rpc worker-1811" 0x00007fb58cd8dad3 in ?? ()
75 LWP 18114 "rpc worker-1811" 0x00007fb58cd8dad3 in ?? ()
76 LWP 18115 "rpc worker-1811" 0x00007fb58cd8dad3 in ?? ()
77 LWP 18116 "rpc worker-1811" 0x00007fb58cd8dad3 in ?? ()
78 LWP 18117 "rpc worker-1811" 0x00007fb58cd8dad3 in ?? ()
79 LWP 18118 "rpc worker-1811" 0x00007fb58cd8dad3 in ?? ()
80 LWP 18119 "rpc worker-1811" 0x00007fb58cd8dad3 in ?? ()
81 LWP 18120 "rpc worker-1812" 0x00007fb58cd8dad3 in ?? ()
82 LWP 18121 "rpc worker-1812" 0x00007fb58cd8dad3 in ?? ()
83 LWP 18122 "rpc worker-1812" 0x00007fb58cd8dad3 in ?? ()
84 LWP 18123 "rpc worker-1812" 0x00007fb58cd8dad3 in ?? ()
85 LWP 18124 "rpc worker-1812" 0x00007fb58cd8dad3 in ?? ()
86 LWP 18125 "rpc worker-1812" 0x00007fb58cd8dad3 in ?? ()
87 LWP 18126 "rpc worker-1812" 0x00007fb58cd8dad3 in ?? ()
88 LWP 18127 "rpc worker-1812" 0x00007fb58cd8dad3 in ?? ()
89 LWP 18128 "rpc worker-1812" 0x00007fb58cd8dad3 in ?? ()
90 LWP 18129 "rpc worker-1812" 0x00007fb58cd8dad3 in ?? ()
91 LWP 18130 "rpc worker-1813" 0x00007fb58cd8dad3 in ?? ()
92 LWP 18131 "rpc worker-1813" 0x00007fb58cd8dad3 in ?? ()
93 LWP 18132 "rpc worker-1813" 0x00007fb58cd8dad3 in ?? ()
94 LWP 18133 "rpc worker-1813" 0x00007fb58cd8dad3 in ?? ()
95 LWP 18134 "rpc worker-1813" 0x00007fb58cd8dad3 in ?? ()
96 LWP 18135 "rpc worker-1813" 0x00007fb58cd8dad3 in ?? ()
97 LWP 18136 "rpc worker-1813" 0x00007fb58cd8dad3 in ?? ()
98 LWP 18137 "rpc worker-1813" 0x00007fb58cd8dad3 in ?? ()
99 LWP 18138 "rpc worker-1813" 0x00007fb58cd8dad3 in ?? ()
100 LWP 18139 "rpc worker-1813" 0x00007fb58cd8dad3 in ?? ()
101 LWP 18140 "rpc worker-1814" 0x00007fb58cd8dad3 in ?? ()
102 LWP 18141 "rpc worker-1814" 0x00007fb58cd8dad3 in ?? ()
103 LWP 18142 "rpc worker-1814" 0x00007fb58cd8dad3 in ?? ()
104 LWP 18143 "rpc worker-1814" 0x00007fb58cd8dad3 in ?? ()
105 LWP 18144 "rpc worker-1814" 0x00007fb58cd8dad3 in ?? ()
106 LWP 18145 "rpc worker-1814" 0x00007fb58cd8dad3 in ?? ()
107 LWP 18146 "rpc worker-1814" 0x00007fb58cd8dad3 in ?? ()
108 LWP 18147 "rpc worker-1814" 0x00007fb58cd8dad3 in ?? ()
109 LWP 18148 "rpc worker-1814" 0x00007fb58cd8dad3 in ?? ()
110 LWP 18149 "rpc worker-1814" 0x00007fb58cd8dad3 in ?? ()
111 LWP 18150 "rpc worker-1815" 0x00007fb58cd8dad3 in ?? ()
112 LWP 18151 "rpc worker-1815" 0x00007fb58cd8dad3 in ?? ()
113 LWP 18152 "rpc worker-1815" 0x00007fb58cd8dad3 in ?? ()
114 LWP 18153 "rpc worker-1815" 0x00007fb58cd8dad3 in ?? ()
115 LWP 18154 "rpc worker-1815" 0x00007fb58cd8dad3 in ?? ()
116 LWP 18155 "rpc worker-1815" 0x00007fb58cd8dad3 in ?? ()
117 LWP 18156 "diag-logger-181" 0x00007fb58cd8dfb9 in ?? ()
118 LWP 18157 "result-tracker-" 0x00007fb58cd8dfb9 in ?? ()
119 LWP 18158 "excess-log-dele" 0x00007fb58cd8dfb9 in ?? ()
120 LWP 18159 "acceptor-18159" 0x00007fb5858b80c7 in ?? ()
121 LWP 18160 "heartbeat-18160" 0x00007fb58cd8dfb9 in ?? ()
122 LWP 18163 "maintenance_sch" 0x00007fb58cd8dfb9 in ?? ()
Thread 122 (LWP 18163):
#0 0x00007fb58cd8dfb9 in ?? ()
#1 0x00007fb541c04700 in ?? ()
#2 0x000000000000004d in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x0000616000016ca0 in ?? ()
#5 0x00007fb541c04750 in ?? ()
#6 0x000000000000009a in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 121 (LWP 18160):
#0 0x00007fb58cd8dfb9 in ?? ()
#1 0xb98bb7de8fab0363 in ?? ()
#2 0x0000000000000013 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061300001a900 in ?? ()
#5 0x00007fb54241c610 in ?? ()
#6 0x0000000000000026 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 120 (LWP 18159):
#0 0x00007fb5858b80c7 in ?? ()
#1 0x00006140000210a8 in ?? ()
#2 0x00007fb542c43d70 in ?? ()
#3 0x00007fb542c43da0 in ?? ()
#4 0x00007fb542c43ea0 in ?? ()
#5 0x00007fb542c43d90 in ?? ()
#6 0x00007fb542c43e00 in ?? ()
#7 0x0000000000000080 in ?? ()
#8 0x00000000008c485b in __sanitizer::theDepot ()
#9 0x0000000500000014 in ?? ()
#10 0x00007fb542c43f20 in ?? ()
#11 0x00007fb542c4365c in ?? ()
#12 0x0000003242c435d0 in ?? ()
#13 0x00007fb542447000 in ?? ()
#14 0x0000000000000000 in ?? ()
Thread 119 (LWP 18158):
#0 0x00007fb58cd8dfb9 in ?? ()
#1 0x00007fb54345df60 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 118 (LWP 18157):
#0 0x00007fb58cd8dfb9 in ?? ()
#1 0x00007fb543c76120 in ?? ()
#2 0x0000000000000013 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061100008abb0 in ?? ()
#5 0x00007fb543c76110 in ?? ()
#6 0x0000000000000026 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 117 (LWP 18156):
#0 0x00007fb58cd8dfb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 116 (LWP 18155):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000004 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d0002b0048 in ?? ()
#4 0x00007fb544ca5eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fb544ca5ed0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 115 (LWP 18154):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000008 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d0002a6858 in ?? ()
#4 0x00007fb5454bdeb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fb5454bded0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 114 (LWP 18153):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 113 (LWP 18152):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 112 (LWP 18151):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 111 (LWP 18150):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 110 (LWP 18149):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 109 (LWP 18148):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 108 (LWP 18147):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 107 (LWP 18146):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 106 (LWP 18145):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 105 (LWP 18144):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 104 (LWP 18143):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 103 (LWP 18142):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 102 (LWP 18141):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 101 (LWP 18140):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 100 (LWP 18139):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 99 (LWP 18138):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 98 (LWP 18137):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 97 (LWP 18136):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 96 (LWP 18135):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 95 (LWP 18134):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 94 (LWP 18133):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 93 (LWP 18132):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 92 (LWP 18131):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 91 (LWP 18130):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 90 (LWP 18129):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 89 (LWP 18128):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 88 (LWP 18127):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 87 (LWP 18126):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 86 (LWP 18125):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 85 (LWP 18124):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 84 (LWP 18123):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 83 (LWP 18122):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 82 (LWP 18121):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 81 (LWP 18120):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 80 (LWP 18119):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 79 (LWP 18118):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 78 (LWP 18117):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 77 (LWP 18116):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 76 (LWP 18115):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000003 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d0001a688c in ?? ()
#4 0x00007fb559066eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fb559066ed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0001a6840 in ?? ()
#9 0x00007fb58cd8d770 in ?? ()
#10 0x00007fb559066ed0 in ?? ()
#11 0x00007fb559066e90 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 75 (LWP 18114):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 74 (LWP 18113):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 73 (LWP 18112):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 72 (LWP 18111):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 71 (LWP 18110):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 70 (LWP 18109):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 69 (LWP 18108):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 68 (LWP 18107):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 67 (LWP 18106):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 66 (LWP 18105):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 65 (LWP 18104):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 64 (LWP 18103):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 63 (LWP 18102):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 62 (LWP 18101):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 61 (LWP 18100):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 60 (LWP 18099):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 59 (LWP 18098):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 58 (LWP 18097):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 57 (LWP 18096):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 56 (LWP 18095):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000003 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00012003c in ?? ()
#4 0x00007fb563247eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fb563247ed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d00011fff0 in ?? ()
#9 0x00007fb58cd8d770 in ?? ()
#10 0x00007fb563247ed0 in ?? ()
#11 0x00007fb563247e90 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 55 (LWP 18094):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 54 (LWP 18093):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 53 (LWP 18092):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 52 (LWP 18091):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 51 (LWP 18090):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 50 (LWP 18089):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 49 (LWP 18088):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 48 (LWP 18087):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 47 (LWP 18086):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 46 (LWP 18085):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 45 (LWP 18084):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 44 (LWP 18083):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 43 (LWP 18082):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 42 (LWP 18081):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 41 (LWP 18080):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 40 (LWP 18079):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 39 (LWP 18077):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 38 (LWP 18076):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 37 (LWP 18075):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 36 (LWP 18074):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000003 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00009ffec in ?? ()
#4 0x00007fb56d428eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fb56d428ed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d00009ffa0 in ?? ()
#9 0x00007fb58cd8d770 in ?? ()
#10 0x00007fb56d428ed0 in ?? ()
#11 0x00007fb56d428e90 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 35 (LWP 18073):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 34 (LWP 18072):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 33 (LWP 18071):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 32 (LWP 18070):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 31 (LWP 18069):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 30 (LWP 18068):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 29 (LWP 18067):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 28 (LWP 18066):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 27 (LWP 18065):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 26 (LWP 18064):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 25 (LWP 18063):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 24 (LWP 18062):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 23 (LWP 18061):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 22 (LWP 18060):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 21 (LWP 18059):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 20 (LWP 18058):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 19 (LWP 18057):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 18 (LWP 18056):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 17 (LWP 18055):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 16 (LWP 18054):
#0 0x00007fb58cd8dfb9 in ?? ()
#1 0x00007fb57762dce0 in ?? ()
#2 0x0000000000000001 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061300001b1a0 in ?? ()
#5 0x00007fb57762dcd0 in ?? ()
#6 0x0000000000000002 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 15 (LWP 18053):
#0 0x00007fb58cd8dfb9 in ?? ()
#1 0x4008000000000000 in ?? ()
#2 0x0000000000000003 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061200001df18 in ?? ()
#5 0x00007fb577e65270 in ?? ()
#6 0x0000000000000006 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 14 (LWP 18052):
#0 0x00007fb58cd8dfb9 in ?? ()
#1 0x00007fb57867b260 in ?? ()
#2 0x0000000000000001 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061800000c1a8 in ?? ()
#5 0x00007fb57867b250 in ?? ()
#6 0x0000000000000002 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 13 (LWP 18051):
#0 0x00007fb58cd8dad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 12 (LWP 18050):
#0 0x00007fb5858b6a47 in ?? ()
#1 0x00007fb5796b2340 in ?? ()
#2 0x000061a00000c680 in ?? ()
#3 0x00007fb5796b2330 in ?? ()
#4 0x00007fb5796b2540 in ?? ()
#5 0x00007fb5796b2380 in ?? ()
#6 0x0000614000021298 in ?? ()
#7 0x00007fb5796b2400 in ?? ()
#8 0x00007fb587f2925d in ?? ()
#9 0x3fb9788fa2939000 in ?? ()
#10 0x000061a00000c680 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000c680 in ?? ()
#13 0x000000001a800000 in ?? ()
#14 0x00007fb500000000 in ?? ()
#15 0x41da5fafd690cf29 in ?? ()
#16 0x00000ff72f2ce480 in ?? ()
#17 0x00007fb5796b23e0 in ?? ()
#18 0x00007fb587f2dba3 in ?? ()
#19 0x00007fb5796b23b0 in ?? ()
#20 0x3fb9788fa2939000 in ?? ()
#21 0x00000000796b2400 in ?? ()
#22 0x000061a00000c680 in ?? ()
#23 0x0000614000021298 in ?? ()
#24 0x3fb9788fa2939000 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 11 (LWP 18049):
#0 0x00007fb5858b6a47 in ?? ()
#1 0x00007fb579eb3340 in ?? ()
#2 0x000061a00000c080 in ?? ()
#3 0x00007fb579eb3330 in ?? ()
#4 0x00007fb579eb3540 in ?? ()
#5 0x00007fb579eb3380 in ?? ()
#6 0x0000614000021098 in ?? ()
#7 0x00007fb579eb3400 in ?? ()
#8 0x00007fb587f2925d in ?? ()
#9 0x3fb951635b2f4000 in ?? ()
#10 0x000061a00000c080 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000c080 in ?? ()
#13 0x000000007a000000 in ?? ()
#14 0x00007fb500000000 in ?? ()
#15 0x41da5fafd690cf2b in ?? ()
#16 0x00000ff72f3ce680 in ?? ()
#17 0x00007fb579eb33e0 in ?? ()
#18 0x00007fb587f2dba3 in ?? ()
#19 0x00007fb579eb33b0 in ?? ()
#20 0x3fb951635b2f4000 in ?? ()
#21 0x0000000079eb3400 in ?? ()
#22 0x000061a00000c080 in ?? ()
#23 0x0000614000021098 in ?? ()
#24 0x3fb951635b2f4000 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 10 (LWP 18048):
#0 0x00007fb5858b6a47 in ?? ()
#1 0x00007fb57a6b4340 in ?? ()
#2 0x000061a00000ba80 in ?? ()
#3 0x00007fb57a6b4330 in ?? ()
#4 0x00007fb57a6b4540 in ?? ()
#5 0x00007fb57a6b4380 in ?? ()
#6 0x0000614000020e98 in ?? ()
#7 0x00007fb57a6b4400 in ?? ()
#8 0x00007fb587f2925d in ?? ()
#9 0x3fb975a7f7db2000 in ?? ()
#10 0x000061a00000ba80 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000ba80 in ?? ()
#13 0x00000000d2800000 in ?? ()
#14 0x00007fb500000000 in ?? ()
#15 0x41da5fafd690cf2a in ?? ()
#16 0x00000ff72f4ce880 in ?? ()
#17 0x00007fb57a6b43e0 in ?? ()
#18 0x00007fb587f2dba3 in ?? ()
#19 0x00007fb57a6b43b0 in ?? ()
#20 0x3fb975a7f7db2000 in ?? ()
#21 0x000000007a6b4400 in ?? ()
#22 0x000061a00000ba80 in ?? ()
#23 0x0000614000020e98 in ?? ()
#24 0x3fb975a7f7db2000 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 9 (LWP 18047):
#0 0x00007fb5858b6a47 in ?? ()
#1 0x00007fb57c6ad340 in ?? ()
#2 0x000061a00000b480 in ?? ()
#3 0x00007fb57c6ad330 in ?? ()
#4 0x00007fb57c6ad540 in ?? ()
#5 0x00007fb57c6ad380 in ?? ()
#6 0x0000614000020c98 in ?? ()
#7 0x00007fb57c6ad400 in ?? ()
#8 0x00007fb587f2925d in ?? ()
#9 0x3fb973ad50238000 in ?? ()
#10 0x000061a00000b480 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000b480 in ?? ()
#13 0x000000007f800000 in ?? ()
#14 0x00007fb500000000 in ?? ()
#15 0x41da5fafd690cf2a in ?? ()
#16 0x00000ff72f8cda80 in ?? ()
#17 0x00007fb57c6ad3e0 in ?? ()
#18 0x00007fb587f2dba3 in ?? ()
#19 0x0000000000000000 in ?? ()
Thread 8 (LWP 18044):
#0 0x00007fb5858a9cb9 in ?? ()
#1 0x00000000000000c8 in ?? ()
#2 0x00007fb57e0b77b8 in ?? ()
#3 0x000060200001ea50 in ?? ()
#4 0x0000000000000002 in ?? ()
#5 0x00000000000000c8 in ?? ()
#6 0x00000000008bc4a1 in __sanitizer::theDepot ()
#7 0x0000000000000000 in ?? ()
Thread 7 (LWP 18043):
#0 0x00007fb58cd8dfb9 in ?? ()
#1 0x00007fb57d8b60e0 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 6 (LWP 18042):
#0 0x00007fb58cd919e2 in ?? ()
#1 0x00007fb57d0b3bc0 in ?? ()
#2 0x00007fb57d0b3c60 in ?? ()
#3 0x000000000000001e in ?? ()
#4 0x0000000000000030 in ?? ()
#5 0x00007fb57d0b3c10 in ?? ()
#6 0x00000000017ab3a0 in ?? ()
#7 0x00007fb57d0b3c70 in ?? ()
#8 0x000061100008b510 in ?? ()
#9 0x00007fb57d0b3c60 in ?? ()
#10 0x00000000008b6997 in __sanitizer::theDepot ()
#11 0x00007fb5926dd61c in ?? ()
#12 0x00007fb5926ccc29 in ?? ()
#13 0x00007fb5926d1216 in ?? ()
#14 0x00007fb5926d5c50 in ?? ()
#15 0x00007fb5926d5a79 in ?? ()
#16 0x0000000000a8970d in __sanitizer::theDepot ()
#17 0x00007fb58977af99 in ?? ()
#18 0x00007fb58cd876db in ?? ()
#19 0x00000ff72fa0e688 in ?? ()
#20 0x00007fb57d0b3460 in ?? ()
#21 0x0000000000000000 in ?? ()
Thread 5 (LWP 18036):
#0 0x00007fb58cd8dfb9 in ?? ()
#1 0x00007fb57f0b8ca0 in ?? ()
#2 0x0000000000000062 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061200001e728 in ?? ()
#5 0x00007fb57f0b8c90 in ?? ()
#6 0x00000000000000c4 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 4 (LWP 18035):
#0 0x00007fb58cd8dfb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 3 (LWP 18034):
#0 0x00007fb58cd8dfb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 2 (LWP 18033):
#0 0x00007fb58cd8dfb9 in ?? ()
#1 0x5f5347414c46000a in ?? ()
#2 0x0000000000000002 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x00006120000126b8 in ?? ()
#5 0x00007fb5808bc450 in ?? ()
#6 0x0000000000000004 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 1 (LWP 18032):
#0 0x00007fb58cd91d50 in ?? ()
#1 0x0000000000000000 in ?? ()
************************* END STACKS ***************************
I20260201 02:57:33.047960 13992 external_mini_cluster-itest-base.cc:86] Attempting to dump stacks of TS 1 with UUID 7c282a4e4a074f7cb7fada1519e23c9b and pid 17895
************************ BEGIN STACKS **************************
[New LWP 17897]
[New LWP 17898]
[New LWP 17899]
[New LWP 17900]
[New LWP 17906]
[New LWP 17907]
[New LWP 17908]
[New LWP 17911]
[New LWP 17912]
[New LWP 17913]
[New LWP 17914]
[New LWP 17915]
[New LWP 17916]
[New LWP 17918]
[New LWP 17919]
[New LWP 17920]
[New LWP 17921]
[New LWP 17922]
[New LWP 17923]
[New LWP 17924]
[New LWP 17925]
[New LWP 17926]
[New LWP 17927]
[New LWP 17928]
[New LWP 17929]
[New LWP 17930]
[New LWP 17931]
[New LWP 17932]
[New LWP 17933]
[New LWP 17934]
[New LWP 17935]
[New LWP 17936]
[New LWP 17937]
[New LWP 17938]
[New LWP 17939]
[New LWP 17940]
[New LWP 17941]
[New LWP 17942]
[New LWP 17943]
[New LWP 17944]
[New LWP 17945]
[New LWP 17946]
[New LWP 17947]
[New LWP 17948]
[New LWP 17949]
[New LWP 17950]
[New LWP 17951]
[New LWP 17952]
[New LWP 17953]
[New LWP 17954]
[New LWP 17955]
[New LWP 17956]
[New LWP 17957]
[New LWP 17958]
[New LWP 17959]
[New LWP 17960]
[New LWP 17961]
[New LWP 17962]
[New LWP 17963]
[New LWP 17964]
[New LWP 17965]
[New LWP 17966]
[New LWP 17967]
[New LWP 17968]
[New LWP 17969]
[New LWP 17970]
[New LWP 17971]
[New LWP 17972]
[New LWP 17973]
[New LWP 17974]
[New LWP 17975]
[New LWP 17976]
[New LWP 17977]
[New LWP 17978]
[New LWP 17979]
[New LWP 17980]
[New LWP 17981]
[New LWP 17982]
[New LWP 17983]
[New LWP 17984]
[New LWP 17985]
[New LWP 17986]
[New LWP 17987]
[New LWP 17988]
[New LWP 17989]
[New LWP 17990]
[New LWP 17991]
[New LWP 17992]
[New LWP 17993]
[New LWP 17994]
[New LWP 17995]
[New LWP 17996]
[New LWP 17997]
[New LWP 17998]
[New LWP 17999]
[New LWP 18000]
[New LWP 18001]
[New LWP 18002]
[New LWP 18003]
[New LWP 18004]
[New LWP 18005]
[New LWP 18006]
[New LWP 18007]
[New LWP 18008]
[New LWP 18009]
[New LWP 18010]
[New LWP 18011]
[New LWP 18012]
[New LWP 18013]
[New LWP 18014]
[New LWP 18015]
[New LWP 18016]
[New LWP 18017]
[New LWP 18018]
[New LWP 18019]
[New LWP 18020]
[New LWP 18021]
[New LWP 18022]
[New LWP 18023]
[New LWP 18024]
[New LWP 18025]
[New LWP 18509]
Cannot access memory at address 0x2074736e6f633c7a
Cannot access memory at address 0x2074736e6f633c72
Cannot access memory at address 0x2074736e6f633c7a
Cannot access memory at address 0x2074736e6f633c7a
Cannot access memory at address 0x2074736e6f633c72
0x00007fc00bbe0d50 in ?? ()
Id Target Id Frame
* 1 LWP 17895 "kudu" 0x00007fc00bbe0d50 in ?? ()
2 LWP 17897 "kudu" 0x00007fc00bbdcfb9 in ?? ()
3 LWP 17898 "kudu" 0x00007fc00bbdcfb9 in ?? ()
4 LWP 17899 "kudu" 0x00007fc00bbdcfb9 in ?? ()
5 LWP 17900 "kernel-watcher-" 0x00007fc00bbdcfb9 in ?? ()
6 LWP 17906 "ntp client-1790" 0x00007fc00bbe09e2 in ?? ()
7 LWP 17907 "file cache-evic" 0x00007fc00bbdcfb9 in ?? ()
8 LWP 17908 "sq_acceptor" 0x00007fc0046f8cb9 in ?? ()
9 LWP 17911 "rpc reactor-179" 0x00007fc004705a47 in ?? ()
10 LWP 17912 "rpc reactor-179" 0x00007fc004705a47 in ?? ()
11 LWP 17913 "rpc reactor-179" 0x00007fc004705a47 in ?? ()
12 LWP 17914 "rpc reactor-179" 0x00007fc004705a47 in ?? ()
13 LWP 17915 "MaintenanceMgr " 0x00007fc00bbdcad3 in ?? ()
14 LWP 17916 "txn-status-mana" 0x00007fc00bbdcfb9 in ?? ()
15 LWP 17918 "collect_and_rem" 0x00007fc00bbdcfb9 in ?? ()
16 LWP 17919 "tc-session-exp-" 0x00007fc00bbdcfb9 in ?? ()
17 LWP 17920 "rpc worker-1792" 0x00007fc00bbdcad3 in ?? ()
18 LWP 17921 "rpc worker-1792" 0x00007fc00bbdcad3 in ?? ()
19 LWP 17922 "rpc worker-1792" 0x00007fc00bbdcad3 in ?? ()
20 LWP 17923 "rpc worker-1792" 0x00007fc00bbdcad3 in ?? ()
21 LWP 17924 "rpc worker-1792" 0x00007fc00bbdcad3 in ?? ()
22 LWP 17925 "rpc worker-1792" 0x00007fc00bbdcad3 in ?? ()
23 LWP 17926 "rpc worker-1792" 0x00007fc00bbdcad3 in ?? ()
24 LWP 17927 "rpc worker-1792" 0x00007fc00bbdcad3 in ?? ()
25 LWP 17928 "rpc worker-1792" 0x00007fc00bbdcad3 in ?? ()
26 LWP 17929 "rpc worker-1792" 0x00007fc00bbdcad3 in ?? ()
27 LWP 17930 "rpc worker-1793" 0x00007fc00bbdcad3 in ?? ()
28 LWP 17931 "rpc worker-1793" 0x00007fc00bbdcad3 in ?? ()
29 LWP 17932 "rpc worker-1793" 0x00007fc00bbdcad3 in ?? ()
30 LWP 17933 "rpc worker-1793" 0x00007fc00bbdcad3 in ?? ()
31 LWP 17934 "rpc worker-1793" 0x00007fc00bbdcad3 in ?? ()
32 LWP 17935 "rpc worker-1793" 0x00007fc00bbdcad3 in ?? ()
33 LWP 17936 "rpc worker-1793" 0x00007fc00bbdcad3 in ?? ()
34 LWP 17937 "rpc worker-1793" 0x00007fc00bbdcad3 in ?? ()
35 LWP 17938 "rpc worker-1793" 0x00007fc00bbdcad3 in ?? ()
36 LWP 17939 "rpc worker-1793" 0x00007fc00bbdcad3 in ?? ()
37 LWP 17940 "rpc worker-1794" 0x00007fc00bbdcad3 in ?? ()
38 LWP 17941 "rpc worker-1794" 0x00007fc00bbdcad3 in ?? ()
39 LWP 17942 "rpc worker-1794" 0x00007fc00bbdcad3 in ?? ()
40 LWP 17943 "rpc worker-1794" 0x00007fc00bbdcad3 in ?? ()
41 LWP 17944 "rpc worker-1794" 0x00007fc00bbdcad3 in ?? ()
42 LWP 17945 "rpc worker-1794" 0x00007fc00bbdcad3 in ?? ()
43 LWP 17946 "rpc worker-1794" 0x00007fc00bbdcad3 in ?? ()
44 LWP 17947 "rpc worker-1794" 0x00007fc00bbdcad3 in ?? ()
45 LWP 17948 "rpc worker-1794" 0x00007fc00bbdcad3 in ?? ()
46 LWP 17949 "rpc worker-1794" 0x00007fc00bbdcad3 in ?? ()
47 LWP 17950 "rpc worker-1795" 0x00007fc00bbdcad3 in ?? ()
48 LWP 17951 "rpc worker-1795" 0x00007fc00bbdcad3 in ?? ()
49 LWP 17952 "rpc worker-1795" 0x00007fc00bbdcad3 in ?? ()
50 LWP 17953 "rpc worker-1795" 0x00007fc00bbdcad3 in ?? ()
51 LWP 17954 "rpc worker-1795" 0x00007fc00bbdcad3 in ?? ()
52 LWP 17955 "rpc worker-1795" 0x00007fc00bbdcad3 in ?? ()
53 LWP 17956 "rpc worker-1795" 0x00007fc00bbdcad3 in ?? ()
54 LWP 17957 "rpc worker-1795" 0x00007fc00bbdcad3 in ?? ()
55 LWP 17958 "rpc worker-1795" 0x00007fc00bbdcad3 in ?? ()
56 LWP 17959 "rpc worker-1795" 0x00007fc00bbdcad3 in ?? ()
57 LWP 17960 "rpc worker-1796" 0x00007fc00bbdcad3 in ?? ()
58 LWP 17961 "rpc worker-1796" 0x00007fc00bbdcad3 in ?? ()
59 LWP 17962 "rpc worker-1796" 0x00007fc00bbdcad3 in ?? ()
60 LWP 17963 "rpc worker-1796" 0x00007fc00bbdcad3 in ?? ()
61 LWP 17964 "rpc worker-1796" 0x00007fc00bbdcad3 in ?? ()
62 LWP 17965 "rpc worker-1796" 0x00007fc00bbdcad3 in ?? ()
63 LWP 17966 "rpc worker-1796" 0x00007fc00bbdcad3 in ?? ()
64 LWP 17967 "rpc worker-1796" 0x00007fc00bbdcad3 in ?? ()
65 LWP 17968 "rpc worker-1796" 0x00007fc00bbdcad3 in ?? ()
66 LWP 17969 "rpc worker-1796" 0x00007fc00bbdcad3 in ?? ()
67 LWP 17970 "rpc worker-1797" 0x00007fc00bbdcad3 in ?? ()
68 LWP 17971 "rpc worker-1797" 0x00007fc00bbdcad3 in ?? ()
69 LWP 17972 "rpc worker-1797" 0x00007fc00bbdcad3 in ?? ()
70 LWP 17973 "rpc worker-1797" 0x00007fc00bbdcad3 in ?? ()
71 LWP 17974 "rpc worker-1797" 0x00007fc00bbdcad3 in ?? ()
72 LWP 17975 "rpc worker-1797" 0x00007fc00bbdcad3 in ?? ()
73 LWP 17976 "rpc worker-1797" 0x00007fc00bbdcad3 in ?? ()
74 LWP 17977 "rpc worker-1797" 0x00007fc00bbdcad3 in ?? ()
75 LWP 17978 "rpc worker-1797" 0x00007fc00bbdcad3 in ?? ()
76 LWP 17979 "rpc worker-1797" 0x00007fc00bbdcad3 in ?? ()
77 LWP 17980 "rpc worker-1798" 0x00007fc00bbdcad3 in ?? ()
78 LWP 17981 "rpc worker-1798" 0x00007fc00bbdcad3 in ?? ()
79 LWP 17982 "rpc worker-1798" 0x00007fc00bbdcad3 in ?? ()
80 LWP 17983 "rpc worker-1798" 0x00007fc00bbdcad3 in ?? ()
81 LWP 17984 "rpc worker-1798" 0x00007fc00bbdcad3 in ?? ()
82 LWP 17985 "rpc worker-1798" 0x00007fc00bbdcad3 in ?? ()
83 LWP 17986 "rpc worker-1798" 0x00007fc00bbdcad3 in ?? ()
84 LWP 17987 "rpc worker-1798" 0x00007fc00bbdcad3 in ?? ()
85 LWP 17988 "rpc worker-1798" 0x00007fc00bbdcad3 in ?? ()
86 LWP 17989 "rpc worker-1798" 0x00007fc00bbdcad3 in ?? ()
87 LWP 17990 "rpc worker-1799" 0x00007fc00bbdcad3 in ?? ()
88 LWP 17991 "rpc worker-1799" 0x00007fc00bbdcad3 in ?? ()
89 LWP 17992 "rpc worker-1799" 0x00007fc00bbdcad3 in ?? ()
90 LWP 17993 "rpc worker-1799" 0x00007fc00bbdcad3 in ?? ()
91 LWP 17994 "rpc worker-1799" 0x00007fc00bbdcad3 in ?? ()
92 LWP 17995 "rpc worker-1799" 0x00007fc00bbdcad3 in ?? ()
93 LWP 17996 "rpc worker-1799" 0x00007fc00bbdcad3 in ?? ()
94 LWP 17997 "rpc worker-1799" 0x00007fc00bbdcad3 in ?? ()
95 LWP 17998 "rpc worker-1799" 0x00007fc00bbdcad3 in ?? ()
96 LWP 17999 "rpc worker-1799" 0x00007fc00bbdcad3 in ?? ()
97 LWP 18000 "rpc worker-1800" 0x00007fc00bbdcad3 in ?? ()
98 LWP 18001 "rpc worker-1800" 0x00007fc00bbdcad3 in ?? ()
99 LWP 18002 "rpc worker-1800" 0x00007fc00bbdcad3 in ?? ()
100 LWP 18003 "rpc worker-1800" 0x00007fc00bbdcad3 in ?? ()
101 LWP 18004 "rpc worker-1800" 0x00007fc00bbdcad3 in ?? ()
102 LWP 18005 "rpc worker-1800" 0x00007fc00bbdcad3 in ?? ()
103 LWP 18006 "rpc worker-1800" 0x00007fc00bbdcad3 in ?? ()
104 LWP 18007 "rpc worker-1800" 0x00007fc00bbdcad3 in ?? ()
105 LWP 18008 "rpc worker-1800" 0x00007fc00bbdcad3 in ?? ()
106 LWP 18009 "rpc worker-1800" 0x00007fc00bbdcad3 in ?? ()
107 LWP 18010 "rpc worker-1801" 0x00007fc00bbdcad3 in ?? ()
108 LWP 18011 "rpc worker-1801" 0x00007fc00bbdcad3 in ?? ()
109 LWP 18012 "rpc worker-1801" 0x00007fc00bbdcad3 in ?? ()
110 LWP 18013 "rpc worker-1801" 0x00007fc00bbdcad3 in ?? ()
111 LWP 18014 "rpc worker-1801" 0x00007fc00bbdcad3 in ?? ()
112 LWP 18015 "rpc worker-1801" 0x00007fc00bbdcad3 in ?? ()
113 LWP 18016 "rpc worker-1801" 0x00007fc00bbdcad3 in ?? ()
114 LWP 18017 "rpc worker-1801" 0x00007fc00bbdcad3 in ?? ()
115 LWP 18018 "rpc worker-1801" 0x00007fc00bbdcad3 in ?? ()
116 LWP 18019 "rpc worker-1801" 0x00007fc00bbdcad3 in ?? ()
117 LWP 18020 "diag-logger-180" 0x00007fc00bbdcfb9 in ?? ()
118 LWP 18021 "result-tracker-" 0x00007fc00bbdcfb9 in ?? ()
119 LWP 18022 "excess-log-dele" 0x00007fc00bbdcfb9 in ?? ()
120 LWP 18023 "acceptor-18023" 0x00007fc0047070c7 in ?? ()
121 LWP 18024 "heartbeat-18024" 0x00007fc00bbdcfb9 in ?? ()
122 LWP 18025 "maintenance_sch" 0x00007fc00bbdcfb9 in ?? ()
123 LWP 18509 "raft [worker]-1" 0x00007fc00bbdcfb9 in ?? ()
Thread 123 (LWP 18509):
#0 0x00007fc00bbdcfb9 in ?? ()
#1 0x0000000045e0360e in ?? ()
#2 0x00000000000000a5 in ?? ()
#3 0x0000000100000081 in ?? ()
#4 0x00007fbfba7ffbc4 in ?? ()
#5 0x00007fbfba7ff850 in ?? ()
#6 0x000000000000014b in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x00007fbfba7ff870 in ?? ()
#9 0x0000000200000000 in ?? ()
#10 0x0000008000000189 in ?? ()
#11 0x0000000000000000 in ?? ()
Thread 122 (LWP 18025):
#0 0x00007fc00bbdcfb9 in ?? ()
#1 0x00007fbfc01fa700 in ?? ()
#2 0x0000000000000054 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x0000616000016ca0 in ?? ()
#5 0x00007fbfc01fa750 in ?? ()
#6 0x00000000000000a8 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 121 (LWP 18024):
#0 0x00007fc00bbdcfb9 in ?? ()
#1 0xb98bb7de8fab0363 in ?? ()
#2 0x0000000000000018 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061300001a900 in ?? ()
#5 0x00007fbfc0a12610 in ?? ()
#6 0x0000000000000030 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 120 (LWP 18023):
#0 0x00007fc0047070c7 in ?? ()
#1 0x0000614000020ea8 in ?? ()
#2 0x00007fbfc123ad70 in ?? ()
#3 0x00007fbfc123ada0 in ?? ()
#4 0x00007fbfc123aea0 in ?? ()
#5 0x00007fbfc123ad90 in ?? ()
#6 0x00007fbfc123ae00 in ?? ()
#7 0x0000000000000080 in ?? ()
#8 0x00000000008c485b in __sanitizer::theDepot ()
#9 0x0000000500000014 in ?? ()
#10 0x00007fbfc123af20 in ?? ()
#11 0x00007fbfc123a65c in ?? ()
#12 0x00000032c123a5d0 in ?? ()
#13 0x00007fbfc0a3e000 in ?? ()
#14 0x0000000000000000 in ?? ()
Thread 119 (LWP 18022):
#0 0x00007fc00bbdcfb9 in ?? ()
#1 0x00007fbfc1a52f60 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 118 (LWP 18021):
#0 0x00007fc00bbdcfb9 in ?? ()
#1 0x00007fbfc226c120 in ?? ()
#2 0x0000000000000015 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061100008abb0 in ?? ()
#5 0x00007fbfc226c110 in ?? ()
#6 0x000000000000002a in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 117 (LWP 18020):
#0 0x00007fc00bbdcfb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 116 (LWP 18019):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000008 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d0002b6848 in ?? ()
#4 0x00007fbfc329beb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fbfc329bed0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 115 (LWP 18018):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000004 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d0002b0048 in ?? ()
#4 0x00007fbfc3ab3eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fbfc3ab3ed0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 114 (LWP 18017):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 113 (LWP 18016):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 112 (LWP 18015):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 111 (LWP 18014):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 110 (LWP 18013):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 109 (LWP 18012):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 108 (LWP 18011):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 107 (LWP 18010):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 106 (LWP 18009):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 105 (LWP 18008):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 104 (LWP 18007):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 103 (LWP 18006):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 102 (LWP 18005):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 101 (LWP 18004):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 100 (LWP 18003):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 99 (LWP 18002):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 98 (LWP 18001):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 97 (LWP 18000):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 96 (LWP 17999):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 95 (LWP 17998):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 94 (LWP 17997):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 93 (LWP 17996):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 92 (LWP 17995):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 91 (LWP 17994):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 90 (LWP 17993):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 89 (LWP 17992):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 88 (LWP 17991):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 87 (LWP 17990):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 86 (LWP 17989):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 85 (LWP 17988):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 84 (LWP 17987):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 83 (LWP 17986):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 82 (LWP 17985):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 81 (LWP 17984):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 80 (LWP 17983):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 79 (LWP 17982):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 78 (LWP 17981):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 77 (LWP 17980):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 76 (LWP 17979):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000007 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d0001ad08c in ?? ()
#4 0x00007fbfd765ceb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fbfd765ced0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0001ad040 in ?? ()
#9 0x00007fc00bbdc770 in ?? ()
#10 0x00007fbfd765ced0 in ?? ()
#11 0x00007fbfd765ce90 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 75 (LWP 17978):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 74 (LWP 17977):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 73 (LWP 17976):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 72 (LWP 17975):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 71 (LWP 17974):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 70 (LWP 17973):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 69 (LWP 17972):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 68 (LWP 17971):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 67 (LWP 17970):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 66 (LWP 17969):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 65 (LWP 17968):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 64 (LWP 17967):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 63 (LWP 17966):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 62 (LWP 17965):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 61 (LWP 17964):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 60 (LWP 17963):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 59 (LWP 17962):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 58 (LWP 17961):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 57 (LWP 17960):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 56 (LWP 17959):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000003 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00012683c in ?? ()
#4 0x00007fbfe183deb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fbfe183ded0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0001267f0 in ?? ()
#9 0x00007fc00bbdc770 in ?? ()
#10 0x00007fbfe183ded0 in ?? ()
#11 0x00007fbfe183de90 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 55 (LWP 17958):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 54 (LWP 17957):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 53 (LWP 17956):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 52 (LWP 17955):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 51 (LWP 17954):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 50 (LWP 17953):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 49 (LWP 17952):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 48 (LWP 17951):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 47 (LWP 17950):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 46 (LWP 17949):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 45 (LWP 17948):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 44 (LWP 17947):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 43 (LWP 17946):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 42 (LWP 17945):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 41 (LWP 17944):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 40 (LWP 17943):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 39 (LWP 17942):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 38 (LWP 17941):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 37 (LWP 17940):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 36 (LWP 17939):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x00000000000000bb in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d0000a67ec in ?? ()
#4 0x00007fbfeba1eeb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fbfeba1eed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0000a67a0 in ?? ()
#9 0x00007fc00bbdc770 in ?? ()
#10 0x00007fbfeba1eed0 in ?? ()
#11 0x00007fbfeba1ee90 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 35 (LWP 17938):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000208 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d00009ffe8 in ?? ()
#4 0x00007fbfec236eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fbfec236ed0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 34 (LWP 17937):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000177 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d0000967fc in ?? ()
#4 0x00007fbfeca4eeb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fbfeca4eed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0000967b0 in ?? ()
#9 0x00007fc00bbdc770 in ?? ()
#10 0x00007fbfeca4eed0 in ?? ()
#11 0x00007fbfeca4ee90 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 33 (LWP 17936):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 32 (LWP 17935):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 31 (LWP 17934):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 30 (LWP 17933):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 29 (LWP 17932):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 28 (LWP 17931):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 27 (LWP 17930):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 26 (LWP 17929):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 25 (LWP 17928):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 24 (LWP 17927):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 23 (LWP 17926):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 22 (LWP 17925):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 21 (LWP 17924):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 20 (LWP 17923):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 19 (LWP 17922):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 18 (LWP 17921):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 17 (LWP 17920):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 16 (LWP 17919):
#0 0x00007fc00bbdcfb9 in ?? ()
#1 0x00007fbff5c30ce0 in ?? ()
#2 0x0000000000000002 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061300001b8a0 in ?? ()
#5 0x00007fbff5c30cd0 in ?? ()
#6 0x0000000000000004 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 15 (LWP 17918):
#0 0x00007fc00bbdcfb9 in ?? ()
#1 0x0000000000003ff8 in ?? ()
#2 0x0000000000000004 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061200001df18 in ?? ()
#5 0x00007fbff6468270 in ?? ()
#6 0x0000000000000008 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 14 (LWP 17916):
#0 0x00007fc00bbdcfb9 in ?? ()
#1 0x00007fbff74af260 in ?? ()
#2 0x0000000000000002 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061800000c1a8 in ?? ()
#5 0x00007fbff74af250 in ?? ()
#6 0x0000000000000004 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 13 (LWP 17915):
#0 0x00007fc00bbdcad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 12 (LWP 17914):
#0 0x00007fc004705a47 in ?? ()
#1 0x00007fbff84b2340 in ?? ()
#2 0x000061a00000c680 in ?? ()
#3 0x00007fbff84b2330 in ?? ()
#4 0x00007fbff84b2540 in ?? ()
#5 0x00007fbff84b2380 in ?? ()
#6 0x0000614000021298 in ?? ()
#7 0x00007fbff84b2400 in ?? ()
#8 0x00007fc006d7825d in ?? ()
#9 0x3fb98fde8d779000 in ?? ()
#10 0x000061a00000c680 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000c680 in ?? ()
#13 0x0000000064000000 in ?? ()
#14 0x00007fbf00000000 in ?? ()
#15 0x41da5fafd690cf28 in ?? ()
#16 0x00000ff87f08e480 in ?? ()
#17 0x00007fbff84b23e0 in ?? ()
#18 0x00007fc006d7cba3 in ?? ()
#19 0x00007fbff84b23b0 in ?? ()
#20 0x3fb98fde8d779000 in ?? ()
#21 0x00000000f84b2400 in ?? ()
#22 0x000061a00000c680 in ?? ()
#23 0x0000614000021298 in ?? ()
#24 0x3fb98fde8d779000 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 11 (LWP 17913):
#0 0x00007fc004705a47 in ?? ()
#1 0x00007fbff8cb3340 in ?? ()
#2 0x000061a00000c080 in ?? ()
#3 0x00007fbff8cb3330 in ?? ()
#4 0x00007fbff8cb3540 in ?? ()
#5 0x00007fbff8cb3380 in ?? ()
#6 0x0000614000021098 in ?? ()
#7 0x00007fbff8cb3400 in ?? ()
#8 0x00007fc006d7825d in ?? ()
#9 0x3fad2137e6a9c000 in ?? ()
#10 0x000061a00000c080 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000c080 in ?? ()
#13 0x00000000e2000000 in ?? ()
#14 0x00007fbf00000000 in ?? ()
#15 0x41da5fafd690cf2a in ?? ()
#16 0x00000ff87f18e680 in ?? ()
#17 0x00007fbff8cb33e0 in ?? ()
#18 0x00007fc006d7cba3 in ?? ()
#19 0x00007fbff8cb33b0 in ?? ()
#20 0x3fad2137e6a9c000 in ?? ()
#21 0x00000000f8cb3400 in ?? ()
#22 0x000061a00000c080 in ?? ()
#23 0x0000614000021098 in ?? ()
#24 0x3fad2137e6a9c000 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 10 (LWP 17912):
#0 0x00007fc004705a47 in ?? ()
#1 0x00007fbff94b4340 in ?? ()
#2 0x000061a00000ba80 in ?? ()
#3 0x00007fbff94b4330 in ?? ()
#4 0x00007fbff94b4540 in ?? ()
#5 0x00007fbff94b4380 in ?? ()
#6 0x0000614000020e98 in ?? ()
#7 0x00007fbff94b4400 in ?? ()
#8 0x00007fc006d7825d in ?? ()
#9 0x3fab38b32d720000 in ?? ()
#10 0x000061a00000ba80 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000ba80 in ?? ()
#13 0x0000000065000000 in ?? ()
#14 0x00007fbf00000000 in ?? ()
#15 0x41da5fafd690cf2e in ?? ()
#16 0x00000ff87f28e880 in ?? ()
#17 0x00007fbff94b43e0 in ?? ()
#18 0x00007fc006d7cba3 in ?? ()
#19 0x00007fbff94b43b0 in ?? ()
#20 0x3fab38b32d720000 in ?? ()
#21 0x00000000f94b4400 in ?? ()
#22 0x000061a00000ba80 in ?? ()
#23 0x0000614000020e98 in ?? ()
#24 0x3fab38b32d720000 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 9 (LWP 17911):
#0 0x00007fc004705a47 in ?? ()
#1 0x00007fbffb4ad340 in ?? ()
#2 0x000061a00000b480 in ?? ()
#3 0x00007fbffb4ad330 in ?? ()
#4 0x00007fbffb4ad540 in ?? ()
#5 0x00007fbffb4ad380 in ?? ()
#6 0x0000614000020c98 in ?? ()
#7 0x00007fbffb4ad400 in ?? ()
#8 0x00007fc006d7825d in ?? ()
#9 0x3fb9857fa8a97000 in ?? ()
#10 0x000061a00000b480 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000b480 in ?? ()
#13 0x0000000005800000 in ?? ()
#14 0x00007fbf00000000 in ?? ()
#15 0x41da5fafd690cf2b in ?? ()
#16 0x00000ff87f68da80 in ?? ()
#17 0x00007fbffb4ad3e0 in ?? ()
#18 0x00007fc006d7cba3 in ?? ()
#19 0x0000000000000000 in ?? ()
Thread 8 (LWP 17908):
#0 0x00007fc0046f8cb9 in ?? ()
#1 0x00000000000000c8 in ?? ()
#2 0x00007fbffceb77b8 in ?? ()
#3 0x000060200001ca50 in ?? ()
#4 0x0000000000000002 in ?? ()
#5 0x00000000000000c8 in ?? ()
#6 0x00000000008bc4a1 in __sanitizer::theDepot ()
#7 0x0000000000000000 in ?? ()
Thread 7 (LWP 17907):
#0 0x00007fc00bbdcfb9 in ?? ()
#1 0x00007fbffc6b60e0 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 6 (LWP 17906):
#0 0x00007fc00bbe09e2 in ?? ()
#1 0x00007fbffbeb3bc0 in ?? ()
#2 0x00007fbffbeb3c60 in ?? ()
#3 0x000000000000001e in ?? ()
#4 0x0000000000000030 in ?? ()
#5 0x00007fbffbeb3c10 in ?? ()
#6 0x00000000017ab3a0 in ?? ()
#7 0x00007fbffbeb3c70 in ?? ()
#8 0x000061100008b510 in ?? ()
#9 0x00007fbffbeb3c60 in ?? ()
#10 0x00000000008b6997 in __sanitizer::theDepot ()
#11 0x00007fc01152c61c in ?? ()
#12 0x00007fc01151bc29 in ?? ()
#13 0x00007fc011520216 in ?? ()
#14 0x00007fc011524c50 in ?? ()
#15 0x00007fc011524a79 in ?? ()
#16 0x0000000000a8970d in __sanitizer::theDepot ()
#17 0x00007fc0085c9f99 in ?? ()
#18 0x00007fc00bbd66db in ?? ()
#19 0x00000ff87f7ce688 in ?? ()
#20 0x00007fbffbeb3460 in ?? ()
#21 0x0000000000000000 in ?? ()
Thread 5 (LWP 17900):
#0 0x00007fc00bbdcfb9 in ?? ()
#1 0x00007fbffdeb8ca0 in ?? ()
#2 0x000000000000006b in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061200001e728 in ?? ()
#5 0x00007fbffdeb8c90 in ?? ()
#6 0x00000000000000d6 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 4 (LWP 17899):
#0 0x00007fc00bbdcfb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 3 (LWP 17898):
#0 0x00007fc00bbdcfb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 2 (LWP 17897):
#0 0x00007fc00bbdcfb9 in ?? ()
#1 0x5f5347414c46000a in ?? ()
#2 0x0000000000000002 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x00006120000126b8 in ?? ()
#5 0x00007fbfff6bc450 in ?? ()
#6 0x0000000000000004 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 1 (LWP 17895):
#0 0x00007fc00bbe0d50 in ?? ()
#1 0x0000000000000000 in ?? ()
************************* END STACKS ***************************
I20260201 02:57:33.858359 13992 external_mini_cluster-itest-base.cc:86] Attempting to dump stacks of TS 2 with UUID d74315e006374d648477a8e6109e44a7 and pid 18167
************************ BEGIN STACKS **************************
[New LWP 18169]
[New LWP 18170]
[New LWP 18171]
[New LWP 18172]
[New LWP 18178]
[New LWP 18179]
[New LWP 18180]
[New LWP 18183]
[New LWP 18184]
[New LWP 18185]
[New LWP 18186]
[New LWP 18187]
[New LWP 18188]
[New LWP 18190]
[New LWP 18191]
[New LWP 18192]
[New LWP 18193]
[New LWP 18194]
[New LWP 18195]
[New LWP 18196]
[New LWP 18197]
[New LWP 18198]
[New LWP 18199]
[New LWP 18200]
[New LWP 18201]
[New LWP 18202]
[New LWP 18203]
[New LWP 18204]
[New LWP 18205]
[New LWP 18206]
[New LWP 18207]
[New LWP 18208]
[New LWP 18209]
[New LWP 18210]
[New LWP 18211]
[New LWP 18212]
[New LWP 18213]
[New LWP 18214]
[New LWP 18215]
[New LWP 18216]
[New LWP 18217]
[New LWP 18218]
[New LWP 18219]
[New LWP 18220]
[New LWP 18221]
[New LWP 18222]
[New LWP 18223]
[New LWP 18224]
[New LWP 18225]
[New LWP 18226]
[New LWP 18227]
[New LWP 18228]
[New LWP 18229]
[New LWP 18230]
[New LWP 18231]
[New LWP 18232]
[New LWP 18233]
[New LWP 18234]
[New LWP 18235]
[New LWP 18236]
[New LWP 18237]
[New LWP 18238]
[New LWP 18239]
[New LWP 18240]
[New LWP 18241]
[New LWP 18242]
[New LWP 18243]
[New LWP 18244]
[New LWP 18245]
[New LWP 18246]
[New LWP 18247]
[New LWP 18248]
[New LWP 18249]
[New LWP 18250]
[New LWP 18251]
[New LWP 18252]
[New LWP 18253]
[New LWP 18254]
[New LWP 18255]
[New LWP 18256]
[New LWP 18257]
[New LWP 18258]
[New LWP 18259]
[New LWP 18260]
[New LWP 18261]
[New LWP 18262]
[New LWP 18263]
[New LWP 18264]
[New LWP 18265]
[New LWP 18266]
[New LWP 18267]
[New LWP 18268]
[New LWP 18269]
[New LWP 18270]
[New LWP 18271]
[New LWP 18272]
[New LWP 18273]
[New LWP 18274]
[New LWP 18275]
[New LWP 18276]
[New LWP 18277]
[New LWP 18278]
[New LWP 18279]
[New LWP 18280]
[New LWP 18281]
[New LWP 18282]
[New LWP 18283]
[New LWP 18284]
[New LWP 18285]
[New LWP 18286]
[New LWP 18287]
[New LWP 18288]
[New LWP 18289]
[New LWP 18290]
[New LWP 18291]
[New LWP 18292]
[New LWP 18293]
[New LWP 18294]
[New LWP 18295]
[New LWP 18296]
[New LWP 18297]
Cannot access memory at address 0x2074736e6f633c7a
Cannot access memory at address 0x2074736e6f633c72
Cannot access memory at address 0x2074736e6f633c7a
Cannot access memory at address 0x2074736e6f633c7a
Cannot access memory at address 0x2074736e6f633c72
0x00007ff2eb43fd50 in ?? ()
Id Target Id Frame
* 1 LWP 18167 "kudu" 0x00007ff2eb43fd50 in ?? ()
2 LWP 18169 "kudu" 0x00007ff2eb43bfb9 in ?? ()
3 LWP 18170 "kudu" 0x00007ff2eb43bfb9 in ?? ()
4 LWP 18171 "kudu" 0x00007ff2eb43bfb9 in ?? ()
5 LWP 18172 "kernel-watcher-" 0x00007ff2eb43bfb9 in ?? ()
6 LWP 18178 "ntp client-1817" 0x00007ff2eb43f9e2 in ?? ()
7 LWP 18179 "file cache-evic" 0x00007ff2eb43bfb9 in ?? ()
8 LWP 18180 "sq_acceptor" 0x00007ff2e3f57cb9 in ?? ()
9 LWP 18183 "rpc reactor-181" 0x00007ff2eed4a6e0 in ?? ()
10 LWP 18184 "rpc reactor-181" 0x00007ff2e3f64a47 in ?? ()
11 LWP 18185 "rpc reactor-181" 0x00007ff2e3f64a47 in ?? ()
12 LWP 18186 "rpc reactor-181" 0x00007ff2e3f64a47 in ?? ()
13 LWP 18187 "MaintenanceMgr " 0x00007ff2eb43bad3 in ?? ()
14 LWP 18188 "txn-status-mana" 0x00007ff2eb43bfb9 in ?? ()
15 LWP 18190 "collect_and_rem" 0x00007ff2eb43bfb9 in ?? ()
16 LWP 18191 "tc-session-exp-" 0x00007ff2eb43bfb9 in ?? ()
17 LWP 18192 "rpc worker-1819" 0x00007ff2eb43bad3 in ?? ()
18 LWP 18193 "rpc worker-1819" 0x00007ff2eb43bad3 in ?? ()
19 LWP 18194 "rpc worker-1819" 0x00007ff2eb43bad3 in ?? ()
20 LWP 18195 "rpc worker-1819" 0x00007ff2eb43bad3 in ?? ()
21 LWP 18196 "rpc worker-1819" 0x00007ff2eb43bad3 in ?? ()
22 LWP 18197 "rpc worker-1819" 0x00007ff2eb43bad3 in ?? ()
23 LWP 18198 "rpc worker-1819" 0x00007ff2eb43bad3 in ?? ()
24 LWP 18199 "rpc worker-1819" 0x00007ff2eb43bad3 in ?? ()
25 LWP 18200 "rpc worker-1820" 0x00007ff2eb43bad3 in ?? ()
26 LWP 18201 "rpc worker-1820" 0x00007ff2eb43bad3 in ?? ()
27 LWP 18202 "rpc worker-1820" 0x00007ff2eb43bad3 in ?? ()
28 LWP 18203 "rpc worker-1820" 0x00007ff2eb43bad3 in ?? ()
29 LWP 18204 "rpc worker-1820" 0x00007ff2eb43bad3 in ?? ()
30 LWP 18205 "rpc worker-1820" 0x00007ff2eb43bad3 in ?? ()
31 LWP 18206 "rpc worker-1820" 0x00007ff2eb43bad3 in ?? ()
32 LWP 18207 "rpc worker-1820" 0x00007ff2eb43bad3 in ?? ()
33 LWP 18208 "rpc worker-1820" 0x00007ff2eb43bad3 in ?? ()
34 LWP 18209 "rpc worker-1820" 0x00007ff2eb43bad3 in ?? ()
35 LWP 18210 "rpc worker-1821" 0x00007ff2eb43bad3 in ?? ()
36 LWP 18211 "rpc worker-1821" 0x00007ff2eb43bad3 in ?? ()
37 LWP 18212 "rpc worker-1821" 0x00007ff2eb43bad3 in ?? ()
38 LWP 18213 "rpc worker-1821" 0x00007ff2eb43bad3 in ?? ()
39 LWP 18214 "rpc worker-1821" 0x00007ff2eb43bad3 in ?? ()
40 LWP 18215 "rpc worker-1821" 0x00007ff2eb43bad3 in ?? ()
41 LWP 18216 "rpc worker-1821" 0x00007ff2eb43bad3 in ?? ()
42 LWP 18217 "rpc worker-1821" 0x00007ff2eb43bad3 in ?? ()
43 LWP 18218 "rpc worker-1821" 0x00007ff2eb43bad3 in ?? ()
44 LWP 18219 "rpc worker-1821" 0x00007ff2eb43bad3 in ?? ()
45 LWP 18220 "rpc worker-1822" 0x00007ff2eb43bad3 in ?? ()
46 LWP 18221 "rpc worker-1822" 0x00007ff2eb43bad3 in ?? ()
47 LWP 18222 "rpc worker-1822" 0x00007ff2eb43bad3 in ?? ()
48 LWP 18223 "rpc worker-1822" 0x00007ff2eb43bad3 in ?? ()
49 LWP 18224 "rpc worker-1822" 0x00007ff2eb43bad3 in ?? ()
50 LWP 18225 "rpc worker-1822" 0x00007ff2eb43bad3 in ?? ()
51 LWP 18226 "rpc worker-1822" 0x00007ff2eb43bad3 in ?? ()
52 LWP 18227 "rpc worker-1822" 0x00007ff2eb43bad3 in ?? ()
53 LWP 18228 "rpc worker-1822" 0x00007ff2eb43bad3 in ?? ()
54 LWP 18229 "rpc worker-1822" 0x00007ff2eb43bad3 in ?? ()
55 LWP 18230 "rpc worker-1823" 0x00007ff2eb43bad3 in ?? ()
56 LWP 18231 "rpc worker-1823" 0x00007ff2eb43bad3 in ?? ()
57 LWP 18232 "rpc worker-1823" 0x00007ff2eb43bad3 in ?? ()
58 LWP 18233 "rpc worker-1823" 0x00007ff2eb43bad3 in ?? ()
59 LWP 18234 "rpc worker-1823" 0x00007ff2eb43bad3 in ?? ()
60 LWP 18235 "rpc worker-1823" 0x00007ff2eb43bad3 in ?? ()
61 LWP 18236 "rpc worker-1823" 0x00007ff2eb43bad3 in ?? ()
62 LWP 18237 "rpc worker-1823" 0x00007ff2eb43bad3 in ?? ()
63 LWP 18238 "rpc worker-1823" 0x00007ff2eb43bad3 in ?? ()
64 LWP 18239 "rpc worker-1823" 0x00007ff2eb43bad3 in ?? ()
65 LWP 18240 "rpc worker-1824" 0x00007ff2eb43bad3 in ?? ()
66 LWP 18241 "rpc worker-1824" 0x00007ff2eb43bad3 in ?? ()
67 LWP 18242 "rpc worker-1824" 0x00007ff2eb43bad3 in ?? ()
68 LWP 18243 "rpc worker-1824" 0x00007ff2eb43bad3 in ?? ()
69 LWP 18244 "rpc worker-1824" 0x00007ff2eb43bad3 in ?? ()
70 LWP 18245 "rpc worker-1824" 0x00007ff2eb43bad3 in ?? ()
71 LWP 18246 "rpc worker-1824" 0x00007ff2eb43bad3 in ?? ()
72 LWP 18247 "rpc worker-1824" 0x00007ff2eb43bad3 in ?? ()
73 LWP 18248 "rpc worker-1824" 0x00007ff2eb43bad3 in ?? ()
74 LWP 18249 "rpc worker-1824" 0x00007ff2eb43bad3 in ?? ()
75 LWP 18250 "rpc worker-1825" 0x00007ff2eb43bad3 in ?? ()
76 LWP 18251 "rpc worker-1825" 0x00007ff2eb43bad3 in ?? ()
77 LWP 18252 "rpc worker-1825" 0x00007ff2eb43bad3 in ?? ()
78 LWP 18253 "rpc worker-1825" 0x00007ff2eb43bad3 in ?? ()
79 LWP 18254 "rpc worker-1825" 0x00007ff2eb43bad3 in ?? ()
80 LWP 18255 "rpc worker-1825" 0x00007ff2eb43bad3 in ?? ()
81 LWP 18256 "rpc worker-1825" 0x00007ff2eb43bad3 in ?? ()
82 LWP 18257 "rpc worker-1825" 0x00007ff2eb43bad3 in ?? ()
83 LWP 18258 "rpc worker-1825" 0x00007ff2eb43bad3 in ?? ()
84 LWP 18259 "rpc worker-1825" 0x00007ff2eb43bad3 in ?? ()
85 LWP 18260 "rpc worker-1826" 0x00007ff2eb43bad3 in ?? ()
86 LWP 18261 "rpc worker-1826" 0x00007ff2eb43bad3 in ?? ()
87 LWP 18262 "rpc worker-1826" 0x00007ff2eb43bad3 in ?? ()
88 LWP 18263 "rpc worker-1826" 0x00007ff2eb43bad3 in ?? ()
89 LWP 18264 "rpc worker-1826" 0x00007ff2eb43bad3 in ?? ()
90 LWP 18265 "rpc worker-1826" 0x00007ff2eb43bad3 in ?? ()
91 LWP 18266 "rpc worker-1826" 0x00007ff2eb43bad3 in ?? ()
92 LWP 18267 "rpc worker-1826" 0x00007ff2eb43bad3 in ?? ()
93 LWP 18268 "rpc worker-1826" 0x00007ff2eb43bad3 in ?? ()
94 LWP 18269 "rpc worker-1826" 0x00007ff2eb43bad3 in ?? ()
95 LWP 18270 "rpc worker-1827" 0x00007ff2eb43bad3 in ?? ()
96 LWP 18271 "rpc worker-1827" 0x00007ff2eb43bad3 in ?? ()
97 LWP 18272 "rpc worker-1827" 0x00007ff2eb43bad3 in ?? ()
98 LWP 18273 "rpc worker-1827" 0x00007ff2eb43bad3 in ?? ()
99 LWP 18274 "rpc worker-1827" 0x00007ff2eb43bad3 in ?? ()
100 LWP 18275 "rpc worker-1827" 0x00007ff2eb43bad3 in ?? ()
101 LWP 18276 "rpc worker-1827" 0x00007ff2eb43bad3 in ?? ()
102 LWP 18277 "rpc worker-1827" 0x00007ff2eb43bad3 in ?? ()
103 LWP 18278 "rpc worker-1827" 0x00007ff2eb43bad3 in ?? ()
104 LWP 18279 "rpc worker-1827" 0x00007ff2eb43bad3 in ?? ()
105 LWP 18280 "rpc worker-1828" 0x00007ff2eb43bad3 in ?? ()
106 LWP 18281 "rpc worker-1828" 0x00007ff2eb43bad3 in ?? ()
107 LWP 18282 "rpc worker-1828" 0x00007ff2eb43bad3 in ?? ()
108 LWP 18283 "rpc worker-1828" 0x00007ff2eb43bad3 in ?? ()
109 LWP 18284 "rpc worker-1828" 0x00007ff2eb43bad3 in ?? ()
110 LWP 18285 "rpc worker-1828" 0x00007ff2eb43bad3 in ?? ()
111 LWP 18286 "rpc worker-1828" 0x00007ff2eb43bad3 in ?? ()
112 LWP 18287 "rpc worker-1828" 0x00007ff2eb43bad3 in ?? ()
113 LWP 18288 "rpc worker-1828" 0x00007ff2eb43bad3 in ?? ()
114 LWP 18289 "rpc worker-1828" 0x00007ff2eb43bad3 in ?? ()
115 LWP 18290 "rpc worker-1829" 0x00007ff2eb43bad3 in ?? ()
116 LWP 18291 "rpc worker-1829" 0x00007ff2eb43bad3 in ?? ()
117 LWP 18292 "diag-logger-182" 0x00007ff2eb43bfb9 in ?? ()
118 LWP 18293 "result-tracker-" 0x00007ff2eb43bfb9 in ?? ()
119 LWP 18294 "excess-log-dele" 0x00007ff2eb43bfb9 in ?? ()
120 LWP 18295 "acceptor-18295" 0x00007ff2e3f660c7 in ?? ()
121 LWP 18296 "heartbeat-18296" 0x00007ff2eb43bfb9 in ?? ()
122 LWP 18297 "maintenance_sch" 0x00007ff2eb43bfb9 in ?? ()
Thread 122 (LWP 18297):
#0 0x00007ff2eb43bfb9 in ?? ()
#1 0x00007ff2a0272700 in ?? ()
#2 0x000000000000004c in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x0000616000016ca0 in ?? ()
#5 0x00007ff2a0272750 in ?? ()
#6 0x0000000000000098 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 121 (LWP 18296):
#0 0x00007ff2eb43bfb9 in ?? ()
#1 0xb98bb7de8fab0363 in ?? ()
#2 0x0000000000000014 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061300001a900 in ?? ()
#5 0x00007ff2a0a8a610 in ?? ()
#6 0x0000000000000028 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 120 (LWP 18295):
#0 0x00007ff2e3f660c7 in ?? ()
#1 0x0000614000020ea8 in ?? ()
#2 0x00007ff2a12a1d70 in ?? ()
#3 0x00007ff2a12a1da0 in ?? ()
#4 0x00007ff2a12a1ea0 in ?? ()
#5 0x00007ff2a12a1d90 in ?? ()
#6 0x00007ff2a12a1e00 in ?? ()
#7 0x0000000000000080 in ?? ()
#8 0x00000000008c485b in __sanitizer::theDepot ()
#9 0x0000000500000014 in ?? ()
#10 0x00007ff2a12a1f20 in ?? ()
#11 0x00007ff2a12a165c in ?? ()
#12 0x00000032a12a15d0 in ?? ()
#13 0x00007ff2a0aa5000 in ?? ()
#14 0x0000000000000000 in ?? ()
Thread 119 (LWP 18294):
#0 0x00007ff2eb43bfb9 in ?? ()
#1 0x00007ff2a1abaf60 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 118 (LWP 18293):
#0 0x00007ff2eb43bfb9 in ?? ()
#1 0x00007ff2a22e4120 in ?? ()
#2 0x0000000000000013 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061100008abb0 in ?? ()
#5 0x00007ff2a22e4110 in ?? ()
#6 0x0000000000000026 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 117 (LWP 18292):
#0 0x00007ff2eb43bfb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 116 (LWP 18291):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000003 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d0002b684c in ?? ()
#4 0x00007ff2a3313eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007ff2a3313ed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0002b6800 in ?? ()
#9 0x00007ff2eb43b770 in ?? ()
#10 0x00007ff2a3313ed0 in ?? ()
#11 0x00007ff2a3313e90 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 115 (LWP 18290):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000009 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d0002b004c in ?? ()
#4 0x00007ff2a3b2beb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007ff2a3b2bed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0002b0000 in ?? ()
#9 0x00007ff2eb43b770 in ?? ()
#10 0x00007ff2a3b2bed0 in ?? ()
#11 0x00007ff2a3b2be90 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 114 (LWP 18289):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 113 (LWP 18288):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 112 (LWP 18287):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 111 (LWP 18286):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 110 (LWP 18285):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 109 (LWP 18284):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 108 (LWP 18283):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 107 (LWP 18282):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 106 (LWP 18281):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 105 (LWP 18280):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 104 (LWP 18279):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 103 (LWP 18278):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 102 (LWP 18277):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 101 (LWP 18276):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 100 (LWP 18275):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 99 (LWP 18274):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 98 (LWP 18273):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 97 (LWP 18272):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 96 (LWP 18271):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 95 (LWP 18270):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 94 (LWP 18269):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 93 (LWP 18268):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 92 (LWP 18267):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 91 (LWP 18266):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 90 (LWP 18265):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 89 (LWP 18264):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 88 (LWP 18263):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 87 (LWP 18262):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 86 (LWP 18261):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 85 (LWP 18260):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 84 (LWP 18259):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 83 (LWP 18258):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 82 (LWP 18257):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 81 (LWP 18256):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 80 (LWP 18255):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 79 (LWP 18254):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 78 (LWP 18253):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 77 (LWP 18252):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 76 (LWP 18251):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x000000000000019d in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d0001ad08c in ?? ()
#4 0x00007ff2b6ebceb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007ff2b6ebced0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0001ad040 in ?? ()
#9 0x00007ff2eb43b770 in ?? ()
#10 0x00007ff2b6ebced0 in ?? ()
#11 0x00007ff2b6ebce90 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 75 (LWP 18250):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x00000000000000fa in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d0001a6888 in ?? ()
#4 0x00007ff2b76d4eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007ff2b76d4ed0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 74 (LWP 18249):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x000000000000017e in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d0001a0088 in ?? ()
#4 0x00007ff2b7eeceb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007ff2b7eeced0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 73 (LWP 18248):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 72 (LWP 18247):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 71 (LWP 18246):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 70 (LWP 18245):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 69 (LWP 18244):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 68 (LWP 18243):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 67 (LWP 18242):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 66 (LWP 18241):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 65 (LWP 18240):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 64 (LWP 18239):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 63 (LWP 18238):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 62 (LWP 18237):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 61 (LWP 18236):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 60 (LWP 18235):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 59 (LWP 18234):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 58 (LWP 18233):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 57 (LWP 18232):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 56 (LWP 18231):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000003 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00012683c in ?? ()
#4 0x00007ff2c109deb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007ff2c109ded0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0001267f0 in ?? ()
#9 0x00007ff2eb43b770 in ?? ()
#10 0x00007ff2c109ded0 in ?? ()
#11 0x00007ff2c109de90 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 55 (LWP 18230):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 54 (LWP 18229):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 53 (LWP 18228):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 52 (LWP 18227):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 51 (LWP 18226):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 50 (LWP 18225):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 49 (LWP 18224):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 48 (LWP 18223):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 47 (LWP 18222):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 46 (LWP 18221):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 45 (LWP 18220):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 44 (LWP 18219):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 43 (LWP 18218):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 42 (LWP 18217):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 41 (LWP 18216):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 40 (LWP 18215):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 39 (LWP 18214):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 38 (LWP 18213):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 37 (LWP 18212):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 36 (LWP 18211):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000001 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d0000a67ec in ?? ()
#4 0x00007ff2cb27eeb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007ff2cb27eed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0000a67a0 in ?? ()
#9 0x00007ff2eb43b770 in ?? ()
#10 0x00007ff2cb27eed0 in ?? ()
#11 0x00007ff2cb27ee90 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 35 (LWP 18210):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000001 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00009ffec in ?? ()
#4 0x00007ff2cba96eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007ff2cba96ed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d00009ffa0 in ?? ()
#9 0x00007ff2eb43b770 in ?? ()
#10 0x00007ff2cba96ed0 in ?? ()
#11 0x00007ff2cba96e90 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 34 (LWP 18209):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000037 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d0000967fc in ?? ()
#4 0x00007ff2cc2aeeb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007ff2cc2aeed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0000967b0 in ?? ()
#9 0x00007ff2eb43b770 in ?? ()
#10 0x00007ff2cc2aeed0 in ?? ()
#11 0x00007ff2cc2aee90 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 33 (LWP 18208):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 32 (LWP 18207):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 31 (LWP 18206):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 30 (LWP 18205):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 29 (LWP 18204):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 28 (LWP 18203):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 27 (LWP 18202):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 26 (LWP 18201):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 25 (LWP 18200):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 24 (LWP 18199):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 23 (LWP 18198):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 22 (LWP 18197):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 21 (LWP 18196):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 20 (LWP 18195):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 19 (LWP 18194):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 18 (LWP 18193):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 17 (LWP 18192):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 16 (LWP 18191):
#0 0x00007ff2eb43bfb9 in ?? ()
#1 0x00007ff2d5483ce0 in ?? ()
#2 0x0000000000000001 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061300001b8a0 in ?? ()
#5 0x00007ff2d5483cd0 in ?? ()
#6 0x0000000000000002 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 15 (LWP 18190):
#0 0x00007ff2eb43bfb9 in ?? ()
#1 0x0000000000003ff8 in ?? ()
#2 0x0000000000000003 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061200001df18 in ?? ()
#5 0x00007ff2d5ccc270 in ?? ()
#6 0x0000000000000006 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 14 (LWP 18188):
#0 0x00007ff2eb43bfb9 in ?? ()
#1 0x00007ff2d6d29260 in ?? ()
#2 0x0000000000000001 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061800000c1a8 in ?? ()
#5 0x00007ff2d6d29250 in ?? ()
#6 0x0000000000000002 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 13 (LWP 18187):
#0 0x00007ff2eb43bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 12 (LWP 18186):
#0 0x00007ff2e3f64a47 in ?? ()
#1 0x00007ff2d7d68340 in ?? ()
#2 0x000061a00000c680 in ?? ()
#3 0x00007ff2d7d68330 in ?? ()
#4 0x00007ff2d7d68540 in ?? ()
#5 0x00007ff2d7d68380 in ?? ()
#6 0x0000614000021298 in ?? ()
#7 0x00007ff2d7d68400 in ?? ()
#8 0x00007ff2e65d725d in ?? ()
#9 0x3fb97761beef6000 in ?? ()
#10 0x000061a00000c680 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000c680 in ?? ()
#13 0x000000008a800000 in ?? ()
#14 0x00007ff200000000 in ?? ()
#15 0x41da5fafd690cf2b in ?? ()
#16 0x00000ffedafa5080 in ?? ()
#17 0x00007ff2d7d683e0 in ?? ()
#18 0x00007ff2e65dbba3 in ?? ()
#19 0x00007ff2d7d683b0 in ?? ()
#20 0x3fb97761beef6000 in ?? ()
#21 0x00000000d7d68400 in ?? ()
#22 0x000061a00000c680 in ?? ()
#23 0x0000614000021298 in ?? ()
#24 0x3fb97761beef6000 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 11 (LWP 18185):
#0 0x00007ff2e3f64a47 in ?? ()
#1 0x00007ff2d857f340 in ?? ()
#2 0x000061a00000c080 in ?? ()
#3 0x00007ff2d857f330 in ?? ()
#4 0x00007ff2d857f540 in ?? ()
#5 0x00007ff2d857f380 in ?? ()
#6 0x0000614000021098 in ?? ()
#7 0x00007ff2d857f400 in ?? ()
#8 0x00007ff2e65d725d in ?? ()
#9 0x3f8ea28fe2888000 in ?? ()
#10 0x000061a00000c080 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000c080 in ?? ()
#13 0x00000000eb500000 in ?? ()
#14 0x00007ff200000000 in ?? ()
#15 0x41da5fafd690cf2c in ?? ()
#16 0x00000ffedb0a7e80 in ?? ()
#17 0x00007ff2d857f3e0 in ?? ()
#18 0x00007ff2e65dbba3 in ?? ()
#19 0x00007ff2d857f3b0 in ?? ()
#20 0x3f8ea28fe2888000 in ?? ()
#21 0x00000000d857f400 in ?? ()
#22 0x000061a00000c080 in ?? ()
#23 0x0000614000021098 in ?? ()
#24 0x3f8ea28fe2888000 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 10 (LWP 18184):
#0 0x00007ff2e3f64a47 in ?? ()
#1 0x00007ff2d8d96340 in ?? ()
#2 0x000061a00000ba80 in ?? ()
#3 0x00007ff2d8d96330 in ?? ()
#4 0x00007ff2d8d96540 in ?? ()
#5 0x00007ff2d8d96380 in ?? ()
#6 0x0000614000020e98 in ?? ()
#7 0x00007ff2d8d96400 in ?? ()
#8 0x00007ff2e65d725d in ?? ()
#9 0x3fb95bbf4c134000 in ?? ()
#10 0x000061a00000ba80 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000ba80 in ?? ()
#13 0x0000000065000000 in ?? ()
#14 0x00007ff200000000 in ?? ()
#15 0x41da5fafd690cf2a in ?? ()
#16 0x00000ffedb1aac80 in ?? ()
#17 0x00007ff2d8d963e0 in ?? ()
#18 0x00007ff2e65dbba3 in ?? ()
#19 0x00007ff2d8d963b0 in ?? ()
#20 0x3fb95bbf4c134000 in ?? ()
#21 0x00000000d8d96400 in ?? ()
#22 0x000061a00000ba80 in ?? ()
#23 0x0000614000020e98 in ?? ()
#24 0x3fb95bbf4c134000 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 9 (LWP 18183):
#0 0x00007ff2eed4a6e0 in ?? ()
#1 0x00007ff2eed42282 in ?? ()
#2 0x0000000041b58ab3 in ?? ()
#3 0x00007ff2eeadf7d6 in ?? ()
#4 0x00007ff2eed42060 in ?? ()
#5 0x00007ff2eecc1108 in ?? ()
#6 0x0000000045e0360e in ?? ()
#7 0x00007ff2eeade10e in ?? ()
#8 0x00006180001206b0 in ?? ()
#9 0x000061a00000b480 in ?? ()
#10 0x00006180001206b0 in ?? ()
#11 0x000061a00000b480 in ?? ()
#12 0x00007ff2dadac9a0 in ?? ()
#13 0x00007ff2e65dc014 in ?? ()
#14 0x0000001e00000081 in ?? ()
#15 0x000061a00000b480 in ?? ()
#16 0x00006180001206b0 in ?? ()
#17 0x00006150000216e0 in ?? ()
#18 0x00007ff2dadac9d0 in ?? ()
#19 0x00007ff2e65dc1ef in ?? ()
#20 0x00006180001206b0 in ?? ()
#21 0x000061a00000b480 in ?? ()
#22 0x00007ff2dadac9d0 in ?? ()
#23 0x00007ff20000001e in ?? ()
#24 0x0000614000020d70 in ?? ()
#25 0x00007ff2eecc11f2 in ?? ()
#26 0x00000c30000240d9 in ?? ()
#27 0x00007ff2dadacc40 in ?? ()
#28 0x0000000000000000 in ?? ()
Thread 8 (LWP 18180):
#0 0x00007ff2e3f57cb9 in ?? ()
#1 0x00000000000000c8 in ?? ()
#2 0x00007ff2dc7b77b8 in ?? ()
#3 0x000060200001ca50 in ?? ()
#4 0x0000000000000002 in ?? ()
#5 0x00000000000000c8 in ?? ()
#6 0x00000000008bc4a1 in __sanitizer::theDepot ()
#7 0x0000000000000000 in ?? ()
Thread 7 (LWP 18179):
#0 0x00007ff2eb43bfb9 in ?? ()
#1 0x00007ff2dbfb60e0 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 6 (LWP 18178):
#0 0x00007ff2eb43f9e2 in ?? ()
#1 0x00007ff2db7b3bc0 in ?? ()
#2 0x00007ff2db7b3c60 in ?? ()
#3 0x000000000000001e in ?? ()
#4 0x0000000000000030 in ?? ()
#5 0x00007ff2db7b3c10 in ?? ()
#6 0x00000000017ab3a0 in ?? ()
#7 0x00007ff2db7b3c70 in ?? ()
#8 0x000061100008b510 in ?? ()
#9 0x00007ff2db7b3c60 in ?? ()
#10 0x00000000008b6997 in __sanitizer::theDepot ()
#11 0x00007ff2f0d8b61c in ?? ()
#12 0x00007ff2f0d7ac29 in ?? ()
#13 0x00007ff2f0d7f216 in ?? ()
#14 0x00007ff2f0d83c50 in ?? ()
#15 0x00007ff2f0d83a79 in ?? ()
#16 0x0000000000a8970d in __sanitizer::theDepot ()
#17 0x00007ff2e7e28f99 in ?? ()
#18 0x00007ff2eb4356db in ?? ()
#19 0x00000ffedb6ee688 in ?? ()
#20 0x00007ff2db7b3460 in ?? ()
#21 0x0000000000000000 in ?? ()
Thread 5 (LWP 18172):
#0 0x00007ff2eb43bfb9 in ?? ()
#1 0x00007ff2dd7b8ca0 in ?? ()
#2 0x0000000000000063 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061200001e728 in ?? ()
#5 0x00007ff2dd7b8c90 in ?? ()
#6 0x00000000000000c6 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 4 (LWP 18171):
#0 0x00007ff2eb43bfb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 3 (LWP 18170):
#0 0x00007ff2eb43bfb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 2 (LWP 18169):
#0 0x00007ff2eb43bfb9 in ?? ()
#1 0x5f5347414c46000a in ?? ()
#2 0x0000000000000002 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x00006120000126b8 in ?? ()
#5 0x00007ff2defbc450 in ?? ()
#6 0x0000000000000004 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 1 (LWP 18167):
#0 0x00007ff2eb43fd50 in ?? ()
#1 0x0000000000000000 in ?? ()
************************* END STACKS ***************************
I20260201 02:57:34.655859 13992 external_mini_cluster-itest-base.cc:86] Attempting to dump stacks of TS 3 with UUID 94d535b533b04887be4fac8a82a48cb1 and pid 17758
************************ BEGIN STACKS **************************
[New LWP 17760]
[New LWP 17761]
[New LWP 17762]
[New LWP 17763]
[New LWP 17769]
[New LWP 17770]
[New LWP 17771]
[New LWP 17774]
[New LWP 17775]
[New LWP 17776]
[New LWP 17777]
[New LWP 17778]
[New LWP 17779]
[New LWP 17781]
[New LWP 17782]
[New LWP 17783]
[New LWP 17784]
[New LWP 17785]
[New LWP 17786]
[New LWP 17787]
[New LWP 17788]
[New LWP 17789]
[New LWP 17790]
[New LWP 17791]
[New LWP 17792]
[New LWP 17793]
[New LWP 17794]
[New LWP 17795]
[New LWP 17796]
[New LWP 17797]
[New LWP 17798]
[New LWP 17799]
[New LWP 17800]
[New LWP 17801]
[New LWP 17802]
[New LWP 17803]
[New LWP 17804]
[New LWP 17805]
[New LWP 17806]
[New LWP 17807]
[New LWP 17808]
[New LWP 17809]
[New LWP 17810]
[New LWP 17811]
[New LWP 17812]
[New LWP 17813]
[New LWP 17814]
[New LWP 17815]
[New LWP 17816]
[New LWP 17817]
[New LWP 17818]
[New LWP 17819]
[New LWP 17820]
[New LWP 17821]
[New LWP 17822]
[New LWP 17823]
[New LWP 17824]
[New LWP 17825]
[New LWP 17826]
[New LWP 17827]
[New LWP 17828]
[New LWP 17829]
[New LWP 17830]
[New LWP 17831]
[New LWP 17832]
[New LWP 17833]
[New LWP 17834]
[New LWP 17835]
[New LWP 17836]
[New LWP 17837]
[New LWP 17838]
[New LWP 17839]
[New LWP 17840]
[New LWP 17841]
[New LWP 17842]
[New LWP 17843]
[New LWP 17844]
[New LWP 17845]
[New LWP 17846]
[New LWP 17847]
[New LWP 17848]
[New LWP 17849]
[New LWP 17850]
[New LWP 17851]
[New LWP 17852]
[New LWP 17853]
[New LWP 17854]
[New LWP 17855]
[New LWP 17856]
[New LWP 17857]
[New LWP 17858]
[New LWP 17859]
[New LWP 17860]
[New LWP 17861]
[New LWP 17862]
[New LWP 17863]
[New LWP 17864]
[New LWP 17865]
[New LWP 17866]
[New LWP 17867]
[New LWP 17868]
[New LWP 17869]
[New LWP 17870]
[New LWP 17871]
[New LWP 17872]
[New LWP 17873]
[New LWP 17874]
[New LWP 17875]
[New LWP 17876]
[New LWP 17877]
[New LWP 17878]
[New LWP 17879]
[New LWP 17880]
[New LWP 17881]
[New LWP 17882]
[New LWP 17883]
[New LWP 17884]
[New LWP 17885]
[New LWP 17886]
[New LWP 17887]
[New LWP 17888]
Cannot access memory at address 0x2074736e6f633c7a
Cannot access memory at address 0x2074736e6f633c72
Cannot access memory at address 0x2074736e6f633c7a
Cannot access memory at address 0x2074736e6f633c7a
Cannot access memory at address 0x2074736e6f633c72
0x00007f6b7e506d50 in ?? ()
Id Target Id Frame
* 1 LWP 17758 "kudu" 0x00007f6b7e506d50 in ?? ()
2 LWP 17760 "kudu" 0x00007f6b7e502fb9 in ?? ()
3 LWP 17761 "kudu" 0x00007f6b7e502fb9 in ?? ()
4 LWP 17762 "kudu" 0x00007f6b7e502fb9 in ?? ()
5 LWP 17763 "kernel-watcher-" 0x00007f6b7e502fb9 in ?? ()
6 LWP 17769 "ntp client-1776" 0x00007f6b7e5069e2 in ?? ()
7 LWP 17770 "file cache-evic" 0x00007f6b7e502fb9 in ?? ()
8 LWP 17771 "sq_acceptor" 0x00007f6b7701ecb9 in ?? ()
9 LWP 17774 "rpc reactor-177" 0x00007f6b7702ba47 in ?? ()
10 LWP 17775 "rpc reactor-177" 0x00007f6b7702ba47 in ?? ()
11 LWP 17776 "rpc reactor-177" 0x00007f6b7702ba47 in ?? ()
12 LWP 17777 "rpc reactor-177" 0x00007f6b7702ba47 in ?? ()
13 LWP 17778 "MaintenanceMgr " 0x00007f6b7e502ad3 in ?? ()
14 LWP 17779 "txn-status-mana" 0x00007f6b7e502fb9 in ?? ()
15 LWP 17781 "collect_and_rem" 0x00007f6b7e502fb9 in ?? ()
16 LWP 17782 "tc-session-exp-" 0x00007f6b7e502fb9 in ?? ()
17 LWP 17783 "rpc worker-1778" 0x00007f6b7e502ad3 in ?? ()
18 LWP 17784 "rpc worker-1778" 0x00007f6b7e502ad3 in ?? ()
19 LWP 17785 "rpc worker-1778" 0x00007f6b7e502ad3 in ?? ()
20 LWP 17786 "rpc worker-1778" 0x00007f6b7e502ad3 in ?? ()
21 LWP 17787 "rpc worker-1778" 0x00007f6b7e502ad3 in ?? ()
22 LWP 17788 "rpc worker-1778" 0x00007f6b7e502ad3 in ?? ()
23 LWP 17789 "rpc worker-1778" 0x00007f6b7e502ad3 in ?? ()
24 LWP 17790 "rpc worker-1779" 0x00007f6b7e502ad3 in ?? ()
25 LWP 17791 "rpc worker-1779" 0x00007f6b7e502ad3 in ?? ()
26 LWP 17792 "rpc worker-1779" 0x00007f6b7e502ad3 in ?? ()
27 LWP 17793 "rpc worker-1779" 0x00007f6b7e502ad3 in ?? ()
28 LWP 17794 "rpc worker-1779" 0x00007f6b7e502ad3 in ?? ()
29 LWP 17795 "rpc worker-1779" 0x00007f6b7e502ad3 in ?? ()
30 LWP 17796 "rpc worker-1779" 0x00007f6b7e502ad3 in ?? ()
31 LWP 17797 "rpc worker-1779" 0x00007f6b7e502ad3 in ?? ()
32 LWP 17798 "rpc worker-1779" 0x00007f6b7e502ad3 in ?? ()
33 LWP 17799 "rpc worker-1779" 0x00007f6b7e502ad3 in ?? ()
34 LWP 17800 "rpc worker-1780" 0x00007f6b7e502ad3 in ?? ()
35 LWP 17801 "rpc worker-1780" 0x00007f6b7e502ad3 in ?? ()
36 LWP 17802 "rpc worker-1780" 0x00007f6b7e502ad3 in ?? ()
37 LWP 17803 "rpc worker-1780" 0x00007f6b7e502ad3 in ?? ()
38 LWP 17804 "rpc worker-1780" 0x00007f6b7e502ad3 in ?? ()
39 LWP 17805 "rpc worker-1780" 0x00007f6b7e502ad3 in ?? ()
40 LWP 17806 "rpc worker-1780" 0x00007f6b7e502ad3 in ?? ()
41 LWP 17807 "rpc worker-1780" 0x00007f6b7e502ad3 in ?? ()
42 LWP 17808 "rpc worker-1780" 0x00007f6b7e502ad3 in ?? ()
43 LWP 17809 "rpc worker-1780" 0x00007f6b7e502ad3 in ?? ()
44 LWP 17810 "rpc worker-1781" 0x00007f6b7e502ad3 in ?? ()
45 LWP 17811 "rpc worker-1781" 0x00007f6b7e502ad3 in ?? ()
46 LWP 17812 "rpc worker-1781" 0x00007f6b7e502ad3 in ?? ()
47 LWP 17813 "rpc worker-1781" 0x00007f6b7e502ad3 in ?? ()
48 LWP 17814 "rpc worker-1781" 0x00007f6b7e502ad3 in ?? ()
49 LWP 17815 "rpc worker-1781" 0x00007f6b7e502ad3 in ?? ()
50 LWP 17816 "rpc worker-1781" 0x00007f6b7e502ad3 in ?? ()
51 LWP 17817 "rpc worker-1781" 0x00007f6b7e502ad3 in ?? ()
52 LWP 17818 "rpc worker-1781" 0x00007f6b7e502ad3 in ?? ()
53 LWP 17819 "rpc worker-1781" 0x00007f6b7e502ad3 in ?? ()
54 LWP 17820 "rpc worker-1782" 0x00007f6b7e502ad3 in ?? ()
55 LWP 17821 "rpc worker-1782" 0x00007f6b7e502ad3 in ?? ()
56 LWP 17822 "rpc worker-1782" 0x00007f6b7e502ad3 in ?? ()
57 LWP 17823 "rpc worker-1782" 0x00007f6b7e502ad3 in ?? ()
58 LWP 17824 "rpc worker-1782" 0x00007f6b7e502ad3 in ?? ()
59 LWP 17825 "rpc worker-1782" 0x00007f6b7e502ad3 in ?? ()
60 LWP 17826 "rpc worker-1782" 0x00007f6b7e502ad3 in ?? ()
61 LWP 17827 "rpc worker-1782" 0x00007f6b7e502ad3 in ?? ()
62 LWP 17828 "rpc worker-1782" 0x00007f6b7e502ad3 in ?? ()
63 LWP 17829 "rpc worker-1782" 0x00007f6b7e502ad3 in ?? ()
64 LWP 17830 "rpc worker-1783" 0x00007f6b7e502ad3 in ?? ()
65 LWP 17831 "rpc worker-1783" 0x00007f6b7e502ad3 in ?? ()
66 LWP 17832 "rpc worker-1783" 0x00007f6b7e502ad3 in ?? ()
67 LWP 17833 "rpc worker-1783" 0x00007f6b7e502ad3 in ?? ()
68 LWP 17834 "rpc worker-1783" 0x00007f6b7e502ad3 in ?? ()
69 LWP 17835 "rpc worker-1783" 0x00007f6b7e502ad3 in ?? ()
70 LWP 17836 "rpc worker-1783" 0x00007f6b7e502ad3 in ?? ()
71 LWP 17837 "rpc worker-1783" 0x00007f6b7e502ad3 in ?? ()
72 LWP 17838 "rpc worker-1783" 0x00007f6b7e502ad3 in ?? ()
73 LWP 17839 "rpc worker-1783" 0x00007f6b7e502ad3 in ?? ()
74 LWP 17840 "rpc worker-1784" 0x00007f6b7e502ad3 in ?? ()
75 LWP 17841 "rpc worker-1784" 0x00007f6b7e502ad3 in ?? ()
76 LWP 17842 "rpc worker-1784" 0x00007f6b7e502ad3 in ?? ()
77 LWP 17843 "rpc worker-1784" 0x00007f6b7e502ad3 in ?? ()
78 LWP 17844 "rpc worker-1784" 0x00007f6b7e502ad3 in ?? ()
79 LWP 17845 "rpc worker-1784" 0x00007f6b7e502ad3 in ?? ()
80 LWP 17846 "rpc worker-1784" 0x00007f6b7e502ad3 in ?? ()
81 LWP 17847 "rpc worker-1784" 0x00007f6b7e502ad3 in ?? ()
82 LWP 17848 "rpc worker-1784" 0x00007f6b7e502ad3 in ?? ()
83 LWP 17849 "rpc worker-1784" 0x00007f6b7e502ad3 in ?? ()
84 LWP 17850 "rpc worker-1785" 0x00007f6b7e502ad3 in ?? ()
85 LWP 17851 "rpc worker-1785" 0x00007f6b7e502ad3 in ?? ()
86 LWP 17852 "rpc worker-1785" 0x00007f6b7e502ad3 in ?? ()
87 LWP 17853 "rpc worker-1785" 0x00007f6b7e502ad3 in ?? ()
88 LWP 17854 "rpc worker-1785" 0x00007f6b7e502ad3 in ?? ()
89 LWP 17855 "rpc worker-1785" 0x00007f6b7e502ad3 in ?? ()
90 LWP 17856 "rpc worker-1785" 0x00007f6b7e502ad3 in ?? ()
91 LWP 17857 "rpc worker-1785" 0x00007f6b7e502ad3 in ?? ()
92 LWP 17858 "rpc worker-1785" 0x00007f6b7e502ad3 in ?? ()
93 LWP 17859 "rpc worker-1785" 0x00007f6b7e502ad3 in ?? ()
94 LWP 17860 "rpc worker-1786" 0x00007f6b7e502ad3 in ?? ()
95 LWP 17861 "rpc worker-1786" 0x00007f6b7e502ad3 in ?? ()
96 LWP 17862 "rpc worker-1786" 0x00007f6b7e502ad3 in ?? ()
97 LWP 17863 "rpc worker-1786" 0x00007f6b7e502ad3 in ?? ()
98 LWP 17864 "rpc worker-1786" 0x00007f6b7e502ad3 in ?? ()
99 LWP 17865 "rpc worker-1786" 0x00007f6b7e502ad3 in ?? ()
100 LWP 17866 "rpc worker-1786" 0x00007f6b7e502ad3 in ?? ()
101 LWP 17867 "rpc worker-1786" 0x00007f6b7e502ad3 in ?? ()
102 LWP 17868 "rpc worker-1786" 0x00007f6b7e502ad3 in ?? ()
103 LWP 17869 "rpc worker-1786" 0x00007f6b7e502ad3 in ?? ()
104 LWP 17870 "rpc worker-1787" 0x00007f6b7e502ad3 in ?? ()
105 LWP 17871 "rpc worker-1787" 0x00007f6b7e502ad3 in ?? ()
106 LWP 17872 "rpc worker-1787" 0x00007f6b7e502ad3 in ?? ()
107 LWP 17873 "rpc worker-1787" 0x00007f6b7e502ad3 in ?? ()
108 LWP 17874 "rpc worker-1787" 0x00007f6b7e502ad3 in ?? ()
109 LWP 17875 "rpc worker-1787" 0x00007f6b7e502ad3 in ?? ()
110 LWP 17876 "rpc worker-1787" 0x00007f6b7e502ad3 in ?? ()
111 LWP 17877 "rpc worker-1787" 0x00007f6b7e502ad3 in ?? ()
112 LWP 17878 "rpc worker-1787" 0x00007f6b7e502ad3 in ?? ()
113 LWP 17879 "rpc worker-1787" 0x00007f6b7e502ad3 in ?? ()
114 LWP 17880 "rpc worker-1788" 0x00007f6b7e502ad3 in ?? ()
115 LWP 17881 "rpc worker-1788" 0x00007f6b7e502ad3 in ?? ()
116 LWP 17882 "rpc worker-1788" 0x00007f6b7e502ad3 in ?? ()
117 LWP 17883 "diag-logger-178" 0x00007f6b7e502fb9 in ?? ()
118 LWP 17884 "result-tracker-" 0x00007f6b7e502fb9 in ?? ()
119 LWP 17885 "excess-log-dele" 0x00007f6b7e502fb9 in ?? ()
120 LWP 17886 "acceptor-17886" 0x00007f6b7702d0c7 in ?? ()
121 LWP 17887 "heartbeat-17887" 0x00007f6b7e502fb9 in ?? ()
122 LWP 17888 "maintenance_sch" 0x00007f6b7e502fb9 in ?? ()
Thread 122 (LWP 17888):
#0 0x00007f6b7e502fb9 in ?? ()
#1 0x00007f6b32b21700 in ?? ()
#2 0x000000000000005f in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x0000616000016ca0 in ?? ()
#5 0x00007f6b32b21750 in ?? ()
#6 0x00000000000000be in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 121 (LWP 17887):
#0 0x00007f6b7e502fb9 in ?? ()
#1 0xb98bb7de8fab0363 in ?? ()
#2 0x0000000000000019 in ?? ()
#3 0x0000000100000081 in ?? ()
#4 0x000061300001a904 in ?? ()
#5 0x00007f6b33339610 in ?? ()
#6 0x0000000000000033 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x00007f6b33339630 in ?? ()
#9 0x0000000200000000 in ?? ()
#10 0x0000008000000189 in ?? ()
#11 0x00007f6b333396b0 in ?? ()
#12 0x00000fed666672d8 in ?? ()
#13 0x0000000000000000 in ?? ()
Thread 120 (LWP 17886):
#0 0x00007f6b7702d0c7 in ?? ()
#1 0x0000614000020ca8 in ?? ()
#2 0x00007f6b33b60d70 in ?? ()
#3 0x00007f6b33b60da0 in ?? ()
#4 0x00007f6b33b60ea0 in ?? ()
#5 0x00007f6b33b60d90 in ?? ()
#6 0x00007f6b33b60e00 in ?? ()
#7 0x0000000000000080 in ?? ()
#8 0x00000000008c485b in __sanitizer::theDepot ()
#9 0x0000000500000014 in ?? ()
#10 0x00007f6b33b60f20 in ?? ()
#11 0x00007f6b33b6065c in ?? ()
#12 0x0000003233b605d0 in ?? ()
#13 0x00007f6b33364000 in ?? ()
#14 0x0000000000000000 in ?? ()
Thread 119 (LWP 17885):
#0 0x00007f6b7e502fb9 in ?? ()
#1 0x00007f6b34379f60 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 118 (LWP 17884):
#0 0x00007f6b7e502fb9 in ?? ()
#1 0x00007f6b34b93120 in ?? ()
#2 0x0000000000000017 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061100008abb0 in ?? ()
#5 0x00007f6b34b93110 in ?? ()
#6 0x000000000000002e in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 117 (LWP 17883):
#0 0x00007f6b7e502fb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 116 (LWP 17882):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000003 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d0002b684c in ?? ()
#4 0x00007f6b35bc2eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f6b35bc2ed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0002b6800 in ?? ()
#9 0x00007f6b7e502770 in ?? ()
#10 0x00007f6b35bc2ed0 in ?? ()
#11 0x00007f6b35bc2e90 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 115 (LWP 17881):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000009 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d0002b004c in ?? ()
#4 0x00007f6b363daeb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f6b363daed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0002b0000 in ?? ()
#9 0x00007f6b7e502770 in ?? ()
#10 0x00007f6b363daed0 in ?? ()
#11 0x00007f6b363dae90 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 114 (LWP 17880):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 113 (LWP 17879):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 112 (LWP 17878):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 111 (LWP 17877):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 110 (LWP 17876):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 109 (LWP 17875):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 108 (LWP 17874):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 107 (LWP 17873):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 106 (LWP 17872):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 105 (LWP 17871):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 104 (LWP 17870):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 103 (LWP 17869):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 102 (LWP 17868):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 101 (LWP 17867):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 100 (LWP 17866):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 99 (LWP 17865):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 98 (LWP 17864):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 97 (LWP 17863):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 96 (LWP 17862):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 95 (LWP 17861):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 94 (LWP 17860):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 93 (LWP 17859):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 92 (LWP 17858):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 91 (LWP 17857):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 90 (LWP 17856):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 89 (LWP 17855):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 88 (LWP 17854):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 87 (LWP 17853):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 86 (LWP 17852):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 85 (LWP 17851):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 84 (LWP 17850):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 83 (LWP 17849):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 82 (LWP 17848):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 81 (LWP 17847):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 80 (LWP 17846):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 79 (LWP 17845):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 78 (LWP 17844):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 77 (LWP 17843):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 76 (LWP 17842):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x000000000000025a in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d0001ad088 in ?? ()
#4 0x00007f6b49f83eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f6b49f83ed0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 75 (LWP 17841):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000295 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d0001a688c in ?? ()
#4 0x00007f6b4a79beb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f6b4a79bed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0001a6840 in ?? ()
#9 0x00007f6b7e502770 in ?? ()
#10 0x00007f6b4a79bed0 in ?? ()
#11 0x00007f6b4a79be90 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 74 (LWP 17840):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000076 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d0001a0088 in ?? ()
#4 0x00007f6b4afb3eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f6b4afb3ed0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 73 (LWP 17839):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 72 (LWP 17838):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 71 (LWP 17837):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 70 (LWP 17836):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 69 (LWP 17835):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 68 (LWP 17834):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 67 (LWP 17833):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 66 (LWP 17832):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 65 (LWP 17831):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 64 (LWP 17830):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 63 (LWP 17829):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 62 (LWP 17828):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 61 (LWP 17827):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 60 (LWP 17826):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 59 (LWP 17825):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 58 (LWP 17824):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 57 (LWP 17823):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 56 (LWP 17822):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000003 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00012683c in ?? ()
#4 0x00007f6b54164eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f6b54164ed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0001267f0 in ?? ()
#9 0x00007f6b7e502770 in ?? ()
#10 0x00007f6b54164ed0 in ?? ()
#11 0x00007f6b54164e90 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 55 (LWP 17821):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 54 (LWP 17820):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 53 (LWP 17819):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 52 (LWP 17818):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 51 (LWP 17817):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 50 (LWP 17816):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 49 (LWP 17815):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 48 (LWP 17814):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 47 (LWP 17813):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 46 (LWP 17812):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 45 (LWP 17811):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 44 (LWP 17810):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 43 (LWP 17809):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 42 (LWP 17808):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 41 (LWP 17807):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 40 (LWP 17806):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 39 (LWP 17805):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 38 (LWP 17804):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 37 (LWP 17803):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 36 (LWP 17802):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x000000000000004b in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d0000a67ec in ?? ()
#4 0x00007f6b5e355eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f6b5e355ed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0000a67a0 in ?? ()
#9 0x00007f6b7e502770 in ?? ()
#10 0x00007f6b5e355ed0 in ?? ()
#11 0x00007f6b5e355e90 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 35 (LWP 17801):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000021 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00009ffec in ?? ()
#4 0x00007f6b5eb6deb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f6b5eb6ded0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d00009ffa0 in ?? ()
#9 0x00007f6b7e502770 in ?? ()
#10 0x00007f6b5eb6ded0 in ?? ()
#11 0x00007f6b5eb6de90 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 34 (LWP 17800):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 33 (LWP 17799):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 32 (LWP 17798):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 31 (LWP 17797):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 30 (LWP 17796):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 29 (LWP 17795):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 28 (LWP 17794):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 27 (LWP 17793):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 26 (LWP 17792):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 25 (LWP 17791):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 24 (LWP 17790):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 23 (LWP 17789):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 22 (LWP 17788):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 21 (LWP 17787):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 20 (LWP 17786):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 19 (LWP 17785):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 18 (LWP 17784):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 17 (LWP 17783):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 16 (LWP 17782):
#0 0x00007f6b7e502fb9 in ?? ()
#1 0x00007f6b68556ce0 in ?? ()
#2 0x0000000000000002 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061300001b8a0 in ?? ()
#5 0x00007f6b68556cd0 in ?? ()
#6 0x0000000000000004 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 15 (LWP 17781):
#0 0x00007f6b7e502fb9 in ?? ()
#1 0x4008000000000000 in ?? ()
#2 0x0000000000000004 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061200001df18 in ?? ()
#5 0x00007f6b68d8e270 in ?? ()
#6 0x0000000000000008 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 14 (LWP 17779):
#0 0x00007f6b7e502fb9 in ?? ()
#1 0x00007f6b69daf260 in ?? ()
#2 0x0000000000000002 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061800000c1a8 in ?? ()
#5 0x00007f6b69daf250 in ?? ()
#6 0x0000000000000004 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 13 (LWP 17778):
#0 0x00007f6b7e502ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 12 (LWP 17777):
#0 0x00007f6b7702ba47 in ?? ()
#1 0x00007f6b6adb2340 in ?? ()
#2 0x000061a00000c680 in ?? ()
#3 0x00007f6b6adb2330 in ?? ()
#4 0x00007f6b6adb2540 in ?? ()
#5 0x00007f6b6adb2380 in ?? ()
#6 0x0000614000021298 in ?? ()
#7 0x00007f6b6adb2400 in ?? ()
#8 0x00007f6b7969e25d in ?? ()
#9 0x3fb987d3c0da3000 in ?? ()
#10 0x000061a00000c680 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000c680 in ?? ()
#13 0x000000007f000000 in ?? ()
#14 0x00007f6b00000000 in ?? ()
#15 0x41da5fafd690cf29 in ?? ()
#16 0x00000feded5ae480 in ?? ()
#17 0x00007f6b6adb23e0 in ?? ()
#18 0x00007f6b796a2ba3 in ?? ()
#19 0x00007f6b6adb23b0 in ?? ()
#20 0x3fb987d3c0da3000 in ?? ()
#21 0x000000006adb2400 in ?? ()
#22 0x000061a00000c680 in ?? ()
#23 0x0000614000021298 in ?? ()
#24 0x3fb987d3c0da3000 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 11 (LWP 17776):
#0 0x00007f6b7702ba47 in ?? ()
#1 0x00007f6b6b5b3340 in ?? ()
#2 0x000061a00000c080 in ?? ()
#3 0x00007f6b6b5b3330 in ?? ()
#4 0x00007f6b6b5b3540 in ?? ()
#5 0x00007f6b6b5b3380 in ?? ()
#6 0x0000614000021098 in ?? ()
#7 0x00007f6b6b5b3400 in ?? ()
#8 0x00007f6b7969e25d in ?? ()
#9 0x3fb957cf5271c000 in ?? ()
#10 0x000061a00000c080 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000c080 in ?? ()
#13 0x00000000a0000000 in ?? ()
#14 0x00007f6b00000000 in ?? ()
#15 0x41da5fafd690cf2b in ?? ()
#16 0x00000feded6ae680 in ?? ()
#17 0x00007f6b6b5b33e0 in ?? ()
#18 0x00007f6b796a2ba3 in ?? ()
#19 0x00007f6b6b5b33b0 in ?? ()
#20 0x3fb957cf5271c000 in ?? ()
#21 0x000000006b5b3400 in ?? ()
#22 0x000061a00000c080 in ?? ()
#23 0x0000614000021098 in ?? ()
#24 0x3fb957cf5271c000 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 10 (LWP 17775):
#0 0x00007f6b7702ba47 in ?? ()
#1 0x00007f6b6bdb4340 in ?? ()
#2 0x000061a00000ba80 in ?? ()
#3 0x00007f6b6bdb4330 in ?? ()
#4 0x00007f6b6bdb4540 in ?? ()
#5 0x00007f6b6bdb4380 in ?? ()
#6 0x0000614000020e98 in ?? ()
#7 0x00007f6b6bdb4400 in ?? ()
#8 0x00007f6b7969e25d in ?? ()
#9 0x3f9ab0b9fa3fc000 in ?? ()
#10 0x000061a00000ba80 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000ba80 in ?? ()
#13 0x00000000dc200000 in ?? ()
#14 0x00007f6b00000000 in ?? ()
#15 0x41da5fafd690cf2a in ?? ()
#16 0x00000feded7ae880 in ?? ()
#17 0x00007f6b6bdb43e0 in ?? ()
#18 0x00007f6b796a2ba3 in ?? ()
#19 0x00007f6b6bdb43b0 in ?? ()
#20 0x3f9ab0b9fa3fc000 in ?? ()
#21 0x000000006bdb4400 in ?? ()
#22 0x000061a00000ba80 in ?? ()
#23 0x0000614000020e98 in ?? ()
#24 0x3f9ab0b9fa3fc000 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 9 (LWP 17774):
#0 0x00007f6b7702ba47 in ?? ()
#1 0x00007f6b6ddad340 in ?? ()
#2 0x000061a00000b480 in ?? ()
#3 0x00007f6b6ddad330 in ?? ()
#4 0x00007f6b6ddad540 in ?? ()
#5 0x00007f6b6ddad380 in ?? ()
#6 0x0000614000020c98 in ?? ()
#7 0x00007f6b6ddad400 in ?? ()
#8 0x00007f6b7969e25d in ?? ()
#9 0x3fb976e5a95c7000 in ?? ()
#10 0x000061a00000b480 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000b480 in ?? ()
#13 0x00000000d1c00000 in ?? ()
#14 0x00007f6b00000000 in ?? ()
#15 0x41da5fafd690cf2d in ?? ()
#16 0x00000fededbada80 in ?? ()
#17 0x00007f6b6ddad3e0 in ?? ()
#18 0x00007f6b796a2ba3 in ?? ()
#19 0x0000000000000000 in ?? ()
Thread 8 (LWP 17771):
#0 0x00007f6b7701ecb9 in ?? ()
#1 0x00000000000000c8 in ?? ()
#2 0x00007f6b6f7b77b8 in ?? ()
#3 0x000060200001f750 in ?? ()
#4 0x0000000000000002 in ?? ()
#5 0x00000000000000c8 in ?? ()
#6 0x00000000008bc4a1 in __sanitizer::theDepot ()
#7 0x0000000000000000 in ?? ()
Thread 7 (LWP 17770):
#0 0x00007f6b7e502fb9 in ?? ()
#1 0x00007f6b6efb60e0 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 6 (LWP 17769):
#0 0x00007f6b7e5069e2 in ?? ()
#1 0x00007f6b6e7b3bc0 in ?? ()
#2 0x00007f6b6e7b3c60 in ?? ()
#3 0x000000000000001e in ?? ()
#4 0x0000000000000030 in ?? ()
#5 0x00007f6b6e7b3c10 in ?? ()
#6 0x00000000017ab3a0 in ?? ()
#7 0x00007f6b6e7b3c70 in ?? ()
#8 0x000061100008b510 in ?? ()
#9 0x00007f6b6e7b3c60 in ?? ()
#10 0x00000000008b6997 in __sanitizer::theDepot ()
#11 0x00007f6b83e5261c in ?? ()
#12 0x00007f6b83e41c29 in ?? ()
#13 0x00007f6b83e46216 in ?? ()
#14 0x00007f6b83e4ac50 in ?? ()
#15 0x00007f6b83e4aa79 in ?? ()
#16 0x0000000000a8970d in __sanitizer::theDepot ()
#17 0x00007f6b7aeeff99 in ?? ()
#18 0x00007f6b7e4fc6db in ?? ()
#19 0x00000fededcee688 in ?? ()
#20 0x00007f6b6e7b3460 in ?? ()
#21 0x0000000000000000 in ?? ()
Thread 5 (LWP 17763):
#0 0x00007f6b7e502fb9 in ?? ()
#1 0x00007f6b707b8ca0 in ?? ()
#2 0x0000000000000077 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061200001e728 in ?? ()
#5 0x00007f6b707b8c90 in ?? ()
#6 0x00000000000000ee in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 4 (LWP 17762):
#0 0x00007f6b7e502fb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 3 (LWP 17761):
#0 0x00007f6b7e502fb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 2 (LWP 17760):
#0 0x00007f6b7e502fb9 in ?? ()
#1 0x5f5347414c46000a in ?? ()
#2 0x0000000000000002 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x00006120000126b8 in ?? ()
#5 0x00007f6b71fbc450 in ?? ()
#6 0x0000000000000004 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 1 (LWP 17758):
#0 0x00007f6b7e506d50 in ?? ()
#1 0x0000000000000000 in ?? ()
************************* END STACKS ***************************
I20260201 02:57:35.455801 13992 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-taskfoNO09/build/asan/bin/kudu pid 18032
I20260201 02:57:35.468236 18155 generic_service.cc:196] Checking for leaks (request via RPC)
I20260201 02:57:35.575971 13992 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskfoNO09/build/asan/bin/kudu with pid 18032
I20260201 02:57:35.596720 13992 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-taskfoNO09/build/asan/bin/kudu pid 17895
I20260201 02:57:35.603462 18019 generic_service.cc:196] Checking for leaks (request via RPC)
I20260201 02:57:35.832829 18550 raft_consensus.cc:493] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7c282a4e4a074f7cb7fada1519e23c9b)
I20260201 02:57:35.833205 18550 raft_consensus.cc:515] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d535b533b04887be4fac8a82a48cb1" member_type: VOTER last_known_addr { host: "127.13.170.4" port: 46319 } } peers { permanent_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 36827 } } peers { permanent_uuid: "d74315e006374d648477a8e6109e44a7" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 41669 } }
I20260201 02:57:35.834226 18550 leader_election.cc:290] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7c282a4e4a074f7cb7fada1519e23c9b (127.13.170.2:36827), d74315e006374d648477a8e6109e44a7 (127.13.170.3:41669)
I20260201 02:57:35.834868 18251 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0faa3d899dba409fa6df255630da23e4" candidate_uuid: "94d535b533b04887be4fac8a82a48cb1" candidate_term: 9 candidate_status { last_received { term: 8 index: 3399 } } ignore_live_leader: false dest_uuid: "d74315e006374d648477a8e6109e44a7" is_pre_election: true
I20260201 02:57:35.898638 18551 raft_consensus.cc:493] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7c282a4e4a074f7cb7fada1519e23c9b)
I20260201 02:57:35.899044 18551 raft_consensus.cc:515] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d535b533b04887be4fac8a82a48cb1" member_type: VOTER last_known_addr { host: "127.13.170.4" port: 46319 } } peers { permanent_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 36827 } } peers { permanent_uuid: "d74315e006374d648477a8e6109e44a7" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 41669 } }
I20260201 02:57:35.900621 18551 leader_election.cc:290] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 94d535b533b04887be4fac8a82a48cb1 (127.13.170.4:46319), 7c282a4e4a074f7cb7fada1519e23c9b (127.13.170.2:36827)
I20260201 02:57:35.919695 17841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0faa3d899dba409fa6df255630da23e4" candidate_uuid: "d74315e006374d648477a8e6109e44a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 3399 } } ignore_live_leader: false dest_uuid: "94d535b533b04887be4fac8a82a48cb1" is_pre_election: true
I20260201 02:57:35.919987 17841 raft_consensus.cc:2468] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d74315e006374d648477a8e6109e44a7 in term 8.
I20260201 02:57:35.920545 18186 leader_election.cc:304] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94d535b533b04887be4fac8a82a48cb1, d74315e006374d648477a8e6109e44a7; no voters:
I20260201 02:57:35.921005 18551 raft_consensus.cc:2804] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260201 02:57:35.921159 18551 raft_consensus.cc:493] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7c282a4e4a074f7cb7fada1519e23c9b)
I20260201 02:57:35.921294 18551 raft_consensus.cc:3060] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [term 8 FOLLOWER]: Advancing to term 9
I20260201 02:57:35.924762 18551 raft_consensus.cc:515] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d535b533b04887be4fac8a82a48cb1" member_type: VOTER last_known_addr { host: "127.13.170.4" port: 46319 } } peers { permanent_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 36827 } } peers { permanent_uuid: "d74315e006374d648477a8e6109e44a7" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 41669 } }
I20260201 02:57:35.925506 18551 leader_election.cc:290] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [CANDIDATE]: Term 9 election: Requested vote from peers 94d535b533b04887be4fac8a82a48cb1 (127.13.170.4:46319), 7c282a4e4a074f7cb7fada1519e23c9b (127.13.170.2:36827)
I20260201 02:57:35.926168 17841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0faa3d899dba409fa6df255630da23e4" candidate_uuid: "d74315e006374d648477a8e6109e44a7" candidate_term: 9 candidate_status { last_received { term: 8 index: 3399 } } ignore_live_leader: false dest_uuid: "94d535b533b04887be4fac8a82a48cb1"
I20260201 02:57:35.926416 17841 raft_consensus.cc:3060] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 8 FOLLOWER]: Advancing to term 9
I20260201 02:57:35.929032 18251 raft_consensus.cc:1240] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [term 9 FOLLOWER]: Rejecting Update request from peer 7c282a4e4a074f7cb7fada1519e23c9b for earlier term 8. Current term is 9. Ops: []
I20260201 02:57:35.930452 17841 raft_consensus.cc:2468] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d74315e006374d648477a8e6109e44a7 in term 9.
I20260201 02:57:35.930858 17840 raft_consensus.cc:1240] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 9 FOLLOWER]: Rejecting Update request from peer 7c282a4e4a074f7cb7fada1519e23c9b for earlier term 8. Current term is 9. Ops: []
I20260201 02:57:35.931643 17979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0faa3d899dba409fa6df255630da23e4" candidate_uuid: "94d535b533b04887be4fac8a82a48cb1" candidate_term: 9 candidate_status { last_received { term: 8 index: 3399 } } ignore_live_leader: false dest_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" is_pre_election: true
I20260201 02:57:35.931672 18528 consensus_queue.cc:1059] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d74315e006374d648477a8e6109e44a7" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 41669 }, Status: INVALID_TERM, Last received: 8.3399, Next index: 3400, Last known committed idx: 3399, Time since last communication: 0.002s
I20260201 02:57:35.932493 18528 consensus_queue.cc:1059] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "94d535b533b04887be4fac8a82a48cb1" member_type: VOTER last_known_addr { host: "127.13.170.4" port: 46319 }, Status: INVALID_TERM, Last received: 8.3399, Next index: 3400, Last known committed idx: 3399, Time since last communication: 0.000s
I20260201 02:57:35.932796 18556 raft_consensus.cc:3055] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [term 8 LEADER]: Stepping down as leader of term 8
I20260201 02:57:35.932950 18556 raft_consensus.cc:740] T 0faa3d899dba409fa6df255630da23e4 P 7c282a4e4a074f7cb7fada1519e23c9b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7c282a4e4a074f7cb7fada1519e23c9b, State: Running, Role: LEADER
I20260201 02:57:35.932948 17774 leader_election.cc:304] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94d535b533b04887be4fac8a82a48cb1; no voters: 7c282a4e4a074f7cb7fada1519e23c9b, d74315e006374d648477a8e6109e44a7
I20260201 02:57:35.933319 13992 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskfoNO09/build/asan/bin/kudu with pid 17895
I20260201 02:57:35.933317 18550 raft_consensus.cc:2749] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260201 02:57:35.936385 18186 leader_election.cc:304] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94d535b533b04887be4fac8a82a48cb1, d74315e006374d648477a8e6109e44a7; no voters:
I20260201 02:57:35.936779 18551 raft_consensus.cc:2804] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [term 9 FOLLOWER]: Leader election won for term 9
I20260201 02:57:35.937208 18551 raft_consensus.cc:697] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [term 9 LEADER]: Becoming Leader. State: Replica: d74315e006374d648477a8e6109e44a7, State: Running, Role: LEADER
I20260201 02:57:35.937669 18551 consensus_queue.cc:237] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3399, Committed index: 3399, Last appended: 8.3399, Last appended by leader: 3399, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d535b533b04887be4fac8a82a48cb1" member_type: VOTER last_known_addr { host: "127.13.170.4" port: 46319 } } peers { permanent_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 36827 } } peers { permanent_uuid: "d74315e006374d648477a8e6109e44a7" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 41669 } }
I20260201 02:57:35.944825 15224 catalog_manager.cc:5654] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 reported cstate change: term changed from 8 to 9, leader changed from 7c282a4e4a074f7cb7fada1519e23c9b (127.13.170.2) to d74315e006374d648477a8e6109e44a7 (127.13.170.3). New cstate: current_term: 9 leader_uuid: "d74315e006374d648477a8e6109e44a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d535b533b04887be4fac8a82a48cb1" member_type: VOTER last_known_addr { host: "127.13.170.4" port: 46319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 36827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d74315e006374d648477a8e6109e44a7" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 41669 } health_report { overall_health: HEALTHY } } }
I20260201 02:57:35.989384 13992 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-taskfoNO09/build/asan/bin/kudu pid 18167
W20260201 02:57:35.989876 18552 negotiation.cc:337] Failed RPC negotiation. Trace:
0201 02:57:35.900919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.170.2:36827 (local address 127.13.170.3:60607)
0201 02:57:35.913984 (+ 13065us) negotiation.cc:107] Waiting for socket to connect
0201 02:57:35.914004 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0201 02:57:35.914117 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0201 02:57:35.989041 (+ 74924us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.170.2:36827: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":12966,"thread_start_us":12518,"threads_started":1}
W20260201 02:57:35.990157 18183 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.170.2:36827: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260201 02:57:35.992043 18183 leader_election.cc:336] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7c282a4e4a074f7cb7fada1519e23c9b (127.13.170.2:36827): Network error: Client connection negotiation failed: client connection to 127.13.170.2:36827: connect: Connection refused (error 111)
W20260201 02:57:35.992502 18183 leader_election.cc:336] T 0faa3d899dba409fa6df255630da23e4 P d74315e006374d648477a8e6109e44a7 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 7c282a4e4a074f7cb7fada1519e23c9b (127.13.170.2:36827): Network error: Client connection negotiation failed: client connection to 127.13.170.2:36827: connect: Connection refused (error 111)
I20260201 02:57:35.997857 18290 generic_service.cc:196] Checking for leaks (request via RPC)
I20260201 02:57:36.281595 18550 raft_consensus.cc:493] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 02:57:36.281863 18550 raft_consensus.cc:515] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94d535b533b04887be4fac8a82a48cb1" member_type: VOTER last_known_addr { host: "127.13.170.4" port: 46319 } } peers { permanent_uuid: "7c282a4e4a074f7cb7fada1519e23c9b" member_type: VOTER last_known_addr { host: "127.13.170.2" port: 36827 } } peers { permanent_uuid: "d74315e006374d648477a8e6109e44a7" member_type: VOTER last_known_addr { host: "127.13.170.3" port: 41669 } }
I20260201 02:57:36.282598 18550 leader_election.cc:290] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7c282a4e4a074f7cb7fada1519e23c9b (127.13.170.2:36827), d74315e006374d648477a8e6109e44a7 (127.13.170.3:41669)
W20260201 02:57:36.283792 17774 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.170.2:36827: connect: Connection refused (error 111)
W20260201 02:57:36.285357 17774 leader_election.cc:336] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 7c282a4e4a074f7cb7fada1519e23c9b (127.13.170.2:36827): Network error: Client connection negotiation failed: client connection to 127.13.170.2:36827: connect: Connection refused (error 111)
I20260201 02:57:36.310563 18251 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0faa3d899dba409fa6df255630da23e4" candidate_uuid: "94d535b533b04887be4fac8a82a48cb1" candidate_term: 10 candidate_status { last_received { term: 8 index: 3399 } } ignore_live_leader: false dest_uuid: "d74315e006374d648477a8e6109e44a7" is_pre_election: true
I20260201 02:57:36.311121 13992 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskfoNO09/build/asan/bin/kudu with pid 18167
I20260201 02:57:36.311192 17841 raft_consensus.cc:1275] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 9 FOLLOWER]: Refusing update from remote peer d74315e006374d648477a8e6109e44a7: Log matching property violated. Preceding OpId in replica: term: 8 index: 3399. Preceding OpId from leader: term: 9 index: 3400. (index mismatch)
I20260201 02:57:36.313270 17775 leader_election.cc:304] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94d535b533b04887be4fac8a82a48cb1; no voters: 7c282a4e4a074f7cb7fada1519e23c9b, d74315e006374d648477a8e6109e44a7
I20260201 02:57:36.313623 18550 raft_consensus.cc:2749] T 0faa3d899dba409fa6df255630da23e4 P 94d535b533b04887be4fac8a82a48cb1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260201 02:57:36.364259 17774 connection.cc:537] server connection from 127.13.170.3:56695 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260201 02:57:36.364390 13992 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-taskfoNO09/build/asan/bin/kudu pid 17758
I20260201 02:57:36.371167 17881 generic_service.cc:196] Checking for leaks (request via RPC)
I20260201 02:57:36.679816 13992 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskfoNO09/build/asan/bin/kudu with pid 17758
I20260201 02:57:36.735713 13992 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-taskfoNO09/build/asan/bin/kudu pid 15198
I20260201 02:57:36.742786 15259 generic_service.cc:196] Checking for leaks (request via RPC)
I20260201 02:57:36.894495 13992 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskfoNO09/build/asan/bin/kudu with pid 15198
2026-02-01T02:57:36Z chronyd exiting
I20260201 02:57:36.942207 13992 test_util.cc:183] -----------------------------------------------
I20260201 02:57:36.942322 13992 test_util.cc:184] Had failures, leaving test files at /tmp/dist-test-taskfoNO09/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1769914534130798-13992-0
[ FAILED ] RollingRestartArgs/RollingRestartITest.TestWorkloads/4, where GetParam() = 800-byte object <01-00 00-00 01-61 00-00 04-00 00-00 BE-BE BE-BE A0-24 00-00 80-61 00-00 00-00 00-00 00-00 00-00 00-BE BE-BE BE-BE BE-BE BE-BE BE-BE BE-BE BE-BE C0-24 00-00 80-61 00-00 00-00 00-00 00-00 00-00 ... BE-BE BE-BE BE-BE BE-BE 78-27 00-00 80-61 00-00 00-00 00-00 00-00 00-00 00-BE BE-BE BE-BE BE-BE BE-BE BE-BE BE-BE BE-BE 00-01 00-BE BE-BE BE-BE 04-00 00-00 03-00 00-00 01-BE BE-BE BE-BE BE-BE> (78048 ms)
[----------] 1 test from RollingRestartArgs/RollingRestartITest (78048 ms total)
[----------] Global test environment tear-down
[==========] 2 tests from 2 test suites ran. (122744 ms total)
[ PASSED ] 1 test.
[ FAILED ] 1 test, listed below:
[ FAILED ] RollingRestartArgs/RollingRestartITest.TestWorkloads/4, where GetParam() = 800-byte object <01-00 00-00 01-61 00-00 04-00 00-00 BE-BE BE-BE A0-24 00-00 80-61 00-00 00-00 00-00 00-00 00-00 00-BE BE-BE BE-BE BE-BE BE-BE BE-BE BE-BE BE-BE C0-24 00-00 80-61 00-00 00-00 00-00 00-00 00-00 ... BE-BE BE-BE BE-BE BE-BE 78-27 00-00 80-61 00-00 00-00 00-00 00-00 00-00 00-BE BE-BE BE-BE BE-BE BE-BE BE-BE BE-BE BE-BE 00-01 00-BE BE-BE BE-BE 04-00 00-00 03-00 00-00 01-BE BE-BE BE-BE BE-BE>
1 FAILED TEST
I20260201 02:57:36.943958 13992 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/client/meta_cache.cc:302: suppressed but not reported on 1 messages since previous log ~21 seconds ago