Note: This is test shard 1 of 8.
[==========] Running 2 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 1 test from MaintenanceModeRF3ITest
[ RUN ] MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate
2026-05-03T19:55:21Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-05-03T19:55:21Z Disabled control of system clock
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260503 19:55:21.233955 420 external_mini_cluster.cc:1366] Running /tmp/dist-test-task4vf7p3/build/asan/bin/kudu
/tmp/dist-test-task4vf7p3/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.105.62:45771
--webserver_interface=127.0.105.62
--webserver_port=0
--builtin_ntp_servers=127.0.105.20:45495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.105.62:45771 with env {}
W20260503 19:55:21.718904 428 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260503 19:55:21.719295 428 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260503 19:55:21.719455 428 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260503 19:55:21.730926 428 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260503 19:55:21.731128 428 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260503 19:55:21.731247 428 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260503 19:55:21.731351 428 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260503 19:55:21.752005 428 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.105.20:45495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.105.62:45771
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.105.62:45771
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.105.62
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 0ba7f54e15c9f673bf3e350f30b8d5f1a4037b79
build type FASTDEBUG
built by None at 03 May 2026 19:43:25 UTC on bdcb31816ec0
build id 11730
ASAN enabled
I20260503 19:55:21.754510 428 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260503 19:55:21.765591 428 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260503 19:55:21.784135 433 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 19:55:21.784569 434 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 19:55:21.785441 436 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260503 19:55:21.786727 428 server_base.cc:1061] running on GCE node
I20260503 19:55:21.787863 428 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260503 19:55:21.790032 428 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260503 19:55:21.793799 428 hybrid_clock.cc:648] HybridClock initialized: now 1777838121793619 us; error 118 us; skew 500 ppm
I20260503 19:55:21.794414 428 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260503 19:55:21.799607 428 webserver.cc:492] Webserver started at http://127.0.105.62:41273/ using document root <none> and password file <none>
I20260503 19:55:21.801981 428 fs_manager.cc:362] Metadata directory not provided
I20260503 19:55:21.802222 428 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260503 19:55:21.802712 428 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260503 19:55:21.807334 428 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/master-0/data/instance:
uuid: "0cfd85cd0cf5439fbdd92ac67a0587df"
format_stamp: "Formatted at 2026-05-03 19:55:21 on dist-test-slave-nzs1"
I20260503 19:55:21.808632 428 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/master-0/wal/instance:
uuid: "0cfd85cd0cf5439fbdd92ac67a0587df"
format_stamp: "Formatted at 2026-05-03 19:55:21 on dist-test-slave-nzs1"
I20260503 19:55:21.818624 428 fs_manager.cc:696] Time spent creating directory manager: real 0.009s user 0.007s sys 0.001s
I20260503 19:55:21.826357 442 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260503 19:55:21.829246 428 fs_manager.cc:730] Time spent opening block manager: real 0.005s user 0.002s sys 0.000s
I20260503 19:55:21.829488 428 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/master-0/data,/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/master-0/wal
uuid: "0cfd85cd0cf5439fbdd92ac67a0587df"
format_stamp: "Formatted at 2026-05-03 19:55:21 on dist-test-slave-nzs1"
I20260503 19:55:21.829706 428 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260503 19:55:21.854840 428 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260503 19:55:21.856098 428 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260503 19:55:21.856415 428 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260503 19:55:21.891878 428 rpc_server.cc:307] RPC server started. Bound to: 127.0.105.62:45771
I20260503 19:55:21.891836 493 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.105.62:45771 every 8 connection(s)
I20260503 19:55:21.893788 428 server_base.cc:1193] Dumped server information to /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/master-0/data/info.pb
I20260503 19:55:21.899430 494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 19:55:21.903818 420 external_mini_cluster.cc:1428] Started /tmp/dist-test-task4vf7p3/build/asan/bin/kudu as pid 428
I20260503 19:55:21.904147 420 external_mini_cluster.cc:1442] Reading /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/master-0/wal/instance
I20260503 19:55:21.912882 494 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0cfd85cd0cf5439fbdd92ac67a0587df: Bootstrap starting.
I20260503 19:55:21.918983 494 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0cfd85cd0cf5439fbdd92ac67a0587df: Neither blocks nor log segments found. Creating new log.
I20260503 19:55:21.920828 494 log.cc:826] T 00000000000000000000000000000000 P 0cfd85cd0cf5439fbdd92ac67a0587df: Log is configured to *not* fsync() on all Append() calls
I20260503 19:55:21.930645 494 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0cfd85cd0cf5439fbdd92ac67a0587df: No bootstrap required, opened a new log
I20260503 19:55:21.940099 494 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0cfd85cd0cf5439fbdd92ac67a0587df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0cfd85cd0cf5439fbdd92ac67a0587df" member_type: VOTER last_known_addr { host: "127.0.105.62" port: 45771 } }
I20260503 19:55:21.940622 494 raft_consensus.cc:385] T 00000000000000000000000000000000 P 0cfd85cd0cf5439fbdd92ac67a0587df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 19:55:21.940752 494 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0cfd85cd0cf5439fbdd92ac67a0587df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cfd85cd0cf5439fbdd92ac67a0587df, State: Initialized, Role: FOLLOWER
I20260503 19:55:21.942657 494 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0cfd85cd0cf5439fbdd92ac67a0587df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0cfd85cd0cf5439fbdd92ac67a0587df" member_type: VOTER last_known_addr { host: "127.0.105.62" port: 45771 } }
I20260503 19:55:21.943179 494 raft_consensus.cc:399] T 00000000000000000000000000000000 P 0cfd85cd0cf5439fbdd92ac67a0587df [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260503 19:55:21.943750 494 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0cfd85cd0cf5439fbdd92ac67a0587df [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260503 19:55:21.944177 494 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0cfd85cd0cf5439fbdd92ac67a0587df [term 0 FOLLOWER]: Advancing to term 1
I20260503 19:55:22.023516 494 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0cfd85cd0cf5439fbdd92ac67a0587df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0cfd85cd0cf5439fbdd92ac67a0587df" member_type: VOTER last_known_addr { host: "127.0.105.62" port: 45771 } }
I20260503 19:55:22.024384 494 leader_election.cc:304] T 00000000000000000000000000000000 P 0cfd85cd0cf5439fbdd92ac67a0587df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0cfd85cd0cf5439fbdd92ac67a0587df; no voters:
I20260503 19:55:22.025463 494 leader_election.cc:290] T 00000000000000000000000000000000 P 0cfd85cd0cf5439fbdd92ac67a0587df [CANDIDATE]: Term 1 election: Requested vote from peers
I20260503 19:55:22.025799 499 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0cfd85cd0cf5439fbdd92ac67a0587df [term 1 FOLLOWER]: Leader election won for term 1
I20260503 19:55:22.027251 499 raft_consensus.cc:697] T 00000000000000000000000000000000 P 0cfd85cd0cf5439fbdd92ac67a0587df [term 1 LEADER]: Becoming Leader. State: Replica: 0cfd85cd0cf5439fbdd92ac67a0587df, State: Running, Role: LEADER
I20260503 19:55:22.028079 499 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0cfd85cd0cf5439fbdd92ac67a0587df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0cfd85cd0cf5439fbdd92ac67a0587df" member_type: VOTER last_known_addr { host: "127.0.105.62" port: 45771 } }
I20260503 19:55:22.029362 494 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0cfd85cd0cf5439fbdd92ac67a0587df [sys.catalog]: configured and running, proceeding with master startup.
I20260503 19:55:22.036540 500 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0cfd85cd0cf5439fbdd92ac67a0587df [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0cfd85cd0cf5439fbdd92ac67a0587df" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0cfd85cd0cf5439fbdd92ac67a0587df" member_type: VOTER last_known_addr { host: "127.0.105.62" port: 45771 } } }
I20260503 19:55:22.037557 500 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0cfd85cd0cf5439fbdd92ac67a0587df [sys.catalog]: This master's current role is: LEADER
I20260503 19:55:22.037286 501 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0cfd85cd0cf5439fbdd92ac67a0587df [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0cfd85cd0cf5439fbdd92ac67a0587df. Latest consensus state: current_term: 1 leader_uuid: "0cfd85cd0cf5439fbdd92ac67a0587df" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0cfd85cd0cf5439fbdd92ac67a0587df" member_type: VOTER last_known_addr { host: "127.0.105.62" port: 45771 } } }
I20260503 19:55:22.038125 501 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0cfd85cd0cf5439fbdd92ac67a0587df [sys.catalog]: This master's current role is: LEADER
I20260503 19:55:22.043144 506 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260503 19:55:22.067899 506 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260503 19:55:22.089569 506 catalog_manager.cc:1357] Generated new cluster ID: 61d4022c2ac24effb519232b53791738
I20260503 19:55:22.089962 506 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260503 19:55:22.134267 506 catalog_manager.cc:1380] Generated new certificate authority record
I20260503 19:55:22.136999 506 catalog_manager.cc:1514] Loading token signing keys...
I20260503 19:55:22.170938 506 catalog_manager.cc:6044] T 00000000000000000000000000000000 P 0cfd85cd0cf5439fbdd92ac67a0587df: Generated new TSK 0
I20260503 19:55:22.172366 506 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260503 19:55:22.197957 420 external_mini_cluster.cc:1366] Running /tmp/dist-test-task4vf7p3/build/asan/bin/kudu
/tmp/dist-test-task4vf7p3/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.105.1:0
--local_ip_for_outbound_sockets=127.0.105.1
--webserver_interface=127.0.105.1
--webserver_port=0
--tserver_master_addrs=127.0.105.62:45771
--builtin_ntp_servers=127.0.105.20:45495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--follower_unavailable_considered_failed_sec=2
--enable_log_gc=false with env {}
W20260503 19:55:22.726980 518 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260503 19:55:22.727470 518 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260503 19:55:22.727975 518 flags.cc:432] Enabled unsafe flag: --enable_log_gc=false
W20260503 19:55:22.728159 518 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260503 19:55:22.741103 518 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260503 19:55:22.741535 518 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.105.1
I20260503 19:55:22.753674 518 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.105.20:45495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=2
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.105.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.105.1
--webserver_port=0
--enable_log_gc=false
--tserver_master_addrs=127.0.105.62:45771
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.105.1
--log_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 0ba7f54e15c9f673bf3e350f30b8d5f1a4037b79
build type FASTDEBUG
built by None at 03 May 2026 19:43:25 UTC on bdcb31816ec0
build id 11730
ASAN enabled
I20260503 19:55:22.755563 518 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260503 19:55:22.757691 518 file_cache.cc:492] Constructed file cache file cache with capacity 419430
E20260503 19:55:22.763003 518 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260503 19:55:22.772228 523 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 19:55:22.773295 526 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 19:55:22.772959 524 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260503 19:55:22.775168 518 server_base.cc:1061] running on GCE node
I20260503 19:55:22.776309 518 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260503 19:55:22.777853 518 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260503 19:55:22.779424 518 hybrid_clock.cc:648] HybridClock initialized: now 1777838122779312 us; error 236 us; skew 500 ppm
I20260503 19:55:22.780001 518 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260503 19:55:22.783500 518 webserver.cc:492] Webserver started at http://127.0.105.1:45969/ using document root <none> and password file <none>
I20260503 19:55:22.784536 518 fs_manager.cc:362] Metadata directory not provided
I20260503 19:55:22.784703 518 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260503 19:55:22.785123 518 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260503 19:55:22.788158 518 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-0/data/instance:
uuid: "0e52aa88a17542609e84f0c09fb85d87"
format_stamp: "Formatted at 2026-05-03 19:55:22 on dist-test-slave-nzs1"
I20260503 19:55:22.789104 518 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-0/wal/instance:
uuid: "0e52aa88a17542609e84f0c09fb85d87"
format_stamp: "Formatted at 2026-05-03 19:55:22 on dist-test-slave-nzs1"
I20260503 19:55:22.797057 518 fs_manager.cc:696] Time spent creating directory manager: real 0.007s user 0.006s sys 0.001s
I20260503 19:55:22.802922 532 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260503 19:55:22.805145 518 fs_manager.cc:730] Time spent opening block manager: real 0.005s user 0.002s sys 0.000s
I20260503 19:55:22.805433 518 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-0/data,/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-0/wal
uuid: "0e52aa88a17542609e84f0c09fb85d87"
format_stamp: "Formatted at 2026-05-03 19:55:22 on dist-test-slave-nzs1"
I20260503 19:55:22.805696 518 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260503 19:55:22.859480 518 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260503 19:55:22.861743 518 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260503 19:55:22.862144 518 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260503 19:55:22.863613 518 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260503 19:55:22.867282 518 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260503 19:55:22.868556 518 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s user 0.000s sys 0.002s
I20260503 19:55:22.868844 518 ts_tablet_manager.cc:616] Registered 0 tablets
I20260503 19:55:22.868961 518 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260503 19:55:22.986748 518 rpc_server.cc:307] RPC server started. Bound to: 127.0.105.1:37847
I20260503 19:55:22.986977 644 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.105.1:37847 every 8 connection(s)
I20260503 19:55:22.991923 518 server_base.cc:1193] Dumped server information to /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-0/data/info.pb
I20260503 19:55:22.995014 420 external_mini_cluster.cc:1428] Started /tmp/dist-test-task4vf7p3/build/asan/bin/kudu as pid 518
I20260503 19:55:22.995486 420 external_mini_cluster.cc:1442] Reading /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-0/wal/instance
I20260503 19:55:23.005316 420 external_mini_cluster.cc:1366] Running /tmp/dist-test-task4vf7p3/build/asan/bin/kudu
/tmp/dist-test-task4vf7p3/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.105.2:0
--local_ip_for_outbound_sockets=127.0.105.2
--webserver_interface=127.0.105.2
--webserver_port=0
--tserver_master_addrs=127.0.105.62:45771
--builtin_ntp_servers=127.0.105.20:45495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--follower_unavailable_considered_failed_sec=2
--enable_log_gc=false with env {}
I20260503 19:55:23.030731 645 heartbeater.cc:344] Connected to a master server at 127.0.105.62:45771
I20260503 19:55:23.031500 645 heartbeater.cc:461] Registering TS with master...
I20260503 19:55:23.033917 645 heartbeater.cc:507] Master 127.0.105.62:45771 requested a full tablet report, sending...
I20260503 19:55:23.041319 459 ts_manager.cc:194] Registered new tserver with Master: 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847)
I20260503 19:55:23.043828 459 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.105.1:40843
W20260503 19:55:23.498481 649 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260503 19:55:23.498836 649 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260503 19:55:23.498903 649 flags.cc:432] Enabled unsafe flag: --enable_log_gc=false
W20260503 19:55:23.498962 649 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260503 19:55:23.509214 649 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260503 19:55:23.509428 649 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.105.2
I20260503 19:55:23.520210 649 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.105.20:45495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=2
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.105.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.105.2
--webserver_port=0
--enable_log_gc=false
--tserver_master_addrs=127.0.105.62:45771
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.105.2
--log_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 0ba7f54e15c9f673bf3e350f30b8d5f1a4037b79
build type FASTDEBUG
built by None at 03 May 2026 19:43:25 UTC on bdcb31816ec0
build id 11730
ASAN enabled
I20260503 19:55:23.521945 649 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260503 19:55:23.524336 649 file_cache.cc:492] Constructed file cache file cache with capacity 419430
E20260503 19:55:23.529048 649 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260503 19:55:23.540061 654 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 19:55:23.539984 655 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 19:55:23.540885 657 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260503 19:55:23.541446 649 server_base.cc:1061] running on GCE node
I20260503 19:55:23.542222 649 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260503 19:55:23.543439 649 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260503 19:55:23.544973 649 hybrid_clock.cc:648] HybridClock initialized: now 1777838123544882 us; error 130 us; skew 500 ppm
I20260503 19:55:23.545318 649 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260503 19:55:23.548146 649 webserver.cc:492] Webserver started at http://127.0.105.2:36089/ using document root <none> and password file <none>
I20260503 19:55:23.549019 649 fs_manager.cc:362] Metadata directory not provided
I20260503 19:55:23.549127 649 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260503 19:55:23.549556 649 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260503 19:55:23.552884 649 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-1/data/instance:
uuid: "a1219433b66444d091420ceeab5092ef"
format_stamp: "Formatted at 2026-05-03 19:55:23 on dist-test-slave-nzs1"
I20260503 19:55:23.553694 649 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-1/wal/instance:
uuid: "a1219433b66444d091420ceeab5092ef"
format_stamp: "Formatted at 2026-05-03 19:55:23 on dist-test-slave-nzs1"
I20260503 19:55:23.560556 649 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260503 19:55:23.565052 663 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260503 19:55:23.567286 649 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260503 19:55:23.567567 649 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-1/data,/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-1/wal
uuid: "a1219433b66444d091420ceeab5092ef"
format_stamp: "Formatted at 2026-05-03 19:55:23 on dist-test-slave-nzs1"
I20260503 19:55:23.567866 649 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260503 19:55:23.598902 649 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260503 19:55:23.599968 649 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260503 19:55:23.600278 649 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260503 19:55:23.601374 649 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260503 19:55:23.603271 649 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260503 19:55:23.603415 649 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260503 19:55:23.603569 649 ts_tablet_manager.cc:616] Registered 0 tablets
I20260503 19:55:23.603684 649 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260503 19:55:23.652118 649 rpc_server.cc:307] RPC server started. Bound to: 127.0.105.2:38837
I20260503 19:55:23.652176 775 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.105.2:38837 every 8 connection(s)
I20260503 19:55:23.653771 649 server_base.cc:1193] Dumped server information to /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-1/data/info.pb
I20260503 19:55:23.662256 420 external_mini_cluster.cc:1428] Started /tmp/dist-test-task4vf7p3/build/asan/bin/kudu as pid 649
I20260503 19:55:23.662482 420 external_mini_cluster.cc:1442] Reading /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-1/wal/instance
I20260503 19:55:23.666070 420 external_mini_cluster.cc:1366] Running /tmp/dist-test-task4vf7p3/build/asan/bin/kudu
/tmp/dist-test-task4vf7p3/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.105.3:0
--local_ip_for_outbound_sockets=127.0.105.3
--webserver_interface=127.0.105.3
--webserver_port=0
--tserver_master_addrs=127.0.105.62:45771
--builtin_ntp_servers=127.0.105.20:45495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--follower_unavailable_considered_failed_sec=2
--enable_log_gc=false with env {}
I20260503 19:55:23.671169 776 heartbeater.cc:344] Connected to a master server at 127.0.105.62:45771
I20260503 19:55:23.671569 776 heartbeater.cc:461] Registering TS with master...
I20260503 19:55:23.672528 776 heartbeater.cc:507] Master 127.0.105.62:45771 requested a full tablet report, sending...
I20260503 19:55:23.674302 459 ts_manager.cc:194] Registered new tserver with Master: a1219433b66444d091420ceeab5092ef (127.0.105.2:38837)
I20260503 19:55:23.676324 459 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.105.2:39011
I20260503 19:55:24.052099 645 heartbeater.cc:499] Master 127.0.105.62:45771 was elected leader, sending a full tablet report...
W20260503 19:55:24.064977 780 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260503 19:55:24.065325 780 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260503 19:55:24.065389 780 flags.cc:432] Enabled unsafe flag: --enable_log_gc=false
W20260503 19:55:24.065512 780 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260503 19:55:24.075332 780 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260503 19:55:24.075766 780 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.105.3
I20260503 19:55:24.086534 780 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.105.20:45495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=2
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.105.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.105.3
--webserver_port=0
--enable_log_gc=false
--tserver_master_addrs=127.0.105.62:45771
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.105.3
--log_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 0ba7f54e15c9f673bf3e350f30b8d5f1a4037b79
build type FASTDEBUG
built by None at 03 May 2026 19:43:25 UTC on bdcb31816ec0
build id 11730
ASAN enabled
I20260503 19:55:24.088330 780 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260503 19:55:24.090876 780 file_cache.cc:492] Constructed file cache file cache with capacity 419430
E20260503 19:55:24.095189 780 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260503 19:55:24.102815 786 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 19:55:24.103009 785 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 19:55:24.103713 788 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260503 19:55:24.103711 780 server_base.cc:1061] running on GCE node
I20260503 19:55:24.104446 780 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260503 19:55:24.105556 780 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260503 19:55:24.106863 780 hybrid_clock.cc:648] HybridClock initialized: now 1777838124106834 us; error 67 us; skew 500 ppm
I20260503 19:55:24.107232 780 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260503 19:55:24.110023 780 webserver.cc:492] Webserver started at http://127.0.105.3:45327/ using document root <none> and password file <none>
I20260503 19:55:24.110924 780 fs_manager.cc:362] Metadata directory not provided
I20260503 19:55:24.111083 780 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260503 19:55:24.111461 780 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260503 19:55:24.116115 780 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-2/data/instance:
uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8"
format_stamp: "Formatted at 2026-05-03 19:55:24 on dist-test-slave-nzs1"
I20260503 19:55:24.117414 780 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-2/wal/instance:
uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8"
format_stamp: "Formatted at 2026-05-03 19:55:24 on dist-test-slave-nzs1"
I20260503 19:55:24.125067 780 fs_manager.cc:696] Time spent creating directory manager: real 0.007s user 0.007s sys 0.000s
I20260503 19:55:24.129806 794 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260503 19:55:24.132524 780 fs_manager.cc:730] Time spent opening block manager: real 0.005s user 0.006s sys 0.000s
I20260503 19:55:24.132773 780 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-2/data,/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-2/wal
uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8"
format_stamp: "Formatted at 2026-05-03 19:55:24 on dist-test-slave-nzs1"
I20260503 19:55:24.132994 780 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260503 19:55:24.155831 780 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260503 19:55:24.156931 780 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260503 19:55:24.157248 780 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260503 19:55:24.158357 780 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260503 19:55:24.160374 780 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260503 19:55:24.160490 780 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260503 19:55:24.160642 780 ts_tablet_manager.cc:616] Registered 0 tablets
I20260503 19:55:24.160701 780 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260503 19:55:24.207894 780 rpc_server.cc:307] RPC server started. Bound to: 127.0.105.3:35005
I20260503 19:55:24.207949 906 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.105.3:35005 every 8 connection(s)
I20260503 19:55:24.209676 780 server_base.cc:1193] Dumped server information to /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-2/data/info.pb
I20260503 19:55:24.210016 420 external_mini_cluster.cc:1428] Started /tmp/dist-test-task4vf7p3/build/asan/bin/kudu as pid 780
I20260503 19:55:24.210220 420 external_mini_cluster.cc:1442] Reading /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-2/wal/instance
I20260503 19:55:24.226104 907 heartbeater.cc:344] Connected to a master server at 127.0.105.62:45771
I20260503 19:55:24.226485 907 heartbeater.cc:461] Registering TS with master...
I20260503 19:55:24.227406 907 heartbeater.cc:507] Master 127.0.105.62:45771 requested a full tablet report, sending...
I20260503 19:55:24.229697 459 ts_manager.cc:194] Registered new tserver with Master: 6d99e4f4d5ca48e0bdb54daf8361c5e8 (127.0.105.3:35005)
I20260503 19:55:24.230763 459 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.105.3:59193
I20260503 19:55:24.230751 420 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
I20260503 19:55:24.289708 459 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57378:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\004\001\000UUU\025\004\001\000\252\252\252*\004\001\000\377\377\377?\004\001\000TUUU\004\001\000\251\252\252j"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 19:55:24.292266 459 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 19:55:24.339609 839 tablet_service.cc:1511] Processing CreateTablet for tablet ecf4b80ba8714f24a49387dc8bbe2da3 (DEFAULT_TABLE table=test-workload [id=d7958170ae984d5b8940e4bbd6275af2]), partition=RANGE (key) PARTITION 1073741823 <= VALUES < 1431655764
I20260503 19:55:24.339327 841 tablet_service.cc:1511] Processing CreateTablet for tablet 1c99d75cb2be4439a1610c0de343d73a (DEFAULT_TABLE table=test-workload [id=d7958170ae984d5b8940e4bbd6275af2]), partition=RANGE (key) PARTITION 357913941 <= VALUES < 715827882
I20260503 19:55:24.339977 840 tablet_service.cc:1511] Processing CreateTablet for tablet d2bf53fe00c2417b872db2ecd4ede593 (DEFAULT_TABLE table=test-workload [id=d7958170ae984d5b8940e4bbd6275af2]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 1073741823
I20260503 19:55:24.342445 841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c99d75cb2be4439a1610c0de343d73a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 19:55:24.345574 838 tablet_service.cc:1511] Processing CreateTablet for tablet 3983c88812214bc0bfaaa35c08c38875 (DEFAULT_TABLE table=test-workload [id=d7958170ae984d5b8940e4bbd6275af2]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1789569705
I20260503 19:55:24.346244 838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3983c88812214bc0bfaaa35c08c38875. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 19:55:24.347982 840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2bf53fe00c2417b872db2ecd4ede593. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 19:55:24.349021 839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecf4b80ba8714f24a49387dc8bbe2da3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 19:55:24.349319 837 tablet_service.cc:1511] Processing CreateTablet for tablet 4d80fc29b7a64074b4a2ce4003054d1a (DEFAULT_TABLE table=test-workload [id=d7958170ae984d5b8940e4bbd6275af2]), partition=RANGE (key) PARTITION 1789569705 <= VALUES
I20260503 19:55:24.349843 837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d80fc29b7a64074b4a2ce4003054d1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 19:55:24.357407 709 tablet_service.cc:1511] Processing CreateTablet for tablet d2bf53fe00c2417b872db2ecd4ede593 (DEFAULT_TABLE table=test-workload [id=d7958170ae984d5b8940e4bbd6275af2]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 1073741823
I20260503 19:55:24.359477 709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2bf53fe00c2417b872db2ecd4ede593. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 19:55:24.360189 711 tablet_service.cc:1511] Processing CreateTablet for tablet a860805e8df84220ae4be7d3279b75f1 (DEFAULT_TABLE table=test-workload [id=d7958170ae984d5b8940e4bbd6275af2]), partition=RANGE (key) PARTITION VALUES < 357913941
I20260503 19:55:24.363170 706 tablet_service.cc:1511] Processing CreateTablet for tablet 4d80fc29b7a64074b4a2ce4003054d1a (DEFAULT_TABLE table=test-workload [id=d7958170ae984d5b8940e4bbd6275af2]), partition=RANGE (key) PARTITION 1789569705 <= VALUES
I20260503 19:55:24.360281 710 tablet_service.cc:1511] Processing CreateTablet for tablet 1c99d75cb2be4439a1610c0de343d73a (DEFAULT_TABLE table=test-workload [id=d7958170ae984d5b8940e4bbd6275af2]), partition=RANGE (key) PARTITION 357913941 <= VALUES < 715827882
I20260503 19:55:24.361158 708 tablet_service.cc:1511] Processing CreateTablet for tablet ecf4b80ba8714f24a49387dc8bbe2da3 (DEFAULT_TABLE table=test-workload [id=d7958170ae984d5b8940e4bbd6275af2]), partition=RANGE (key) PARTITION 1073741823 <= VALUES < 1431655764
I20260503 19:55:24.363997 842 tablet_service.cc:1511] Processing CreateTablet for tablet a860805e8df84220ae4be7d3279b75f1 (DEFAULT_TABLE table=test-workload [id=d7958170ae984d5b8940e4bbd6275af2]), partition=RANGE (key) PARTITION VALUES < 357913941
I20260503 19:55:24.361214 707 tablet_service.cc:1511] Processing CreateTablet for tablet 3983c88812214bc0bfaaa35c08c38875 (DEFAULT_TABLE table=test-workload [id=d7958170ae984d5b8940e4bbd6275af2]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1789569705
I20260503 19:55:24.366345 708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecf4b80ba8714f24a49387dc8bbe2da3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 19:55:24.367105 707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3983c88812214bc0bfaaa35c08c38875. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 19:55:24.367619 706 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d80fc29b7a64074b4a2ce4003054d1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 19:55:24.368477 711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a860805e8df84220ae4be7d3279b75f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 19:55:24.370457 710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c99d75cb2be4439a1610c0de343d73a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 19:55:24.370987 842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a860805e8df84220ae4be7d3279b75f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 19:55:24.385289 931 tablet_bootstrap.cc:492] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8: Bootstrap starting.
I20260503 19:55:24.393216 931 tablet_bootstrap.cc:654] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8: Neither blocks nor log segments found. Creating new log.
I20260503 19:55:24.392081 579 tablet_service.cc:1511] Processing CreateTablet for tablet 1c99d75cb2be4439a1610c0de343d73a (DEFAULT_TABLE table=test-workload [id=d7958170ae984d5b8940e4bbd6275af2]), partition=RANGE (key) PARTITION 357913941 <= VALUES < 715827882
I20260503 19:55:24.395174 931 log.cc:826] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8: Log is configured to *not* fsync() on all Append() calls
I20260503 19:55:24.395407 577 tablet_service.cc:1511] Processing CreateTablet for tablet ecf4b80ba8714f24a49387dc8bbe2da3 (DEFAULT_TABLE table=test-workload [id=d7958170ae984d5b8940e4bbd6275af2]), partition=RANGE (key) PARTITION 1073741823 <= VALUES < 1431655764
I20260503 19:55:24.396643 580 tablet_service.cc:1511] Processing CreateTablet for tablet a860805e8df84220ae4be7d3279b75f1 (DEFAULT_TABLE table=test-workload [id=d7958170ae984d5b8940e4bbd6275af2]), partition=RANGE (key) PARTITION VALUES < 357913941
I20260503 19:55:24.397976 576 tablet_service.cc:1511] Processing CreateTablet for tablet 3983c88812214bc0bfaaa35c08c38875 (DEFAULT_TABLE table=test-workload [id=d7958170ae984d5b8940e4bbd6275af2]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1789569705
I20260503 19:55:24.399339 575 tablet_service.cc:1511] Processing CreateTablet for tablet 4d80fc29b7a64074b4a2ce4003054d1a (DEFAULT_TABLE table=test-workload [id=d7958170ae984d5b8940e4bbd6275af2]), partition=RANGE (key) PARTITION 1789569705 <= VALUES
I20260503 19:55:24.400180 579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c99d75cb2be4439a1610c0de343d73a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 19:55:24.403337 575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d80fc29b7a64074b4a2ce4003054d1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 19:55:24.404575 576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3983c88812214bc0bfaaa35c08c38875. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 19:55:24.405529 577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecf4b80ba8714f24a49387dc8bbe2da3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 19:55:24.406661 580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a860805e8df84220ae4be7d3279b75f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 19:55:24.407375 578 tablet_service.cc:1511] Processing CreateTablet for tablet d2bf53fe00c2417b872db2ecd4ede593 (DEFAULT_TABLE table=test-workload [id=d7958170ae984d5b8940e4bbd6275af2]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 1073741823
I20260503 19:55:24.408519 578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2bf53fe00c2417b872db2ecd4ede593. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 19:55:24.412925 932 tablet_bootstrap.cc:492] T 4d80fc29b7a64074b4a2ce4003054d1a P a1219433b66444d091420ceeab5092ef: Bootstrap starting.
I20260503 19:55:24.415356 931 tablet_bootstrap.cc:492] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8: No bootstrap required, opened a new log
I20260503 19:55:24.415946 931 ts_tablet_manager.cc:1403] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8: Time spent bootstrapping tablet: real 0.031s user 0.011s sys 0.015s
I20260503 19:55:24.417387 932 tablet_bootstrap.cc:654] T 4d80fc29b7a64074b4a2ce4003054d1a P a1219433b66444d091420ceeab5092ef: Neither blocks nor log segments found. Creating new log.
I20260503 19:55:24.419404 932 log.cc:826] T 4d80fc29b7a64074b4a2ce4003054d1a P a1219433b66444d091420ceeab5092ef: Log is configured to *not* fsync() on all Append() calls
I20260503 19:55:24.425889 931 raft_consensus.cc:359] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:24.426868 931 raft_consensus.cc:385] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 19:55:24.427062 931 raft_consensus.cc:740] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d99e4f4d5ca48e0bdb54daf8361c5e8, State: Initialized, Role: FOLLOWER
I20260503 19:55:24.428299 931 consensus_queue.cc:260] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:24.434824 932 tablet_bootstrap.cc:492] T 4d80fc29b7a64074b4a2ce4003054d1a P a1219433b66444d091420ceeab5092ef: No bootstrap required, opened a new log
I20260503 19:55:24.435320 932 ts_tablet_manager.cc:1403] T 4d80fc29b7a64074b4a2ce4003054d1a P a1219433b66444d091420ceeab5092ef: Time spent bootstrapping tablet: real 0.023s user 0.009s sys 0.005s
I20260503 19:55:24.439529 907 heartbeater.cc:499] Master 127.0.105.62:45771 was elected leader, sending a full tablet report...
I20260503 19:55:24.441232 931 ts_tablet_manager.cc:1434] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8: Time spent starting tablet: real 0.025s user 0.019s sys 0.005s
I20260503 19:55:24.442164 931 tablet_bootstrap.cc:492] T d2bf53fe00c2417b872db2ecd4ede593 P 6d99e4f4d5ca48e0bdb54daf8361c5e8: Bootstrap starting.
I20260503 19:55:24.442425 935 tablet_bootstrap.cc:492] T 4d80fc29b7a64074b4a2ce4003054d1a P 0e52aa88a17542609e84f0c09fb85d87: Bootstrap starting.
I20260503 19:55:24.444530 931 tablet_bootstrap.cc:654] T d2bf53fe00c2417b872db2ecd4ede593 P 6d99e4f4d5ca48e0bdb54daf8361c5e8: Neither blocks nor log segments found. Creating new log.
I20260503 19:55:24.446484 932 raft_consensus.cc:359] T 4d80fc29b7a64074b4a2ce4003054d1a P a1219433b66444d091420ceeab5092ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:24.447180 932 raft_consensus.cc:385] T 4d80fc29b7a64074b4a2ce4003054d1a P a1219433b66444d091420ceeab5092ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 19:55:24.447362 932 raft_consensus.cc:740] T 4d80fc29b7a64074b4a2ce4003054d1a P a1219433b66444d091420ceeab5092ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1219433b66444d091420ceeab5092ef, State: Initialized, Role: FOLLOWER
I20260503 19:55:24.448933 932 consensus_queue.cc:260] T 4d80fc29b7a64074b4a2ce4003054d1a P a1219433b66444d091420ceeab5092ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:24.453779 776 heartbeater.cc:499] Master 127.0.105.62:45771 was elected leader, sending a full tablet report...
I20260503 19:55:24.453910 931 tablet_bootstrap.cc:492] T d2bf53fe00c2417b872db2ecd4ede593 P 6d99e4f4d5ca48e0bdb54daf8361c5e8: No bootstrap required, opened a new log
I20260503 19:55:24.454098 931 ts_tablet_manager.cc:1403] T d2bf53fe00c2417b872db2ecd4ede593 P 6d99e4f4d5ca48e0bdb54daf8361c5e8: Time spent bootstrapping tablet: real 0.012s user 0.007s sys 0.003s
I20260503 19:55:24.454670 932 ts_tablet_manager.cc:1434] T 4d80fc29b7a64074b4a2ce4003054d1a P a1219433b66444d091420ceeab5092ef: Time spent starting tablet: real 0.019s user 0.016s sys 0.004s
I20260503 19:55:24.455240 931 raft_consensus.cc:359] T d2bf53fe00c2417b872db2ecd4ede593 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:24.455296 935 tablet_bootstrap.cc:654] T 4d80fc29b7a64074b4a2ce4003054d1a P 0e52aa88a17542609e84f0c09fb85d87: Neither blocks nor log segments found. Creating new log.
I20260503 19:55:24.455456 931 raft_consensus.cc:385] T d2bf53fe00c2417b872db2ecd4ede593 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 19:55:24.455551 931 raft_consensus.cc:740] T d2bf53fe00c2417b872db2ecd4ede593 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d99e4f4d5ca48e0bdb54daf8361c5e8, State: Initialized, Role: FOLLOWER
I20260503 19:55:24.455858 931 consensus_queue.cc:260] T d2bf53fe00c2417b872db2ecd4ede593 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:24.455986 932 tablet_bootstrap.cc:492] T 3983c88812214bc0bfaaa35c08c38875 P a1219433b66444d091420ceeab5092ef: Bootstrap starting.
I20260503 19:55:24.456472 931 ts_tablet_manager.cc:1434] T d2bf53fe00c2417b872db2ecd4ede593 P 6d99e4f4d5ca48e0bdb54daf8361c5e8: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260503 19:55:24.456817 931 tablet_bootstrap.cc:492] T 4d80fc29b7a64074b4a2ce4003054d1a P 6d99e4f4d5ca48e0bdb54daf8361c5e8: Bootstrap starting.
I20260503 19:55:24.457243 935 log.cc:826] T 4d80fc29b7a64074b4a2ce4003054d1a P 0e52aa88a17542609e84f0c09fb85d87: Log is configured to *not* fsync() on all Append() calls
I20260503 19:55:24.457924 932 tablet_bootstrap.cc:654] T 3983c88812214bc0bfaaa35c08c38875 P a1219433b66444d091420ceeab5092ef: Neither blocks nor log segments found. Creating new log.
I20260503 19:55:24.458822 931 tablet_bootstrap.cc:654] T 4d80fc29b7a64074b4a2ce4003054d1a P 6d99e4f4d5ca48e0bdb54daf8361c5e8: Neither blocks nor log segments found. Creating new log.
W20260503 19:55:24.461755 908 tablet.cc:2404] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260503 19:55:24.463496 938 raft_consensus.cc:493] T 4d80fc29b7a64074b4a2ce4003054d1a P a1219433b66444d091420ceeab5092ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 19:55:24.463917 938 raft_consensus.cc:515] T 4d80fc29b7a64074b4a2ce4003054d1a P a1219433b66444d091420ceeab5092ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:24.477047 932 tablet_bootstrap.cc:492] T 3983c88812214bc0bfaaa35c08c38875 P a1219433b66444d091420ceeab5092ef: No bootstrap required, opened a new log
I20260503 19:55:24.477293 931 tablet_bootstrap.cc:492] T 4d80fc29b7a64074b4a2ce4003054d1a P 6d99e4f4d5ca48e0bdb54daf8361c5e8: No bootstrap required, opened a new log
I20260503 19:55:24.477470 931 ts_tablet_manager.cc:1403] T 4d80fc29b7a64074b4a2ce4003054d1a P 6d99e4f4d5ca48e0bdb54daf8361c5e8: Time spent bootstrapping tablet: real 0.021s user 0.007s sys 0.011s
I20260503 19:55:24.477504 932 ts_tablet_manager.cc:1403] T 3983c88812214bc0bfaaa35c08c38875 P a1219433b66444d091420ceeab5092ef: Time spent bootstrapping tablet: real 0.021s user 0.003s sys 0.009s
I20260503 19:55:24.478382 931 raft_consensus.cc:359] T 4d80fc29b7a64074b4a2ce4003054d1a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:24.478624 931 raft_consensus.cc:385] T 4d80fc29b7a64074b4a2ce4003054d1a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 19:55:24.478710 931 raft_consensus.cc:740] T 4d80fc29b7a64074b4a2ce4003054d1a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d99e4f4d5ca48e0bdb54daf8361c5e8, State: Initialized, Role: FOLLOWER
I20260503 19:55:24.478854 932 raft_consensus.cc:359] T 3983c88812214bc0bfaaa35c08c38875 P a1219433b66444d091420ceeab5092ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:24.479004 931 consensus_queue.cc:260] T 4d80fc29b7a64074b4a2ce4003054d1a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:24.479120 932 raft_consensus.cc:385] T 3983c88812214bc0bfaaa35c08c38875 P a1219433b66444d091420ceeab5092ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 19:55:24.479321 932 raft_consensus.cc:740] T 3983c88812214bc0bfaaa35c08c38875 P a1219433b66444d091420ceeab5092ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1219433b66444d091420ceeab5092ef, State: Initialized, Role: FOLLOWER
I20260503 19:55:24.479182 935 tablet_bootstrap.cc:492] T 4d80fc29b7a64074b4a2ce4003054d1a P 0e52aa88a17542609e84f0c09fb85d87: No bootstrap required, opened a new log
I20260503 19:55:24.479565 931 ts_tablet_manager.cc:1434] T 4d80fc29b7a64074b4a2ce4003054d1a P 6d99e4f4d5ca48e0bdb54daf8361c5e8: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260503 19:55:24.479746 935 ts_tablet_manager.cc:1403] T 4d80fc29b7a64074b4a2ce4003054d1a P 0e52aa88a17542609e84f0c09fb85d87: Time spent bootstrapping tablet: real 0.052s user 0.016s sys 0.003s
I20260503 19:55:24.479606 932 consensus_queue.cc:260] T 3983c88812214bc0bfaaa35c08c38875 P a1219433b66444d091420ceeab5092ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:24.480000 931 tablet_bootstrap.cc:492] T ecf4b80ba8714f24a49387dc8bbe2da3 P 6d99e4f4d5ca48e0bdb54daf8361c5e8: Bootstrap starting.
I20260503 19:55:24.480417 932 ts_tablet_manager.cc:1434] T 3983c88812214bc0bfaaa35c08c38875 P a1219433b66444d091420ceeab5092ef: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260503 19:55:24.481907 931 tablet_bootstrap.cc:654] T ecf4b80ba8714f24a49387dc8bbe2da3 P 6d99e4f4d5ca48e0bdb54daf8361c5e8: Neither blocks nor log segments found. Creating new log.
I20260503 19:55:24.488226 936 raft_consensus.cc:493] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 19:55:24.488590 936 raft_consensus.cc:515] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:24.489830 935 raft_consensus.cc:359] T 4d80fc29b7a64074b4a2ce4003054d1a P 0e52aa88a17542609e84f0c09fb85d87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:24.490407 935 raft_consensus.cc:385] T 4d80fc29b7a64074b4a2ce4003054d1a P 0e52aa88a17542609e84f0c09fb85d87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 19:55:24.490556 935 raft_consensus.cc:740] T 4d80fc29b7a64074b4a2ce4003054d1a P 0e52aa88a17542609e84f0c09fb85d87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e52aa88a17542609e84f0c09fb85d87, State: Initialized, Role: FOLLOWER
I20260503 19:55:24.491123 938 leader_election.cc:290] T 4d80fc29b7a64074b4a2ce4003054d1a P a1219433b66444d091420ceeab5092ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847), 6d99e4f4d5ca48e0bdb54daf8361c5e8 (127.0.105.3:35005)
I20260503 19:55:24.491679 935 consensus_queue.cc:260] T 4d80fc29b7a64074b4a2ce4003054d1a P 0e52aa88a17542609e84f0c09fb85d87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:24.491544 936 leader_election.cc:290] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847), a1219433b66444d091420ceeab5092ef (127.0.105.2:38837)
I20260503 19:55:24.500933 932 tablet_bootstrap.cc:492] T ecf4b80ba8714f24a49387dc8bbe2da3 P a1219433b66444d091420ceeab5092ef: Bootstrap starting.
I20260503 19:55:24.504465 932 tablet_bootstrap.cc:654] T ecf4b80ba8714f24a49387dc8bbe2da3 P a1219433b66444d091420ceeab5092ef: Neither blocks nor log segments found. Creating new log.
I20260503 19:55:24.509600 600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3983c88812214bc0bfaaa35c08c38875" candidate_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e52aa88a17542609e84f0c09fb85d87" is_pre_election: true
I20260503 19:55:24.511904 935 ts_tablet_manager.cc:1434] T 4d80fc29b7a64074b4a2ce4003054d1a P 0e52aa88a17542609e84f0c09fb85d87: Time spent starting tablet: real 0.032s user 0.015s sys 0.005s
W20260503 19:55:24.512377 796 leader_election.cc:343] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Illegal state: must be running to vote when last-logged opid is not known
I20260503 19:55:24.514400 935 tablet_bootstrap.cc:492] T ecf4b80ba8714f24a49387dc8bbe2da3 P 0e52aa88a17542609e84f0c09fb85d87: Bootstrap starting.
I20260503 19:55:24.505795 938 raft_consensus.cc:493] T 3983c88812214bc0bfaaa35c08c38875 P a1219433b66444d091420ceeab5092ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 19:55:24.514850 938 raft_consensus.cc:515] T 3983c88812214bc0bfaaa35c08c38875 P a1219433b66444d091420ceeab5092ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:24.516003 938 leader_election.cc:290] T 3983c88812214bc0bfaaa35c08c38875 P a1219433b66444d091420ceeab5092ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847), 6d99e4f4d5ca48e0bdb54daf8361c5e8 (127.0.105.3:35005)
I20260503 19:55:24.516530 935 tablet_bootstrap.cc:654] T ecf4b80ba8714f24a49387dc8bbe2da3 P 0e52aa88a17542609e84f0c09fb85d87: Neither blocks nor log segments found. Creating new log.
I20260503 19:55:24.519488 932 tablet_bootstrap.cc:492] T ecf4b80ba8714f24a49387dc8bbe2da3 P a1219433b66444d091420ceeab5092ef: No bootstrap required, opened a new log
I20260503 19:55:24.519696 931 tablet_bootstrap.cc:492] T ecf4b80ba8714f24a49387dc8bbe2da3 P 6d99e4f4d5ca48e0bdb54daf8361c5e8: No bootstrap required, opened a new log
I20260503 19:55:24.519822 932 ts_tablet_manager.cc:1403] T ecf4b80ba8714f24a49387dc8bbe2da3 P a1219433b66444d091420ceeab5092ef: Time spent bootstrapping tablet: real 0.019s user 0.005s sys 0.001s
I20260503 19:55:24.519960 931 ts_tablet_manager.cc:1403] T ecf4b80ba8714f24a49387dc8bbe2da3 P 6d99e4f4d5ca48e0bdb54daf8361c5e8: Time spent bootstrapping tablet: real 0.040s user 0.009s sys 0.030s
I20260503 19:55:24.520939 931 raft_consensus.cc:359] T ecf4b80ba8714f24a49387dc8bbe2da3 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:24.521440 932 raft_consensus.cc:359] T ecf4b80ba8714f24a49387dc8bbe2da3 P a1219433b66444d091420ceeab5092ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:24.521643 932 raft_consensus.cc:385] T ecf4b80ba8714f24a49387dc8bbe2da3 P a1219433b66444d091420ceeab5092ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 19:55:24.521735 931 raft_consensus.cc:385] T ecf4b80ba8714f24a49387dc8bbe2da3 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 19:55:24.521744 932 raft_consensus.cc:740] T ecf4b80ba8714f24a49387dc8bbe2da3 P a1219433b66444d091420ceeab5092ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1219433b66444d091420ceeab5092ef, State: Initialized, Role: FOLLOWER
I20260503 19:55:24.521898 931 raft_consensus.cc:740] T ecf4b80ba8714f24a49387dc8bbe2da3 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d99e4f4d5ca48e0bdb54daf8361c5e8, State: Initialized, Role: FOLLOWER
I20260503 19:55:24.521994 932 consensus_queue.cc:260] T ecf4b80ba8714f24a49387dc8bbe2da3 P a1219433b66444d091420ceeab5092ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:24.522317 931 consensus_queue.cc:260] T ecf4b80ba8714f24a49387dc8bbe2da3 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:24.523226 931 ts_tablet_manager.cc:1434] T ecf4b80ba8714f24a49387dc8bbe2da3 P 6d99e4f4d5ca48e0bdb54daf8361c5e8: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260503 19:55:24.523945 931 tablet_bootstrap.cc:492] T a860805e8df84220ae4be7d3279b75f1 P 6d99e4f4d5ca48e0bdb54daf8361c5e8: Bootstrap starting.
I20260503 19:55:24.524091 936 raft_consensus.cc:493] T d2bf53fe00c2417b872db2ecd4ede593 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 19:55:24.524314 936 raft_consensus.cc:515] T d2bf53fe00c2417b872db2ecd4ede593 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:24.525023 936 leader_election.cc:290] T d2bf53fe00c2417b872db2ecd4ede593 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847), a1219433b66444d091420ceeab5092ef (127.0.105.2:38837)
I20260503 19:55:24.526150 600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2bf53fe00c2417b872db2ecd4ede593" candidate_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e52aa88a17542609e84f0c09fb85d87" is_pre_election: true
I20260503 19:55:24.526505 931 tablet_bootstrap.cc:654] T a860805e8df84220ae4be7d3279b75f1 P 6d99e4f4d5ca48e0bdb54daf8361c5e8: Neither blocks nor log segments found. Creating new log.
I20260503 19:55:24.526644 932 ts_tablet_manager.cc:1434] T ecf4b80ba8714f24a49387dc8bbe2da3 P a1219433b66444d091420ceeab5092ef: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
W20260503 19:55:24.527248 796 leader_election.cc:343] T d2bf53fe00c2417b872db2ecd4ede593 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Illegal state: must be running to vote when last-logged opid is not known
I20260503 19:55:24.530004 731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3983c88812214bc0bfaaa35c08c38875" candidate_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1219433b66444d091420ceeab5092ef" is_pre_election: true
I20260503 19:55:24.530560 731 raft_consensus.cc:2468] T 3983c88812214bc0bfaaa35c08c38875 P a1219433b66444d091420ceeab5092ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d99e4f4d5ca48e0bdb54daf8361c5e8 in term 0.
I20260503 19:55:24.530030 730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2bf53fe00c2417b872db2ecd4ede593" candidate_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1219433b66444d091420ceeab5092ef" is_pre_election: true
I20260503 19:55:24.531977 795 leader_election.cc:304] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d99e4f4d5ca48e0bdb54daf8361c5e8, a1219433b66444d091420ceeab5092ef; no voters: 0e52aa88a17542609e84f0c09fb85d87
I20260503 19:55:24.532536 936 raft_consensus.cc:2804] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 19:55:24.532719 936 raft_consensus.cc:493] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 19:55:24.532876 936 raft_consensus.cc:3060] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 0 FOLLOWER]: Advancing to term 1
W20260503 19:55:24.533267 795 leader_election.cc:343] T d2bf53fe00c2417b872db2ecd4ede593 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1219433b66444d091420ceeab5092ef (127.0.105.2:38837): Illegal state: must be running to vote when last-logged opid is not known
I20260503 19:55:24.533437 795 leader_election.cc:304] T d2bf53fe00c2417b872db2ecd4ede593 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d99e4f4d5ca48e0bdb54daf8361c5e8; no voters: 0e52aa88a17542609e84f0c09fb85d87, a1219433b66444d091420ceeab5092ef
I20260503 19:55:24.533520 932 tablet_bootstrap.cc:492] T a860805e8df84220ae4be7d3279b75f1 P a1219433b66444d091420ceeab5092ef: Bootstrap starting.
I20260503 19:55:24.536294 932 tablet_bootstrap.cc:654] T a860805e8df84220ae4be7d3279b75f1 P a1219433b66444d091420ceeab5092ef: Neither blocks nor log segments found. Creating new log.
I20260503 19:55:24.537490 936 raft_consensus.cc:515] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:24.538625 952 raft_consensus.cc:2749] T d2bf53fe00c2417b872db2ecd4ede593 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 19:55:24.539422 600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3983c88812214bc0bfaaa35c08c38875" candidate_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e52aa88a17542609e84f0c09fb85d87"
W20260503 19:55:24.540340 796 leader_election.cc:343] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Illegal state: must be running to vote when last-logged opid is not known
I20260503 19:55:24.540843 936 leader_election.cc:290] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [CANDIDATE]: Term 1 election: Requested vote from peers 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847), a1219433b66444d091420ceeab5092ef (127.0.105.2:38837)
I20260503 19:55:24.541672 730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3983c88812214bc0bfaaa35c08c38875" candidate_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1219433b66444d091420ceeab5092ef"
I20260503 19:55:24.542091 932 tablet_bootstrap.cc:492] T a860805e8df84220ae4be7d3279b75f1 P a1219433b66444d091420ceeab5092ef: No bootstrap required, opened a new log
I20260503 19:55:24.542145 730 raft_consensus.cc:3060] T 3983c88812214bc0bfaaa35c08c38875 P a1219433b66444d091420ceeab5092ef [term 0 FOLLOWER]: Advancing to term 1
I20260503 19:55:24.542281 932 ts_tablet_manager.cc:1403] T a860805e8df84220ae4be7d3279b75f1 P a1219433b66444d091420ceeab5092ef: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.003s
I20260503 19:55:24.543233 932 raft_consensus.cc:359] T a860805e8df84220ae4be7d3279b75f1 P a1219433b66444d091420ceeab5092ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } }
I20260503 19:55:24.543454 932 raft_consensus.cc:385] T a860805e8df84220ae4be7d3279b75f1 P a1219433b66444d091420ceeab5092ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 19:55:24.543560 932 raft_consensus.cc:740] T a860805e8df84220ae4be7d3279b75f1 P a1219433b66444d091420ceeab5092ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1219433b66444d091420ceeab5092ef, State: Initialized, Role: FOLLOWER
I20260503 19:55:24.543889 932 consensus_queue.cc:260] T a860805e8df84220ae4be7d3279b75f1 P a1219433b66444d091420ceeab5092ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } }
I20260503 19:55:24.545555 730 raft_consensus.cc:2468] T 3983c88812214bc0bfaaa35c08c38875 P a1219433b66444d091420ceeab5092ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d99e4f4d5ca48e0bdb54daf8361c5e8 in term 1.
I20260503 19:55:24.546223 795 leader_election.cc:304] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d99e4f4d5ca48e0bdb54daf8361c5e8, a1219433b66444d091420ceeab5092ef; no voters: 0e52aa88a17542609e84f0c09fb85d87
I20260503 19:55:24.546687 936 raft_consensus.cc:2804] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 19:55:24.546871 936 raft_consensus.cc:697] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 1 LEADER]: Becoming Leader. State: Replica: 6d99e4f4d5ca48e0bdb54daf8361c5e8, State: Running, Role: LEADER
I20260503 19:55:24.546955 935 tablet_bootstrap.cc:492] T ecf4b80ba8714f24a49387dc8bbe2da3 P 0e52aa88a17542609e84f0c09fb85d87: No bootstrap required, opened a new log
I20260503 19:55:24.546873 600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d80fc29b7a64074b4a2ce4003054d1a" candidate_uuid: "a1219433b66444d091420ceeab5092ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e52aa88a17542609e84f0c09fb85d87" is_pre_election: true
I20260503 19:55:24.547111 935 ts_tablet_manager.cc:1403] T ecf4b80ba8714f24a49387dc8bbe2da3 P 0e52aa88a17542609e84f0c09fb85d87: Time spent bootstrapping tablet: real 0.033s user 0.019s sys 0.011s
I20260503 19:55:24.547269 600 raft_consensus.cc:2468] T 4d80fc29b7a64074b4a2ce4003054d1a P 0e52aa88a17542609e84f0c09fb85d87 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1219433b66444d091420ceeab5092ef in term 0.
I20260503 19:55:24.547359 932 ts_tablet_manager.cc:1434] T a860805e8df84220ae4be7d3279b75f1 P a1219433b66444d091420ceeab5092ef: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260503 19:55:24.547399 936 consensus_queue.cc:237] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:24.548401 600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3983c88812214bc0bfaaa35c08c38875" candidate_uuid: "a1219433b66444d091420ceeab5092ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e52aa88a17542609e84f0c09fb85d87" is_pre_election: true
I20260503 19:55:24.548939 935 raft_consensus.cc:359] T ecf4b80ba8714f24a49387dc8bbe2da3 P 0e52aa88a17542609e84f0c09fb85d87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:24.549172 935 raft_consensus.cc:385] T ecf4b80ba8714f24a49387dc8bbe2da3 P 0e52aa88a17542609e84f0c09fb85d87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 19:55:24.549288 935 raft_consensus.cc:740] T ecf4b80ba8714f24a49387dc8bbe2da3 P 0e52aa88a17542609e84f0c09fb85d87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e52aa88a17542609e84f0c09fb85d87, State: Initialized, Role: FOLLOWER
I20260503 19:55:24.549154 665 leader_election.cc:304] T 4d80fc29b7a64074b4a2ce4003054d1a P a1219433b66444d091420ceeab5092ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e52aa88a17542609e84f0c09fb85d87, a1219433b66444d091420ceeab5092ef; no voters:
I20260503 19:55:24.549690 938 raft_consensus.cc:493] T a860805e8df84220ae4be7d3279b75f1 P a1219433b66444d091420ceeab5092ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 19:55:24.549639 935 consensus_queue.cc:260] T ecf4b80ba8714f24a49387dc8bbe2da3 P 0e52aa88a17542609e84f0c09fb85d87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:24.549858 938 raft_consensus.cc:515] T a860805e8df84220ae4be7d3279b75f1 P a1219433b66444d091420ceeab5092ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } }
I20260503 19:55:24.550457 931 tablet_bootstrap.cc:492] T a860805e8df84220ae4be7d3279b75f1 P 6d99e4f4d5ca48e0bdb54daf8361c5e8: No bootstrap required, opened a new log
I20260503 19:55:24.550524 938 leader_election.cc:290] T a860805e8df84220ae4be7d3279b75f1 P a1219433b66444d091420ceeab5092ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d99e4f4d5ca48e0bdb54daf8361c5e8 (127.0.105.3:35005), 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847)
I20260503 19:55:24.550714 931 ts_tablet_manager.cc:1403] T a860805e8df84220ae4be7d3279b75f1 P 6d99e4f4d5ca48e0bdb54daf8361c5e8: Time spent bootstrapping tablet: real 0.027s user 0.004s sys 0.004s
I20260503 19:55:24.551316 938 raft_consensus.cc:2804] T 4d80fc29b7a64074b4a2ce4003054d1a P a1219433b66444d091420ceeab5092ef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 19:55:24.551448 938 raft_consensus.cc:493] T 4d80fc29b7a64074b4a2ce4003054d1a P a1219433b66444d091420ceeab5092ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 19:55:24.551554 938 raft_consensus.cc:3060] T 4d80fc29b7a64074b4a2ce4003054d1a P a1219433b66444d091420ceeab5092ef [term 0 FOLLOWER]: Advancing to term 1
I20260503 19:55:24.552070 931 raft_consensus.cc:359] T a860805e8df84220ae4be7d3279b75f1 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } }
I20260503 19:55:24.552393 931 raft_consensus.cc:385] T a860805e8df84220ae4be7d3279b75f1 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 19:55:24.552686 931 raft_consensus.cc:740] T a860805e8df84220ae4be7d3279b75f1 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d99e4f4d5ca48e0bdb54daf8361c5e8, State: Initialized, Role: FOLLOWER
I20260503 19:55:24.553118 931 consensus_queue.cc:260] T a860805e8df84220ae4be7d3279b75f1 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } }
I20260503 19:55:24.553418 935 ts_tablet_manager.cc:1434] T ecf4b80ba8714f24a49387dc8bbe2da3 P 0e52aa88a17542609e84f0c09fb85d87: Time spent starting tablet: real 0.006s user 0.000s sys 0.003s
I20260503 19:55:24.553815 931 ts_tablet_manager.cc:1434] T a860805e8df84220ae4be7d3279b75f1 P 6d99e4f4d5ca48e0bdb54daf8361c5e8: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260503 19:55:24.554248 931 tablet_bootstrap.cc:492] T 1c99d75cb2be4439a1610c0de343d73a P 6d99e4f4d5ca48e0bdb54daf8361c5e8: Bootstrap starting.
I20260503 19:55:24.555187 938 raft_consensus.cc:515] T 4d80fc29b7a64074b4a2ce4003054d1a P a1219433b66444d091420ceeab5092ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:24.556313 938 leader_election.cc:290] T 4d80fc29b7a64074b4a2ce4003054d1a P a1219433b66444d091420ceeab5092ef [CANDIDATE]: Term 1 election: Requested vote from peers 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847), 6d99e4f4d5ca48e0bdb54daf8361c5e8 (127.0.105.3:35005)
I20260503 19:55:24.556780 931 tablet_bootstrap.cc:654] T 1c99d75cb2be4439a1610c0de343d73a P 6d99e4f4d5ca48e0bdb54daf8361c5e8: Neither blocks nor log segments found. Creating new log.
W20260503 19:55:24.556800 665 leader_election.cc:343] T 3983c88812214bc0bfaaa35c08c38875 P a1219433b66444d091420ceeab5092ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Illegal state: must be running to vote when last-logged opid is not known
I20260503 19:55:24.557103 935 tablet_bootstrap.cc:492] T a860805e8df84220ae4be7d3279b75f1 P 0e52aa88a17542609e84f0c09fb85d87: Bootstrap starting.
I20260503 19:55:24.557835 600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860805e8df84220ae4be7d3279b75f1" candidate_uuid: "a1219433b66444d091420ceeab5092ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e52aa88a17542609e84f0c09fb85d87" is_pre_election: true
I20260503 19:55:24.558856 600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d80fc29b7a64074b4a2ce4003054d1a" candidate_uuid: "a1219433b66444d091420ceeab5092ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e52aa88a17542609e84f0c09fb85d87"
I20260503 19:55:24.559147 600 raft_consensus.cc:3060] T 4d80fc29b7a64074b4a2ce4003054d1a P 0e52aa88a17542609e84f0c09fb85d87 [term 0 FOLLOWER]: Advancing to term 1
I20260503 19:55:24.559871 935 tablet_bootstrap.cc:654] T a860805e8df84220ae4be7d3279b75f1 P 0e52aa88a17542609e84f0c09fb85d87: Neither blocks nor log segments found. Creating new log.
I20260503 19:55:24.564254 458 catalog_manager.cc:5671] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d99e4f4d5ca48e0bdb54daf8361c5e8 (127.0.105.3). New cstate: current_term: 1 leader_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } health_report { overall_health: HEALTHY } } }
I20260503 19:55:24.568233 600 raft_consensus.cc:2468] T 4d80fc29b7a64074b4a2ce4003054d1a P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1219433b66444d091420ceeab5092ef in term 1.
W20260503 19:55:24.569213 665 leader_election.cc:343] T a860805e8df84220ae4be7d3279b75f1 P a1219433b66444d091420ceeab5092ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Illegal state: must be running to vote when last-logged opid is not known
I20260503 19:55:24.569603 665 leader_election.cc:304] T 4d80fc29b7a64074b4a2ce4003054d1a P a1219433b66444d091420ceeab5092ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e52aa88a17542609e84f0c09fb85d87, a1219433b66444d091420ceeab5092ef; no voters:
I20260503 19:55:24.569938 942 raft_consensus.cc:493] T ecf4b80ba8714f24a49387dc8bbe2da3 P a1219433b66444d091420ceeab5092ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 19:55:24.570251 935 tablet_bootstrap.cc:492] T a860805e8df84220ae4be7d3279b75f1 P 0e52aa88a17542609e84f0c09fb85d87: No bootstrap required, opened a new log
I20260503 19:55:24.570127 942 raft_consensus.cc:515] T ecf4b80ba8714f24a49387dc8bbe2da3 P a1219433b66444d091420ceeab5092ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:24.570457 935 ts_tablet_manager.cc:1403] T a860805e8df84220ae4be7d3279b75f1 P 0e52aa88a17542609e84f0c09fb85d87: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.005s
I20260503 19:55:24.571398 942 leader_election.cc:290] T ecf4b80ba8714f24a49387dc8bbe2da3 P a1219433b66444d091420ceeab5092ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847), 6d99e4f4d5ca48e0bdb54daf8361c5e8 (127.0.105.3:35005)
I20260503 19:55:24.571481 935 raft_consensus.cc:359] T a860805e8df84220ae4be7d3279b75f1 P 0e52aa88a17542609e84f0c09fb85d87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } }
I20260503 19:55:24.571704 942 raft_consensus.cc:2804] T 4d80fc29b7a64074b4a2ce4003054d1a P a1219433b66444d091420ceeab5092ef [term 1 FOLLOWER]: Leader election won for term 1
I20260503 19:55:24.571800 935 raft_consensus.cc:385] T a860805e8df84220ae4be7d3279b75f1 P 0e52aa88a17542609e84f0c09fb85d87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 19:55:24.571879 935 raft_consensus.cc:740] T a860805e8df84220ae4be7d3279b75f1 P 0e52aa88a17542609e84f0c09fb85d87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e52aa88a17542609e84f0c09fb85d87, State: Initialized, Role: FOLLOWER
I20260503 19:55:24.571893 942 raft_consensus.cc:697] T 4d80fc29b7a64074b4a2ce4003054d1a P a1219433b66444d091420ceeab5092ef [term 1 LEADER]: Becoming Leader. State: Replica: a1219433b66444d091420ceeab5092ef, State: Running, Role: LEADER
I20260503 19:55:24.572126 935 consensus_queue.cc:260] T a860805e8df84220ae4be7d3279b75f1 P 0e52aa88a17542609e84f0c09fb85d87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } }
I20260503 19:55:24.572577 942 consensus_queue.cc:237] T 4d80fc29b7a64074b4a2ce4003054d1a P a1219433b66444d091420ceeab5092ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:24.573493 935 ts_tablet_manager.cc:1434] T a860805e8df84220ae4be7d3279b75f1 P 0e52aa88a17542609e84f0c09fb85d87: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260503 19:55:24.573868 935 tablet_bootstrap.cc:492] T d2bf53fe00c2417b872db2ecd4ede593 P 0e52aa88a17542609e84f0c09fb85d87: Bootstrap starting.
I20260503 19:55:24.576364 935 tablet_bootstrap.cc:654] T d2bf53fe00c2417b872db2ecd4ede593 P 0e52aa88a17542609e84f0c09fb85d87: Neither blocks nor log segments found. Creating new log.
I20260503 19:55:24.577842 936 raft_consensus.cc:493] T 4d80fc29b7a64074b4a2ce4003054d1a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 19:55:24.578119 936 raft_consensus.cc:515] T 4d80fc29b7a64074b4a2ce4003054d1a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:24.578197 600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf4b80ba8714f24a49387dc8bbe2da3" candidate_uuid: "a1219433b66444d091420ceeab5092ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e52aa88a17542609e84f0c09fb85d87" is_pre_election: true
I20260503 19:55:24.578646 600 raft_consensus.cc:2468] T ecf4b80ba8714f24a49387dc8bbe2da3 P 0e52aa88a17542609e84f0c09fb85d87 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1219433b66444d091420ceeab5092ef in term 0.
I20260503 19:55:24.579087 936 leader_election.cc:290] T 4d80fc29b7a64074b4a2ce4003054d1a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847), a1219433b66444d091420ceeab5092ef (127.0.105.2:38837)
I20260503 19:55:24.579694 665 leader_election.cc:304] T ecf4b80ba8714f24a49387dc8bbe2da3 P a1219433b66444d091420ceeab5092ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e52aa88a17542609e84f0c09fb85d87, a1219433b66444d091420ceeab5092ef; no voters:
I20260503 19:55:24.580516 730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d80fc29b7a64074b4a2ce4003054d1a" candidate_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1219433b66444d091420ceeab5092ef" is_pre_election: true
I20260503 19:55:24.580909 932 tablet_bootstrap.cc:492] T 1c99d75cb2be4439a1610c0de343d73a P a1219433b66444d091420ceeab5092ef: Bootstrap starting.
I20260503 19:55:24.580590 938 raft_consensus.cc:2804] T ecf4b80ba8714f24a49387dc8bbe2da3 P a1219433b66444d091420ceeab5092ef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 19:55:24.581240 938 raft_consensus.cc:493] T ecf4b80ba8714f24a49387dc8bbe2da3 P a1219433b66444d091420ceeab5092ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 19:55:24.581419 938 raft_consensus.cc:3060] T ecf4b80ba8714f24a49387dc8bbe2da3 P a1219433b66444d091420ceeab5092ef [term 0 FOLLOWER]: Advancing to term 1
I20260503 19:55:24.581902 600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d80fc29b7a64074b4a2ce4003054d1a" candidate_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e52aa88a17542609e84f0c09fb85d87" is_pre_election: true
I20260503 19:55:24.582296 600 raft_consensus.cc:2393] T 4d80fc29b7a64074b4a2ce4003054d1a P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d99e4f4d5ca48e0bdb54daf8361c5e8 in current term 1: Already voted for candidate a1219433b66444d091420ceeab5092ef in this term.
I20260503 19:55:24.582978 935 tablet_bootstrap.cc:492] T d2bf53fe00c2417b872db2ecd4ede593 P 0e52aa88a17542609e84f0c09fb85d87: No bootstrap required, opened a new log
I20260503 19:55:24.583141 935 ts_tablet_manager.cc:1403] T d2bf53fe00c2417b872db2ecd4ede593 P 0e52aa88a17542609e84f0c09fb85d87: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.008s
I20260503 19:55:24.583993 795 leader_election.cc:304] T 4d80fc29b7a64074b4a2ce4003054d1a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d99e4f4d5ca48e0bdb54daf8361c5e8; no voters: 0e52aa88a17542609e84f0c09fb85d87, a1219433b66444d091420ceeab5092ef
I20260503 19:55:24.584420 935 raft_consensus.cc:359] T d2bf53fe00c2417b872db2ecd4ede593 P 0e52aa88a17542609e84f0c09fb85d87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:24.584535 936 raft_consensus.cc:3060] T 4d80fc29b7a64074b4a2ce4003054d1a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 0 FOLLOWER]: Advancing to term 1
I20260503 19:55:24.584625 935 raft_consensus.cc:385] T d2bf53fe00c2417b872db2ecd4ede593 P 0e52aa88a17542609e84f0c09fb85d87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 19:55:24.584707 935 raft_consensus.cc:740] T d2bf53fe00c2417b872db2ecd4ede593 P 0e52aa88a17542609e84f0c09fb85d87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e52aa88a17542609e84f0c09fb85d87, State: Initialized, Role: FOLLOWER
I20260503 19:55:24.584961 932 tablet_bootstrap.cc:654] T 1c99d75cb2be4439a1610c0de343d73a P a1219433b66444d091420ceeab5092ef: Neither blocks nor log segments found. Creating new log.
I20260503 19:55:24.584885 938 raft_consensus.cc:515] T ecf4b80ba8714f24a49387dc8bbe2da3 P a1219433b66444d091420ceeab5092ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:24.584990 935 consensus_queue.cc:260] T d2bf53fe00c2417b872db2ecd4ede593 P 0e52aa88a17542609e84f0c09fb85d87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:24.585740 938 leader_election.cc:290] T ecf4b80ba8714f24a49387dc8bbe2da3 P a1219433b66444d091420ceeab5092ef [CANDIDATE]: Term 1 election: Requested vote from peers 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847), 6d99e4f4d5ca48e0bdb54daf8361c5e8 (127.0.105.3:35005)
I20260503 19:55:24.586246 935 ts_tablet_manager.cc:1434] T d2bf53fe00c2417b872db2ecd4ede593 P 0e52aa88a17542609e84f0c09fb85d87: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260503 19:55:24.586550 935 tablet_bootstrap.cc:492] T 3983c88812214bc0bfaaa35c08c38875 P 0e52aa88a17542609e84f0c09fb85d87: Bootstrap starting.
I20260503 19:55:24.587366 936 raft_consensus.cc:2749] T 4d80fc29b7a64074b4a2ce4003054d1a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 19:55:24.588990 946 raft_consensus.cc:493] T a860805e8df84220ae4be7d3279b75f1 P 0e52aa88a17542609e84f0c09fb85d87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 19:55:24.589138 600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf4b80ba8714f24a49387dc8bbe2da3" candidate_uuid: "a1219433b66444d091420ceeab5092ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e52aa88a17542609e84f0c09fb85d87"
I20260503 19:55:24.589367 600 raft_consensus.cc:3060] T ecf4b80ba8714f24a49387dc8bbe2da3 P 0e52aa88a17542609e84f0c09fb85d87 [term 0 FOLLOWER]: Advancing to term 1
I20260503 19:55:24.589244 946 raft_consensus.cc:515] T a860805e8df84220ae4be7d3279b75f1 P 0e52aa88a17542609e84f0c09fb85d87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } }
I20260503 19:55:24.592027 946 leader_election.cc:290] T a860805e8df84220ae4be7d3279b75f1 P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d99e4f4d5ca48e0bdb54daf8361c5e8 (127.0.105.3:35005), a1219433b66444d091420ceeab5092ef (127.0.105.2:38837)
I20260503 19:55:24.593353 935 tablet_bootstrap.cc:654] T 3983c88812214bc0bfaaa35c08c38875 P 0e52aa88a17542609e84f0c09fb85d87: Neither blocks nor log segments found. Creating new log.
I20260503 19:55:24.596302 862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d80fc29b7a64074b4a2ce4003054d1a" candidate_uuid: "a1219433b66444d091420ceeab5092ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" is_pre_election: true
I20260503 19:55:24.596823 861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3983c88812214bc0bfaaa35c08c38875" candidate_uuid: "a1219433b66444d091420ceeab5092ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" is_pre_election: true
I20260503 19:55:24.599160 936 raft_consensus.cc:493] T ecf4b80ba8714f24a49387dc8bbe2da3 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 19:55:24.599377 936 raft_consensus.cc:515] T ecf4b80ba8714f24a49387dc8bbe2da3 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:24.599908 862 raft_consensus.cc:2468] T 4d80fc29b7a64074b4a2ce4003054d1a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1219433b66444d091420ceeab5092ef in term 1.
I20260503 19:55:24.600119 936 leader_election.cc:290] T ecf4b80ba8714f24a49387dc8bbe2da3 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847), a1219433b66444d091420ceeab5092ef (127.0.105.2:38837)
I20260503 19:55:24.600240 859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d80fc29b7a64074b4a2ce4003054d1a" candidate_uuid: "a1219433b66444d091420ceeab5092ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8"
I20260503 19:55:24.601620 458 catalog_manager.cc:5671] T 4d80fc29b7a64074b4a2ce4003054d1a P a1219433b66444d091420ceeab5092ef reported cstate change: term changed from 0 to 1, leader changed from <none> to a1219433b66444d091420ceeab5092ef (127.0.105.2). New cstate: current_term: 1 leader_uuid: "a1219433b66444d091420ceeab5092ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } health_report { overall_health: UNKNOWN } } }
I20260503 19:55:24.604035 858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf4b80ba8714f24a49387dc8bbe2da3" candidate_uuid: "a1219433b66444d091420ceeab5092ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" is_pre_election: true
I20260503 19:55:24.604543 858 raft_consensus.cc:2468] T ecf4b80ba8714f24a49387dc8bbe2da3 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1219433b66444d091420ceeab5092ef in term 0.
I20260503 19:55:24.607800 857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf4b80ba8714f24a49387dc8bbe2da3" candidate_uuid: "a1219433b66444d091420ceeab5092ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8"
I20260503 19:55:24.608237 857 raft_consensus.cc:3060] T ecf4b80ba8714f24a49387dc8bbe2da3 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 0 FOLLOWER]: Advancing to term 1
I20260503 19:55:24.611217 600 raft_consensus.cc:2468] T ecf4b80ba8714f24a49387dc8bbe2da3 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1219433b66444d091420ceeab5092ef in term 1.
I20260503 19:55:24.611945 860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860805e8df84220ae4be7d3279b75f1" candidate_uuid: "a1219433b66444d091420ceeab5092ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" is_pre_election: true
I20260503 19:55:24.612401 860 raft_consensus.cc:2468] T a860805e8df84220ae4be7d3279b75f1 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1219433b66444d091420ceeab5092ef in term 0.
I20260503 19:55:24.614495 666 leader_election.cc:304] T 3983c88812214bc0bfaaa35c08c38875 P a1219433b66444d091420ceeab5092ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1219433b66444d091420ceeab5092ef; no voters: 0e52aa88a17542609e84f0c09fb85d87, 6d99e4f4d5ca48e0bdb54daf8361c5e8
I20260503 19:55:24.616880 666 leader_election.cc:304] T a860805e8df84220ae4be7d3279b75f1 P a1219433b66444d091420ceeab5092ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d99e4f4d5ca48e0bdb54daf8361c5e8, a1219433b66444d091420ceeab5092ef; no voters: 0e52aa88a17542609e84f0c09fb85d87
I20260503 19:55:24.617434 938 raft_consensus.cc:2749] T 3983c88812214bc0bfaaa35c08c38875 P a1219433b66444d091420ceeab5092ef [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 19:55:24.617725 938 raft_consensus.cc:2804] T a860805e8df84220ae4be7d3279b75f1 P a1219433b66444d091420ceeab5092ef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 19:55:24.617839 938 raft_consensus.cc:493] T a860805e8df84220ae4be7d3279b75f1 P a1219433b66444d091420ceeab5092ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 19:55:24.617962 938 raft_consensus.cc:3060] T a860805e8df84220ae4be7d3279b75f1 P a1219433b66444d091420ceeab5092ef [term 0 FOLLOWER]: Advancing to term 1
I20260503 19:55:24.619699 932 tablet_bootstrap.cc:492] T 1c99d75cb2be4439a1610c0de343d73a P a1219433b66444d091420ceeab5092ef: No bootstrap required, opened a new log
I20260503 19:55:24.619952 932 ts_tablet_manager.cc:1403] T 1c99d75cb2be4439a1610c0de343d73a P a1219433b66444d091420ceeab5092ef: Time spent bootstrapping tablet: real 0.039s user 0.004s sys 0.001s
I20260503 19:55:24.621165 932 raft_consensus.cc:359] T 1c99d75cb2be4439a1610c0de343d73a P a1219433b66444d091420ceeab5092ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:24.621492 932 raft_consensus.cc:385] T 1c99d75cb2be4439a1610c0de343d73a P a1219433b66444d091420ceeab5092ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 19:55:24.621616 932 raft_consensus.cc:740] T 1c99d75cb2be4439a1610c0de343d73a P a1219433b66444d091420ceeab5092ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1219433b66444d091420ceeab5092ef, State: Initialized, Role: FOLLOWER
I20260503 19:55:24.622071 932 consensus_queue.cc:260] T 1c99d75cb2be4439a1610c0de343d73a P a1219433b66444d091420ceeab5092ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:24.622834 932 ts_tablet_manager.cc:1434] T 1c99d75cb2be4439a1610c0de343d73a P a1219433b66444d091420ceeab5092ef: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260503 19:55:24.626495 730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf4b80ba8714f24a49387dc8bbe2da3" candidate_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1219433b66444d091420ceeab5092ef" is_pre_election: true
I20260503 19:55:24.627014 730 raft_consensus.cc:2393] T ecf4b80ba8714f24a49387dc8bbe2da3 P a1219433b66444d091420ceeab5092ef [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d99e4f4d5ca48e0bdb54daf8361c5e8 in current term 1: Already voted for candidate a1219433b66444d091420ceeab5092ef in this term.
I20260503 19:55:24.628919 946 raft_consensus.cc:493] T d2bf53fe00c2417b872db2ecd4ede593 P 0e52aa88a17542609e84f0c09fb85d87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 19:55:24.629287 946 raft_consensus.cc:515] T d2bf53fe00c2417b872db2ecd4ede593 P 0e52aa88a17542609e84f0c09fb85d87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:24.630309 946 leader_election.cc:290] T d2bf53fe00c2417b872db2ecd4ede593 P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1219433b66444d091420ceeab5092ef (127.0.105.2:38837), 6d99e4f4d5ca48e0bdb54daf8361c5e8 (127.0.105.3:35005)
I20260503 19:55:24.631979 932 tablet_bootstrap.cc:492] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef: Bootstrap starting.
I20260503 19:55:24.633395 857 raft_consensus.cc:2468] T ecf4b80ba8714f24a49387dc8bbe2da3 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1219433b66444d091420ceeab5092ef in term 1.
I20260503 19:55:24.634754 938 raft_consensus.cc:515] T a860805e8df84220ae4be7d3279b75f1 P a1219433b66444d091420ceeab5092ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } }
I20260503 19:55:24.634232 859 raft_consensus.cc:2468] T 4d80fc29b7a64074b4a2ce4003054d1a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1219433b66444d091420ceeab5092ef in term 1.
I20260503 19:55:24.637878 860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860805e8df84220ae4be7d3279b75f1" candidate_uuid: "a1219433b66444d091420ceeab5092ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8"
I20260503 19:55:24.638557 860 raft_consensus.cc:3060] T a860805e8df84220ae4be7d3279b75f1 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 0 FOLLOWER]: Advancing to term 1
I20260503 19:55:24.642686 860 raft_consensus.cc:2468] T a860805e8df84220ae4be7d3279b75f1 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1219433b66444d091420ceeab5092ef in term 1.
I20260503 19:55:24.644026 666 leader_election.cc:304] T ecf4b80ba8714f24a49387dc8bbe2da3 P a1219433b66444d091420ceeab5092ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d99e4f4d5ca48e0bdb54daf8361c5e8, a1219433b66444d091420ceeab5092ef; no voters:
I20260503 19:55:24.644392 666 leader_election.cc:304] T a860805e8df84220ae4be7d3279b75f1 P a1219433b66444d091420ceeab5092ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d99e4f4d5ca48e0bdb54daf8361c5e8, a1219433b66444d091420ceeab5092ef; no voters:
I20260503 19:55:24.644596 942 raft_consensus.cc:2804] T ecf4b80ba8714f24a49387dc8bbe2da3 P a1219433b66444d091420ceeab5092ef [term 1 FOLLOWER]: Leader election won for term 1
I20260503 19:55:24.644814 935 tablet_bootstrap.cc:492] T 3983c88812214bc0bfaaa35c08c38875 P 0e52aa88a17542609e84f0c09fb85d87: No bootstrap required, opened a new log
I20260503 19:55:24.645062 935 ts_tablet_manager.cc:1403] T 3983c88812214bc0bfaaa35c08c38875 P 0e52aa88a17542609e84f0c09fb85d87: Time spent bootstrapping tablet: real 0.059s user 0.015s sys 0.037s
I20260503 19:55:24.646121 935 raft_consensus.cc:359] T 3983c88812214bc0bfaaa35c08c38875 P 0e52aa88a17542609e84f0c09fb85d87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:24.646435 935 raft_consensus.cc:385] T 3983c88812214bc0bfaaa35c08c38875 P 0e52aa88a17542609e84f0c09fb85d87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 19:55:24.643273 931 tablet_bootstrap.cc:492] T 1c99d75cb2be4439a1610c0de343d73a P 6d99e4f4d5ca48e0bdb54daf8361c5e8: No bootstrap required, opened a new log
I20260503 19:55:24.646566 935 raft_consensus.cc:740] T 3983c88812214bc0bfaaa35c08c38875 P 0e52aa88a17542609e84f0c09fb85d87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e52aa88a17542609e84f0c09fb85d87, State: Initialized, Role: FOLLOWER
I20260503 19:55:24.646775 931 ts_tablet_manager.cc:1403] T 1c99d75cb2be4439a1610c0de343d73a P 6d99e4f4d5ca48e0bdb54daf8361c5e8: Time spent bootstrapping tablet: real 0.093s user 0.016s sys 0.061s
I20260503 19:55:24.647012 938 leader_election.cc:290] T a860805e8df84220ae4be7d3279b75f1 P a1219433b66444d091420ceeab5092ef [CANDIDATE]: Term 1 election: Requested vote from peers 6d99e4f4d5ca48e0bdb54daf8361c5e8 (127.0.105.3:35005), 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847)
I20260503 19:55:24.647116 935 consensus_queue.cc:260] T 3983c88812214bc0bfaaa35c08c38875 P 0e52aa88a17542609e84f0c09fb85d87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:24.647836 935 ts_tablet_manager.cc:1434] T 3983c88812214bc0bfaaa35c08c38875 P 0e52aa88a17542609e84f0c09fb85d87: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260503 19:55:24.648049 931 raft_consensus.cc:359] T 1c99d75cb2be4439a1610c0de343d73a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:24.648317 935 tablet_bootstrap.cc:492] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87: Bootstrap starting.
I20260503 19:55:24.648468 931 raft_consensus.cc:385] T 1c99d75cb2be4439a1610c0de343d73a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 19:55:24.648712 931 raft_consensus.cc:740] T 1c99d75cb2be4439a1610c0de343d73a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d99e4f4d5ca48e0bdb54daf8361c5e8, State: Initialized, Role: FOLLOWER
I20260503 19:55:24.650264 857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860805e8df84220ae4be7d3279b75f1" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" is_pre_election: true
I20260503 19:55:24.650421 931 consensus_queue.cc:260] T 1c99d75cb2be4439a1610c0de343d73a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:24.650612 857 raft_consensus.cc:2393] T a860805e8df84220ae4be7d3279b75f1 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0e52aa88a17542609e84f0c09fb85d87 in current term 1: Already voted for candidate a1219433b66444d091420ceeab5092ef in this term.
I20260503 19:55:24.652522 599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860805e8df84220ae4be7d3279b75f1" candidate_uuid: "a1219433b66444d091420ceeab5092ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e52aa88a17542609e84f0c09fb85d87"
I20260503 19:55:24.652945 599 raft_consensus.cc:3060] T a860805e8df84220ae4be7d3279b75f1 P 0e52aa88a17542609e84f0c09fb85d87 [term 0 FOLLOWER]: Advancing to term 1
I20260503 19:55:24.656386 931 ts_tablet_manager.cc:1434] T 1c99d75cb2be4439a1610c0de343d73a P 6d99e4f4d5ca48e0bdb54daf8361c5e8: Time spent starting tablet: real 0.009s user 0.003s sys 0.000s
I20260503 19:55:24.656597 860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2bf53fe00c2417b872db2ecd4ede593" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" is_pre_election: true
I20260503 19:55:24.656845 860 raft_consensus.cc:2468] T d2bf53fe00c2417b872db2ecd4ede593 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e52aa88a17542609e84f0c09fb85d87 in term 0.
I20260503 19:55:24.648636 932 tablet_bootstrap.cc:654] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef: Neither blocks nor log segments found. Creating new log.
W20260503 19:55:24.664112 777 tablet.cc:2404] T 1c99d75cb2be4439a1610c0de343d73a P a1219433b66444d091420ceeab5092ef: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260503 19:55:24.667112 935 tablet_bootstrap.cc:654] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87: Neither blocks nor log segments found. Creating new log.
I20260503 19:55:24.668533 535 leader_election.cc:304] T d2bf53fe00c2417b872db2ecd4ede593 P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e52aa88a17542609e84f0c09fb85d87, 6d99e4f4d5ca48e0bdb54daf8361c5e8; no voters:
I20260503 19:55:24.669592 936 raft_consensus.cc:493] T 1c99d75cb2be4439a1610c0de343d73a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 19:55:24.669797 936 raft_consensus.cc:515] T 1c99d75cb2be4439a1610c0de343d73a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:24.670576 936 leader_election.cc:290] T 1c99d75cb2be4439a1610c0de343d73a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847), a1219433b66444d091420ceeab5092ef (127.0.105.2:38837)
I20260503 19:55:24.670928 599 raft_consensus.cc:2468] T a860805e8df84220ae4be7d3279b75f1 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1219433b66444d091420ceeab5092ef in term 1.
I20260503 19:55:24.673588 597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c99d75cb2be4439a1610c0de343d73a" candidate_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e52aa88a17542609e84f0c09fb85d87" is_pre_election: true
W20260503 19:55:24.675223 796 leader_election.cc:343] T 1c99d75cb2be4439a1610c0de343d73a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Illegal state: must be running to vote when last-logged opid is not known
I20260503 19:55:24.675781 938 raft_consensus.cc:2804] T a860805e8df84220ae4be7d3279b75f1 P a1219433b66444d091420ceeab5092ef [term 1 FOLLOWER]: Leader election won for term 1
I20260503 19:55:24.675918 598 raft_consensus.cc:3060] T 3983c88812214bc0bfaaa35c08c38875 P 0e52aa88a17542609e84f0c09fb85d87 [term 0 FOLLOWER]: Advancing to term 1
I20260503 19:55:24.681058 936 consensus_queue.cc:1048] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 19:55:24.682395 938 raft_consensus.cc:697] T a860805e8df84220ae4be7d3279b75f1 P a1219433b66444d091420ceeab5092ef [term 1 LEADER]: Becoming Leader. State: Replica: a1219433b66444d091420ceeab5092ef, State: Running, Role: LEADER
I20260503 19:55:24.683032 938 consensus_queue.cc:237] T a860805e8df84220ae4be7d3279b75f1 P a1219433b66444d091420ceeab5092ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } }
I20260503 19:55:24.686515 942 raft_consensus.cc:697] T ecf4b80ba8714f24a49387dc8bbe2da3 P a1219433b66444d091420ceeab5092ef [term 1 LEADER]: Becoming Leader. State: Replica: a1219433b66444d091420ceeab5092ef, State: Running, Role: LEADER
I20260503 19:55:24.686980 942 consensus_queue.cc:237] T ecf4b80ba8714f24a49387dc8bbe2da3 P a1219433b66444d091420ceeab5092ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:24.687498 965 consensus_queue.cc:1048] T 4d80fc29b7a64074b4a2ce4003054d1a P a1219433b66444d091420ceeab5092ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 19:55:24.688357 946 raft_consensus.cc:2804] T d2bf53fe00c2417b872db2ecd4ede593 P 0e52aa88a17542609e84f0c09fb85d87 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 19:55:24.688512 946 raft_consensus.cc:493] T d2bf53fe00c2417b872db2ecd4ede593 P 0e52aa88a17542609e84f0c09fb85d87 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 19:55:24.688696 946 raft_consensus.cc:3060] T d2bf53fe00c2417b872db2ecd4ede593 P 0e52aa88a17542609e84f0c09fb85d87 [term 0 FOLLOWER]: Advancing to term 1
I20260503 19:55:24.692433 600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf4b80ba8714f24a49387dc8bbe2da3" candidate_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e52aa88a17542609e84f0c09fb85d87" is_pre_election: true
I20260503 19:55:24.692906 600 raft_consensus.cc:2393] T ecf4b80ba8714f24a49387dc8bbe2da3 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d99e4f4d5ca48e0bdb54daf8361c5e8 in current term 1: Already voted for candidate a1219433b66444d091420ceeab5092ef in this term.
W20260503 19:55:24.693396 666 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.3:35005, user_credentials={real_user=slave}} blocked reactor thread for 48950.2us
I20260503 19:55:24.693890 935 tablet_bootstrap.cc:492] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87: No bootstrap required, opened a new log
I20260503 19:55:24.694154 935 ts_tablet_manager.cc:1403] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87: Time spent bootstrapping tablet: real 0.046s user 0.005s sys 0.001s
I20260503 19:55:24.694638 730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c99d75cb2be4439a1610c0de343d73a" candidate_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1219433b66444d091420ceeab5092ef" is_pre_election: true
I20260503 19:55:24.694919 730 raft_consensus.cc:2468] T 1c99d75cb2be4439a1610c0de343d73a P a1219433b66444d091420ceeab5092ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d99e4f4d5ca48e0bdb54daf8361c5e8 in term 0.
I20260503 19:55:24.695048 935 raft_consensus.cc:359] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:24.695230 935 raft_consensus.cc:385] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 19:55:24.695305 935 raft_consensus.cc:740] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e52aa88a17542609e84f0c09fb85d87, State: Initialized, Role: FOLLOWER
I20260503 19:55:24.695319 796 leader_election.cc:304] T ecf4b80ba8714f24a49387dc8bbe2da3 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d99e4f4d5ca48e0bdb54daf8361c5e8; no voters: 0e52aa88a17542609e84f0c09fb85d87, a1219433b66444d091420ceeab5092ef
I20260503 19:55:24.696038 936 raft_consensus.cc:2749] T ecf4b80ba8714f24a49387dc8bbe2da3 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 19:55:24.699292 795 leader_election.cc:304] T 1c99d75cb2be4439a1610c0de343d73a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d99e4f4d5ca48e0bdb54daf8361c5e8, a1219433b66444d091420ceeab5092ef; no voters: 0e52aa88a17542609e84f0c09fb85d87
I20260503 19:55:24.699874 952 consensus_queue.cc:1048] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 19:55:24.700644 952 raft_consensus.cc:2804] T 1c99d75cb2be4439a1610c0de343d73a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 19:55:24.700788 952 raft_consensus.cc:493] T 1c99d75cb2be4439a1610c0de343d73a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 19:55:24.700912 952 raft_consensus.cc:3060] T 1c99d75cb2be4439a1610c0de343d73a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 0 FOLLOWER]: Advancing to term 1
I20260503 19:55:24.705154 952 raft_consensus.cc:515] T 1c99d75cb2be4439a1610c0de343d73a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:24.705417 458 catalog_manager.cc:5671] T ecf4b80ba8714f24a49387dc8bbe2da3 P a1219433b66444d091420ceeab5092ef reported cstate change: term changed from 0 to 1, leader changed from <none> to a1219433b66444d091420ceeab5092ef (127.0.105.2). New cstate: current_term: 1 leader_uuid: "a1219433b66444d091420ceeab5092ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } health_report { overall_health: UNKNOWN } } }
I20260503 19:55:24.707330 952 leader_election.cc:290] T 1c99d75cb2be4439a1610c0de343d73a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [CANDIDATE]: Term 1 election: Requested vote from peers 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847), a1219433b66444d091420ceeab5092ef (127.0.105.2:38837)
I20260503 19:55:24.707751 598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c99d75cb2be4439a1610c0de343d73a" candidate_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e52aa88a17542609e84f0c09fb85d87"
I20260503 19:55:24.708516 932 tablet_bootstrap.cc:492] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef: No bootstrap required, opened a new log
I20260503 19:55:24.708719 932 ts_tablet_manager.cc:1403] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef: Time spent bootstrapping tablet: real 0.077s user 0.005s sys 0.007s
I20260503 19:55:24.709628 932 raft_consensus.cc:359] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:24.709884 932 raft_consensus.cc:385] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 19:55:24.710011 932 raft_consensus.cc:740] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1219433b66444d091420ceeab5092ef, State: Initialized, Role: FOLLOWER
I20260503 19:55:24.710309 932 consensus_queue.cc:260] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:24.710888 946 raft_consensus.cc:515] T d2bf53fe00c2417b872db2ecd4ede593 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:24.711295 932 ts_tablet_manager.cc:1434] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260503 19:55:24.716073 730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860805e8df84220ae4be7d3279b75f1" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1219433b66444d091420ceeab5092ef" is_pre_election: true
I20260503 19:55:24.716967 459 catalog_manager.cc:5671] T a860805e8df84220ae4be7d3279b75f1 P a1219433b66444d091420ceeab5092ef reported cstate change: term changed from 0 to 1, leader changed from <none> to a1219433b66444d091420ceeab5092ef (127.0.105.2). New cstate: current_term: 1 leader_uuid: "a1219433b66444d091420ceeab5092ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } health_report { overall_health: UNKNOWN } } }
I20260503 19:55:24.718886 730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2bf53fe00c2417b872db2ecd4ede593" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1219433b66444d091420ceeab5092ef" is_pre_election: true
I20260503 19:55:24.719223 730 raft_consensus.cc:2468] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e52aa88a17542609e84f0c09fb85d87 in term 0.
I20260503 19:55:24.732697 729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c99d75cb2be4439a1610c0de343d73a" candidate_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1219433b66444d091420ceeab5092ef"
I20260503 19:55:24.732894 730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2bf53fe00c2417b872db2ecd4ede593" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1219433b66444d091420ceeab5092ef"
I20260503 19:55:24.733192 729 raft_consensus.cc:3060] T 1c99d75cb2be4439a1610c0de343d73a P a1219433b66444d091420ceeab5092ef [term 0 FOLLOWER]: Advancing to term 1
I20260503 19:55:24.733318 730 raft_consensus.cc:3060] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef [term 0 FOLLOWER]: Advancing to term 1
I20260503 19:55:24.739063 730 raft_consensus.cc:2468] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e52aa88a17542609e84f0c09fb85d87 in term 1.
I20260503 19:55:24.740036 942 consensus_queue.cc:1048] T 4d80fc29b7a64074b4a2ce4003054d1a P a1219433b66444d091420ceeab5092ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 19:55:24.740401 533 leader_election.cc:304] T a860805e8df84220ae4be7d3279b75f1 P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e52aa88a17542609e84f0c09fb85d87; no voters: 6d99e4f4d5ca48e0bdb54daf8361c5e8, a1219433b66444d091420ceeab5092ef
I20260503 19:55:24.742585 973 raft_consensus.cc:2749] T a860805e8df84220ae4be7d3279b75f1 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 19:55:24.742805 729 raft_consensus.cc:2468] T 1c99d75cb2be4439a1610c0de343d73a P a1219433b66444d091420ceeab5092ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d99e4f4d5ca48e0bdb54daf8361c5e8 in term 1.
I20260503 19:55:24.748071 795 leader_election.cc:304] T 1c99d75cb2be4439a1610c0de343d73a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d99e4f4d5ca48e0bdb54daf8361c5e8, a1219433b66444d091420ceeab5092ef; no voters:
I20260503 19:55:24.748775 952 raft_consensus.cc:2804] T 1c99d75cb2be4439a1610c0de343d73a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 19:55:24.749550 952 raft_consensus.cc:697] T 1c99d75cb2be4439a1610c0de343d73a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 1 LEADER]: Becoming Leader. State: Replica: 6d99e4f4d5ca48e0bdb54daf8361c5e8, State: Running, Role: LEADER
I20260503 19:55:24.750195 860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2bf53fe00c2417b872db2ecd4ede593" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8"
I20260503 19:55:24.750133 952 consensus_queue.cc:237] T 1c99d75cb2be4439a1610c0de343d73a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:24.750461 860 raft_consensus.cc:3060] T d2bf53fe00c2417b872db2ecd4ede593 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 0 FOLLOWER]: Advancing to term 1
W20260503 19:55:24.748102 646 tablet.cc:2404] T 3983c88812214bc0bfaaa35c08c38875 P 0e52aa88a17542609e84f0c09fb85d87: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260503 19:55:24.750640 946 leader_election.cc:290] T d2bf53fe00c2417b872db2ecd4ede593 P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 1 election: Requested vote from peers a1219433b66444d091420ceeab5092ef (127.0.105.2:38837), 6d99e4f4d5ca48e0bdb54daf8361c5e8 (127.0.105.3:35005)
I20260503 19:55:24.752384 533 leader_election.cc:304] T d2bf53fe00c2417b872db2ecd4ede593 P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e52aa88a17542609e84f0c09fb85d87, a1219433b66444d091420ceeab5092ef; no voters:
I20260503 19:55:24.753682 946 raft_consensus.cc:2804] T d2bf53fe00c2417b872db2ecd4ede593 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 19:55:24.753895 946 raft_consensus.cc:697] T d2bf53fe00c2417b872db2ecd4ede593 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 LEADER]: Becoming Leader. State: Replica: 0e52aa88a17542609e84f0c09fb85d87, State: Running, Role: LEADER
I20260503 19:55:24.753942 976 raft_consensus.cc:493] T 3983c88812214bc0bfaaa35c08c38875 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d99e4f4d5ca48e0bdb54daf8361c5e8)
I20260503 19:55:24.754098 976 raft_consensus.cc:515] T 3983c88812214bc0bfaaa35c08c38875 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:24.754484 860 raft_consensus.cc:2468] T d2bf53fe00c2417b872db2ecd4ede593 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e52aa88a17542609e84f0c09fb85d87 in term 1.
I20260503 19:55:24.756350 860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3983c88812214bc0bfaaa35c08c38875" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" is_pre_election: true
I20260503 19:55:24.753720 935 consensus_queue.cc:260] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:24.757133 968 raft_consensus.cc:493] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 19:55:24.757436 935 ts_tablet_manager.cc:1434] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87: Time spent starting tablet: real 0.063s user 0.017s sys 0.033s
I20260503 19:55:24.757378 968 raft_consensus.cc:515] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:24.758322 598 raft_consensus.cc:3060] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87 [term 0 FOLLOWER]: Advancing to term 1
I20260503 19:55:24.759053 968 leader_election.cc:290] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1219433b66444d091420ceeab5092ef (127.0.105.2:38837), 6d99e4f4d5ca48e0bdb54daf8361c5e8 (127.0.105.3:35005)
I20260503 19:55:24.760941 860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c99d75cb2be4439a1610c0de343d73a" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" is_pre_election: true
I20260503 19:55:24.754768 946 consensus_queue.cc:237] T d2bf53fe00c2417b872db2ecd4ede593 P 0e52aa88a17542609e84f0c09fb85d87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:24.755765 976 leader_election.cc:290] T 3983c88812214bc0bfaaa35c08c38875 P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1219433b66444d091420ceeab5092ef (127.0.105.2:38837), 6d99e4f4d5ca48e0bdb54daf8361c5e8 (127.0.105.3:35005)
I20260503 19:55:24.761729 598 raft_consensus.cc:2468] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d99e4f4d5ca48e0bdb54daf8361c5e8 in term 1.
I20260503 19:55:24.766094 731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3983c88812214bc0bfaaa35c08c38875" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1219433b66444d091420ceeab5092ef" is_pre_election: true
I20260503 19:55:24.767444 533 leader_election.cc:304] T 3983c88812214bc0bfaaa35c08c38875 P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e52aa88a17542609e84f0c09fb85d87; no voters: 6d99e4f4d5ca48e0bdb54daf8361c5e8, a1219433b66444d091420ceeab5092ef
I20260503 19:55:24.767714 459 catalog_manager.cc:5671] T 1c99d75cb2be4439a1610c0de343d73a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d99e4f4d5ca48e0bdb54daf8361c5e8 (127.0.105.3). New cstate: current_term: 1 leader_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } health_report { overall_health: HEALTHY } } }
I20260503 19:55:24.768174 976 raft_consensus.cc:2749] T 3983c88812214bc0bfaaa35c08c38875 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 19:55:24.768940 731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c99d75cb2be4439a1610c0de343d73a" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1219433b66444d091420ceeab5092ef" is_pre_election: true
I20260503 19:55:24.769429 731 raft_consensus.cc:2393] T 1c99d75cb2be4439a1610c0de343d73a P a1219433b66444d091420ceeab5092ef [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0e52aa88a17542609e84f0c09fb85d87 in current term 1: Already voted for candidate 6d99e4f4d5ca48e0bdb54daf8361c5e8 in this term.
I20260503 19:55:24.770897 533 leader_election.cc:304] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e52aa88a17542609e84f0c09fb85d87; no voters: 6d99e4f4d5ca48e0bdb54daf8361c5e8, a1219433b66444d091420ceeab5092ef
I20260503 19:55:24.771790 976 raft_consensus.cc:2749] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 19:55:24.779515 965 consensus_queue.cc:1048] T a860805e8df84220ae4be7d3279b75f1 P a1219433b66444d091420ceeab5092ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 19:55:24.787564 965 consensus_queue.cc:1048] T ecf4b80ba8714f24a49387dc8bbe2da3 P a1219433b66444d091420ceeab5092ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 19:55:24.797962 942 consensus_queue.cc:1048] T ecf4b80ba8714f24a49387dc8bbe2da3 P a1219433b66444d091420ceeab5092ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 19:55:24.829358 938 consensus_queue.cc:1048] T a860805e8df84220ae4be7d3279b75f1 P a1219433b66444d091420ceeab5092ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 19:55:24.831192 459 catalog_manager.cc:5671] T d2bf53fe00c2417b872db2ecd4ede593 P 0e52aa88a17542609e84f0c09fb85d87 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1). New cstate: current_term: 1 leader_uuid: "0e52aa88a17542609e84f0c09fb85d87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } health_report { overall_health: UNKNOWN } } }
I20260503 19:55:24.844123 979 consensus_queue.cc:1048] T 1c99d75cb2be4439a1610c0de343d73a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 19:55:24.847153 979 consensus_queue.cc:1048] T 1c99d75cb2be4439a1610c0de343d73a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 19:55:24.854449 946 consensus_queue.cc:1048] T d2bf53fe00c2417b872db2ecd4ede593 P 0e52aa88a17542609e84f0c09fb85d87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 19:55:24.861640 972 consensus_queue.cc:1048] T d2bf53fe00c2417b872db2ecd4ede593 P 0e52aa88a17542609e84f0c09fb85d87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 19:55:24.947788 420 external_mini_cluster.cc:1366] Running /tmp/dist-test-task4vf7p3/build/asan/bin/kudu
/tmp/dist-test-task4vf7p3/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-3/wal
--fs_data_dirs=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-3/logs
--server_dump_info_path=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.105.4:0
--local_ip_for_outbound_sockets=127.0.105.4
--webserver_interface=127.0.105.4
--webserver_port=0
--tserver_master_addrs=127.0.105.62:45771
--builtin_ntp_servers=127.0.105.20:45495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--follower_unavailable_considered_failed_sec=2
--enable_log_gc=false with env {}
W20260503 19:55:25.934224 1000 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260503 19:55:25.934720 1000 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260503 19:55:25.934832 1000 flags.cc:432] Enabled unsafe flag: --enable_log_gc=false
W20260503 19:55:25.934971 1000 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260503 19:55:25.951917 1000 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260503 19:55:25.952239 1000 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.105.4
I20260503 19:55:25.973640 1000 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.105.20:45495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=2
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-3/data
--fs_wal_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.105.4:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-3/data/info.pb
--webserver_interface=127.0.105.4
--webserver_port=0
--enable_log_gc=false
--tserver_master_addrs=127.0.105.62:45771
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.105.4
--log_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-3/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 0ba7f54e15c9f673bf3e350f30b8d5f1a4037b79
build type FASTDEBUG
built by None at 03 May 2026 19:43:25 UTC on bdcb31816ec0
build id 11730
ASAN enabled
I20260503 19:55:25.976400 1000 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260503 19:55:25.979143 1000 file_cache.cc:492] Constructed file cache file cache with capacity 419430
E20260503 19:55:25.990764 1000 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260503 19:55:26.106299 1031 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 19:55:26.128734 1034 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 19:55:26.232008 1032 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260503 19:55:26.309269 1000 server_base.cc:1061] running on GCE node
I20260503 19:55:26.310354 1000 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260503 19:55:26.327610 1000 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260503 19:55:26.331040 1000 hybrid_clock.cc:648] HybridClock initialized: now 1777838126330896 us; error 116 us; skew 500 ppm
I20260503 19:55:26.331629 1000 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260503 19:55:26.418177 1000 webserver.cc:492] Webserver started at http://127.0.105.4:45845/ using document root <none> and password file <none>
I20260503 19:55:26.419929 1000 fs_manager.cc:362] Metadata directory not provided
I20260503 19:55:26.420097 1000 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260503 19:55:26.420575 1000 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260503 19:55:26.424348 1000 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-3/data/instance:
uuid: "6ee23f35facc4d309ca4099163d9ccb2"
format_stamp: "Formatted at 2026-05-03 19:55:26 on dist-test-slave-nzs1"
I20260503 19:55:26.425637 1000 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-3/wal/instance:
uuid: "6ee23f35facc4d309ca4099163d9ccb2"
format_stamp: "Formatted at 2026-05-03 19:55:26 on dist-test-slave-nzs1"
I20260503 19:55:26.448354 1000 fs_manager.cc:696] Time spent creating directory manager: real 0.022s user 0.005s sys 0.016s
I20260503 19:55:26.538443 1043 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260503 19:55:26.548302 1000 fs_manager.cc:730] Time spent opening block manager: real 0.031s user 0.002s sys 0.008s
I20260503 19:55:26.548565 1000 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-3/data,/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-3/wal
uuid: "6ee23f35facc4d309ca4099163d9ccb2"
format_stamp: "Formatted at 2026-05-03 19:55:26 on dist-test-slave-nzs1"
I20260503 19:55:26.548818 1000 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-3/wal
metadata directory: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-3/wal
1 data directories: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260503 19:55:26.629441 1000 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260503 19:55:26.635234 1000 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260503 19:55:26.635690 1000 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260503 19:55:26.683280 1000 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260503 19:55:26.692581 1000 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260503 19:55:26.692741 1000 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260503 19:55:26.692881 1000 ts_tablet_manager.cc:616] Registered 0 tablets
I20260503 19:55:26.692963 1000 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
W20260503 19:55:27.181110 665 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.1:37847, user_credentials={real_user=slave}} blocked reactor thread for 98591.3us
W20260503 19:55:27.698884 665 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.1:37847, user_credentials={real_user=slave}} blocked reactor thread for 73237.9us
I20260503 19:55:29.463430 1000 rpc_server.cc:307] RPC server started. Bound to: 127.0.105.4:36991
I20260503 19:55:29.463591 1166 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.105.4:36991 every 8 connection(s)
I20260503 19:55:29.466109 1000 server_base.cc:1193] Dumped server information to /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-3/data/info.pb
I20260503 19:55:29.474910 420 external_mini_cluster.cc:1428] Started /tmp/dist-test-task4vf7p3/build/asan/bin/kudu as pid 1000
I20260503 19:55:29.475169 420 external_mini_cluster.cc:1442] Reading /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-3/wal/instance
I20260503 19:55:29.651610 1167 heartbeater.cc:344] Connected to a master server at 127.0.105.62:45771
I20260503 19:55:29.652130 1167 heartbeater.cc:461] Registering TS with master...
I20260503 19:55:29.653435 1167 heartbeater.cc:507] Master 127.0.105.62:45771 requested a full tablet report, sending...
I20260503 19:55:29.655869 458 ts_manager.cc:194] Registered new tserver with Master: 6ee23f35facc4d309ca4099163d9ccb2 (127.0.105.4:36991)
I20260503 19:55:29.656965 458 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.105.4:55893
W20260503 19:55:30.087332 665 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.1:37847, user_credentials={real_user=slave}} blocked reactor thread for 63468.6us
I20260503 19:55:30.255352 458 ts_manager.cc:295] Set tserver state for 0e52aa88a17542609e84f0c09fb85d87 to MAINTENANCE_MODE
I20260503 19:55:30.257381 420 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-task4vf7p3/build/asan/bin/kudu pid 518
I20260503 19:55:30.259171 640 generic_service.cc:196] Checking for leaks (request via RPC)
I20260503 19:55:30.490892 420 external_mini_cluster.cc:1658] Killing /tmp/dist-test-task4vf7p3/build/asan/bin/kudu with pid 518
W20260503 19:55:30.533492 795 connection.cc:570] server connection from 127.0.105.1:32911 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260503 19:55:30.533936 665 connection.cc:570] client connection to 127.0.105.1:37847 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260503 19:55:30.534116 917 connection.cc:570] client connection to 127.0.105.1:37847 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260503 19:55:30.534162 665 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260503 19:55:30.534384 917 meta_cache.cc:302] tablet d2bf53fe00c2417b872db2ecd4ede593: replica 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847) has failed: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260503 19:55:30.534847 796 connection.cc:570] client connection to 127.0.105.1:37847 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260503 19:55:30.535099 796 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260503 19:55:30.537531 665 consensus_peers.cc:597] T ecf4b80ba8714f24a49387dc8bbe2da3 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260503 19:55:30.537691 665 consensus_peers.cc:597] T 4d80fc29b7a64074b4a2ce4003054d1a P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260503 19:55:30.538097 665 consensus_peers.cc:597] T a860805e8df84220ae4be7d3279b75f1 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260503 19:55:30.539165 796 consensus_peers.cc:597] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260503 19:55:30.539373 796 consensus_peers.cc:597] T 1c99d75cb2be4439a1610c0de343d73a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260503 19:55:30.541028 691 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34946: Illegal state: replica a1219433b66444d091420ceeab5092ef is not leader of this config: current role FOLLOWER
W20260503 19:55:30.541183 689 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34946: Illegal state: replica a1219433b66444d091420ceeab5092ef is not leader of this config: current role FOLLOWER
W20260503 19:55:30.541235 687 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34946: Illegal state: replica a1219433b66444d091420ceeab5092ef is not leader of this config: current role FOLLOWER
W20260503 19:55:30.546811 821 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:47586: Illegal state: replica 6d99e4f4d5ca48e0bdb54daf8361c5e8 is not leader of this config: current role FOLLOWER
W20260503 19:55:30.548894 821 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:47586: Illegal state: replica 6d99e4f4d5ca48e0bdb54daf8361c5e8 is not leader of this config: current role FOLLOWER
W20260503 19:55:30.550097 821 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:47586: Illegal state: replica 6d99e4f4d5ca48e0bdb54daf8361c5e8 is not leader of this config: current role FOLLOWER
W20260503 19:55:30.563500 689 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34946: Illegal state: replica a1219433b66444d091420ceeab5092ef is not leader of this config: current role FOLLOWER
W20260503 19:55:30.565538 689 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34946: Illegal state: replica a1219433b66444d091420ceeab5092ef is not leader of this config: current role FOLLOWER
W20260503 19:55:30.574460 821 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:47586: Illegal state: replica 6d99e4f4d5ca48e0bdb54daf8361c5e8 is not leader of this config: current role FOLLOWER
W20260503 19:55:30.576491 821 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:47586: Illegal state: replica 6d99e4f4d5ca48e0bdb54daf8361c5e8 is not leader of this config: current role FOLLOWER
W20260503 19:55:30.576617 820 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:47586: Illegal state: replica 6d99e4f4d5ca48e0bdb54daf8361c5e8 is not leader of this config: current role FOLLOWER
W20260503 19:55:30.588230 689 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34946: Illegal state: replica a1219433b66444d091420ceeab5092ef is not leader of this config: current role FOLLOWER
W20260503 19:55:30.599530 689 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34946: Illegal state: replica a1219433b66444d091420ceeab5092ef is not leader of this config: current role FOLLOWER
W20260503 19:55:30.601956 689 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34946: Illegal state: replica a1219433b66444d091420ceeab5092ef is not leader of this config: current role FOLLOWER
W20260503 19:55:30.611245 820 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:47586: Illegal state: replica 6d99e4f4d5ca48e0bdb54daf8361c5e8 is not leader of this config: current role FOLLOWER
W20260503 19:55:30.612778 820 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:47586: Illegal state: replica 6d99e4f4d5ca48e0bdb54daf8361c5e8 is not leader of this config: current role FOLLOWER
W20260503 19:55:30.613297 821 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:47586: Illegal state: replica 6d99e4f4d5ca48e0bdb54daf8361c5e8 is not leader of this config: current role FOLLOWER
W20260503 19:55:30.625589 689 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34946: Illegal state: replica a1219433b66444d091420ceeab5092ef is not leader of this config: current role FOLLOWER
W20260503 19:55:30.640916 689 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34946: Illegal state: replica a1219433b66444d091420ceeab5092ef is not leader of this config: current role FOLLOWER
W20260503 19:55:30.643095 689 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34946: Illegal state: replica a1219433b66444d091420ceeab5092ef is not leader of this config: current role FOLLOWER
W20260503 19:55:30.659020 820 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:47586: Illegal state: replica 6d99e4f4d5ca48e0bdb54daf8361c5e8 is not leader of this config: current role FOLLOWER
W20260503 19:55:30.658921 821 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:47586: Illegal state: replica 6d99e4f4d5ca48e0bdb54daf8361c5e8 is not leader of this config: current role FOLLOWER
W20260503 19:55:30.660360 822 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:47586: Illegal state: replica 6d99e4f4d5ca48e0bdb54daf8361c5e8 is not leader of this config: current role FOLLOWER
I20260503 19:55:30.662456 1167 heartbeater.cc:499] Master 127.0.105.62:45771 was elected leader, sending a full tablet report...
W20260503 19:55:30.694097 691 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34946: Illegal state: replica a1219433b66444d091420ceeab5092ef is not leader of this config: current role FOLLOWER
W20260503 19:55:30.694097 689 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34946: Illegal state: replica a1219433b66444d091420ceeab5092ef is not leader of this config: current role FOLLOWER
W20260503 19:55:30.696295 689 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34946: Illegal state: replica a1219433b66444d091420ceeab5092ef is not leader of this config: current role FOLLOWER
W20260503 19:55:30.713413 822 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:47586: Illegal state: replica 6d99e4f4d5ca48e0bdb54daf8361c5e8 is not leader of this config: current role FOLLOWER
W20260503 19:55:30.713696 821 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:47586: Illegal state: replica 6d99e4f4d5ca48e0bdb54daf8361c5e8 is not leader of this config: current role FOLLOWER
W20260503 19:55:30.733493 689 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34946: Illegal state: replica a1219433b66444d091420ceeab5092ef is not leader of this config: current role FOLLOWER
W20260503 19:55:30.755045 821 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:47586: Illegal state: replica 6d99e4f4d5ca48e0bdb54daf8361c5e8 is not leader of this config: current role FOLLOWER
W20260503 19:55:30.757213 821 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:47586: Illegal state: replica 6d99e4f4d5ca48e0bdb54daf8361c5e8 is not leader of this config: current role FOLLOWER
W20260503 19:55:30.757213 822 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:47586: Illegal state: replica 6d99e4f4d5ca48e0bdb54daf8361c5e8 is not leader of this config: current role FOLLOWER
W20260503 19:55:30.779364 689 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34946: Illegal state: replica a1219433b66444d091420ceeab5092ef is not leader of this config: current role FOLLOWER
W20260503 19:55:30.779371 691 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34946: Illegal state: replica a1219433b66444d091420ceeab5092ef is not leader of this config: current role FOLLOWER
I20260503 19:55:30.785000 1036 raft_consensus.cc:493] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0e52aa88a17542609e84f0c09fb85d87)
I20260503 19:55:30.785233 1036 raft_consensus.cc:515] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:30.786077 1036 leader_election.cc:290] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847), 6d99e4f4d5ca48e0bdb54daf8361c5e8 (127.0.105.3:35005)
I20260503 19:55:30.786736 862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2bf53fe00c2417b872db2ecd4ede593" candidate_uuid: "a1219433b66444d091420ceeab5092ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 162 } } ignore_live_leader: false dest_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" is_pre_election: true
W20260503 19:55:30.788041 665 leader_election.cc:336] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111)
I20260503 19:55:30.788219 665 leader_election.cc:304] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1219433b66444d091420ceeab5092ef; no voters: 0e52aa88a17542609e84f0c09fb85d87, 6d99e4f4d5ca48e0bdb54daf8361c5e8
I20260503 19:55:30.788546 1036 raft_consensus.cc:2749] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 19:55:30.798395 1006 raft_consensus.cc:493] T d2bf53fe00c2417b872db2ecd4ede593 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0e52aa88a17542609e84f0c09fb85d87)
I20260503 19:55:30.798619 1006 raft_consensus.cc:515] T d2bf53fe00c2417b872db2ecd4ede593 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:30.799371 1006 leader_election.cc:290] T d2bf53fe00c2417b872db2ecd4ede593 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847), a1219433b66444d091420ceeab5092ef (127.0.105.2:38837)
I20260503 19:55:30.800071 729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2bf53fe00c2417b872db2ecd4ede593" candidate_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 161 } } ignore_live_leader: false dest_uuid: "a1219433b66444d091420ceeab5092ef" is_pre_election: true
I20260503 19:55:30.800447 729 raft_consensus.cc:2410] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d99e4f4d5ca48e0bdb54daf8361c5e8 for term 2 because replica has last-logged OpId of term: 1 index: 162, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 161.
W20260503 19:55:30.800969 796 leader_election.cc:336] T d2bf53fe00c2417b872db2ecd4ede593 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111)
I20260503 19:55:30.801265 795 leader_election.cc:304] T d2bf53fe00c2417b872db2ecd4ede593 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d99e4f4d5ca48e0bdb54daf8361c5e8; no voters: 0e52aa88a17542609e84f0c09fb85d87, a1219433b66444d091420ceeab5092ef
I20260503 19:55:30.801635 1006 raft_consensus.cc:2749] T d2bf53fe00c2417b872db2ecd4ede593 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260503 19:55:30.803920 689 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34946: Illegal state: replica a1219433b66444d091420ceeab5092ef is not leader of this config: current role FOLLOWER
W20260503 19:55:30.826761 689 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34946: Illegal state: replica a1219433b66444d091420ceeab5092ef is not leader of this config: current role FOLLOWER
W20260503 19:55:30.827055 822 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:47586: Illegal state: replica 6d99e4f4d5ca48e0bdb54daf8361c5e8 is not leader of this config: current role FOLLOWER
W20260503 19:55:30.828665 822 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:47586: Illegal state: replica 6d99e4f4d5ca48e0bdb54daf8361c5e8 is not leader of this config: current role FOLLOWER
W20260503 19:55:30.853410 822 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:47586: Illegal state: replica 6d99e4f4d5ca48e0bdb54daf8361c5e8 is not leader of this config: current role FOLLOWER
W20260503 19:55:30.854763 689 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34946: Illegal state: replica a1219433b66444d091420ceeab5092ef is not leader of this config: current role FOLLOWER
W20260503 19:55:30.878969 689 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34946: Illegal state: replica a1219433b66444d091420ceeab5092ef is not leader of this config: current role FOLLOWER
W20260503 19:55:30.904614 822 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:47586: Illegal state: replica 6d99e4f4d5ca48e0bdb54daf8361c5e8 is not leader of this config: current role FOLLOWER
W20260503 19:55:30.906267 822 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:47586: Illegal state: replica 6d99e4f4d5ca48e0bdb54daf8361c5e8 is not leader of this config: current role FOLLOWER
W20260503 19:55:30.910261 822 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:47586: Illegal state: replica 6d99e4f4d5ca48e0bdb54daf8361c5e8 is not leader of this config: current role FOLLOWER
W20260503 19:55:30.931980 689 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34946: Illegal state: replica a1219433b66444d091420ceeab5092ef is not leader of this config: current role FOLLOWER
W20260503 19:55:30.938766 665 consensus_peers.cc:597] T a860805e8df84220ae4be7d3279b75f1 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260503 19:55:30.967339 689 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34946: Illegal state: replica a1219433b66444d091420ceeab5092ef is not leader of this config: current role FOLLOWER
W20260503 19:55:30.967499 691 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34946: Illegal state: replica a1219433b66444d091420ceeab5092ef is not leader of this config: current role FOLLOWER
W20260503 19:55:30.978003 796 consensus_peers.cc:597] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260503 19:55:30.992060 691 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34946: Illegal state: replica a1219433b66444d091420ceeab5092ef is not leader of this config: current role FOLLOWER
W20260503 19:55:30.996632 822 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:47586: Illegal state: replica 6d99e4f4d5ca48e0bdb54daf8361c5e8 is not leader of this config: current role FOLLOWER
W20260503 19:55:30.999408 665 consensus_peers.cc:597] T ecf4b80ba8714f24a49387dc8bbe2da3 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260503 19:55:31.004346 665 consensus_peers.cc:597] T 4d80fc29b7a64074b4a2ce4003054d1a P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260503 19:55:31.017437 796 consensus_peers.cc:597] T 1c99d75cb2be4439a1610c0de343d73a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260503 19:55:31.023573 822 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:47586: Illegal state: replica 6d99e4f4d5ca48e0bdb54daf8361c5e8 is not leader of this config: current role FOLLOWER
W20260503 19:55:31.058452 691 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34946: Illegal state: replica a1219433b66444d091420ceeab5092ef is not leader of this config: current role FOLLOWER
W20260503 19:55:31.059568 691 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34946: Illegal state: replica a1219433b66444d091420ceeab5092ef is not leader of this config: current role FOLLOWER
W20260503 19:55:31.086572 691 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34946: Illegal state: replica a1219433b66444d091420ceeab5092ef is not leader of this config: current role FOLLOWER
W20260503 19:55:31.089962 822 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:47586: Illegal state: replica 6d99e4f4d5ca48e0bdb54daf8361c5e8 is not leader of this config: current role FOLLOWER
W20260503 19:55:31.092051 822 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:47586: Illegal state: replica 6d99e4f4d5ca48e0bdb54daf8361c5e8 is not leader of this config: current role FOLLOWER
W20260503 19:55:31.119745 822 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:47586: Illegal state: replica 6d99e4f4d5ca48e0bdb54daf8361c5e8 is not leader of this config: current role FOLLOWER
W20260503 19:55:31.159725 691 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34946: Illegal state: replica a1219433b66444d091420ceeab5092ef is not leader of this config: current role FOLLOWER
W20260503 19:55:31.162918 691 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34946: Illegal state: replica a1219433b66444d091420ceeab5092ef is not leader of this config: current role FOLLOWER
I20260503 19:55:31.172724 1036 raft_consensus.cc:493] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0e52aa88a17542609e84f0c09fb85d87)
I20260503 19:55:31.173007 1036 raft_consensus.cc:515] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:31.173620 1036 leader_election.cc:290] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847), 6d99e4f4d5ca48e0bdb54daf8361c5e8 (127.0.105.3:35005)
I20260503 19:55:31.174220 862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2bf53fe00c2417b872db2ecd4ede593" candidate_uuid: "a1219433b66444d091420ceeab5092ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 162 } } ignore_live_leader: false dest_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" is_pre_election: true
I20260503 19:55:31.174523 862 raft_consensus.cc:2468] T d2bf53fe00c2417b872db2ecd4ede593 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1219433b66444d091420ceeab5092ef in term 1.
I20260503 19:55:31.175019 666 leader_election.cc:304] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d99e4f4d5ca48e0bdb54daf8361c5e8, a1219433b66444d091420ceeab5092ef; no voters:
I20260503 19:55:31.175302 1036 raft_consensus.cc:2804] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 19:55:31.175443 1036 raft_consensus.cc:493] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0e52aa88a17542609e84f0c09fb85d87)
I20260503 19:55:31.175555 1036 raft_consensus.cc:3060] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef [term 1 FOLLOWER]: Advancing to term 2
W20260503 19:55:31.175751 665 leader_election.cc:336] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111)
I20260503 19:55:31.179373 1036 raft_consensus.cc:515] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:31.180289 1036 leader_election.cc:290] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef [CANDIDATE]: Term 2 election: Requested vote from peers 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847), 6d99e4f4d5ca48e0bdb54daf8361c5e8 (127.0.105.3:35005)
I20260503 19:55:31.180850 860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2bf53fe00c2417b872db2ecd4ede593" candidate_uuid: "a1219433b66444d091420ceeab5092ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 162 } } ignore_live_leader: false dest_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8"
I20260503 19:55:31.181164 860 raft_consensus.cc:3060] T d2bf53fe00c2417b872db2ecd4ede593 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 1 FOLLOWER]: Advancing to term 2
W20260503 19:55:31.182301 665 leader_election.cc:336] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111)
I20260503 19:55:31.183540 860 raft_consensus.cc:2468] T d2bf53fe00c2417b872db2ecd4ede593 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1219433b66444d091420ceeab5092ef in term 2.
I20260503 19:55:31.184134 666 leader_election.cc:304] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d99e4f4d5ca48e0bdb54daf8361c5e8, a1219433b66444d091420ceeab5092ef; no voters: 0e52aa88a17542609e84f0c09fb85d87
I20260503 19:55:31.184518 1177 raft_consensus.cc:2804] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef [term 2 FOLLOWER]: Leader election won for term 2
I20260503 19:55:31.184939 1177 raft_consensus.cc:697] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef [term 2 LEADER]: Becoming Leader. State: Replica: a1219433b66444d091420ceeab5092ef, State: Running, Role: LEADER
I20260503 19:55:31.185281 1177 consensus_queue.cc:237] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 160, Committed index: 160, Last appended: 1.162, Last appended by leader: 162, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:31.188272 450 catalog_manager.cc:5671] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef reported cstate change: term changed from 1 to 2, leader changed from 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1) to a1219433b66444d091420ceeab5092ef (127.0.105.2). New cstate: current_term: 2 leader_uuid: "a1219433b66444d091420ceeab5092ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } health_report { overall_health: UNKNOWN } } }
I20260503 19:55:31.192610 860 raft_consensus.cc:1275] T d2bf53fe00c2417b872db2ecd4ede593 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 2 FOLLOWER]: Refusing update from remote peer a1219433b66444d091420ceeab5092ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 161. Preceding OpId from leader: term: 2 index: 164. (index mismatch)
I20260503 19:55:31.193379 1177 consensus_queue.cc:1048] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 163, Last known committed idx: 160, Time since last communication: 0.000s
W20260503 19:55:31.194144 822 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:47586: Illegal state: replica 6d99e4f4d5ca48e0bdb54daf8361c5e8 is not leader of this config: current role FOLLOWER
W20260503 19:55:31.194406 665 consensus_peers.cc:597] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260503 19:55:31.198969 822 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:47586: Illegal state: replica 6d99e4f4d5ca48e0bdb54daf8361c5e8 is not leader of this config: current role FOLLOWER
I20260503 19:55:31.207583 1195 mvcc.cc:204] Tried to move back new op lower bound from 7282024985355280384 to 7282024985337012224. Current Snapshot: MvccSnapshot[applied={T|T < 7282024985355280384 or (T in {7282024985355280384})}]
W20260503 19:55:31.209167 822 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:47586: Illegal state: replica 6d99e4f4d5ca48e0bdb54daf8361c5e8 is not leader of this config: current role FOLLOWER
W20260503 19:55:31.450598 665 consensus_peers.cc:597] T ecf4b80ba8714f24a49387dc8bbe2da3 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260503 19:55:31.509936 796 consensus_peers.cc:597] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260503 19:55:31.513087 665 consensus_peers.cc:597] T 4d80fc29b7a64074b4a2ce4003054d1a P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260503 19:55:31.514175 665 consensus_peers.cc:597] T a860805e8df84220ae4be7d3279b75f1 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260503 19:55:31.558298 796 consensus_peers.cc:597] T 1c99d75cb2be4439a1610c0de343d73a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260503 19:55:31.719960 665 consensus_peers.cc:597] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260503 19:55:31.942023 665 consensus_peers.cc:597] T ecf4b80ba8714f24a49387dc8bbe2da3 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260503 19:55:32.010005 796 consensus_peers.cc:597] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260503 19:55:32.037988 665 consensus_peers.cc:597] T a860805e8df84220ae4be7d3279b75f1 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260503 19:55:32.075425 665 consensus_peers.cc:597] T 4d80fc29b7a64074b4a2ce4003054d1a P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260503 19:55:32.111804 796 consensus_peers.cc:597] T 1c99d75cb2be4439a1610c0de343d73a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260503 19:55:32.259356 1177 consensus_queue.cc:579] T ecf4b80ba8714f24a49387dc8bbe2da3 P a1219433b66444d091420ceeab5092ef [LEADER]: Leader has been unable to successfully communicate with peer 0e52aa88a17542609e84f0c09fb85d87 for more than 2 seconds (2.006s)
W20260503 19:55:32.263737 665 consensus_peers.cc:597] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260503 19:55:32.467864 665 consensus_peers.cc:597] T ecf4b80ba8714f24a49387dc8bbe2da3 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260503 19:55:32.539307 1201 consensus_queue.cc:579] T 4d80fc29b7a64074b4a2ce4003054d1a P a1219433b66444d091420ceeab5092ef [LEADER]: Leader has been unable to successfully communicate with peer 0e52aa88a17542609e84f0c09fb85d87 for more than 2 seconds (2.054s)
I20260503 19:55:32.563578 1006 consensus_queue.cc:579] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [LEADER]: Leader has been unable to successfully communicate with peer 0e52aa88a17542609e84f0c09fb85d87 for more than 2 seconds (2.088s)
W20260503 19:55:32.583900 796 consensus_peers.cc:597] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260503 19:55:32.595530 1006 consensus_queue.cc:579] T 1c99d75cb2be4439a1610c0de343d73a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [LEADER]: Leader has been unable to successfully communicate with peer 0e52aa88a17542609e84f0c09fb85d87 for more than 2 seconds (2.103s)
W20260503 19:55:32.606204 796 consensus_peers.cc:597] T 1c99d75cb2be4439a1610c0de343d73a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260503 19:55:32.622179 1201 consensus_queue.cc:579] T a860805e8df84220ae4be7d3279b75f1 P a1219433b66444d091420ceeab5092ef [LEADER]: Leader has been unable to successfully communicate with peer 0e52aa88a17542609e84f0c09fb85d87 for more than 2 seconds (2.138s)
W20260503 19:55:32.647749 665 consensus_peers.cc:597] T a860805e8df84220ae4be7d3279b75f1 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260503 19:55:32.653999 665 consensus_peers.cc:597] T 4d80fc29b7a64074b4a2ce4003054d1a P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260503 19:55:32.840615 665 consensus_peers.cc:597] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260503 19:55:32.984292 665 consensus_peers.cc:597] T ecf4b80ba8714f24a49387dc8bbe2da3 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260503 19:55:33.093119 796 consensus_peers.cc:597] T 1c99d75cb2be4439a1610c0de343d73a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260503 19:55:33.157881 665 consensus_peers.cc:597] T a860805e8df84220ae4be7d3279b75f1 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260503 19:55:33.160578 796 consensus_peers.cc:597] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260503 19:55:33.219600 665 consensus_peers.cc:597] T 4d80fc29b7a64074b4a2ce4003054d1a P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260503 19:55:33.261305 1205 consensus_queue.cc:579] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef [LEADER]: Leader has been unable to successfully communicate with peer 0e52aa88a17542609e84f0c09fb85d87 for more than 2 seconds (2.076s)
W20260503 19:55:33.391812 665 consensus_peers.cc:597] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260503 19:55:33.484073 665 consensus_peers.cc:597] T ecf4b80ba8714f24a49387dc8bbe2da3 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260503 19:55:33.596520 796 consensus_peers.cc:597] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260503 19:55:33.617286 796 consensus_peers.cc:597] T 1c99d75cb2be4439a1610c0de343d73a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260503 19:55:33.691322 665 consensus_peers.cc:597] T a860805e8df84220ae4be7d3279b75f1 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260503 19:55:33.697098 420 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-task4vf7p3/build/asan/bin/kudu pid 428
I20260503 19:55:33.699122 489 generic_service.cc:196] Checking for leaks (request via RPC)
W20260503 19:55:33.770255 665 consensus_peers.cc:597] T 4d80fc29b7a64074b4a2ce4003054d1a P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260503 19:55:33.949507 665 consensus_peers.cc:597] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260503 19:55:34.002758 665 consensus_peers.cc:597] T ecf4b80ba8714f24a49387dc8bbe2da3 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260503 19:55:34.115401 796 consensus_peers.cc:597] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260503 19:55:34.132012 420 external_mini_cluster.cc:1658] Killing /tmp/dist-test-task4vf7p3/build/asan/bin/kudu with pid 428
W20260503 19:55:34.156690 796 consensus_peers.cc:597] T 1c99d75cb2be4439a1610c0de343d73a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260503 19:55:34.203171 665 consensus_peers.cc:597] T a860805e8df84220ae4be7d3279b75f1 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260503 19:55:34.216004 420 external_mini_cluster.cc:1366] Running /tmp/dist-test-task4vf7p3/build/asan/bin/kudu
/tmp/dist-test-task4vf7p3/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.105.62:45771
--webserver_interface=127.0.105.62
--webserver_port=41273
--builtin_ntp_servers=127.0.105.20:45495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.105.62:45771 with env {}
W20260503 19:55:34.269928 776 heartbeater.cc:646] Failed to heartbeat to 127.0.105.62:45771 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.0.105.62:45771: connect: Connection refused (error 111)
W20260503 19:55:34.323345 665 consensus_peers.cc:597] T 4d80fc29b7a64074b4a2ce4003054d1a P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260503 19:55:34.458448 665 consensus_peers.cc:597] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260503 19:55:34.489708 665 consensus_peers.cc:597] T ecf4b80ba8714f24a49387dc8bbe2da3 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260503 19:55:34.605814 907 heartbeater.cc:646] Failed to heartbeat to 127.0.105.62:45771 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.0.105.62:45771: connect: Connection refused (error 111)
W20260503 19:55:34.608319 796 consensus_peers.cc:597] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260503 19:55:34.655754 796 consensus_peers.cc:597] T 1c99d75cb2be4439a1610c0de343d73a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260503 19:55:34.736306 1167 heartbeater.cc:646] Failed to heartbeat to 127.0.105.62:45771 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.0.105.62:45771: connect: Connection refused (error 111)
W20260503 19:55:34.756489 665 consensus_peers.cc:597] T a860805e8df84220ae4be7d3279b75f1 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260503 19:55:34.931783 665 consensus_peers.cc:597] T 4d80fc29b7a64074b4a2ce4003054d1a P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260503 19:55:35.024704 665 consensus_peers.cc:597] T ecf4b80ba8714f24a49387dc8bbe2da3 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260503 19:55:35.025032 665 consensus_peers.cc:597] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260503 19:55:35.098606 1228 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260503 19:55:35.099151 1228 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260503 19:55:35.099334 1228 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260503 19:55:35.115056 1228 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260503 19:55:35.115197 1228 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260503 19:55:35.115310 1228 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260503 19:55:35.115430 1228 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
W20260503 19:55:35.160116 796 consensus_peers.cc:597] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260503 19:55:35.161736 1228 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.105.20:45495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.105.62:45771
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.105.62:45771
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.105.62
--webserver_port=41273
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 0ba7f54e15c9f673bf3e350f30b8d5f1a4037b79
build type FASTDEBUG
built by None at 03 May 2026 19:43:25 UTC on bdcb31816ec0
build id 11730
ASAN enabled
I20260503 19:55:35.164448 1228 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260503 19:55:35.167276 1228 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260503 19:55:35.199252 796 consensus_peers.cc:597] T 1c99d75cb2be4439a1610c0de343d73a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260503 19:55:35.220913 1236 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 19:55:35.249382 665 consensus_peers.cc:597] T a860805e8df84220ae4be7d3279b75f1 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260503 19:55:35.372578 1238 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260503 19:55:35.401825 1228 server_base.cc:1061] running on GCE node
W20260503 19:55:35.408053 1241 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260503 19:55:35.415534 1228 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260503 19:55:35.418164 1228 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260503 19:55:35.431416 1228 hybrid_clock.cc:648] HybridClock initialized: now 1777838135431310 us; error 69 us; skew 500 ppm
I20260503 19:55:35.433411 1228 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260503 19:55:35.452414 1228 webserver.cc:492] Webserver started at http://127.0.105.62:41273/ using document root <none> and password file <none>
I20260503 19:55:35.454141 1228 fs_manager.cc:362] Metadata directory not provided
I20260503 19:55:35.454457 1228 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
W20260503 19:55:35.540319 665 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111) [suppressed 183 similar messages]
I20260503 19:55:35.547045 1228 fs_manager.cc:714] Time spent opening directory manager: real 0.089s user 0.008s sys 0.020s
W20260503 19:55:35.559561 665 consensus_peers.cc:597] T ecf4b80ba8714f24a49387dc8bbe2da3 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260503 19:55:35.559777 665 consensus_peers.cc:597] T 4d80fc29b7a64074b4a2ce4003054d1a P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260503 19:55:35.584736 1246 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260503 19:55:35.593706 1228 fs_manager.cc:730] Time spent opening block manager: real 0.028s user 0.008s sys 0.004s
I20260503 19:55:35.593974 1228 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/master-0/data,/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/master-0/wal
uuid: "0cfd85cd0cf5439fbdd92ac67a0587df"
format_stamp: "Formatted at 2026-05-03 19:55:21 on dist-test-slave-nzs1"
I20260503 19:55:35.595609 1228 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260503 19:55:35.611027 796 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111) [suppressed 99 similar messages]
W20260503 19:55:35.613397 796 consensus_peers.cc:597] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260503 19:55:35.630522 665 consensus_peers.cc:597] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260503 19:55:35.668242 1228 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260503 19:55:35.672749 1228 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260503 19:55:35.674340 1228 kserver.cc:163] Server-wide thread pool size limit: 3276
W20260503 19:55:35.733332 796 consensus_peers.cc:597] T 1c99d75cb2be4439a1610c0de343d73a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260503 19:55:35.851150 665 consensus_peers.cc:597] T a860805e8df84220ae4be7d3279b75f1 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260503 19:55:36.032197 665 consensus_peers.cc:597] T 4d80fc29b7a64074b4a2ce4003054d1a P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260503 19:55:36.127450 665 consensus_peers.cc:597] T ecf4b80ba8714f24a49387dc8bbe2da3 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260503 19:55:36.198046 796 consensus_peers.cc:597] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260503 19:55:36.198465 665 consensus_peers.cc:597] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260503 19:55:36.322019 796 consensus_peers.cc:597] T 1c99d75cb2be4439a1610c0de343d73a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260503 19:55:36.414085 665 consensus_peers.cc:597] T a860805e8df84220ae4be7d3279b75f1 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260503 19:55:36.584009 1228 rpc_server.cc:307] RPC server started. Bound to: 127.0.105.62:45771
I20260503 19:55:36.584026 1304 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.105.62:45771 every 8 connection(s)
I20260503 19:55:36.586642 1228 server_base.cc:1193] Dumped server information to /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/master-0/data/info.pb
I20260503 19:55:36.588843 420 external_mini_cluster.cc:1428] Started /tmp/dist-test-task4vf7p3/build/asan/bin/kudu as pid 1228
I20260503 19:55:36.610532 1305 sys_catalog.cc:263] Verifying existing consensus state
I20260503 19:55:36.616374 1305 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0cfd85cd0cf5439fbdd92ac67a0587df: Bootstrap starting.
W20260503 19:55:36.652830 665 consensus_peers.cc:597] T 4d80fc29b7a64074b4a2ce4003054d1a P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260503 19:55:36.653568 1305 log.cc:826] T 00000000000000000000000000000000 P 0cfd85cd0cf5439fbdd92ac67a0587df: Log is configured to *not* fsync() on all Append() calls
I20260503 19:55:36.665896 907 heartbeater.cc:344] Connected to a master server at 127.0.105.62:45771
I20260503 19:55:36.689529 1305 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0cfd85cd0cf5439fbdd92ac67a0587df: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=11 ignored=0} mutations{seen=13 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260503 19:55:36.690874 1305 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0cfd85cd0cf5439fbdd92ac67a0587df: Bootstrap complete.
I20260503 19:55:36.702049 1305 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0cfd85cd0cf5439fbdd92ac67a0587df [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0cfd85cd0cf5439fbdd92ac67a0587df" member_type: VOTER last_known_addr { host: "127.0.105.62" port: 45771 } }
I20260503 19:55:36.703815 1305 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0cfd85cd0cf5439fbdd92ac67a0587df [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cfd85cd0cf5439fbdd92ac67a0587df, State: Initialized, Role: FOLLOWER
I20260503 19:55:36.706367 1305 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0cfd85cd0cf5439fbdd92ac67a0587df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 1.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0cfd85cd0cf5439fbdd92ac67a0587df" member_type: VOTER last_known_addr { host: "127.0.105.62" port: 45771 } }
I20260503 19:55:36.707073 1305 raft_consensus.cc:399] T 00000000000000000000000000000000 P 0cfd85cd0cf5439fbdd92ac67a0587df [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260503 19:55:36.707397 1305 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0cfd85cd0cf5439fbdd92ac67a0587df [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260503 19:55:36.707772 1305 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0cfd85cd0cf5439fbdd92ac67a0587df [term 1 FOLLOWER]: Advancing to term 2
W20260503 19:55:36.712127 665 consensus_peers.cc:597] T ecf4b80ba8714f24a49387dc8bbe2da3 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260503 19:55:36.714183 1305 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0cfd85cd0cf5439fbdd92ac67a0587df [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0cfd85cd0cf5439fbdd92ac67a0587df" member_type: VOTER last_known_addr { host: "127.0.105.62" port: 45771 } }
I20260503 19:55:36.715008 1305 leader_election.cc:304] T 00000000000000000000000000000000 P 0cfd85cd0cf5439fbdd92ac67a0587df [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0cfd85cd0cf5439fbdd92ac67a0587df; no voters:
I20260503 19:55:36.732564 1305 leader_election.cc:290] T 00000000000000000000000000000000 P 0cfd85cd0cf5439fbdd92ac67a0587df [CANDIDATE]: Term 2 election: Requested vote from peers
I20260503 19:55:36.732705 1309 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0cfd85cd0cf5439fbdd92ac67a0587df [term 2 FOLLOWER]: Leader election won for term 2
I20260503 19:55:36.742756 1309 raft_consensus.cc:697] T 00000000000000000000000000000000 P 0cfd85cd0cf5439fbdd92ac67a0587df [term 2 LEADER]: Becoming Leader. State: Replica: 0cfd85cd0cf5439fbdd92ac67a0587df, State: Running, Role: LEADER
I20260503 19:55:36.743558 1309 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0cfd85cd0cf5439fbdd92ac67a0587df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 1.14, Last appended by leader: 14, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0cfd85cd0cf5439fbdd92ac67a0587df" member_type: VOTER last_known_addr { host: "127.0.105.62" port: 45771 } }
I20260503 19:55:36.748080 1305 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0cfd85cd0cf5439fbdd92ac67a0587df [sys.catalog]: configured and running, proceeding with master startup.
I20260503 19:55:36.755211 1311 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0cfd85cd0cf5439fbdd92ac67a0587df [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "0cfd85cd0cf5439fbdd92ac67a0587df" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0cfd85cd0cf5439fbdd92ac67a0587df" member_type: VOTER last_known_addr { host: "127.0.105.62" port: 45771 } } }
I20260503 19:55:36.756243 1311 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0cfd85cd0cf5439fbdd92ac67a0587df [sys.catalog]: This master's current role is: LEADER
I20260503 19:55:36.755959 1310 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0cfd85cd0cf5439fbdd92ac67a0587df [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0cfd85cd0cf5439fbdd92ac67a0587df. Latest consensus state: current_term: 2 leader_uuid: "0cfd85cd0cf5439fbdd92ac67a0587df" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0cfd85cd0cf5439fbdd92ac67a0587df" member_type: VOTER last_known_addr { host: "127.0.105.62" port: 45771 } } }
I20260503 19:55:36.756836 1310 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0cfd85cd0cf5439fbdd92ac67a0587df [sys.catalog]: This master's current role is: LEADER
I20260503 19:55:36.762503 1316 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260503 19:55:36.796033 1316 catalog_manager.cc:679] Loaded metadata for table test-workload [id=d7958170ae984d5b8940e4bbd6275af2]
I20260503 19:55:36.805644 1316 tablet_loader.cc:96] loaded metadata for tablet 1c99d75cb2be4439a1610c0de343d73a (table test-workload [id=d7958170ae984d5b8940e4bbd6275af2])
W20260503 19:55:36.813766 796 consensus_peers.cc:597] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260503 19:55:36.817065 1316 tablet_loader.cc:96] loaded metadata for tablet 3983c88812214bc0bfaaa35c08c38875 (table test-workload [id=d7958170ae984d5b8940e4bbd6275af2])
I20260503 19:55:36.818315 1316 tablet_loader.cc:96] loaded metadata for tablet 4d80fc29b7a64074b4a2ce4003054d1a (table test-workload [id=d7958170ae984d5b8940e4bbd6275af2])
I20260503 19:55:36.819835 1316 tablet_loader.cc:96] loaded metadata for tablet a860805e8df84220ae4be7d3279b75f1 (table test-workload [id=d7958170ae984d5b8940e4bbd6275af2])
I20260503 19:55:36.821295 1316 tablet_loader.cc:96] loaded metadata for tablet d2bf53fe00c2417b872db2ecd4ede593 (table test-workload [id=d7958170ae984d5b8940e4bbd6275af2])
I20260503 19:55:36.828210 1316 tablet_loader.cc:96] loaded metadata for tablet ecf4b80ba8714f24a49387dc8bbe2da3 (table test-workload [id=d7958170ae984d5b8940e4bbd6275af2])
I20260503 19:55:36.832093 1316 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260503 19:55:36.835764 1316 catalog_manager.cc:1269] Loaded cluster ID: 61d4022c2ac24effb519232b53791738
I20260503 19:55:36.837450 1316 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
W20260503 19:55:36.843760 665 consensus_peers.cc:597] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260503 19:55:36.849252 1316 catalog_manager.cc:1514] Loading token signing keys...
I20260503 19:55:36.853315 1316 catalog_manager.cc:6055] T 00000000000000000000000000000000 P 0cfd85cd0cf5439fbdd92ac67a0587df: Loaded TSK: 0
I20260503 19:55:36.856001 1316 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260503 19:55:36.869212 1167 heartbeater.cc:344] Connected to a master server at 127.0.105.62:45771
W20260503 19:55:36.891389 796 consensus_peers.cc:597] T 1c99d75cb2be4439a1610c0de343d73a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260503 19:55:36.979951 665 consensus_peers.cc:597] T a860805e8df84220ae4be7d3279b75f1 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260503 19:55:37.108543 665 consensus_peers.cc:597] T 4d80fc29b7a64074b4a2ce4003054d1a P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260503 19:55:37.237138 665 consensus_peers.cc:597] T ecf4b80ba8714f24a49387dc8bbe2da3 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260503 19:55:37.285534 776 heartbeater.cc:344] Connected to a master server at 127.0.105.62:45771
I20260503 19:55:37.289268 1266 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "a1219433b66444d091420ceeab5092ef" instance_seqno: 1777838123640585) as {username='slave'} at 127.0.105.2:36915; Asking this server to re-register.
I20260503 19:55:37.290545 776 heartbeater.cc:461] Registering TS with master...
I20260503 19:55:37.290867 776 heartbeater.cc:507] Master 127.0.105.62:45771 requested a full tablet report, sending...
I20260503 19:55:37.294595 1266 ts_manager.cc:194] Registered new tserver with Master: a1219433b66444d091420ceeab5092ef (127.0.105.2:38837)
W20260503 19:55:37.363229 796 consensus_peers.cc:597] T 1c99d75cb2be4439a1610c0de343d73a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260503 19:55:37.365087 665 consensus_peers.cc:597] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260503 19:55:37.412680 796 consensus_peers.cc:597] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260503 19:55:37.601293 665 consensus_peers.cc:597] T a860805e8df84220ae4be7d3279b75f1 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260503 19:55:37.625164 665 consensus_peers.cc:597] T 4d80fc29b7a64074b4a2ce4003054d1a P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260503 19:55:37.686530 1266 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" instance_seqno: 1777838124196322) as {username='slave'} at 127.0.105.3:35015; Asking this server to re-register.
I20260503 19:55:37.687624 907 heartbeater.cc:461] Registering TS with master...
I20260503 19:55:37.687942 907 heartbeater.cc:507] Master 127.0.105.62:45771 requested a full tablet report, sending...
I20260503 19:55:37.689751 1266 ts_manager.cc:194] Registered new tserver with Master: 6d99e4f4d5ca48e0bdb54daf8361c5e8 (127.0.105.3:35005)
W20260503 19:55:37.734022 665 consensus_peers.cc:597] T ecf4b80ba8714f24a49387dc8bbe2da3 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
I20260503 19:55:37.872591 1266 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "6ee23f35facc4d309ca4099163d9ccb2" instance_seqno: 1777838129144449) as {username='slave'} at 127.0.105.4:60427; Asking this server to re-register.
I20260503 19:55:37.873312 1167 heartbeater.cc:461] Registering TS with master...
I20260503 19:55:37.873607 1167 heartbeater.cc:507] Master 127.0.105.62:45771 requested a full tablet report, sending...
I20260503 19:55:37.875286 1266 ts_manager.cc:194] Registered new tserver with Master: 6ee23f35facc4d309ca4099163d9ccb2 (127.0.105.4:36991)
W20260503 19:55:37.903194 796 consensus_peers.cc:597] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260503 19:55:37.935132 796 consensus_peers.cc:597] T 1c99d75cb2be4439a1610c0de343d73a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260503 19:55:37.949678 665 consensus_peers.cc:597] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260503 19:55:38.185869 665 consensus_peers.cc:597] T a860805e8df84220ae4be7d3279b75f1 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260503 19:55:38.223115 665 consensus_peers.cc:597] T 4d80fc29b7a64074b4a2ce4003054d1a P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260503 19:55:38.258124 665 consensus_peers.cc:597] T ecf4b80ba8714f24a49387dc8bbe2da3 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260503 19:55:38.433323 796 consensus_peers.cc:597] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260503 19:55:38.444015 796 consensus_peers.cc:597] T 1c99d75cb2be4439a1610c0de343d73a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260503 19:55:38.554464 665 consensus_peers.cc:597] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260503 19:55:38.688076 665 consensus_peers.cc:597] T a860805e8df84220ae4be7d3279b75f1 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260503 19:55:38.742465 665 consensus_peers.cc:597] T 4d80fc29b7a64074b4a2ce4003054d1a P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260503 19:55:38.823861 665 consensus_peers.cc:597] T ecf4b80ba8714f24a49387dc8bbe2da3 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 81: this message will repeat every 5th retry.
W20260503 19:55:38.972535 796 consensus_peers.cc:597] T 1c99d75cb2be4439a1610c0de343d73a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 81: this message will repeat every 5th retry.
W20260503 19:55:38.998235 796 consensus_peers.cc:597] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 81: this message will repeat every 5th retry.
W20260503 19:55:39.048941 665 consensus_peers.cc:597] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260503 19:55:39.256481 665 consensus_peers.cc:597] T a860805e8df84220ae4be7d3279b75f1 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 81: this message will repeat every 5th retry.
W20260503 19:55:39.359622 665 consensus_peers.cc:597] T ecf4b80ba8714f24a49387dc8bbe2da3 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 86: this message will repeat every 5th retry.
W20260503 19:55:39.407086 665 consensus_peers.cc:597] T 4d80fc29b7a64074b4a2ce4003054d1a P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 81: this message will repeat every 5th retry.
W20260503 19:55:39.581315 796 consensus_peers.cc:597] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 86: this message will repeat every 5th retry.
W20260503 19:55:39.593526 796 consensus_peers.cc:597] T 1c99d75cb2be4439a1610c0de343d73a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 86: this message will repeat every 5th retry.
W20260503 19:55:39.598389 665 consensus_peers.cc:597] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
I20260503 19:55:39.732643 420 external_mini_cluster.cc:1366] Running /tmp/dist-test-task4vf7p3/build/asan/bin/kudu
/tmp/dist-test-task4vf7p3/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.105.1:37847
--local_ip_for_outbound_sockets=127.0.105.1
--tserver_master_addrs=127.0.105.62:45771
--webserver_port=45969
--webserver_interface=127.0.105.1
--builtin_ntp_servers=127.0.105.20:45495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--follower_unavailable_considered_failed_sec=2
--enable_log_gc=false with env {}
W20260503 19:55:39.907227 665 consensus_peers.cc:597] T a860805e8df84220ae4be7d3279b75f1 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 86: this message will repeat every 5th retry.
W20260503 19:55:39.952368 665 consensus_peers.cc:597] T ecf4b80ba8714f24a49387dc8bbe2da3 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 91: this message will repeat every 5th retry.
W20260503 19:55:39.985790 796 consensus_peers.cc:597] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 91: this message will repeat every 5th retry.
W20260503 19:55:40.131551 665 consensus_peers.cc:597] T 4d80fc29b7a64074b4a2ce4003054d1a P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 86: this message will repeat every 5th retry.
W20260503 19:55:40.152146 796 consensus_peers.cc:597] T 1c99d75cb2be4439a1610c0de343d73a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 91: this message will repeat every 5th retry.
W20260503 19:55:40.279119 665 consensus_peers.cc:597] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 81: this message will repeat every 5th retry.
W20260503 19:55:40.493376 665 consensus_peers.cc:597] T ecf4b80ba8714f24a49387dc8bbe2da3 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 96: this message will repeat every 5th retry.
W20260503 19:55:40.498097 665 consensus_peers.cc:597] T a860805e8df84220ae4be7d3279b75f1 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 91: this message will repeat every 5th retry.
W20260503 19:55:40.512924 1341 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260503 19:55:40.514071 1341 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260503 19:55:40.514323 1341 flags.cc:432] Enabled unsafe flag: --enable_log_gc=false
W20260503 19:55:40.514503 1341 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260503 19:55:40.532303 1341 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260503 19:55:40.532757 1341 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.105.1
W20260503 19:55:40.542933 665 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111) [suppressed 176 similar messages]
I20260503 19:55:40.554679 1341 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.105.20:45495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=2
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.105.1:37847
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.105.1
--webserver_port=45969
--enable_log_gc=false
--tserver_master_addrs=127.0.105.62:45771
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.105.1
--log_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 0ba7f54e15c9f673bf3e350f30b8d5f1a4037b79
build type FASTDEBUG
built by None at 03 May 2026 19:43:25 UTC on bdcb31816ec0
build id 11730
ASAN enabled
I20260503 19:55:40.557376 1341 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260503 19:55:40.560597 1341 file_cache.cc:492] Constructed file cache file cache with capacity 419430
E20260503 19:55:40.571128 1341 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260503 19:55:40.585701 1346 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 19:55:40.611251 796 consensus_peers.cc:597] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 96: this message will repeat every 5th retry.
W20260503 19:55:40.648038 1347 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 19:55:40.680547 1350 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260503 19:55:40.685492 1341 server_base.cc:1061] running on GCE node
I20260503 19:55:40.687285 1341 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
W20260503 19:55:40.692127 796 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111) [suppressed 91 similar messages]
W20260503 19:55:40.724259 665 consensus_peers.cc:597] T 4d80fc29b7a64074b4a2ce4003054d1a P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 91: this message will repeat every 5th retry.
I20260503 19:55:40.735076 1341 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260503 19:55:40.737066 1341 hybrid_clock.cc:648] HybridClock initialized: now 1777838140736984 us; error 90 us; skew 500 ppm
I20260503 19:55:40.737581 1341 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260503 19:55:40.816852 1341 webserver.cc:492] Webserver started at http://127.0.105.1:45969/ using document root <none> and password file <none>
I20260503 19:55:40.819010 1341 fs_manager.cc:362] Metadata directory not provided
I20260503 19:55:40.819236 1341 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
W20260503 19:55:40.835930 796 consensus_peers.cc:597] T 1c99d75cb2be4439a1610c0de343d73a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 96: this message will repeat every 5th retry.
I20260503 19:55:40.844774 1341 fs_manager.cc:714] Time spent opening directory manager: real 0.019s user 0.007s sys 0.009s
I20260503 19:55:40.878417 1355 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260503 19:55:40.882650 1341 fs_manager.cc:730] Time spent opening block manager: real 0.033s user 0.004s sys 0.004s
I20260503 19:55:40.883281 1341 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-0/data,/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-0/wal
uuid: "0e52aa88a17542609e84f0c09fb85d87"
format_stamp: "Formatted at 2026-05-03 19:55:22 on dist-test-slave-nzs1"
I20260503 19:55:40.884608 1341 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260503 19:55:40.957077 665 consensus_peers.cc:597] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 86: this message will repeat every 5th retry.
I20260503 19:55:40.968772 1341 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260503 19:55:40.970201 1341 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260503 19:55:40.970655 1341 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260503 19:55:40.989858 1341 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
W20260503 19:55:41.090261 665 consensus_peers.cc:597] T ecf4b80ba8714f24a49387dc8bbe2da3 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 101: this message will repeat every 5th retry.
I20260503 19:55:41.119411 1362 ts_tablet_manager.cc:548] Loading tablet metadata (0/6 complete)
I20260503 19:55:41.161127 1341 ts_tablet_manager.cc:585] Loaded tablet metadata (6 total tablets, 6 live tablets)
I20260503 19:55:41.161267 1341 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.053s user 0.006s sys 0.004s
I20260503 19:55:41.161423 1341 ts_tablet_manager.cc:600] Registering tablets (0/6 complete)
W20260503 19:55:41.169648 796 consensus_peers.cc:597] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 101: this message will repeat every 5th retry.
I20260503 19:55:41.175282 1362 tablet_bootstrap.cc:492] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87: Bootstrap starting.
I20260503 19:55:41.197445 1341 ts_tablet_manager.cc:616] Registered 6 tablets
I20260503 19:55:41.197921 1341 ts_tablet_manager.cc:595] Time spent register tablets: real 0.037s user 0.018s sys 0.001s
W20260503 19:55:41.271134 665 consensus_peers.cc:597] T a860805e8df84220ae4be7d3279b75f1 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 96: this message will repeat every 5th retry.
W20260503 19:55:41.303424 796 consensus_peers.cc:597] T 1c99d75cb2be4439a1610c0de343d73a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 101: this message will repeat every 5th retry.
I20260503 19:55:41.421126 1362 log.cc:826] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87: Log is configured to *not* fsync() on all Append() calls
W20260503 19:55:41.465368 666 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.3:35005, user_credentials={real_user=slave}} blocked reactor thread for 87057.5us
W20260503 19:55:41.516428 665 consensus_peers.cc:597] T 4d80fc29b7a64074b4a2ce4003054d1a P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 96: this message will repeat every 5th retry.
W20260503 19:55:41.540656 665 consensus_peers.cc:597] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 91: this message will repeat every 5th retry.
W20260503 19:55:41.705593 665 consensus_peers.cc:597] T ecf4b80ba8714f24a49387dc8bbe2da3 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 106: this message will repeat every 5th retry.
I20260503 19:55:42.010846 1362 tablet_bootstrap.cc:492] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87: Bootstrap replayed 1/1 log segments. Stats: ops{read=159 overwritten=0 applied=159 ignored=0} inserts{seen=1269 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260503 19:55:42.011751 1362 tablet_bootstrap.cc:492] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87: Bootstrap complete.
I20260503 19:55:42.018927 1362 ts_tablet_manager.cc:1403] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87: Time spent bootstrapping tablet: real 0.844s user 0.385s sys 0.037s
I20260503 19:55:42.026826 1362 raft_consensus.cc:359] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:42.039916 1362 raft_consensus.cc:740] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e52aa88a17542609e84f0c09fb85d87, State: Initialized, Role: FOLLOWER
I20260503 19:55:42.041633 1362 consensus_queue.cc:260] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 159, Last appended: 1.159, Last appended by leader: 159, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
W20260503 19:55:42.060282 665 consensus_peers.cc:597] T a860805e8df84220ae4be7d3279b75f1 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 101: this message will repeat every 5th retry.
W20260503 19:55:42.131119 796 consensus_peers.cc:597] T 1c99d75cb2be4439a1610c0de343d73a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 106: this message will repeat every 5th retry.
W20260503 19:55:42.131304 796 consensus_peers.cc:597] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 106: this message will repeat every 5th retry.
I20260503 19:55:42.162168 1362 ts_tablet_manager.cc:1434] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87: Time spent starting tablet: real 0.143s user 0.025s sys 0.018s
I20260503 19:55:42.162691 1362 tablet_bootstrap.cc:492] T ecf4b80ba8714f24a49387dc8bbe2da3 P 0e52aa88a17542609e84f0c09fb85d87: Bootstrap starting.
I20260503 19:55:42.286173 1411 raft_consensus.cc:493] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 19:55:42.286465 1411 raft_consensus.cc:515] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:42.304590 1411 leader_election.cc:290] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1219433b66444d091420ceeab5092ef (127.0.105.2:38837), 6d99e4f4d5ca48e0bdb54daf8361c5e8 (127.0.105.3:35005)
I20260503 19:55:42.361850 859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c99d75cb2be4439a1610c0de343d73a" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 159 } } ignore_live_leader: false dest_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" is_pre_election: true
I20260503 19:55:42.365422 731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c99d75cb2be4439a1610c0de343d73a" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 159 } } ignore_live_leader: false dest_uuid: "a1219433b66444d091420ceeab5092ef" is_pre_election: true
I20260503 19:55:42.367269 1358 leader_election.cc:304] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e52aa88a17542609e84f0c09fb85d87; no voters: 6d99e4f4d5ca48e0bdb54daf8361c5e8, a1219433b66444d091420ceeab5092ef
I20260503 19:55:42.368669 1411 raft_consensus.cc:2749] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260503 19:55:42.374943 665 consensus_peers.cc:597] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 96: this message will repeat every 5th retry.
I20260503 19:55:42.653795 1362 tablet_bootstrap.cc:492] T ecf4b80ba8714f24a49387dc8bbe2da3 P 0e52aa88a17542609e84f0c09fb85d87: Bootstrap replayed 1/1 log segments. Stats: ops{read=159 overwritten=0 applied=158 ignored=0} inserts{seen=1272 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260503 19:55:42.655330 1362 tablet_bootstrap.cc:492] T ecf4b80ba8714f24a49387dc8bbe2da3 P 0e52aa88a17542609e84f0c09fb85d87: Bootstrap complete.
I20260503 19:55:42.656962 1362 ts_tablet_manager.cc:1403] T ecf4b80ba8714f24a49387dc8bbe2da3 P 0e52aa88a17542609e84f0c09fb85d87: Time spent bootstrapping tablet: real 0.494s user 0.295s sys 0.043s
I20260503 19:55:42.658672 1362 raft_consensus.cc:359] T ecf4b80ba8714f24a49387dc8bbe2da3 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:42.733244 1362 raft_consensus.cc:740] T ecf4b80ba8714f24a49387dc8bbe2da3 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e52aa88a17542609e84f0c09fb85d87, State: Initialized, Role: FOLLOWER
I20260503 19:55:42.733767 1362 consensus_queue.cc:260] T ecf4b80ba8714f24a49387dc8bbe2da3 P 0e52aa88a17542609e84f0c09fb85d87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 158, Last appended: 1.159, Last appended by leader: 159, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:42.735277 1362 ts_tablet_manager.cc:1434] T ecf4b80ba8714f24a49387dc8bbe2da3 P 0e52aa88a17542609e84f0c09fb85d87: Time spent starting tablet: real 0.078s user 0.029s sys 0.038s
I20260503 19:55:42.735994 1362 tablet_bootstrap.cc:492] T a860805e8df84220ae4be7d3279b75f1 P 0e52aa88a17542609e84f0c09fb85d87: Bootstrap starting.
I20260503 19:55:42.772365 1411 raft_consensus.cc:493] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 19:55:42.772596 1411 raft_consensus.cc:515] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:42.773345 1411 leader_election.cc:290] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1219433b66444d091420ceeab5092ef (127.0.105.2:38837), 6d99e4f4d5ca48e0bdb54daf8361c5e8 (127.0.105.3:35005)
I20260503 19:55:42.775009 857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c99d75cb2be4439a1610c0de343d73a" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 159 } } ignore_live_leader: false dest_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" is_pre_election: true
I20260503 19:55:42.826345 729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c99d75cb2be4439a1610c0de343d73a" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 159 } } ignore_live_leader: false dest_uuid: "a1219433b66444d091420ceeab5092ef" is_pre_election: true
I20260503 19:55:42.827334 1356 leader_election.cc:304] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e52aa88a17542609e84f0c09fb85d87; no voters: 6d99e4f4d5ca48e0bdb54daf8361c5e8, a1219433b66444d091420ceeab5092ef
I20260503 19:55:42.828089 1411 raft_consensus.cc:2749] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260503 19:55:42.955783 796 consensus_peers.cc:597] T 1c99d75cb2be4439a1610c0de343d73a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 111: this message will repeat every 5th retry.
W20260503 19:55:42.967602 665 consensus_peers.cc:597] T a860805e8df84220ae4be7d3279b75f1 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 106: this message will repeat every 5th retry.
I20260503 19:55:42.998569 1411 raft_consensus.cc:493] T ecf4b80ba8714f24a49387dc8bbe2da3 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 19:55:42.998981 1411 raft_consensus.cc:515] T ecf4b80ba8714f24a49387dc8bbe2da3 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:43.000131 1411 leader_election.cc:290] T ecf4b80ba8714f24a49387dc8bbe2da3 P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1219433b66444d091420ceeab5092ef (127.0.105.2:38837), 6d99e4f4d5ca48e0bdb54daf8361c5e8 (127.0.105.3:35005)
I20260503 19:55:43.001649 731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf4b80ba8714f24a49387dc8bbe2da3" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 159 } } ignore_live_leader: false dest_uuid: "a1219433b66444d091420ceeab5092ef" is_pre_election: true
I20260503 19:55:43.002660 859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf4b80ba8714f24a49387dc8bbe2da3" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 159 } } ignore_live_leader: false dest_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" is_pre_election: true
I20260503 19:55:43.004159 1356 leader_election.cc:304] T ecf4b80ba8714f24a49387dc8bbe2da3 P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e52aa88a17542609e84f0c09fb85d87; no voters: 6d99e4f4d5ca48e0bdb54daf8361c5e8, a1219433b66444d091420ceeab5092ef
I20260503 19:55:43.004558 1411 raft_consensus.cc:2749] T ecf4b80ba8714f24a49387dc8bbe2da3 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260503 19:55:43.021674 665 consensus_peers.cc:597] T 4d80fc29b7a64074b4a2ce4003054d1a P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 101: this message will repeat every 5th retry.
W20260503 19:55:43.021919 665 consensus_peers.cc:597] T ecf4b80ba8714f24a49387dc8bbe2da3 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 111: this message will repeat every 5th retry.
W20260503 19:55:43.194705 796 consensus_peers.cc:597] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 111: this message will repeat every 5th retry.
I20260503 19:55:43.277498 1492 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.105.1:37847 every 8 connection(s)
I20260503 19:55:43.277872 1341 rpc_server.cc:307] RPC server started. Bound to: 127.0.105.1:37847
I20260503 19:55:43.280120 1341 server_base.cc:1193] Dumped server information to /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1777838121084241-420-0/minicluster-data/ts-0/data/info.pb
I20260503 19:55:43.285290 420 external_mini_cluster.cc:1428] Started /tmp/dist-test-task4vf7p3/build/asan/bin/kudu as pid 1341
I20260503 19:55:43.344731 1493 heartbeater.cc:344] Connected to a master server at 127.0.105.62:45771
I20260503 19:55:43.345230 1493 heartbeater.cc:461] Registering TS with master...
I20260503 19:55:43.346305 1493 heartbeater.cc:507] Master 127.0.105.62:45771 requested a full tablet report, sending...
I20260503 19:55:43.349900 1266 ts_manager.cc:194] Registered new tserver with Master: 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847)
I20260503 19:55:43.353556 1266 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.105.1:44507
I20260503 19:55:43.429141 1411 raft_consensus.cc:493] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 19:55:43.429455 1411 raft_consensus.cc:515] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:43.431764 729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c99d75cb2be4439a1610c0de343d73a" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 159 } } ignore_live_leader: false dest_uuid: "a1219433b66444d091420ceeab5092ef" is_pre_election: true
I20260503 19:55:43.432964 1411 leader_election.cc:290] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1219433b66444d091420ceeab5092ef (127.0.105.2:38837), 6d99e4f4d5ca48e0bdb54daf8361c5e8 (127.0.105.3:35005)
I20260503 19:55:43.434552 859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c99d75cb2be4439a1610c0de343d73a" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 159 } } ignore_live_leader: false dest_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" is_pre_election: true
I20260503 19:55:43.437619 1358 leader_election.cc:304] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e52aa88a17542609e84f0c09fb85d87; no voters: 6d99e4f4d5ca48e0bdb54daf8361c5e8, a1219433b66444d091420ceeab5092ef
I20260503 19:55:43.439599 1411 raft_consensus.cc:2749] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 19:55:43.439929 1411 raft_consensus.cc:493] T ecf4b80ba8714f24a49387dc8bbe2da3 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 19:55:43.440518 1411 raft_consensus.cc:515] T ecf4b80ba8714f24a49387dc8bbe2da3 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:43.442737 1411 leader_election.cc:290] T ecf4b80ba8714f24a49387dc8bbe2da3 P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1219433b66444d091420ceeab5092ef (127.0.105.2:38837), 6d99e4f4d5ca48e0bdb54daf8361c5e8 (127.0.105.3:35005)
I20260503 19:55:43.445694 729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf4b80ba8714f24a49387dc8bbe2da3" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 159 } } ignore_live_leader: false dest_uuid: "a1219433b66444d091420ceeab5092ef" is_pre_election: true
I20260503 19:55:43.470547 859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf4b80ba8714f24a49387dc8bbe2da3" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 159 } } ignore_live_leader: false dest_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" is_pre_election: true
I20260503 19:55:43.471823 1358 leader_election.cc:304] T ecf4b80ba8714f24a49387dc8bbe2da3 P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e52aa88a17542609e84f0c09fb85d87; no voters: 6d99e4f4d5ca48e0bdb54daf8361c5e8, a1219433b66444d091420ceeab5092ef
I20260503 19:55:43.473251 1500 raft_consensus.cc:2749] T ecf4b80ba8714f24a49387dc8bbe2da3 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260503 19:55:43.488562 665 consensus_peers.cc:597] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 101: this message will repeat every 5th retry.
I20260503 19:55:43.537352 1493 heartbeater.cc:499] Master 127.0.105.62:45771 was elected leader, sending a full tablet report...
I20260503 19:55:43.825675 1433 raft_consensus.cc:1217] T ecf4b80ba8714f24a49387dc8bbe2da3 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.158->[1.159-1.649] Dedup: 1.159->[1.160-1.649]
W20260503 19:55:44.170845 665 consensus_peers.cc:597] T 4d80fc29b7a64074b4a2ce4003054d1a P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 106: this message will repeat every 5th retry.
W20260503 19:55:44.340802 665 consensus_peers.cc:597] T a860805e8df84220ae4be7d3279b75f1 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 111: this message will repeat every 5th retry.
W20260503 19:55:44.355158 796 consensus_peers.cc:597] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 116: this message will repeat every 5th retry.
W20260503 19:55:45.019469 665 consensus_peers.cc:597] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 106: this message will repeat every 5th retry.
I20260503 19:55:45.469460 1435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.105.3:47337 (request call id 1) took 2133 ms. Trace:
I20260503 19:55:45.469673 1500 raft_consensus.cc:493] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d99e4f4d5ca48e0bdb54daf8361c5e8)
I20260503 19:55:45.470577 1500 raft_consensus.cc:515] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:45.477505 728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c99d75cb2be4439a1610c0de343d73a" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 646 } } ignore_live_leader: false dest_uuid: "a1219433b66444d091420ceeab5092ef" is_pre_election: true
I20260503 19:55:45.476922 1500 leader_election.cc:290] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1219433b66444d091420ceeab5092ef (127.0.105.2:38837), 6d99e4f4d5ca48e0bdb54daf8361c5e8 (127.0.105.3:35005)
I20260503 19:55:45.481341 862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c99d75cb2be4439a1610c0de343d73a" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 646 } } ignore_live_leader: false dest_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" is_pre_election: true
I20260503 19:55:45.500742 1358 leader_election.cc:304] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e52aa88a17542609e84f0c09fb85d87; no voters: 6d99e4f4d5ca48e0bdb54daf8361c5e8, a1219433b66444d091420ceeab5092ef
I20260503 19:55:45.506635 1500 raft_consensus.cc:2749] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 19:55:45.640664 1362 tablet_bootstrap.cc:492] T a860805e8df84220ae4be7d3279b75f1 P 0e52aa88a17542609e84f0c09fb85d87: Bootstrap replayed 1/1 log segments. Stats: ops{read=163 overwritten=0 applied=160 ignored=0} inserts{seen=1351 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 3 replicates
I20260503 19:55:45.642081 1362 tablet_bootstrap.cc:492] T a860805e8df84220ae4be7d3279b75f1 P 0e52aa88a17542609e84f0c09fb85d87: Bootstrap complete.
I20260503 19:55:45.697522 1362 ts_tablet_manager.cc:1403] T a860805e8df84220ae4be7d3279b75f1 P 0e52aa88a17542609e84f0c09fb85d87: Time spent bootstrapping tablet: real 2.908s user 0.448s sys 0.133s
I20260503 19:55:45.724391 1362 raft_consensus.cc:359] T a860805e8df84220ae4be7d3279b75f1 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Replica starting. Triggering 3 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } }
I20260503 19:55:45.786605 1362 raft_consensus.cc:740] T a860805e8df84220ae4be7d3279b75f1 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e52aa88a17542609e84f0c09fb85d87, State: Initialized, Role: FOLLOWER
I20260503 19:55:45.804049 1362 consensus_queue.cc:260] T a860805e8df84220ae4be7d3279b75f1 P 0e52aa88a17542609e84f0c09fb85d87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 160, Last appended: 1.163, Last appended by leader: 163, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } }
I20260503 19:55:45.829035 1362 ts_tablet_manager.cc:1434] T a860805e8df84220ae4be7d3279b75f1 P 0e52aa88a17542609e84f0c09fb85d87: Time spent starting tablet: real 0.109s user 0.006s sys 0.001s
I20260503 19:55:45.829557 1362 tablet_bootstrap.cc:492] T 3983c88812214bc0bfaaa35c08c38875 P 0e52aa88a17542609e84f0c09fb85d87: Bootstrap starting.
W20260503 19:55:45.841552 665 consensus_peers.cc:597] T 4d80fc29b7a64074b4a2ce4003054d1a P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 111: this message will repeat every 5th retry.
I20260503 19:55:45.943702 1500 raft_consensus.cc:493] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d99e4f4d5ca48e0bdb54daf8361c5e8)
I20260503 19:55:45.945319 1500 raft_consensus.cc:515] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:45.946080 1500 leader_election.cc:290] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1219433b66444d091420ceeab5092ef (127.0.105.2:38837), 6d99e4f4d5ca48e0bdb54daf8361c5e8 (127.0.105.3:35005)
I20260503 19:55:45.946844 729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c99d75cb2be4439a1610c0de343d73a" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 646 } } ignore_live_leader: false dest_uuid: "a1219433b66444d091420ceeab5092ef" is_pre_election: true
I20260503 19:55:45.947549 859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c99d75cb2be4439a1610c0de343d73a" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 646 } } ignore_live_leader: false dest_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" is_pre_election: true
I20260503 19:55:45.951089 1358 leader_election.cc:304] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e52aa88a17542609e84f0c09fb85d87; no voters: 6d99e4f4d5ca48e0bdb54daf8361c5e8, a1219433b66444d091420ceeab5092ef
I20260503 19:55:45.953256 1500 raft_consensus.cc:2749] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260503 19:55:46.061712 796 consensus_peers.cc:597] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 121: this message will repeat every 5th retry.
I20260503 19:55:46.103016 1431 raft_consensus.cc:1217] T a860805e8df84220ae4be7d3279b75f1 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.160->[1.161-1.724] Dedup: 1.163->[1.164-1.724]
I20260503 19:55:46.282313 1506 raft_consensus.cc:493] T ecf4b80ba8714f24a49387dc8bbe2da3 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a1219433b66444d091420ceeab5092ef)
I20260503 19:55:46.293962 1433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.105.2:39423 (request call id 4) took 2669 ms. Trace:
I20260503 19:55:46.282570 1506 raft_consensus.cc:515] T ecf4b80ba8714f24a49387dc8bbe2da3 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:46.300493 729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf4b80ba8714f24a49387dc8bbe2da3" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 649 } } ignore_live_leader: false dest_uuid: "a1219433b66444d091420ceeab5092ef" is_pre_election: true
I20260503 19:55:46.303862 860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf4b80ba8714f24a49387dc8bbe2da3" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 649 } } ignore_live_leader: false dest_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" is_pre_election: true
I20260503 19:55:46.322614 1506 leader_election.cc:290] T ecf4b80ba8714f24a49387dc8bbe2da3 P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1219433b66444d091420ceeab5092ef (127.0.105.2:38837), 6d99e4f4d5ca48e0bdb54daf8361c5e8 (127.0.105.3:35005)
I20260503 19:55:46.322872 1506 raft_consensus.cc:493] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d99e4f4d5ca48e0bdb54daf8361c5e8)
I20260503 19:55:46.344048 1358 leader_election.cc:304] T ecf4b80ba8714f24a49387dc8bbe2da3 P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e52aa88a17542609e84f0c09fb85d87; no voters: 6d99e4f4d5ca48e0bdb54daf8361c5e8, a1219433b66444d091420ceeab5092ef
I20260503 19:55:46.344466 1387 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:58682 (request call id 6) took 2738 ms. Trace:
I20260503 19:55:46.360880 1506 raft_consensus.cc:515] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:46.363040 860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c99d75cb2be4439a1610c0de343d73a" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 646 } } ignore_live_leader: false dest_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" is_pre_election: true
I20260503 19:55:46.370864 1506 leader_election.cc:290] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1219433b66444d091420ceeab5092ef (127.0.105.2:38837), 6d99e4f4d5ca48e0bdb54daf8361c5e8 (127.0.105.3:35005)
I20260503 19:55:46.360301 1387 rpcz_store.cc:276] 0503 19:55:43.560170 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 19:55:43.560234 (+ 64us) service_pool.cc:224] Handling call
0503 19:55:45.476617 (+1916383us) spinlock_profiling.cc:243] Waited 1.92 s on lock 0x616000018a54. stack: 00007f2b5ee49086 00007f2b5ee48e40 00007f2b5de023ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007f2b6ad5b8c0 00007f2b6ec16eaf 00007f2b6902ec36 00007f2b6902e965 00007f2b65e3c10e 00007f2b65e3afee 00007f2b65e41228 00007f2b65e41b8f 00007f2b65e419b8 0000000000aa4cac
0503 19:55:46.298605 (+821988us) spinlock_profiling.cc:243] Waited 821 ms on lock 0x616000019054. stack: 00007f2b5ee49086 00007f2b5ee48e40 00007f2b5de023ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007f2b6ad5b8c0 00007f2b6ec16eaf 00007f2b6902ec36 00007f2b6902e965 00007f2b65e3c10e 00007f2b65e3afee 00007f2b65e41228 00007f2b65e41b8f 00007f2b65e419b8 0000000000aa4cac
0503 19:55:46.299013 (+ 408us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6293658752}
I20260503 19:55:46.379372 729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c99d75cb2be4439a1610c0de343d73a" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 646 } } ignore_live_leader: false dest_uuid: "a1219433b66444d091420ceeab5092ef" is_pre_election: true
I20260503 19:55:46.384097 1506 raft_consensus.cc:2749] T ecf4b80ba8714f24a49387dc8bbe2da3 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 19:55:46.396402 1356 leader_election.cc:304] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e52aa88a17542609e84f0c09fb85d87; no voters: 6d99e4f4d5ca48e0bdb54daf8361c5e8, a1219433b66444d091420ceeab5092ef
I20260503 19:55:46.410312 1506 raft_consensus.cc:2749] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260503 19:55:46.643923 665 consensus_peers.cc:597] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 111: this message will repeat every 5th retry.
I20260503 19:55:46.717798 1516 raft_consensus.cc:493] T ecf4b80ba8714f24a49387dc8bbe2da3 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a1219433b66444d091420ceeab5092ef)
I20260503 19:55:46.726122 1516 raft_consensus.cc:515] T ecf4b80ba8714f24a49387dc8bbe2da3 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:46.731371 728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf4b80ba8714f24a49387dc8bbe2da3" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 649 } } ignore_live_leader: false dest_uuid: "a1219433b66444d091420ceeab5092ef" is_pre_election: true
I20260503 19:55:46.731371 859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf4b80ba8714f24a49387dc8bbe2da3" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 649 } } ignore_live_leader: false dest_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" is_pre_election: true
I20260503 19:55:46.736578 1356 leader_election.cc:304] T ecf4b80ba8714f24a49387dc8bbe2da3 P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e52aa88a17542609e84f0c09fb85d87; no voters: 6d99e4f4d5ca48e0bdb54daf8361c5e8, a1219433b66444d091420ceeab5092ef
I20260503 19:55:46.736599 1516 leader_election.cc:290] T ecf4b80ba8714f24a49387dc8bbe2da3 P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1219433b66444d091420ceeab5092ef (127.0.105.2:38837), 6d99e4f4d5ca48e0bdb54daf8361c5e8 (127.0.105.3:35005)
I20260503 19:55:46.743897 1506 raft_consensus.cc:2749] T ecf4b80ba8714f24a49387dc8bbe2da3 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 19:55:45.469633 1435 rpcz_store.cc:276] 0503 19:55:43.335171 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 19:55:43.337985 (+ 2814us) service_pool.cc:224] Handling call
0503 19:55:43.475506 (+137521us) raft_consensus.cc:1471] Updating replica for 487 ops
0503 19:55:43.536606 (+ 61100us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 19:55:43.536618 (+ 12us) raft_consensus.cc:1539] Triggering prepare for 487 ops
0503 19:55:43.537073 (+ 455us) write_op.cc:270] Start()
0503 19:55:43.537121 (+ 48us) write_op.cc:276] Timestamp: P: 1777838130284747 usec, L: 0
0503 19:55:43.543463 (+ 6342us) write_op.cc:270] Start()
0503 19:55:43.543535 (+ 72us) write_op.cc:276] Timestamp: P: 1777838130289736 usec, L: 0
0503 19:55:43.544326 (+ 791us) write_op.cc:270] Start()
0503 19:55:43.544385 (+ 59us) write_op.cc:276] Timestamp: P: 1777838130302307 usec, L: 0
0503 19:55:43.544635 (+ 250us) write_op.cc:270] Start()
0503 19:55:43.544659 (+ 24us) write_op.cc:276] Timestamp: P: 1777838130342422 usec, L: 0
0503 19:55:43.544909 (+ 250us) write_op.cc:270] Start()
0503 19:55:43.544932 (+ 23us) write_op.cc:276] Timestamp: P: 1777838130499384 usec, L: 0
0503 19:55:43.545095 (+ 163us) write_op.cc:270] Start()
0503 19:55:43.545118 (+ 23us) write_op.cc:276] Timestamp: P: 1777838130509619 usec, L: 0
0503 19:55:43.545305 (+ 187us) write_op.cc:270] Start()
0503 19:55:43.545357 (+ 52us) write_op.cc:276] Timestamp: P: 1777838131245155 usec, L: 0
0503 19:55:43.545517 (+ 160us) write_op.cc:270] Start()
0503 19:55:43.545537 (+ 20us) write_op.cc:276] Timestamp: P: 1777838131276463 usec, L: 0
0503 19:55:43.545688 (+ 151us) write_op.cc:270] Start()
0503 19:55:43.545711 (+ 23us) write_op.cc:276] Timestamp: P: 1777838131295768 usec, L: 0
0503 19:55:43.545938 (+ 227us) write_op.cc:270] Start()
0503 19:55:43.545960 (+ 22us) write_op.cc:276] Timestamp: P: 1777838131328346 usec, L: 0
0503 19:55:43.546144 (+ 184us) write_op.cc:270] Start()
0503 19:55:43.546165 (+ 21us) write_op.cc:276] Timestamp: P: 1777838131329022 usec, L: 0
0503 19:55:43.546322 (+ 157us) write_op.cc:270] Start()
0503 19:55:43.546343 (+ 21us) write_op.cc:276] Timestamp: P: 1777838131349894 usec, L: 0
0503 19:55:43.546512 (+ 169us) write_op.cc:270] Start()
0503 19:55:43.546534 (+ 22us) write_op.cc:276] Timestamp: P: 1777838131366570 usec, L: 0
0503 19:55:43.546774 (+ 240us) write_op.cc:270] Start()
0503 19:55:43.546798 (+ 24us) write_op.cc:276] Timestamp: P: 1777838131377127 usec, L: 0
0503 19:55:43.548722 (+ 1924us) write_op.cc:270] Start()
0503 19:55:43.548757 (+ 35us) write_op.cc:276] Timestamp: P: 1777838131397752 usec, L: 0
0503 19:55:43.549071 (+ 314us) write_op.cc:270] Start()
0503 19:55:43.549096 (+ 25us) write_op.cc:276] Timestamp: P: 1777838131430769 usec, L: 0
0503 19:55:43.549248 (+ 152us) write_op.cc:270] Start()
0503 19:55:43.549273 (+ 25us) write_op.cc:276] Timestamp: P: 1777838131438584 usec, L: 0
0503 19:55:43.549397 (+ 124us) write_op.cc:270] Start()
0503 19:55:43.549412 (+ 15us) write_op.cc:276] Timestamp: P: 1777838131456221 usec, L: 0
0503 19:55:43.549516 (+ 104us) write_op.cc:270] Start()
0503 19:55:43.549530 (+ 14us) write_op.cc:276] Timestamp: P: 1777838131460918 usec, L: 0
0503 19:55:43.549654 (+ 124us) write_op.cc:270] Start()
0503 19:55:43.549671 (+ 17us) write_op.cc:276] Timestamp: P: 1777838131493163 usec, L: 0
0503 19:55:43.549951 (+ 280us) write_op.cc:270] Start()
0503 19:55:43.549978 (+ 27us) write_op.cc:276] Timestamp: P: 1777838131518879 usec, L: 0
0503 19:55:43.550478 (+ 500us) write_op.cc:270] Start()
0503 19:55:43.550502 (+ 24us) write_op.cc:276] Timestamp: P: 1777838131524432 usec, L: 0
0503 19:55:43.550684 (+ 182us) write_op.cc:270] Start()
0503 19:55:43.550810 (+ 126us) write_op.cc:276] Timestamp: P: 1777838131536958 usec, L: 0
0503 19:55:43.550951 (+ 141us) write_op.cc:270] Start()
0503 19:55:43.550989 (+ 38us) write_op.cc:276] Timestamp: P: 1777838131559579 usec, L: 0
0503 19:55:43.551157 (+ 168us) write_op.cc:270] Start()
0503 19:55:43.551177 (+ 20us) write_op.cc:276] Timestamp: P: 1777838131579749 usec, L: 0
0503 19:55:43.551351 (+ 174us) write_op.cc:270] Start()
0503 19:55:43.551369 (+ 18us) write_op.cc:276] Timestamp: P: 1777838131588643 usec, L: 0
0503 19:55:43.551514 (+ 145us) write_op.cc:270] Start()
0503 19:55:43.551532 (+ 18us) write_op.cc:276] Timestamp: P: 1777838131611396 usec, L: 0
0503 19:55:43.551687 (+ 155us) write_op.cc:270] Start()
0503 19:55:43.551715 (+ 28us) write_op.cc:276] Timestamp: P: 1777838131619122 usec, L: 0
0503 19:55:43.551864 (+ 149us) write_op.cc:270] Start()
0503 19:55:43.551884 (+ 20us) write_op.cc:276] Timestamp: P: 1777838131646663 usec, L: 0
0503 19:55:43.552444 (+ 560us) write_op.cc:270] Start()
0503 19:55:43.552490 (+ 46us) write_op.cc:276] Timestamp: P: 1777838131648886 usec, L: 0
0503 19:55:43.553109 (+ 619us) write_op.cc:270] Start()
0503 19:55:43.553141 (+ 32us) write_op.cc:276] Timestamp: P: 1777838131659255 usec, L: 0
0503 19:55:43.553357 (+ 216us) write_op.cc:270] Start()
0503 19:55:43.553386 (+ 29us) write_op.cc:276] Timestamp: P: 1777838131689601 usec, L: 0
0503 19:55:43.553627 (+ 241us) write_op.cc:270] Start()
0503 19:55:43.553827 (+ 200us) write_op.cc:276] Timestamp: P: 1777838131734871 usec, L: 0
0503 19:55:43.554406 (+ 579us) write_op.cc:270] Start()
0503 19:55:43.554439 (+ 33us) write_op.cc:276] Timestamp: P: 1777838131735648 usec, L: 0
0503 19:55:43.556207 (+ 1768us) write_op.cc:270] Start()
0503 19:55:43.556242 (+ 35us) write_op.cc:276] Timestamp: P: 1777838131736263 usec, L: 0
0503 19:55:43.557030 (+ 788us) write_op.cc:270] Start()
0503 19:55:43.557060 (+ 30us) write_op.cc:276] Timestamp: P: 1777838131752990 usec, L: 0
0503 19:55:43.557522 (+ 462us) write_op.cc:270] Start()
0503 19:55:43.557626 (+ 104us) write_op.cc:276] Timestamp: P: 1777838131789730 usec, L: 0
0503 19:55:43.567084 (+ 9458us) write_op.cc:270] Start()
0503 19:55:43.567128 (+ 44us) write_op.cc:276] Timestamp: P: 1777838131798525 usec, L: 0
0503 19:55:43.570146 (+ 3018us) write_op.cc:270] Start()
0503 19:55:43.570186 (+ 40us) write_op.cc:276] Timestamp: P: 1777838131820060 usec, L: 0
0503 19:55:43.570590 (+ 404us) write_op.cc:270] Start()
0503 19:55:43.570616 (+ 26us) write_op.cc:276] Timestamp: P: 1777838131821013 usec, L: 0
0503 19:55:43.570823 (+ 207us) write_op.cc:270] Start()
0503 19:55:43.570845 (+ 22us) write_op.cc:276] Timestamp: P: 1777838131860828 usec, L: 0
0503 19:55:43.585430 (+ 14585us) write_op.cc:270] Start()
0503 19:55:43.585465 (+ 35us) write_op.cc:276] Timestamp: P: 1777838131870641 usec, L: 0
0503 19:55:43.589317 (+ 3852us) write_op.cc:270] Start()
0503 19:55:43.589351 (+ 34us) write_op.cc:276] Timestamp: P: 1777838131889658 usec, L: 0
0503 19:55:43.589608 (+ 257us) write_op.cc:270] Start()
0503 19:55:43.589633 (+ 25us) write_op.cc:276] Timestamp: P: 1777838131914077 usec, L: 0
0503 19:55:43.593777 (+ 4144us) write_op.cc:270] Start()
0503 19:55:43.593824 (+ 47us) write_op.cc:276] Timestamp: P: 1777838131915423 usec, L: 0
0503 19:55:43.594511 (+ 687us) write_op.cc:270] Start()
0503 19:55:43.594550 (+ 39us) write_op.cc:276] Timestamp: P: 1777838131955747 usec, L: 0
0503 19:55:43.594812 (+ 262us) write_op.cc:270] Start()
0503 19:55:43.595339 (+ 527us) write_op.cc:276] Timestamp: P: 1777838131965376 usec, L: 0
0503 19:55:43.598901 (+ 3562us) write_op.cc:270] Start()
0503 19:55:43.598938 (+ 37us) write_op.cc:276] Timestamp: P: 1777838131976915 usec, L: 0
0503 19:55:43.599535 (+ 597us) write_op.cc:270] Start()
0503 19:55:43.599564 (+ 29us) write_op.cc:276] Timestamp: P: 1777838131996463 usec, L: 0
0503 19:55:43.627802 (+ 28238us) write_op.cc:270] Start()
0503 19:55:43.627834 (+ 32us) write_op.cc:276] Timestamp: P: 1777838132021335 usec, L: 0
0503 19:55:43.628215 (+ 381us) write_op.cc:270] Start()
0503 19:55:43.628240 (+ 25us) write_op.cc:276] Timestamp: P: 1777838132039935 usec, L: 0
0503 19:55:43.628440 (+ 200us) write_op.cc:270] Start()
0503 19:55:43.628461 (+ 21us) write_op.cc:276] Timestamp: P: 1777838132056465 usec, L: 0
0503 19:55:43.628606 (+ 145us) write_op.cc:270] Start()
0503 19:55:43.628625 (+ 19us) write_op.cc:276] Timestamp: P: 1777838132059850 usec, L: 0
0503 19:55:43.633002 (+ 4377us) write_op.cc:270] Start()
0503 19:55:43.633047 (+ 45us) write_op.cc:276] Timestamp: P: 1777838132098573 usec, L: 0
0503 19:55:43.633300 (+ 253us) write_op.cc:270] Start()
0503 19:55:43.633322 (+ 22us) write_op.cc:276] Timestamp: P: 1777838132099332 usec, L: 0
0503 19:55:43.633490 (+ 168us) write_op.cc:270] Start()
0503 19:55:43.633510 (+ 20us) write_op.cc:276] Timestamp: P: 1777838132112879 usec, L: 0
0503 19:55:43.633659 (+ 149us) write_op.cc:270] Start()
0503 19:55:43.633678 (+ 19us) write_op.cc:276] Timestamp: P: 1777838132116727 usec, L: 0
0503 19:55:43.661146 (+ 27468us) write_op.cc:270] Start()
0503 19:55:43.661190 (+ 44us) write_op.cc:276] Timestamp: P: 1777838132160031 usec, L: 0
0503 19:55:43.661460 (+ 270us) write_op.cc:270] Start()
0503 19:55:43.661483 (+ 23us) write_op.cc:276] Timestamp: P: 1777838132162890 usec, L: 0
0503 19:55:43.661620 (+ 137us) write_op.cc:270] Start()
0503 19:55:43.661661 (+ 41us) write_op.cc:276] Timestamp: P: 1777838132172790 usec, L: 0
0503 19:55:43.661782 (+ 121us) write_op.cc:270] Start()
0503 19:55:43.661813 (+ 31us) write_op.cc:276] Timestamp: P: 1777838132173780 usec, L: 0
0503 19:55:43.670729 (+ 8916us) write_op.cc:270] Start()
0503 19:55:43.670764 (+ 35us) write_op.cc:276] Timestamp: P: 1777838132208942 usec, L: 0
0503 19:55:43.671264 (+ 500us) write_op.cc:270] Start()
0503 19:55:43.671289 (+ 25us) write_op.cc:276] Timestamp: P: 1777838132224311 usec, L: 0
0503 19:55:43.671431 (+ 142us) write_op.cc:270] Start()
0503 19:55:43.671448 (+ 17us) write_op.cc:276] Timestamp: P: 1777838132230560 usec, L: 0
0503 19:55:43.683987 (+ 12539us) write_op.cc:270] Start()
0503 19:55:43.684038 (+ 51us) write_op.cc:276] Timestamp: P: 1777838132231267 usec, L: 0
0503 19:55:43.684509 (+ 471us) write_op.cc:270] Start()
0503 19:55:43.684559 (+ 50us) write_op.cc:276] Timestamp: P: 1777838132283695 usec, L: 0
0503 19:55:43.684779 (+ 220us) write_op.cc:270] Start()
0503 19:55:43.684807 (+ 28us) write_op.cc:276] Timestamp: P: 1777838132288231 usec, L: 0
0503 19:55:43.685208 (+ 401us) write_op.cc:270] Start()
0503 19:55:43.685234 (+ 26us) write_op.cc:276] Timestamp: P: 1777838132303454 usec, L: 0
0503 19:55:43.685411 (+ 177us) write_op.cc:270] Start()
0503 19:55:43.685438 (+ 27us) write_op.cc:276] Timestamp: P: 1777838132304606 usec, L: 0
0503 19:55:43.686711 (+ 1273us) write_op.cc:270] Start()
0503 19:55:43.686738 (+ 27us) write_op.cc:276] Timestamp: P: 1777838132351903 usec, L: 0
0503 19:55:43.702003 (+ 15265us) write_op.cc:270] Start()
0503 19:55:43.702051 (+ 48us) write_op.cc:276] Timestamp: P: 1777838132359263 usec, L: 0
0503 19:55:43.709425 (+ 7374us) write_op.cc:270] Start()
0503 19:55:43.709465 (+ 40us) write_op.cc:276] Timestamp: P: 1777838132362506 usec, L: 0
0503 19:55:43.755114 (+ 45649us) write_op.cc:270] Start()
0503 19:55:43.755146 (+ 32us) write_op.cc:276] Timestamp: P: 1777838132363458 usec, L: 0
0503 19:55:43.760414 (+ 5268us) write_op.cc:270] Start()
0503 19:55:43.760451 (+ 37us) write_op.cc:276] Timestamp: P: 1777838132409585 usec, L: 0
0503 19:55:43.763056 (+ 2605us) write_op.cc:270] Start()
0503 19:55:43.763095 (+ 39us) write_op.cc:276] Timestamp: P: 1777838132421627 usec, L: 0
0503 19:55:43.763288 (+ 193us) write_op.cc:270] Start()
0503 19:55:43.763306 (+ 18us) write_op.cc:276] Timestamp: P: 1777838132422429 usec, L: 0
0503 19:55:43.763457 (+ 151us) write_op.cc:270] Start()
0503 19:55:43.763932 (+ 475us) write_op.cc:276] Timestamp: P: 1777838132428102 usec, L: 0
0503 19:55:43.770064 (+ 6132us) write_op.cc:270] Start()
0503 19:55:43.770093 (+ 29us) write_op.cc:276] Timestamp: P: 1777838132462110 usec, L: 0
0503 19:55:43.770303 (+ 210us) write_op.cc:270] Start()
0503 19:55:43.770390 (+ 87us) write_op.cc:276] Timestamp: P: 1777838132473180 usec, L: 0
0503 19:55:43.770663 (+ 273us) write_op.cc:270] Start()
0503 19:55:43.770947 (+ 284us) write_op.cc:276] Timestamp: P: 1777838132498740 usec, L: 0
0503 19:55:43.771339 (+ 392us) write_op.cc:270] Start()
0503 19:55:43.771367 (+ 28us) write_op.cc:276] Timestamp: P: 1777838132525062 usec, L: 0
0503 19:55:43.771580 (+ 213us) write_op.cc:270] Start()
0503 19:55:43.771613 (+ 33us) write_op.cc:276] Timestamp: P: 1777838132537016 usec, L: 0
0503 19:55:43.772168 (+ 555us) write_op.cc:270] Start()
0503 19:55:43.772198 (+ 30us) write_op.cc:276] Timestamp: P: 1777838132539508 usec, L: 0
0503 19:55:43.772334 (+ 136us) write_op.cc:270] Start()
0503 19:55:43.772351 (+ 17us) write_op.cc:276] Timestamp: P: 1777838132549136 usec, L: 0
0503 19:55:43.772473 (+ 122us) write_op.cc:270] Start()
0503 19:55:43.772488 (+ 15us) write_op.cc:276] Timestamp: P: 1777838132574122 usec, L: 0
0503 19:55:43.772633 (+ 145us) write_op.cc:270] Start()
0503 19:55:43.772649 (+ 16us) write_op.cc:276] Timestamp: P: 1777838132596430 usec, L: 0
0503 19:55:43.772759 (+ 110us) write_op.cc:270] Start()
0503 19:55:43.772778 (+ 19us) write_op.cc:276] Timestamp: P: 1777838132608669 usec, L: 0
0503 19:55:43.773054 (+ 276us) write_op.cc:270] Start()
0503 19:55:43.773078 (+ 24us) write_op.cc:276] Timestamp: P: 1777838132625690 usec, L: 0
0503 19:55:43.773241 (+ 163us) write_op.cc:270] Start()
0503 19:55:43.773263 (+ 22us) write_op.cc:276] Timestamp: P: 1777838132638857 usec, L: 0
0503 19:55:43.773394 (+ 131us) write_op.cc:270] Start()
0503 19:55:43.773413 (+ 19us) write_op.cc:276] Timestamp: P: 1777838132661709 usec, L: 0
0503 19:55:43.773630 (+ 217us) write_op.cc:270] Start()
0503 19:55:43.773650 (+ 20us) write_op.cc:276] Timestamp: P: 1777838132674915 usec, L: 0
0503 19:55:43.773833 (+ 183us) write_op.cc:270] Start()
0503 19:55:43.773855 (+ 22us) write_op.cc:276] Timestamp: P: 1777838132676032 usec, L: 0
0503 19:55:43.774025 (+ 170us) write_op.cc:270] Start()
0503 19:55:43.774062 (+ 37us) write_op.cc:276] Timestamp: P: 1777838132692913 usec, L: 0
0503 19:55:43.774238 (+ 176us) write_op.cc:270] Start()
0503 19:55:43.774259 (+ 21us) write_op.cc:276] Timestamp: P: 1777838132737497 usec, L: 0
0503 19:55:43.774460 (+ 201us) write_op.cc:270] Start()
0503 19:55:43.774478 (+ 18us) write_op.cc:276] Timestamp: P: 1777838132754204 usec, L: 0
0503 19:55:43.774658 (+ 180us) write_op.cc:270] Start()
0503 19:55:43.774677 (+ 19us) write_op.cc:276] Timestamp: P: 1777838132789267 usec, L: 0
0503 19:55:43.774791 (+ 114us) write_op.cc:270] Start()
0503 19:55:43.774807 (+ 16us) write_op.cc:276] Timestamp: P: 1777838132792188 usec, L: 0
0503 19:55:43.774916 (+ 109us) write_op.cc:270] Start()
0503 19:55:43.774937 (+ 21us) write_op.cc:276] Timestamp: P: 1777838132802463 usec, L: 0
0503 19:55:43.775055 (+ 118us) write_op.cc:270] Start()
0503 19:55:43.775070 (+ 15us) write_op.cc:276] Timestamp: P: 1777838132831761 usec, L: 0
0503 19:55:43.775175 (+ 105us) write_op.cc:270] Start()
0503 19:55:43.775190 (+ 15us) write_op.cc:276] Timestamp: P: 1777838132844556 usec, L: 0
0503 19:55:43.775307 (+ 117us) write_op.cc:270] Start()
0503 19:55:43.775322 (+ 15us) write_op.cc:276] Timestamp: P: 1777838132871543 usec, L: 0
0503 19:55:43.803661 (+ 28339us) write_op.cc:270] Start()
0503 19:55:43.803697 (+ 36us) write_op.cc:276] Timestamp: P: 1777838132874961 usec, L: 0
0503 19:55:43.805655 (+ 1958us) write_op.cc:270] Start()
0503 19:55:43.805685 (+ 30us) write_op.cc:276] Timestamp: P: 1777838132885004 usec, L: 0
0503 19:55:43.805885 (+ 200us) write_op.cc:270] Start()
0503 19:55:43.805911 (+ 26us) write_op.cc:276] Timestamp: P: 1777838132900316 usec, L: 0
0503 19:55:43.806593 (+ 682us) write_op.cc:270] Start()
0503 19:55:43.806664 (+ 71us) write_op.cc:276] Timestamp: P: 1777838132938117 usec, L: 0
0503 19:55:43.807299 (+ 635us) write_op.cc:270] Start()
0503 19:55:43.807347 (+ 48us) write_op.cc:276] Timestamp: P: 1777838132944125 usec, L: 0
0503 19:55:43.807620 (+ 273us) write_op.cc:270] Start()
0503 19:55:43.815857 (+ 8237us) write_op.cc:276] Timestamp: P: 1777838132946597 usec, L: 0
0503 19:55:43.816147 (+ 290us) write_op.cc:270] Start()
0503 19:55:43.816175 (+ 28us) write_op.cc:276] Timestamp: P: 1777838132965858 usec, L: 0
0503 19:55:43.816323 (+ 148us) write_op.cc:270] Start()
0503 19:55:43.816341 (+ 18us) write_op.cc:276] Timestamp: P: 1777838133017929 usec, L: 0
0503 19:55:43.816490 (+ 149us) write_op.cc:270] Start()
0503 19:55:43.816505 (+ 15us) write_op.cc:276] Timestamp: P: 1777838133024162 usec, L: 0
0503 19:55:43.816674 (+ 169us) write_op.cc:270] Start()
0503 19:55:43.816693 (+ 19us) write_op.cc:276] Timestamp: P: 1777838133025649 usec, L: 0
0503 19:55:43.816826 (+ 133us) write_op.cc:270] Start()
0503 19:55:43.816842 (+ 16us) write_op.cc:276] Timestamp: P: 1777838133050001 usec, L: 0
0503 19:55:43.816953 (+ 111us) write_op.cc:270] Start()
0503 19:55:43.816968 (+ 15us) write_op.cc:276] Timestamp: P: 1777838133062328 usec, L: 0
0503 19:55:43.817091 (+ 123us) write_op.cc:270] Start()
0503 19:55:43.817114 (+ 23us) write_op.cc:276] Timestamp: P: 1777838133082031 usec, L: 0
0503 19:55:43.817505 (+ 391us) write_op.cc:270] Start()
0503 19:55:43.817601 (+ 96us) write_op.cc:276] Timestamp: P: 1777838133089969 usec, L: 0
0503 19:55:43.826682 (+ 9081us) write_op.cc:270] Start()
0503 19:55:43.826724 (+ 42us) write_op.cc:276] Timestamp: P: 1777838133109165 usec, L: 0
0503 19:55:43.826903 (+ 179us) write_op.cc:270] Start()
0503 19:55:43.826921 (+ 18us) write_op.cc:276] Timestamp: P: 1777838133137860 usec, L: 0
0503 19:55:43.827058 (+ 137us) write_op.cc:270] Start()
0503 19:55:43.827077 (+ 19us) write_op.cc:276] Timestamp: P: 1777838133169807 usec, L: 0
0503 19:55:43.827284 (+ 207us) write_op.cc:270] Start()
0503 19:55:43.827305 (+ 21us) write_op.cc:276] Timestamp: P: 1777838133189722 usec, L: 0
0503 19:55:43.827439 (+ 134us) write_op.cc:270] Start()
0503 19:55:43.827456 (+ 17us) write_op.cc:276] Timestamp: P: 1777838133192321 usec, L: 0
0503 19:55:43.827585 (+ 129us) write_op.cc:270] Start()
0503 19:55:43.827603 (+ 18us) write_op.cc:276] Timestamp: P: 1777838133210542 usec, L: 0
0503 19:55:43.858879 (+ 31276us) write_op.cc:270] Start()
0503 19:55:43.858931 (+ 52us) write_op.cc:276] Timestamp: P: 1777838133239081 usec, L: 0
0503 19:55:43.859206 (+ 275us) write_op.cc:270] Start()
0503 19:55:43.859233 (+ 27us) write_op.cc:276] Timestamp: P: 1777838133255055 usec, L: 0
0503 19:55:43.859390 (+ 157us) write_op.cc:270] Start()
0503 19:55:43.859412 (+ 22us) write_op.cc:276] Timestamp: P: 1777838133286038 usec, L: 0
0503 19:55:43.859568 (+ 156us) write_op.cc:270] Start()
0503 19:55:43.859590 (+ 22us) write_op.cc:276] Timestamp: P: 1777838133288174 usec, L: 0
0503 19:55:43.859814 (+ 224us) write_op.cc:270] Start()
0503 19:55:43.859838 (+ 24us) write_op.cc:276] Timestamp: P: 1777838133304791 usec, L: 0
0503 19:55:43.860002 (+ 164us) write_op.cc:270] Start()
0503 19:55:43.860023 (+ 21us) write_op.cc:276] Timestamp: P: 1777838133344271 usec, L: 0
0503 19:55:43.860207 (+ 184us) write_op.cc:270] Start()
0503 19:55:43.860230 (+ 23us) write_op.cc:276] Timestamp: P: 1777838133346349 usec, L: 0
0503 19:55:43.860433 (+ 203us) write_op.cc:270] Start()
0503 19:55:43.860458 (+ 25us) write_op.cc:276] Timestamp: P: 1777838133379115 usec, L: 0
0503 19:55:43.860611 (+ 153us) write_op.cc:270] Start()
0503 19:55:43.860632 (+ 21us) write_op.cc:276] Timestamp: P: 1777838133381055 usec, L: 0
0503 19:55:43.860842 (+ 210us) write_op.cc:270] Start()
0503 19:55:43.860906 (+ 64us) write_op.cc:276] Timestamp: P: 1777838133410689 usec, L: 0
0503 19:55:43.861100 (+ 194us) write_op.cc:270] Start()
0503 19:55:43.861124 (+ 24us) write_op.cc:276] Timestamp: P: 1777838133412585 usec, L: 0
0503 19:55:43.861299 (+ 175us) write_op.cc:270] Start()
0503 19:55:43.861321 (+ 22us) write_op.cc:276] Timestamp: P: 1777838133437669 usec, L: 0
0503 19:55:43.861479 (+ 158us) write_op.cc:270] Start()
0503 19:55:43.861516 (+ 37us) write_op.cc:276] Timestamp: P: 1777838133456355 usec, L: 0
0503 19:55:43.861664 (+ 148us) write_op.cc:270] Start()
0503 19:55:43.861684 (+ 20us) write_op.cc:276] Timestamp: P: 1777838133475904 usec, L: 0
0503 19:55:43.861860 (+ 176us) write_op.cc:270] Start()
0503 19:55:43.861883 (+ 23us) write_op.cc:276] Timestamp: P: 1777838133485349 usec, L: 0
0503 19:55:43.862061 (+ 178us) write_op.cc:270] Start()
0503 19:55:43.862100 (+ 39us) write_op.cc:276] Timestamp: P: 1777838133486782 usec, L: 0
0503 19:55:43.862243 (+ 143us) write_op.cc:270] Start()
0503 19:55:43.862264 (+ 21us) write_op.cc:276] Timestamp: P: 1777838133540151 usec, L: 0
0503 19:55:43.862418 (+ 154us) write_op.cc:270] Start()
0503 19:55:43.862441 (+ 23us) write_op.cc:276] Timestamp: P: 1777838133557854 usec, L: 0
0503 19:55:43.862583 (+ 142us) write_op.cc:270] Start()
0503 19:55:43.862605 (+ 22us) write_op.cc:276] Timestamp: P: 1777838133561041 usec, L: 0
0503 19:55:43.862778 (+ 173us) write_op.cc:270] Start()
0503 19:55:43.862800 (+ 22us) write_op.cc:276] Timestamp: P: 1777838133586630 usec, L: 0
0503 19:55:43.862993 (+ 193us) write_op.cc:270] Start()
0503 19:55:43.863023 (+ 30us) write_op.cc:276] Timestamp: P: 1777838133622739 usec, L: 0
0503 19:55:43.863175 (+ 152us) write_op.cc:270] Start()
0503 19:55:43.863197 (+ 22us) write_op.cc:276] Timestamp: P: 1777838133628028 usec, L: 0
0503 19:55:43.863335 (+ 138us) write_op.cc:270] Start()
0503 19:55:43.863355 (+ 20us) write_op.cc:276] Timestamp: P: 1777838133636226 usec, L: 0
0503 19:55:43.863505 (+ 150us) write_op.cc:270] Start()
0503 19:55:43.863525 (+ 20us) write_op.cc:276] Timestamp: P: 1777838133676691 usec, L: 0
0503 19:55:43.909183 (+ 45658us) write_op.cc:270] Start()
0503 19:55:43.909224 (+ 41us) write_op.cc:276] Timestamp: P: 1777838133677420 usec, L: 0
0503 19:55:43.909464 (+ 240us) write_op.cc:270] Start()
0503 19:55:43.909487 (+ 23us) write_op.cc:276] Timestamp: P: 1777838133722717 usec, L: 0
0503 19:55:43.926538 (+ 17051us) write_op.cc:270] Start()
0503 19:55:43.926725 (+ 187us) write_op.cc:276] Timestamp: P: 1777838133723519 usec, L: 0
0503 19:55:43.927320 (+ 595us) write_op.cc:270] Start()
0503 19:55:43.927361 (+ 41us) write_op.cc:276] Timestamp: P: 1777838133756464 usec, L: 0
0503 19:55:43.927574 (+ 213us) write_op.cc:270] Start()
0503 19:55:43.927595 (+ 21us) write_op.cc:276] Timestamp: P: 1777838133760256 usec, L: 0
0503 19:55:43.927793 (+ 198us) write_op.cc:270] Start()
0503 19:55:43.927815 (+ 22us) write_op.cc:276] Timestamp: P: 1777838133785692 usec, L: 0
0503 19:55:43.927960 (+ 145us) write_op.cc:270] Start()
0503 19:55:43.927997 (+ 37us) write_op.cc:276] Timestamp: P: 1777838133811357 usec, L: 0
0503 19:55:43.928206 (+ 209us) write_op.cc:270] Start()
0503 19:55:43.928228 (+ 22us) write_op.cc:276] Timestamp: P: 1777838133857027 usec, L: 0
0503 19:55:43.928386 (+ 158us) write_op.cc:270] Start()
0503 19:55:43.928406 (+ 20us) write_op.cc:276] Timestamp: P: 1777838133891957 usec, L: 0
0503 19:55:43.928581 (+ 175us) write_op.cc:270] Start()
0503 19:55:43.928602 (+ 21us) write_op.cc:276] Timestamp: P: 1777838133912511 usec, L: 0
0503 19:55:43.928747 (+ 145us) write_op.cc:270] Start()
0503 19:55:43.928767 (+ 20us) write_op.cc:276] Timestamp: P: 1777838133913375 usec, L: 0
0503 19:55:43.928917 (+ 150us) write_op.cc:270] Start()
0503 19:55:43.928942 (+ 25us) write_op.cc:276] Timestamp: P: 1777838133914968 usec, L: 0
0503 19:55:43.929173 (+ 231us) write_op.cc:270] Start()
0503 19:55:43.929196 (+ 23us) write_op.cc:276] Timestamp: P: 1777838133976045 usec, L: 0
0503 19:55:43.929352 (+ 156us) write_op.cc:270] Start()
0503 19:55:43.929371 (+ 19us) write_op.cc:276] Timestamp: P: 1777838133993624 usec, L: 0
0503 19:55:43.939775 (+ 10404us) write_op.cc:270] Start()
0503 19:55:43.939805 (+ 30us) write_op.cc:276] Timestamp: P: 1777838133995336 usec, L: 0
0503 19:55:43.940057 (+ 252us) write_op.cc:270] Start()
0503 19:55:43.940080 (+ 23us) write_op.cc:276] Timestamp: P: 1777838133996397 usec, L: 0
0503 19:55:43.940235 (+ 155us) write_op.cc:270] Start()
0503 19:55:43.940255 (+ 20us) write_op.cc:276] Timestamp: P: 1777838134038875 usec, L: 0
0503 19:55:43.940419 (+ 164us) write_op.cc:270] Start()
0503 19:55:43.940441 (+ 22us) write_op.cc:276] Timestamp: P: 1777838134070814 usec, L: 0
0503 19:55:43.940648 (+ 207us) write_op.cc:270] Start()
0503 19:55:43.940670 (+ 22us) write_op.cc:276] Timestamp: P: 1777838134071503 usec, L: 0
0503 19:55:43.940870 (+ 200us) write_op.cc:270] Start()
0503 19:55:43.940891 (+ 21us) write_op.cc:276] Timestamp: P: 1777838134098772 usec, L: 0
0503 19:55:43.941056 (+ 165us) write_op.cc:270] Start()
0503 19:55:43.941076 (+ 20us) write_op.cc:276] Timestamp: P: 1777838134099551 usec, L: 0
0503 19:55:43.941233 (+ 157us) write_op.cc:270] Start()
0503 19:55:43.941294 (+ 61us) write_op.cc:276] Timestamp: P: 1777838134145155 usec, L: 0
0503 19:55:43.941616 (+ 322us) write_op.cc:270] Start()
0503 19:55:43.941638 (+ 22us) write_op.cc:276] Timestamp: P: 1777838134160930 usec, L: 0
0503 19:55:43.941835 (+ 197us) write_op.cc:270] Start()
0503 19:55:43.941856 (+ 21us) write_op.cc:276] Timestamp: P: 1777838134173092 usec, L: 0
0503 19:55:43.941999 (+ 143us) write_op.cc:270] Start()
0503 19:55:43.942032 (+ 33us) write_op.cc:276] Timestamp: P: 1777838134196876 usec, L: 0
0503 19:55:43.942188 (+ 156us) write_op.cc:270] Start()
0503 19:55:43.942208 (+ 20us) write_op.cc:276] Timestamp: P: 1777838134237710 usec, L: 0
0503 19:55:43.942348 (+ 140us) write_op.cc:270] Start()
0503 19:55:43.942367 (+ 19us) write_op.cc:276] Timestamp: P: 1777838134275322 usec, L: 0
0503 19:55:43.942534 (+ 167us) write_op.cc:270] Start()
0503 19:55:43.942554 (+ 20us) write_op.cc:276] Timestamp: P: 1777838134291223 usec, L: 0
0503 19:55:43.942731 (+ 177us) write_op.cc:270] Start()
0503 19:55:43.942751 (+ 20us) write_op.cc:276] Timestamp: P: 1777838134294162 usec, L: 0
0503 19:55:43.942889 (+ 138us) write_op.cc:270] Start()
0503 19:55:43.942908 (+ 19us) write_op.cc:276] Timestamp: P: 1777838134336510 usec, L: 0
0503 19:55:43.975149 (+ 32241us) write_op.cc:270] Start()
0503 19:55:43.975174 (+ 25us) write_op.cc:276] Timestamp: P: 1777838134337181 usec, L: 0
0503 19:55:43.976940 (+ 1766us) write_op.cc:270] Start()
0503 19:55:43.976987 (+ 47us) write_op.cc:276] Timestamp: P: 1777838134342022 usec, L: 0
0503 19:55:43.977209 (+ 222us) write_op.cc:270] Start()
0503 19:55:43.977235 (+ 26us) write_op.cc:276] Timestamp: P: 1777838134374704 usec, L: 0
0503 19:55:43.977445 (+ 210us) write_op.cc:270] Start()
0503 19:55:43.977466 (+ 21us) write_op.cc:276] Timestamp: P: 1777838134421236 usec, L: 0
0503 19:55:43.977636 (+ 170us) write_op.cc:270] Start()
0503 19:55:43.977656 (+ 20us) write_op.cc:276] Timestamp: P: 1777838134452115 usec, L: 0
0503 19:55:43.977795 (+ 139us) write_op.cc:270] Start()
0503 19:55:43.977815 (+ 20us) write_op.cc:276] Timestamp: P: 1777838134465865 usec, L: 0
0503 19:55:43.977959 (+ 144us) write_op.cc:270] Start()
0503 19:55:43.977981 (+ 22us) write_op.cc:276] Timestamp: P: 1777838134496667 usec, L: 0
0503 19:55:43.978140 (+ 159us) write_op.cc:270] Start()
0503 19:55:43.978160 (+ 20us) write_op.cc:276] Timestamp: P: 1777838134504739 usec, L: 0
0503 19:55:43.999276 (+ 21116us) write_op.cc:270] Start()
0503 19:55:43.999327 (+ 51us) write_op.cc:276] Timestamp: P: 1777838134525422 usec, L: 0
0503 19:55:44.009254 (+ 9927us) write_op.cc:270] Start()
0503 19:55:44.009279 (+ 25us) write_op.cc:276] Timestamp: P: 1777838134548089 usec, L: 0
0503 19:55:44.009441 (+ 162us) write_op.cc:270] Start()
0503 19:55:44.009464 (+ 23us) write_op.cc:276] Timestamp: P: 1777838134548697 usec, L: 0
0503 19:55:44.018053 (+ 8589us) write_op.cc:270] Start()
0503 19:55:44.018077 (+ 24us) write_op.cc:276] Timestamp: P: 1777838134551124 usec, L: 0
0503 19:55:44.018833 (+ 756us) write_op.cc:270] Start()
0503 19:55:44.019033 (+ 200us) write_op.cc:276] Timestamp: P: 1777838134597225 usec, L: 0
0503 19:55:44.025085 (+ 6052us) write_op.cc:270] Start()
0503 19:55:44.025125 (+ 40us) write_op.cc:276] Timestamp: P: 1777838134620187 usec, L: 0
0503 19:55:44.025358 (+ 233us) write_op.cc:270] Start()
0503 19:55:44.025376 (+ 18us) write_op.cc:276] Timestamp: P: 1777838134663910 usec, L: 0
0503 19:55:44.025511 (+ 135us) write_op.cc:270] Start()
0503 19:55:44.025527 (+ 16us) write_op.cc:276] Timestamp: P: 1777838134702326 usec, L: 0
0503 19:55:44.025823 (+ 296us) write_op.cc:270] Start()
0503 19:55:44.025844 (+ 21us) write_op.cc:276] Timestamp: P: 1777838134703071 usec, L: 0
0503 19:55:44.026001 (+ 157us) write_op.cc:270] Start()
0503 19:55:44.026022 (+ 21us) write_op.cc:276] Timestamp: P: 1777838134703908 usec, L: 0
0503 19:55:44.026323 (+ 301us) write_op.cc:270] Start()
0503 19:55:44.026641 (+ 318us) write_op.cc:276] Timestamp: P: 1777838134758449 usec, L: 0
0503 19:55:44.026957 (+ 316us) write_op.cc:270] Start()
0503 19:55:44.026982 (+ 25us) write_op.cc:276] Timestamp: P: 1777838134785345 usec, L: 0
0503 19:55:44.027130 (+ 148us) write_op.cc:270] Start()
0503 19:55:44.027155 (+ 25us) write_op.cc:276] Timestamp: P: 1777838134854622 usec, L: 0
0503 19:55:44.027266 (+ 111us) write_op.cc:270] Start()
0503 19:55:44.027282 (+ 16us) write_op.cc:276] Timestamp: P: 17778381
W20260503 19:55:47.249171 665 consensus_peers.cc:597] T 4d80fc29b7a64074b4a2ce4003054d1a P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 116: this message will repeat every 5th retry.
I20260503 19:55:47.548929 1523 raft_consensus.cc:493] T ecf4b80ba8714f24a49387dc8bbe2da3 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a1219433b66444d091420ceeab5092ef)
I20260503 19:55:47.549185 1523 raft_consensus.cc:515] T ecf4b80ba8714f24a49387dc8bbe2da3 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:47.552991 1523 leader_election.cc:290] T ecf4b80ba8714f24a49387dc8bbe2da3 P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1219433b66444d091420ceeab5092ef (127.0.105.2:38837), 6d99e4f4d5ca48e0bdb54daf8361c5e8 (127.0.105.3:35005)
I20260503 19:55:47.553670 859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf4b80ba8714f24a49387dc8bbe2da3" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 649 } } ignore_live_leader: false dest_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" is_pre_election: true
I20260503 19:55:47.554982 731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf4b80ba8714f24a49387dc8bbe2da3" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 649 } } ignore_live_leader: false dest_uuid: "a1219433b66444d091420ceeab5092ef" is_pre_election: true
I20260503 19:55:47.571376 1356 leader_election.cc:304] T ecf4b80ba8714f24a49387dc8bbe2da3 P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e52aa88a17542609e84f0c09fb85d87; no voters: 6d99e4f4d5ca48e0bdb54daf8361c5e8, a1219433b66444d091420ceeab5092ef
I20260503 19:55:47.592015 1523 raft_consensus.cc:2749] T ecf4b80ba8714f24a49387dc8bbe2da3 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 19:55:46.301369 1433 rpcz_store.cc:276] 0503 19:55:43.612035 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 19:55:43.612094 (+ 59us) service_pool.cc:224] Handling call
0503 19:55:43.761937 (+149843us) raft_consensus.cc:1471] Updating replica for 491 ops
0503 19:55:43.925209 (+163272us) raft_consensus.cc:1534] Early marking committed up to index 159
0503 19:55:43.946270 (+ 21061us) raft_consensus.cc:1539] Triggering prepare for 490 ops
0503 19:55:43.946650 (+ 380us) write_op.cc:270] Start()
0503 19:55:43.946679 (+ 29us) write_op.cc:276] Timestamp: P: 1777838130273612 usec, L: 0
0503 19:55:43.950478 (+ 3799us) write_op.cc:270] Start()
0503 19:55:43.950534 (+ 56us) write_op.cc:276] Timestamp: P: 1777838130274262 usec, L: 0
0503 19:55:43.950801 (+ 267us) write_op.cc:270] Start()
0503 19:55:43.950826 (+ 25us) write_op.cc:276] Timestamp: P: 1777838130281242 usec, L: 0
0503 19:55:43.951480 (+ 654us) write_op.cc:270] Start()
0503 19:55:43.951510 (+ 30us) write_op.cc:276] Timestamp: P: 1777838130332325 usec, L: 0
0503 19:55:43.951709 (+ 199us) write_op.cc:270] Start()
0503 19:55:43.951731 (+ 22us) write_op.cc:276] Timestamp: P: 1777838130502644 usec, L: 0
0503 19:55:43.951902 (+ 171us) write_op.cc:270] Start()
0503 19:55:43.951929 (+ 27us) write_op.cc:276] Timestamp: P: 1777838130509777 usec, L: 0
0503 19:55:43.952123 (+ 194us) write_op.cc:270] Start()
0503 19:55:43.952166 (+ 43us) write_op.cc:276] Timestamp: P: 1777838131217272 usec, L: 0
0503 19:55:43.969151 (+ 16985us) write_op.cc:270] Start()
0503 19:55:43.969199 (+ 48us) write_op.cc:276] Timestamp: P: 1777838131278751 usec, L: 0
0503 19:55:43.969931 (+ 732us) write_op.cc:270] Start()
0503 19:55:43.969985 (+ 54us) write_op.cc:276] Timestamp: P: 1777838131295682 usec, L: 0
0503 19:55:43.970200 (+ 215us) write_op.cc:270] Start()
0503 19:55:43.970224 (+ 24us) write_op.cc:276] Timestamp: P: 1777838131322870 usec, L: 0
0503 19:55:43.970418 (+ 194us) write_op.cc:270] Start()
0503 19:55:43.970443 (+ 25us) write_op.cc:276] Timestamp: P: 1777838131325685 usec, L: 0
0503 19:55:43.970600 (+ 157us) write_op.cc:270] Start()
0503 19:55:43.970621 (+ 21us) write_op.cc:276] Timestamp: P: 1777838131344828 usec, L: 0
0503 19:55:43.970942 (+ 321us) write_op.cc:270] Start()
0503 19:55:43.971051 (+ 109us) write_op.cc:276] Timestamp: P: 1777838131370028 usec, L: 0
0503 19:55:43.971249 (+ 198us) write_op.cc:270] Start()
0503 19:55:43.971274 (+ 25us) write_op.cc:276] Timestamp: P: 1777838131375180 usec, L: 0
0503 19:55:43.971445 (+ 171us) write_op.cc:270] Start()
0503 19:55:43.971469 (+ 24us) write_op.cc:276] Timestamp: P: 1777838131403653 usec, L: 0
0503 19:55:43.974014 (+ 2545us) write_op.cc:270] Start()
0503 19:55:43.974053 (+ 39us) write_op.cc:276] Timestamp: P: 1777838131430674 usec, L: 0
0503 19:55:43.974230 (+ 177us) write_op.cc:270] Start()
0503 19:55:43.974252 (+ 22us) write_op.cc:276] Timestamp: P: 1777838131445572 usec, L: 0
0503 19:55:43.974392 (+ 140us) write_op.cc:270] Start()
0503 19:55:43.974410 (+ 18us) write_op.cc:276] Timestamp: P: 1777838131450476 usec, L: 0
0503 19:55:43.979131 (+ 4721us) write_op.cc:270] Start()
0503 19:55:43.979162 (+ 31us) write_op.cc:276] Timestamp: P: 1777838131463800 usec, L: 0
0503 19:55:43.979542 (+ 380us) write_op.cc:270] Start()
0503 19:55:43.979578 (+ 36us) write_op.cc:276] Timestamp: P: 1777838131490350 usec, L: 0
0503 19:55:43.990887 (+ 11309us) write_op.cc:270] Start()
0503 19:55:43.990925 (+ 38us) write_op.cc:276] Timestamp: P: 1777838131533602 usec, L: 0
0503 19:55:43.993155 (+ 2230us) write_op.cc:270] Start()
0503 19:55:43.993191 (+ 36us) write_op.cc:276] Timestamp: P: 1777838131560219 usec, L: 0
0503 19:55:44.008436 (+ 15245us) write_op.cc:270] Start()
0503 19:55:44.008484 (+ 48us) write_op.cc:276] Timestamp: P: 1777838131561495 usec, L: 0
0503 19:55:44.008747 (+ 263us) write_op.cc:270] Start()
0503 19:55:44.008789 (+ 42us) write_op.cc:276] Timestamp: P: 1777838131562411 usec, L: 0
0503 19:55:44.009045 (+ 256us) write_op.cc:270] Start()
0503 19:55:44.009072 (+ 27us) write_op.cc:276] Timestamp: P: 1777838131584802 usec, L: 0
0503 19:55:44.012778 (+ 3706us) write_op.cc:270] Start()
0503 19:55:44.012814 (+ 36us) write_op.cc:276] Timestamp: P: 1777838131598783 usec, L: 0
0503 19:55:44.013070 (+ 256us) write_op.cc:270] Start()
0503 19:55:44.013095 (+ 25us) write_op.cc:276] Timestamp: P: 1777838131612011 usec, L: 0
0503 19:55:44.013282 (+ 187us) write_op.cc:270] Start()
0503 19:55:44.013304 (+ 22us) write_op.cc:276] Timestamp: P: 1777838131621797 usec, L: 0
0503 19:55:44.013490 (+ 186us) write_op.cc:270] Start()
0503 19:55:44.013515 (+ 25us) write_op.cc:276] Timestamp: P: 1777838131653672 usec, L: 0
0503 19:55:44.013663 (+ 148us) write_op.cc:270] Start()
0503 19:55:44.013691 (+ 28us) write_op.cc:276] Timestamp: P: 1777838131669833 usec, L: 0
0503 19:55:44.014651 (+ 960us) write_op.cc:270] Start()
0503 19:55:44.014676 (+ 25us) write_op.cc:276] Timestamp: P: 1777838131670591 usec, L: 0
0503 19:55:44.014867 (+ 191us) write_op.cc:270] Start()
0503 19:55:44.014889 (+ 22us) write_op.cc:276] Timestamp: P: 1777838131687416 usec, L: 0
0503 19:55:44.015063 (+ 174us) write_op.cc:270] Start()
0503 19:55:44.015087 (+ 24us) write_op.cc:276] Timestamp: P: 1777838131722290 usec, L: 0
0503 19:55:44.015254 (+ 167us) write_op.cc:270] Start()
0503 19:55:44.015273 (+ 19us) write_op.cc:276] Timestamp: P: 1777838131732614 usec, L: 0
0503 19:55:44.015456 (+ 183us) write_op.cc:270] Start()
0503 19:55:44.015489 (+ 33us) write_op.cc:276] Timestamp: P: 1777838131740013 usec, L: 0
0503 19:55:44.015668 (+ 179us) write_op.cc:270] Start()
0503 19:55:44.015691 (+ 23us) write_op.cc:276] Timestamp: P: 1777838131765841 usec, L: 0
0503 19:55:44.015869 (+ 178us) write_op.cc:270] Start()
0503 19:55:44.017273 (+ 1404us) write_op.cc:276] Timestamp: P: 1777838131795407 usec, L: 0
0503 19:55:44.017461 (+ 188us) write_op.cc:270] Start()
0503 19:55:44.017483 (+ 22us) write_op.cc:276] Timestamp: P: 1777838131801225 usec, L: 0
0503 19:55:44.017661 (+ 178us) write_op.cc:270] Start()
0503 19:55:44.017683 (+ 22us) write_op.cc:276] Timestamp: P: 1777838131802979 usec, L: 0
0503 19:55:44.017836 (+ 153us) write_op.cc:270] Start()
0503 19:55:44.017856 (+ 20us) write_op.cc:276] Timestamp: P: 1777838131823046 usec, L: 0
0503 19:55:44.029350 (+ 11494us) write_op.cc:270] Start()
0503 19:55:44.029377 (+ 27us) write_op.cc:276] Timestamp: P: 1777838131851553 usec, L: 0
0503 19:55:44.029586 (+ 209us) write_op.cc:270] Start()
0503 19:55:44.029609 (+ 23us) write_op.cc:276] Timestamp: P: 1777838131873323 usec, L: 0
0503 19:55:44.029749 (+ 140us) write_op.cc:270] Start()
0503 19:55:44.029768 (+ 19us) write_op.cc:276] Timestamp: P: 1777838131894569 usec, L: 0
0503 19:55:44.029943 (+ 175us) write_op.cc:270] Start()
0503 19:55:44.029963 (+ 20us) write_op.cc:276] Timestamp: P: 1777838131903425 usec, L: 0
0503 19:55:44.030231 (+ 268us) write_op.cc:270] Start()
0503 19:55:44.030255 (+ 24us) write_op.cc:276] Timestamp: P: 1777838131910616 usec, L: 0
0503 19:55:44.030428 (+ 173us) write_op.cc:270] Start()
0503 19:55:44.030449 (+ 21us) write_op.cc:276] Timestamp: P: 1777838131973650 usec, L: 0
0503 19:55:44.030591 (+ 142us) write_op.cc:270] Start()
0503 19:55:44.030612 (+ 21us) write_op.cc:276] Timestamp: P: 1777838131983743 usec, L: 0
0503 19:55:44.030767 (+ 155us) write_op.cc:270] Start()
0503 19:55:44.030790 (+ 23us) write_op.cc:276] Timestamp: P: 1777838131984456 usec, L: 0
0503 19:55:44.030929 (+ 139us) write_op.cc:270] Start()
0503 19:55:44.030948 (+ 19us) write_op.cc:276] Timestamp: P: 1777838132000750 usec, L: 0
0503 19:55:44.031113 (+ 165us) write_op.cc:270] Start()
0503 19:55:44.031135 (+ 22us) write_op.cc:276] Timestamp: P: 1777838132027254 usec, L: 0
0503 19:55:44.031284 (+ 149us) write_op.cc:270] Start()
0503 19:55:44.031307 (+ 23us) write_op.cc:276] Timestamp: P: 1777838132049468 usec, L: 0
0503 19:55:44.031494 (+ 187us) write_op.cc:270] Start()
0503 19:55:44.031518 (+ 24us) write_op.cc:276] Timestamp: P: 1777838132052825 usec, L: 0
0503 19:55:44.045350 (+ 13832us) write_op.cc:270] Start()
0503 19:55:44.045380 (+ 30us) write_op.cc:276] Timestamp: P: 1777838132053482 usec, L: 0
0503 19:55:44.062692 (+ 17312us) write_op.cc:270] Start()
0503 19:55:44.062730 (+ 38us) write_op.cc:276] Timestamp: P: 1777838132096847 usec, L: 0
0503 19:55:44.064631 (+ 1901us) write_op.cc:270] Start()
0503 19:55:44.064662 (+ 31us) write_op.cc:276] Timestamp: P: 1777838132104875 usec, L: 0
0503 19:55:44.079176 (+ 14514us) write_op.cc:270] Start()
0503 19:55:44.079200 (+ 24us) write_op.cc:276] Timestamp: P: 1777838132107273 usec, L: 0
0503 19:55:44.079772 (+ 572us) write_op.cc:270] Start()
0503 19:55:44.079810 (+ 38us) write_op.cc:276] Timestamp: P: 1777838132123115 usec, L: 0
0503 19:55:44.080002 (+ 192us) write_op.cc:270] Start()
0503 19:55:44.080025 (+ 23us) write_op.cc:276] Timestamp: P: 1777838132164592 usec, L: 0
0503 19:55:44.080175 (+ 150us) write_op.cc:270] Start()
0503 19:55:44.080297 (+ 122us) write_op.cc:276] Timestamp: P: 1777838132169044 usec, L: 0
0503 19:55:44.080477 (+ 180us) write_op.cc:270] Start()
0503 19:55:44.080532 (+ 55us) write_op.cc:276] Timestamp: P: 1777838132176552 usec, L: 0
0503 19:55:44.080703 (+ 171us) write_op.cc:270] Start()
0503 19:55:44.080727 (+ 24us) write_op.cc:276] Timestamp: P: 1777838132185552 usec, L: 0
0503 19:55:44.080883 (+ 156us) write_op.cc:270] Start()
0503 19:55:44.080905 (+ 22us) write_op.cc:276] Timestamp: P: 1777838132217876 usec, L: 0
0503 19:55:44.081085 (+ 180us) write_op.cc:270] Start()
0503 19:55:44.081107 (+ 22us) write_op.cc:276] Timestamp: P: 1777838132234891 usec, L: 0
0503 19:55:44.081244 (+ 137us) write_op.cc:270] Start()
0503 19:55:44.081270 (+ 26us) write_op.cc:276] Timestamp: P: 1777838132236718 usec, L: 0
0503 19:55:44.082090 (+ 820us) write_op.cc:270] Start()
0503 19:55:44.082116 (+ 26us) write_op.cc:276] Timestamp: P: 1777838132238334 usec, L: 0
0503 19:55:44.082291 (+ 175us) write_op.cc:270] Start()
0503 19:55:44.082315 (+ 24us) write_op.cc:276] Timestamp: P: 1777838132274891 usec, L: 0
0503 19:55:44.082482 (+ 167us) write_op.cc:270] Start()
0503 19:55:44.082513 (+ 31us) write_op.cc:276] Timestamp: P: 1777838132291499 usec, L: 0
0503 19:55:44.082663 (+ 150us) write_op.cc:270] Start()
0503 19:55:44.082685 (+ 22us) write_op.cc:276] Timestamp: P: 1777838132295746 usec, L: 0
0503 19:55:44.082833 (+ 148us) write_op.cc:270] Start()
0503 19:55:44.082853 (+ 20us) write_op.cc:276] Timestamp: P: 1777838132304587 usec, L: 0
0503 19:55:44.083026 (+ 173us) write_op.cc:270] Start()
0503 19:55:44.083047 (+ 21us) write_op.cc:276] Timestamp: P: 1777838132333104 usec, L: 0
0503 19:55:44.083193 (+ 146us) write_op.cc:270] Start()
0503 19:55:44.083213 (+ 20us) write_op.cc:276] Timestamp: P: 1777838132371535 usec, L: 0
0503 19:55:44.083339 (+ 126us) write_op.cc:270] Start()
0503 19:55:44.083360 (+ 21us) write_op.cc:276] Timestamp: P: 1777838132372614 usec, L: 0
0503 19:55:44.105099 (+ 21739us) write_op.cc:270] Start()
0503 19:55:44.105135 (+ 36us) write_op.cc:276] Timestamp: P: 1777838132373899 usec, L: 0
0503 19:55:44.119333 (+ 14198us) write_op.cc:270] Start()
0503 19:55:44.119366 (+ 33us) write_op.cc:276] Timestamp: P: 1777838132412928 usec, L: 0
0503 19:55:44.124881 (+ 5515us) write_op.cc:270] Start()
0503 19:55:44.124911 (+ 30us) write_op.cc:276] Timestamp: P: 1777838132414137 usec, L: 0
0503 19:55:44.125084 (+ 173us) write_op.cc:270] Start()
0503 19:55:44.125103 (+ 19us) write_op.cc:276] Timestamp: P: 1777838132416581 usec, L: 0
0503 19:55:44.133394 (+ 8291us) write_op.cc:270] Start()
0503 19:55:44.133433 (+ 39us) write_op.cc:276] Timestamp: P: 1777838132418174 usec, L: 0
0503 19:55:44.137489 (+ 4056us) write_op.cc:270] Start()
0503 19:55:44.137530 (+ 41us) write_op.cc:276] Timestamp: P: 1777838132457009 usec, L: 0
0503 19:55:44.138765 (+ 1235us) write_op.cc:270] Start()
0503 19:55:44.138820 (+ 55us) write_op.cc:276] Timestamp: P: 1777838132473961 usec, L: 0
0503 19:55:44.149438 (+ 10618us) write_op.cc:270] Start()
0503 19:55:44.149480 (+ 42us) write_op.cc:276] Timestamp: P: 1777838132491351 usec, L: 0
0503 19:55:44.149665 (+ 185us) write_op.cc:270] Start()
0503 19:55:44.149688 (+ 23us) write_op.cc:276] Timestamp: P: 1777838132495793 usec, L: 0
0503 19:55:44.149933 (+ 245us) write_op.cc:270] Start()
0503 19:55:44.149958 (+ 25us) write_op.cc:276] Timestamp: P: 1777838132524364 usec, L: 0
0503 19:55:44.150171 (+ 213us) write_op.cc:270] Start()
0503 19:55:44.150194 (+ 23us) write_op.cc:276] Timestamp: P: 1777838132542096 usec, L: 0
0503 19:55:44.150426 (+ 232us) write_op.cc:270] Start()
0503 19:55:44.150449 (+ 23us) write_op.cc:276] Timestamp: P: 1777838132553120 usec, L: 0
0503 19:55:44.153953 (+ 3504us) write_op.cc:270] Start()
0503 19:55:44.153982 (+ 29us) write_op.cc:276] Timestamp: P: 1777838132574714 usec, L: 0
0503 19:55:44.155292 (+ 1310us) write_op.cc:270] Start()
0503 19:55:44.155325 (+ 33us) write_op.cc:276] Timestamp: P: 1777838132591301 usec, L: 0
0503 19:55:44.159015 (+ 3690us) write_op.cc:270] Start()
0503 19:55:44.159048 (+ 33us) write_op.cc:276] Timestamp: P: 1777838132612410 usec, L: 0
0503 19:55:44.162635 (+ 3587us) write_op.cc:270] Start()
0503 19:55:44.167016 (+ 4381us) write_op.cc:276] Timestamp: P: 1777838132615386 usec, L: 0
0503 19:55:44.167279 (+ 263us) write_op.cc:270] Start()
0503 19:55:44.167311 (+ 32us) write_op.cc:276] Timestamp: P: 1777838132623346 usec, L: 0
0503 19:55:44.177463 (+ 10152us) write_op.cc:270] Start()
0503 19:55:44.177498 (+ 35us) write_op.cc:276] Timestamp: P: 1777838132662693 usec, L: 0
0503 19:55:44.179802 (+ 2304us) write_op.cc:270] Start()
0503 19:55:44.179835 (+ 33us) write_op.cc:276] Timestamp: P: 1777838132670165 usec, L: 0
0503 19:55:44.185667 (+ 5832us) write_op.cc:270] Start()
0503 19:55:44.185707 (+ 40us) write_op.cc:276] Timestamp: P: 1777838132672498 usec, L: 0
0503 19:55:44.185937 (+ 230us) write_op.cc:270] Start()
0503 19:55:44.185981 (+ 44us) write_op.cc:276] Timestamp: P: 1777838132694226 usec, L: 0
0503 19:55:44.202494 (+ 16513us) write_op.cc:270] Start()
0503 19:55:44.202543 (+ 49us) write_op.cc:276] Timestamp: P: 1777838132727073 usec, L: 0
0503 19:55:44.205992 (+ 3449us) write_op.cc:270] Start()
0503 19:55:44.206041 (+ 49us) write_op.cc:276] Timestamp: P: 1777838132771160 usec, L: 0
0503 19:55:44.225906 (+ 19865us) write_op.cc:270] Start()
0503 19:55:44.225947 (+ 41us) write_op.cc:276] Timestamp: P: 1777838132772266 usec, L: 0
0503 19:55:44.226155 (+ 208us) write_op.cc:270] Start()
0503 19:55:44.226175 (+ 20us) write_op.cc:276] Timestamp: P: 1777838132782892 usec, L: 0
0503 19:55:44.240610 (+ 14435us) write_op.cc:270] Start()
0503 19:55:44.240656 (+ 46us) write_op.cc:276] Timestamp: P: 1777838132796818 usec, L: 0
0503 19:55:44.246894 (+ 6238us) write_op.cc:270] Start()
0503 19:55:44.246920 (+ 26us) write_op.cc:276] Timestamp: P: 1777838132834307 usec, L: 0
0503 19:55:44.248848 (+ 1928us) write_op.cc:270] Start()
0503 19:55:44.248880 (+ 32us) write_op.cc:276] Timestamp: P: 1777838132841414 usec, L: 0
0503 19:55:44.275337 (+ 26457us) write_op.cc:270] Start()
0503 19:55:44.275378 (+ 41us) write_op.cc:276] Timestamp: P: 1777838132854956 usec, L: 0
0503 19:55:44.291834 (+ 16456us) write_op.cc:270] Start()
0503 19:55:44.291893 (+ 59us) write_op.cc:276] Timestamp: P: 1777838132862611 usec, L: 0
0503 19:55:44.292173 (+ 280us) write_op.cc:270] Start()
0503 19:55:44.292198 (+ 25us) write_op.cc:276] Timestamp: P: 1777838132869087 usec, L: 0
0503 19:55:44.292353 (+ 155us) write_op.cc:270] Start()
0503 19:55:44.292387 (+ 34us) write_op.cc:276] Timestamp: P: 1777838132902798 usec, L: 0
0503 19:55:44.292534 (+ 147us) write_op.cc:270] Start()
0503 19:55:44.292575 (+ 41us) write_op.cc:276] Timestamp: P: 1777838132935143 usec, L: 0
0503 19:55:44.292727 (+ 152us) write_op.cc:270] Start()
0503 19:55:44.292748 (+ 21us) write_op.cc:276] Timestamp: P: 1777838132937450 usec, L: 0
0503 19:55:44.292940 (+ 192us) write_op.cc:270] Start()
0503 19:55:44.292966 (+ 26us) write_op.cc:276] Timestamp: P: 1777838132941989 usec, L: 0
0503 19:55:44.293136 (+ 170us) write_op.cc:270] Start()
0503 19:55:44.293156 (+ 20us) write_op.cc:276] Timestamp: P: 1777838132960917 usec, L: 0
0503 19:55:44.293298 (+ 142us) write_op.cc:270] Start()
0503 19:55:44.293317 (+ 19us) write_op.cc:276] Timestamp: P: 1777838133010159 usec, L: 0
0503 19:55:44.293469 (+ 152us) write_op.cc:270] Start()
0503 19:55:44.293488 (+ 19us) write_op.cc:276] Timestamp: P: 1777838133016374 usec, L: 0
0503 19:55:44.293613 (+ 125us) write_op.cc:270] Start()
0503 19:55:44.293632 (+ 19us) write_op.cc:276] Timestamp: P: 1777838133019405 usec, L: 0
0503 19:55:44.293764 (+ 132us) write_op.cc:270] Start()
0503 19:55:44.293783 (+ 19us) write_op.cc:276] Timestamp: P: 1777838133043283 usec, L: 0
0503 19:55:44.293926 (+ 143us) write_op.cc:270] Start()
0503 19:55:44.293945 (+ 19us) write_op.cc:276] Timestamp: P: 1777838133069092 usec, L: 0
0503 19:55:44.294143 (+ 198us) write_op.cc:270] Start()
0503 19:55:44.294165 (+ 22us) write_op.cc:276] Timestamp: P: 1777838133098724 usec, L: 0
0503 19:55:44.294317 (+ 152us) write_op.cc:270] Start()
0503 19:55:44.294336 (+ 19us) write_op.cc:276] Timestamp: P: 1777838133101167 usec, L: 0
0503 19:55:44.294484 (+ 148us) write_op.cc:270] Start()
0503 19:55:44.294503 (+ 19us) write_op.cc:276] Timestamp: P: 1777838133118790 usec, L: 0
0503 19:55:44.294646 (+ 143us) write_op.cc:270] Start()
0503 19:55:44.294666 (+ 20us) write_op.cc:276] Timestamp: P: 1777838133135809 usec, L: 0
0503 19:55:44.294810 (+ 144us) write_op.cc:270] Start()
0503 19:55:44.294830 (+ 20us) write_op.cc:276] Timestamp: P: 1777838133176471 usec, L: 0
0503 19:55:44.294966 (+ 136us) write_op.cc:270] Start()
0503 19:55:44.294984 (+ 18us) write_op.cc:276] Timestamp: P: 1777838133177106 usec, L: 0
0503 19:55:44.295172 (+ 188us) write_op.cc:270] Start()
0503 19:55:44.295196 (+ 24us) write_op.cc:276] Timestamp: P: 1777838133190740 usec, L: 0
0503 19:55:44.295413 (+ 217us) write_op.cc:270] Start()
0503 19:55:44.295434 (+ 21us) write_op.cc:276] Timestamp: P: 1777838133207084 usec, L: 0
0503 19:55:44.295588 (+ 154us) write_op.cc:270] Start()
0503 19:55:44.295609 (+ 21us) write_op.cc:276] Timestamp: P: 1777838133249394 usec, L: 0
0503 19:55:44.296154 (+ 545us) write_op.cc:270] Start()
0503 19:55:44.296176 (+ 22us) write_op.cc:276] Timestamp: P: 1777838133251493 usec, L: 0
0503 19:55:44.296317 (+ 141us) write_op.cc:270] Start()
0503 19:55:44.296336 (+ 19us) write_op.cc:276] Timestamp: P: 1777838133299761 usec, L: 0
0503 19:55:44.296468 (+ 132us) write_op.cc:270] Start()
0503 19:55:44.296488 (+ 20us) write_op.cc:276] Timestamp: P: 1777838133300950 usec, L: 0
0503 19:55:44.313905 (+ 17417us) write_op.cc:270] Start()
0503 19:55:44.313936 (+ 31us) write_op.cc:276] Timestamp: P: 1777838133308757 usec, L: 0
0503 19:55:44.316190 (+ 2254us) write_op.cc:270] Start()
0503 19:55:44.316224 (+ 34us) write_op.cc:276] Timestamp: P: 1777838133336519 usec, L: 0
0503 19:55:44.318663 (+ 2439us) write_op.cc:270] Start()
0503 19:55:44.318685 (+ 22us) write_op.cc:276] Timestamp: P: 1777838133340788 usec, L: 0
0503 19:55:44.318891 (+ 206us) write_op.cc:270] Start()
0503 19:55:44.318914 (+ 23us) write_op.cc:276] Timestamp: P: 1777838133368519 usec, L: 0
0503 19:55:44.319048 (+ 134us) write_op.cc:270] Start()
0503 19:55:44.319063 (+ 15us) write_op.cc:276] Timestamp: P: 1777838133383843 usec, L: 0
0503 19:55:44.319245 (+ 182us) write_op.cc:270] Start()
0503 19:55:44.319285 (+ 40us) write_op.cc:276] Timestamp: P: 1777838133408353 usec, L: 0
0503 19:55:44.319396 (+ 111us) write_op.cc:270] Start()
0503 19:55:44.319412 (+ 16us) write_op.cc:276] Timestamp: P: 1777838133410130 usec, L: 0
0503 19:55:44.319537 (+ 125us) write_op.cc:270] Start()
0503 19:55:44.319552 (+ 15us) write_op.cc:276] Timestamp: P: 1777838133430547 usec, L: 0
0503 19:55:44.319735 (+ 183us) write_op.cc:270] Start()
0503 19:55:44.319757 (+ 22us) write_op.cc:276] Timestamp: P: 1777838133463669 usec, L: 0
0503 19:55:44.319893 (+ 136us) write_op.cc:270] Start()
0503 19:55:44.319909 (+ 16us) write_op.cc:276] Timestamp: P: 1777838133464880 usec, L: 0
0503 19:55:44.320028 (+ 119us) write_op.cc:270] Start()
0503 19:55:44.320054 (+ 26us) write_op.cc:276] Timestamp: P: 1777838133489159 usec, L: 0
0503 19:55:44.320167 (+ 113us) write_op.cc:270] Start()
0503 19:55:44.320182 (+ 15us) write_op.cc:276] Timestamp: P: 1777838133506457 usec, L: 0
0503 19:55:44.320289 (+ 107us) write_op.cc:270] Start()
0503 19:55:44.320304 (+ 15us) write_op.cc:276] Timestamp: P: 1777838133543308 usec, L: 0
0503 19:55:44.320419 (+ 115us) write_op.cc:270] Start()
0503 19:55:44.320433 (+ 14us) write_op.cc:276] Timestamp: P: 1777838133552029 usec, L: 0
0503 19:55:44.320541 (+ 108us) write_op.cc:270] Start()
0503 19:55:44.320556 (+ 15us) write_op.cc:276] Timestamp: P: 1777838133572598 usec, L: 0
0503 19:55:44.320684 (+ 128us) write_op.cc:270] Start()
0503 19:55:44.320704 (+ 20us) write_op.cc:276] Timestamp: P: 1777838133581297 usec, L: 0
0503 19:55:44.320822 (+ 118us) write_op.cc:270] Start()
0503 19:55:44.320837 (+ 15us) write_op.cc:276] Timestamp: P: 1777838133622267 usec, L: 0
0503 19:55:44.320935 (+ 98us) write_op.cc:270] Start()
0503 19:55:44.320950 (+ 15us) write_op.cc:276] Timestamp: P: 1777838133631852 usec, L: 0
0503 19:55:44.321067 (+ 117us) write_op.cc:270] Start()
0503 19:55:44.321082 (+ 15us) write_op.cc:276] Timestamp: P: 1777838133641328 usec, L: 0
0503 19:55:44.321271 (+ 189us) write_op.cc:270] Start()
0503 19:55:44.321294 (+ 23us) write_op.cc:276] Timestamp: P: 1777838133670086 usec, L: 0
0503 19:55:44.321468 (+ 174us) write_op.cc:270] Start()
0503 19:55:44.321488 (+ 20us) write_op.cc:276] Timestamp: P: 1777838133673068 usec, L: 0
0503 19:55:44.321676 (+ 188us) write_op.cc:270] Start()
0503 19:55:44.321701 (+ 25us) write_op.cc:276] Timestamp: P: 1777838133717443 usec, L: 0
0503 19:55:44.321846 (+ 145us) write_op.cc:270] Start()
0503 19:55:44.321878 (+ 32us) write_op.cc:276] Timestamp: P: 1777838133732410 usec, L: 0
0503 19:55:44.322886 (+ 1008us) write_op.cc:270] Start()
0503 19:55:44.322911 (+ 25us) write_op.cc:276] Timestamp: P: 1777838133756033 usec, L: 0
0503 19:55:44.323087 (+ 176us) write_op.cc:270] Start()
0503 19:55:44.323104 (+ 17us) write_op.cc:276] Timestamp: P: 1777838133756851 usec, L: 0
0503 19:55:44.323226 (+ 122us) write_op.cc:270] Start()
0503 19:55:44.323242 (+ 16us) write_op.cc:276] Timestamp: P: 1777838133780523 usec, L: 0
0503 19:55:44.323489 (+ 247us) write_op.cc:270] Start()
0503 19:55:44.323520 (+ 31us) write_op.cc:276] Timestamp: P: 1777838133817106 usec, L: 0
0503 19:55:44.391705 (+ 68185us) write_op.cc:270] Start()
0503 19:55:44.391755 (+ 50us) write_op.cc:276] Timestamp: P: 1777838133850091 usec, L: 0
0503 19:55:44.393641 (+ 1886us) write_op.cc:270] Start()
0503 19:55:44.393662 (+ 21us) write_op.cc:276] Timestamp: P: 1777838133887634 usec, L: 0
0503 19:55:44.393810 (+ 148us) write_op.cc:270] Start()
0503 19:55:44.393829 (+ 19us) write_op.cc:276] Timestamp: P: 1777838133906556 usec, L: 0
0503 19:55:44.393960 (+ 131us) write_op.cc:270] Start()
0503 19:55:44.393990 (+ 30us) write_op.cc:276] Timestamp: P: 1777838133908096 usec, L: 0
0503 19:55:44.394199 (+ 209us) write_op.cc:270] Start()
0503 19:55:44.394220 (+ 21us) write_op.cc:276] Timestamp: P: 1777838133917493 usec, L: 0
0503 19:55:44.394342 (+ 122us) write_op.cc:270] Start()
0503 19:55:44.394358 (+ 16us) write_op.cc:276] Timestamp: P: 1777838133945325 usec, L: 0
0503 19:55:44.394503 (+ 145us) write_op.cc:270] Start()
0503 19:55:44.394520 (+ 17us) write_op.cc:276] Timestamp: P: 1777838133982968 usec, L: 0
0503 19:55:44.394664 (+ 144us) write_op.cc:270] Start()
0503 19:55:44.394680 (+ 16us) write_op.cc:276] Timestamp: P: 1777838133989762 usec, L: 0
0503 19:55:44.394808 (+ 128us) write_op.cc:270] Start()
0503 19:55:44.394825 (+ 17us) write_op.cc:276] Timestamp: P: 1777838133991828 usec, L: 0
0503 19:55:44.394956 (+ 131us) write_op.cc:270] Start()
0503 19:55:44.394973 (+ 17us) write_op.cc:276] Timestamp: P: 1777838134036248 usec, L: 0
0503 19:55:44.395165 (+ 192us) write_op.cc:270] Start()
0503 19:55:44.395185 (+ 20us) write_op.cc:276] Timestamp: P: 1777838134063495 usec, L: 0
0503 19:55:44.395339 (+ 154us) write_op.cc:270] Start()
0503 19:55:44.395357 (+ 18us) write_op.cc:276] Timestamp: P: 1777838134073303 usec, L: 0
0503 19:55:44.395487 (+ 130us) write_op.cc:270] Start()
0503 19:55:44.395505 (+ 18us) write_op.cc:276] Timestamp: P: 1777838134082069 usec, L: 0
0503 19:55:44.395623 (+ 118us) write_op.cc:270] Start()
0503 19:55:44.395666 (+ 43us) write_op.cc:276] Timestamp: P: 1777838134094887 usec, L: 0
0503 19:55:44.395815 (+ 149us) write_op.cc:270] Start()
0503 19:55:44.429361 (+ 33546us) write_op.cc:276] Timestamp: P: 1777838134136380 usec, L: 0
0503 19:55:44.429700 (+ 339us) write_op.cc:270] Start()
0503 19:55:44.429730 (+ 30us) write_op.cc:276] Timestamp: P: 1777838134164985 usec, L: 0
0503 19:55:44.430193 (+ 463us) write_op.cc:270] Start()
0503 19:55:44.430220 (+ 27us) write_op.cc:276] Timestamp: P: 1777838134170030 usec, L: 0
0503 19:55:44.430388 (+ 168us) write_op.cc:270] Start()
0503 19:55:44.430410 (+ 22us) write_op.cc:276] Timestamp: P: 1777838134196988 usec, L: 0
0503 19:55:44.430576 (+ 166us) write_op.cc:270] Start()
0503 19:55:44.430602 (+ 26us) write_op.cc:276] Timestamp: P: 1777838134221532 usec, L: 0
0503 19:55:44.430785 (+ 183us) write_op.cc:270] Start()
0503 19:55:44.430806 (+ 21us) write_op.cc:276] Timestamp: P: 1777838134254855 usec, L: 0
0503 19:55:44.430971 (+ 165us) write_op.cc:270] Start()
0503 19:55:44.431003 (+ 32us) write_op.cc:276] Timestamp: P: 1777838134258234 usec, L: 0
0503 19:55:44.431152 (+ 149us) write_op.cc:270] Start()
0503 19:55:44.431172 (+ 20us) write_op.cc:276] Timestamp: P: 1777838134292356 usec, L: 0
0503 19:55:44.431417 (+ 245us) write_op.cc:270] Start()
0503 19:55:44.431440 (+ 23us) write_op.cc:276] Timestamp: P: 1777838134334487 usec, L: 0
0503 19:55:44.431577 (+ 137us) write_op.cc:270] Start()
0503 19:55:44.431598 (+ 21us) write_op.cc:276] Timestamp: P: 1777838134359997 usec, L: 0
0503 19:55:44.431793 (+ 195us) write_op.cc:270] Start()
0503 19:55:44.431814 (+ 21us) write_op.cc:276] Timestamp: P: 1777838134373056 usec, L: 0
0503 19:55:44.431964 (+ 150us) write_op.cc:270] Start()
0503 19:55:44.431996 (+ 32us) write_op.cc:276] Timestamp: P: 1777838134400178 usec, L: 0
0503 19:55:44.433095 (+ 1099us) write_op.cc:270] Start()
0503 19:55:44.433123 (+ 28us) write_op.cc:276] Timestamp: P: 1777838134433679 usec, L: 0
0503 19:55:44.433301 (+ 178us) write_op.cc:270] Start()
0503 19:55:44.433323 (+ 22us) write_op.cc:276] Timestamp: P: 1777838134478831 usec, L: 0
0503 19:55:44.433473 (+ 150us) write_op.cc:270] Start()
0503 19:55:44.433497 (+ 24us) write_op.cc:276] Timestamp: P: 1777838134492578 usec, L: 0
0503 19:55:44.433668 (+ 171us) write_op.cc:270] Start()
0503 19:55:44.433684 (+ 16us) write_op.cc:276] Timestamp: P: 1777838134498518 usec, L: 0
0503 19:55:44.433890 (+ 206us) write_op.cc:270] Start()
0503 19:55:44.433908 (+ 18us) write_op.cc:276] Timestamp: P: 1777838134515880 usec, L: 0
0503 19:55:44.434059 (+ 151us) write_op.cc:270] Start()
0503 19:55:44.434076 (+ 17us) write_op.cc:276] Timestamp: P: 1777838134555746 usec, L: 0
0503 19:55:44.459255 (+ 25179us) write_op.cc:270] Start()
0503 19:55:44.459307 (+ 52us) write_op.cc:276] Timestamp: P: 1777838134557938 usec, L: 0
0503 19:55:44.459563 (+ 256us) write_op.cc:270] Start()
0503 19:55:44.459585 (+ 22us) write_op.cc:276] Timestamp: P: 1777838134566666 usec, L: 0
0503 19:55:44.467503 (+ 7918us) write_op.cc:270] Start()
0503 19:55:44.467534 (+ 31us) write_op.cc:276] Timestamp: P: 1777838134575762 usec, L: 0
0503 19:55:44.472425 (+ 4891us) write_op.cc:270] Start()
0503 19:55:44.472457 (+ 32us) write_op.cc:276] Timestamp: P: 1777838134612586 usec, L: 0
0503 19:55:44.472636 (+ 179us) write_op.cc:270] Start()
0503 19:55:44.472656 (+ 20us) write_op.cc:276] Timestamp: P: 1777838134640650 usec, L: 0
0503 19:55:44.475798 (+ 3142us) write_op.cc:270] Start()
0503 19:55:44.475828 (+ 30us) write_op.cc:276] Timestamp: P: 1777838134674567 usec, L: 0
0503 19:55:44.476026 (+ 198us) write_op.cc:270] Start()
0503 19:55:44.476053 (+ 27us) write_op.cc:276] Timestamp: P: 1777838134699277 usec, L: 0
0503 19:55:44.476225 (+ 172us) write_op.cc:270] Start()
0503 19:55:44.476359 (+ 134us) write_op.cc:276] Timestamp: P: 1777838134699953 usec, L: 0
0503 19:55:44.476563 (+ 204us) write_op.cc:270] Start()
0503 19:55:44.476585 (+ 22us) write_op.cc:276] Timestamp: P: 1777838134729455 usec, L: 0
0503 19:55:44.476753 (+ 168us) write_op.cc:270] Start()
0503 19:55:44.476775 (+ 22us) write_op.cc:276] Timestamp: P: 1777838134759880 usec, L: 0
0503 19:55:44.476936 (+ 161us) write_op.cc:270] Start()
0503 19:55:44.476958 (+ 22us) write_op.cc:276] Timestamp: P: 1777838134786740 usec, L: 0
0503 19:55:44.477121 (+ 163us) write_op.cc:270] Start()
0503 19:55:44.477142 (+ 21us) write_op.cc:276] Timestamp: P: 1777838134855331 usec, L: 0
0503 19:55:44.477315 (+ 173us) write_op.cc:270] Start()
0503 19:55:44.477335 (+ 20us) write_op.cc:276] Timestamp: P: 177783
W20260503 19:55:48.204469 796 consensus_peers.cc:597] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 126: this message will repeat every 5th retry.
I20260503 19:55:48.562033 1522 raft_consensus.cc:493] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d99e4f4d5ca48e0bdb54daf8361c5e8)
I20260503 19:55:48.562297 1522 raft_consensus.cc:515] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:48.608325 1435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.105.3:47337 (request call id 14) took 1324 ms. Trace:
I20260503 19:55:48.625385 731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c99d75cb2be4439a1610c0de343d73a" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 795 } } ignore_live_leader: false dest_uuid: "a1219433b66444d091420ceeab5092ef" is_pre_election: true
I20260503 19:55:48.626019 857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c99d75cb2be4439a1610c0de343d73a" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 795 } } ignore_live_leader: false dest_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" is_pre_election: true
I20260503 19:55:48.636860 1522 leader_election.cc:290] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1219433b66444d091420ceeab5092ef (127.0.105.2:38837), 6d99e4f4d5ca48e0bdb54daf8361c5e8 (127.0.105.3:35005)
I20260503 19:55:48.663470 1358 leader_election.cc:304] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e52aa88a17542609e84f0c09fb85d87; no voters: 6d99e4f4d5ca48e0bdb54daf8361c5e8, a1219433b66444d091420ceeab5092ef
I20260503 19:55:48.691335 1522 raft_consensus.cc:2749] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 19:55:48.815852 1500 raft_consensus.cc:493] T a860805e8df84220ae4be7d3279b75f1 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a1219433b66444d091420ceeab5092ef)
I20260503 19:55:48.832882 1500 raft_consensus.cc:515] T a860805e8df84220ae4be7d3279b75f1 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } }
I20260503 19:55:48.836764 1500 leader_election.cc:290] T a860805e8df84220ae4be7d3279b75f1 P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d99e4f4d5ca48e0bdb54daf8361c5e8 (127.0.105.3:35005), a1219433b66444d091420ceeab5092ef (127.0.105.2:38837)
I20260503 19:55:48.842334 860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860805e8df84220ae4be7d3279b75f1" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 724 } } ignore_live_leader: false dest_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" is_pre_election: true
I20260503 19:55:48.847976 731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860805e8df84220ae4be7d3279b75f1" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 724 } } ignore_live_leader: false dest_uuid: "a1219433b66444d091420ceeab5092ef" is_pre_election: true
I20260503 19:55:48.854591 1431 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.105.2:39423 (request call id 26) took 3401 ms. Trace:
I20260503 19:55:48.865846 1356 leader_election.cc:304] T a860805e8df84220ae4be7d3279b75f1 P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e52aa88a17542609e84f0c09fb85d87; no voters: 6d99e4f4d5ca48e0bdb54daf8361c5e8, a1219433b66444d091420ceeab5092ef
I20260503 19:55:48.874109 1500 raft_consensus.cc:2749] T a860805e8df84220ae4be7d3279b75f1 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260503 19:55:48.895749 665 consensus_peers.cc:597] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 116: this message will repeat every 5th retry.
I20260503 19:55:49.045523 1500 raft_consensus.cc:493] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d99e4f4d5ca48e0bdb54daf8361c5e8)
I20260503 19:55:49.068688 1500 raft_consensus.cc:515] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:49.071676 1500 leader_election.cc:290] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1219433b66444d091420ceeab5092ef (127.0.105.2:38837), 6d99e4f4d5ca48e0bdb54daf8361c5e8 (127.0.105.3:35005)
I20260503 19:55:49.072547 860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c99d75cb2be4439a1610c0de343d73a" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 795 } } ignore_live_leader: false dest_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" is_pre_election: true
I20260503 19:55:49.072741 729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c99d75cb2be4439a1610c0de343d73a" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 795 } } ignore_live_leader: false dest_uuid: "a1219433b66444d091420ceeab5092ef" is_pre_election: true
I20260503 19:55:49.077168 1356 leader_election.cc:304] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e52aa88a17542609e84f0c09fb85d87; no voters: 6d99e4f4d5ca48e0bdb54daf8361c5e8, a1219433b66444d091420ceeab5092ef
I20260503 19:55:49.078611 1500 raft_consensus.cc:2749] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 19:55:49.310298 1500 raft_consensus.cc:493] T a860805e8df84220ae4be7d3279b75f1 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a1219433b66444d091420ceeab5092ef)
I20260503 19:55:49.310974 1500 raft_consensus.cc:515] T a860805e8df84220ae4be7d3279b75f1 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } }
I20260503 19:55:49.312240 1500 leader_election.cc:290] T a860805e8df84220ae4be7d3279b75f1 P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d99e4f4d5ca48e0bdb54daf8361c5e8 (127.0.105.3:35005), a1219433b66444d091420ceeab5092ef (127.0.105.2:38837)
I20260503 19:55:49.312819 729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860805e8df84220ae4be7d3279b75f1" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 724 } } ignore_live_leader: false dest_uuid: "a1219433b66444d091420ceeab5092ef" is_pre_election: true
I20260503 19:55:49.316514 859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860805e8df84220ae4be7d3279b75f1" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 724 } } ignore_live_leader: false dest_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" is_pre_election: true
I20260503 19:55:49.323691 1358 leader_election.cc:304] T a860805e8df84220ae4be7d3279b75f1 P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e52aa88a17542609e84f0c09fb85d87; no voters: 6d99e4f4d5ca48e0bdb54daf8361c5e8, a1219433b66444d091420ceeab5092ef
I20260503 19:55:49.326795 1500 raft_consensus.cc:2749] T a860805e8df84220ae4be7d3279b75f1 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 19:55:49.451479 1500 raft_consensus.cc:493] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d99e4f4d5ca48e0bdb54daf8361c5e8)
I20260503 19:55:49.452834 1500 raft_consensus.cc:515] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:49.453565 1500 leader_election.cc:290] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1219433b66444d091420ceeab5092ef (127.0.105.2:38837), 6d99e4f4d5ca48e0bdb54daf8361c5e8 (127.0.105.3:35005)
I20260503 19:55:49.454160 728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c99d75cb2be4439a1610c0de343d73a" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 795 } } ignore_live_leader: false dest_uuid: "a1219433b66444d091420ceeab5092ef" is_pre_election: true
I20260503 19:55:49.454231 860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c99d75cb2be4439a1610c0de343d73a" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 795 } } ignore_live_leader: false dest_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" is_pre_election: true
I20260503 19:55:49.457203 1356 leader_election.cc:304] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e52aa88a17542609e84f0c09fb85d87; no voters: 6d99e4f4d5ca48e0bdb54daf8361c5e8, a1219433b66444d091420ceeab5092ef
I20260503 19:55:49.458189 1500 raft_consensus.cc:2749] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260503 19:55:49.577662 795 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.2:38837, user_credentials={real_user=slave}} blocked reactor thread for 44191.7us
I20260503 19:55:49.619786 1527 raft_consensus.cc:493] T ecf4b80ba8714f24a49387dc8bbe2da3 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a1219433b66444d091420ceeab5092ef)
I20260503 19:55:49.620312 1527 raft_consensus.cc:515] T ecf4b80ba8714f24a49387dc8bbe2da3 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:49.621649 1527 leader_election.cc:290] T ecf4b80ba8714f24a49387dc8bbe2da3 P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1219433b66444d091420ceeab5092ef (127.0.105.2:38837), 6d99e4f4d5ca48e0bdb54daf8361c5e8 (127.0.105.3:35005)
I20260503 19:55:49.622685 860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf4b80ba8714f24a49387dc8bbe2da3" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 835 } } ignore_live_leader: false dest_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" is_pre_election: true
I20260503 19:55:49.623485 728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf4b80ba8714f24a49387dc8bbe2da3" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 835 } } ignore_live_leader: false dest_uuid: "a1219433b66444d091420ceeab5092ef" is_pre_election: true
I20260503 19:55:49.624089 1356 leader_election.cc:304] T ecf4b80ba8714f24a49387dc8bbe2da3 P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e52aa88a17542609e84f0c09fb85d87; no voters: 6d99e4f4d5ca48e0bdb54daf8361c5e8, a1219433b66444d091420ceeab5092ef
I20260503 19:55:49.624606 1527 raft_consensus.cc:2749] T ecf4b80ba8714f24a49387dc8bbe2da3 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 19:55:49.632568 1433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.105.2:39423 (request call id 39) took 1527 ms. Trace:
I20260503 19:55:49.632881 1387 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:58682 (request call id 9) took 3111 ms. Trace:
I20260503 19:55:49.632985 1387 rpcz_store.cc:276] 0503 19:55:46.519796 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 19:55:46.519854 (+ 58us) service_pool.cc:224] Handling call
0503 19:55:48.832850 (+2312996us) spinlock_profiling.cc:243] Waited 2.29 s on lock 0x616000019654. stack: 00007f2b5ee49086 00007f2b5ee48e40 00007f2b5de023ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007f2b6ad5b8c0 00007f2b6ec16eaf 00007f2b6902ec36 00007f2b6902e965 00007f2b65e3c10e 00007f2b65e3afee 00007f2b65e41228 00007f2b65e41b8f 00007f2b65e419b8 0000000000aa4cac
0503 19:55:49.631195 (+798345us) spinlock_profiling.cc:243] Waited 793 ms on lock 0x616000019054. stack: 00007f2b5ee49086 00007f2b5ee48e40 00007f2b5de023ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007f2b6ad5b8c0 00007f2b6ec16eaf 00007f2b6902ec36 00007f2b6902e965 00007f2b65e3c10e 00007f2b65e3afee 00007f2b65e41228 00007f2b65e41b8f 00007f2b65e419b8 0000000000aa4cac
0503 19:55:49.631431 (+ 236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7091684096}
I20260503 19:55:48.639994 1435 rpcz_store.cc:276] 0503 19:55:47.223561 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 19:55:47.223930 (+ 369us) service_pool.cc:224] Handling call
0503 19:55:47.326594 (+102664us) raft_consensus.cc:1471] Updating replica for 149 ops
0503 19:55:47.386666 (+ 60072us) raft_consensus.cc:1534] Early marking committed up to index 646
0503 19:55:47.436283 (+ 49617us) raft_consensus.cc:1539] Triggering prepare for 149 ops
0503 19:55:47.484111 (+ 47828us) write_op.cc:270] Start()
0503 19:55:47.484162 (+ 51us) write_op.cc:276] Timestamp: P: 1777838143363005 usec, L: 0
0503 19:55:47.504641 (+ 20479us) write_op.cc:270] Start()
0503 19:55:47.504677 (+ 36us) write_op.cc:276] Timestamp: P: 1777838143396358 usec, L: 0
0503 19:55:47.510408 (+ 5731us) write_op.cc:270] Start()
0503 19:55:47.510429 (+ 21us) write_op.cc:276] Timestamp: P: 1777838143456872 usec, L: 0
0503 19:55:47.513435 (+ 3006us) write_op.cc:270] Start()
0503 19:55:47.513474 (+ 39us) write_op.cc:276] Timestamp: P: 1777838143534096 usec, L: 0
0503 19:55:47.520632 (+ 7158us) write_op.cc:270] Start()
0503 19:55:47.520681 (+ 49us) write_op.cc:276] Timestamp: P: 1777838143535614 usec, L: 0
0503 19:55:47.521016 (+ 335us) write_op.cc:270] Start()
0503 19:55:47.521046 (+ 30us) write_op.cc:276] Timestamp: P: 1777838143536453 usec, L: 0
0503 19:55:47.521282 (+ 236us) write_op.cc:270] Start()
0503 19:55:47.521345 (+ 63us) write_op.cc:276] Timestamp: P: 1777838143568729 usec, L: 0
0503 19:55:47.532129 (+ 10784us) write_op.cc:270] Start()
0503 19:55:47.532167 (+ 38us) write_op.cc:276] Timestamp: P: 1777838143666649 usec, L: 0
0503 19:55:47.550688 (+ 18521us) write_op.cc:270] Start()
0503 19:55:47.550742 (+ 54us) write_op.cc:276] Timestamp: P: 1777838143667391 usec, L: 0
0503 19:55:47.557471 (+ 6729us) write_op.cc:270] Start()
0503 19:55:47.557508 (+ 37us) write_op.cc:276] Timestamp: P: 1777838143668274 usec, L: 0
0503 19:55:47.576173 (+ 18665us) write_op.cc:270] Start()
0503 19:55:47.576207 (+ 34us) write_op.cc:276] Timestamp: P: 1777838143673840 usec, L: 0
0503 19:55:47.583940 (+ 7733us) write_op.cc:270] Start()
0503 19:55:47.583981 (+ 41us) write_op.cc:276] Timestamp: P: 1777838143711200 usec, L: 0
0503 19:55:47.622882 (+ 38901us) write_op.cc:270] Start()
0503 19:55:47.622911 (+ 29us) write_op.cc:276] Timestamp: P: 1777838143734537 usec, L: 0
0503 19:55:47.623152 (+ 241us) write_op.cc:270] Start()
0503 19:55:47.623179 (+ 27us) write_op.cc:276] Timestamp: P: 1777838143757723 usec, L: 0
0503 19:55:47.623346 (+ 167us) write_op.cc:270] Start()
0503 19:55:47.623367 (+ 21us) write_op.cc:276] Timestamp: P: 1777838143758410 usec, L: 0
0503 19:55:47.624921 (+ 1554us) write_op.cc:270] Start()
0503 19:55:47.624948 (+ 27us) write_op.cc:276] Timestamp: P: 1777838143861345 usec, L: 0
0503 19:55:47.625188 (+ 240us) write_op.cc:270] Start()
0503 19:55:47.625210 (+ 22us) write_op.cc:276] Timestamp: P: 1777838143866545 usec, L: 0
0503 19:55:47.625385 (+ 175us) write_op.cc:270] Start()
0503 19:55:47.625405 (+ 20us) write_op.cc:276] Timestamp: P: 1777838143875425 usec, L: 0
0503 19:55:47.625562 (+ 157us) write_op.cc:270] Start()
0503 19:55:47.625582 (+ 20us) write_op.cc:276] Timestamp: P: 1777838143888548 usec, L: 0
0503 19:55:47.631873 (+ 6291us) write_op.cc:270] Start()
0503 19:55:47.631905 (+ 32us) write_op.cc:276] Timestamp: P: 1777838143933201 usec, L: 0
0503 19:55:47.647363 (+ 15458us) write_op.cc:270] Start()
0503 19:55:47.647402 (+ 39us) write_op.cc:276] Timestamp: P: 1777838143977928 usec, L: 0
0503 19:55:47.647705 (+ 303us) write_op.cc:270] Start()
0503 19:55:47.647737 (+ 32us) write_op.cc:276] Timestamp: P: 1777838144010075 usec, L: 0
0503 19:55:47.647888 (+ 151us) write_op.cc:270] Start()
0503 19:55:47.647911 (+ 23us) write_op.cc:276] Timestamp: P: 1777838144013968 usec, L: 0
0503 19:55:47.653831 (+ 5920us) write_op.cc:270] Start()
0503 19:55:47.653871 (+ 40us) write_op.cc:276] Timestamp: P: 1777838144041565 usec, L: 0
0503 19:55:47.664272 (+ 10401us) write_op.cc:270] Start()
0503 19:55:47.664318 (+ 46us) write_op.cc:276] Timestamp: P: 1777838144066869 usec, L: 0
0503 19:55:47.664590 (+ 272us) write_op.cc:270] Start()
0503 19:55:47.664633 (+ 43us) write_op.cc:276] Timestamp: P: 1777838144068500 usec, L: 0
0503 19:55:47.664921 (+ 288us) write_op.cc:270] Start()
0503 19:55:47.664942 (+ 21us) write_op.cc:276] Timestamp: P: 1777838144087422 usec, L: 0
0503 19:55:47.665406 (+ 464us) write_op.cc:270] Start()
0503 19:55:47.665455 (+ 49us) write_op.cc:276] Timestamp: P: 1777838144130585 usec, L: 0
0503 19:55:47.665654 (+ 199us) write_op.cc:270] Start()
0503 19:55:47.665674 (+ 20us) write_op.cc:276] Timestamp: P: 1777838144131797 usec, L: 0
0503 19:55:47.678638 (+ 12964us) write_op.cc:270] Start()
0503 19:55:47.678660 (+ 22us) write_op.cc:276] Timestamp: P: 1777838144132510 usec, L: 0
0503 19:55:47.682144 (+ 3484us) write_op.cc:270] Start()
0503 19:55:47.682164 (+ 20us) write_op.cc:276] Timestamp: P: 1777838144161446 usec, L: 0
0503 19:55:47.706613 (+ 24449us) write_op.cc:270] Start()
0503 19:55:47.706659 (+ 46us) write_op.cc:276] Timestamp: P: 1777838144186505 usec, L: 0
0503 19:55:47.707928 (+ 1269us) write_op.cc:270] Start()
0503 19:55:47.707960 (+ 32us) write_op.cc:276] Timestamp: P: 1777838144203227 usec, L: 0
0503 19:55:47.708210 (+ 250us) write_op.cc:270] Start()
0503 19:55:47.708237 (+ 27us) write_op.cc:276] Timestamp: P: 1777838144219061 usec, L: 0
0503 19:55:47.708456 (+ 219us) write_op.cc:270] Start()
0503 19:55:47.708482 (+ 26us) write_op.cc:276] Timestamp: P: 1777838144223281 usec, L: 0
0503 19:55:47.708659 (+ 177us) write_op.cc:270] Start()
0503 19:55:47.708677 (+ 18us) write_op.cc:276] Timestamp: P: 1777838144270050 usec, L: 0
0503 19:55:47.708855 (+ 178us) write_op.cc:270] Start()
0503 19:55:47.708876 (+ 21us) write_op.cc:276] Timestamp: P: 1777838144297879 usec, L: 0
0503 19:55:47.709068 (+ 192us) write_op.cc:270] Start()
0503 19:55:47.709088 (+ 20us) write_op.cc:276] Timestamp: P: 1777838144301617 usec, L: 0
0503 19:55:47.710472 (+ 1384us) write_op.cc:270] Start()
0503 19:55:47.710502 (+ 30us) write_op.cc:276] Timestamp: P: 1777838144331874 usec, L: 0
0503 19:55:47.736871 (+ 26369us) write_op.cc:270] Start()
0503 19:55:47.736902 (+ 31us) write_op.cc:276] Timestamp: P: 1777838144341681 usec, L: 0
0503 19:55:47.737602 (+ 700us) write_op.cc:270] Start()
0503 19:55:47.737628 (+ 26us) write_op.cc:276] Timestamp: P: 1777838144367422 usec, L: 0
0503 19:55:47.737858 (+ 230us) write_op.cc:270] Start()
0503 19:55:47.737878 (+ 20us) write_op.cc:276] Timestamp: P: 1777838144369751 usec, L: 0
0503 19:55:47.770503 (+ 32625us) write_op.cc:270] Start()
0503 19:55:47.771210 (+ 707us) write_op.cc:276] Timestamp: P: 1777838144414597 usec, L: 0
0503 19:55:47.815537 (+ 44327us) write_op.cc:270] Start()
0503 19:55:47.839155 (+ 23618us) write_op.cc:276] Timestamp: P: 1777838144415405 usec, L: 0
0503 19:55:47.867923 (+ 28768us) write_op.cc:270] Start()
0503 19:55:47.867983 (+ 60us) write_op.cc:276] Timestamp: P: 1777838144479385 usec, L: 0
0503 19:55:47.890495 (+ 22512us) write_op.cc:270] Start()
0503 19:55:47.890528 (+ 33us) write_op.cc:276] Timestamp: P: 1777838144482186 usec, L: 0
0503 19:55:47.890762 (+ 234us) write_op.cc:270] Start()
0503 19:55:47.890800 (+ 38us) write_op.cc:276] Timestamp: P: 1777838144563517 usec, L: 0
0503 19:55:47.891172 (+ 372us) write_op.cc:270] Start()
0503 19:55:47.891196 (+ 24us) write_op.cc:276] Timestamp: P: 1777838144564713 usec, L: 0
0503 19:55:47.895818 (+ 4622us) write_op.cc:270] Start()
0503 19:55:47.895856 (+ 38us) write_op.cc:276] Timestamp: P: 1777838144567970 usec, L: 0
0503 19:55:47.896101 (+ 245us) write_op.cc:270] Start()
0503 19:55:47.896124 (+ 23us) write_op.cc:276] Timestamp: P: 1777838144569662 usec, L: 0
0503 19:55:47.896316 (+ 192us) write_op.cc:270] Start()
0503 19:55:47.896341 (+ 25us) write_op.cc:276] Timestamp: P: 1777838144625054 usec, L: 0
0503 19:55:47.918059 (+ 21718us) write_op.cc:270] Start()
0503 19:55:47.921344 (+ 3285us) write_op.cc:276] Timestamp: P: 1777838144625787 usec, L: 0
0503 19:55:47.959586 (+ 38242us) write_op.cc:270] Start()
0503 19:55:47.959624 (+ 38us) write_op.cc:276] Timestamp: P: 1777838144628385 usec, L: 0
0503 19:55:47.969606 (+ 9982us) write_op.cc:270] Start()
0503 19:55:47.969655 (+ 49us) write_op.cc:276] Timestamp: P: 1777838144668655 usec, L: 0
0503 19:55:47.970662 (+ 1007us) write_op.cc:270] Start()
0503 19:55:47.970696 (+ 34us) write_op.cc:276] Timestamp: P: 1777838144705119 usec, L: 0
0503 19:55:47.974078 (+ 3382us) write_op.cc:270] Start()
0503 19:55:47.974113 (+ 35us) write_op.cc:276] Timestamp: P: 1777838144727226 usec, L: 0
0503 19:55:47.975792 (+ 1679us) write_op.cc:270] Start()
0503 19:55:47.975843 (+ 51us) write_op.cc:276] Timestamp: P: 1777838144728414 usec, L: 0
0503 19:55:47.976485 (+ 642us) write_op.cc:270] Start()
0503 19:55:47.976512 (+ 27us) write_op.cc:276] Timestamp: P: 1777838144784946 usec, L: 0
0503 19:55:47.990356 (+ 13844us) write_op.cc:270] Start()
0503 19:55:47.990396 (+ 40us) write_op.cc:276] Timestamp: P: 1777838144815704 usec, L: 0
0503 19:55:47.990697 (+ 301us) write_op.cc:270] Start()
0503 19:55:47.990766 (+ 69us) write_op.cc:276] Timestamp: P: 1777838144816368 usec, L: 0
0503 19:55:47.990971 (+ 205us) write_op.cc:270] Start()
0503 19:55:47.991012 (+ 41us) write_op.cc:276] Timestamp: P: 1777838144868462 usec, L: 0
0503 19:55:47.991194 (+ 182us) write_op.cc:270] Start()
0503 19:55:47.991222 (+ 28us) write_op.cc:276] Timestamp: P: 1777838144869311 usec, L: 0
0503 19:55:47.991408 (+ 186us) write_op.cc:270] Start()
0503 19:55:47.991430 (+ 22us) write_op.cc:276] Timestamp: P: 1777838144928424 usec, L: 0
0503 19:55:48.014958 (+ 23528us) write_op.cc:270] Start()
0503 19:55:48.014991 (+ 33us) write_op.cc:276] Timestamp: P: 1777838144953009 usec, L: 0
0503 19:55:48.026739 (+ 11748us) write_op.cc:270] Start()
0503 19:55:48.026768 (+ 29us) write_op.cc:276] Timestamp: P: 1777838144953846 usec, L: 0
0503 19:55:48.026990 (+ 222us) write_op.cc:270] Start()
0503 19:55:48.027013 (+ 23us) write_op.cc:276] Timestamp: P: 1777838144954576 usec, L: 0
0503 19:55:48.042364 (+ 15351us) write_op.cc:270] Start()
0503 19:55:48.042405 (+ 41us) write_op.cc:276] Timestamp: P: 1777838144988116 usec, L: 0
0503 19:55:48.044706 (+ 2301us) write_op.cc:270] Start()
0503 19:55:48.044737 (+ 31us) write_op.cc:276] Timestamp: P: 1777838145051412 usec, L: 0
0503 19:55:48.044942 (+ 205us) write_op.cc:270] Start()
0503 19:55:48.044963 (+ 21us) write_op.cc:276] Timestamp: P: 1777838145088448 usec, L: 0
0503 19:55:48.045520 (+ 557us) write_op.cc:270] Start()
0503 19:55:48.045543 (+ 23us) write_op.cc:276] Timestamp: P: 1777838145089428 usec, L: 0
0503 19:55:48.048362 (+ 2819us) write_op.cc:270] Start()
0503 19:55:48.048413 (+ 51us) write_op.cc:276] Timestamp: P: 1777838145104880 usec, L: 0
0503 19:55:48.053814 (+ 5401us) write_op.cc:270] Start()
0503 19:55:48.053850 (+ 36us) write_op.cc:276] Timestamp: P: 1777838145132020 usec, L: 0
0503 19:55:48.067851 (+ 14001us) write_op.cc:270] Start()
0503 19:55:48.067894 (+ 43us) write_op.cc:276] Timestamp: P: 1777838145161571 usec, L: 0
0503 19:55:48.068137 (+ 243us) write_op.cc:270] Start()
0503 19:55:48.068154 (+ 17us) write_op.cc:276] Timestamp: P: 1777838145166613 usec, L: 0
0503 19:55:48.119871 (+ 51717us) write_op.cc:270] Start()
0503 19:55:48.119899 (+ 28us) write_op.cc:276] Timestamp: P: 1777838145236590 usec, L: 0
0503 19:55:48.126121 (+ 6222us) write_op.cc:270] Start()
0503 19:55:48.126168 (+ 47us) write_op.cc:276] Timestamp: P: 1777838145253045 usec, L: 0
0503 19:55:48.126413 (+ 245us) write_op.cc:270] Start()
0503 19:55:48.126440 (+ 27us) write_op.cc:276] Timestamp: P: 1777838145290708 usec, L: 0
0503 19:55:48.126622 (+ 182us) write_op.cc:270] Start()
0503 19:55:48.126639 (+ 17us) write_op.cc:276] Timestamp: P: 1777838145309820 usec, L: 0
0503 19:55:48.126763 (+ 124us) write_op.cc:270] Start()
0503 19:55:48.126776 (+ 13us) write_op.cc:276] Timestamp: P: 1777838145394053 usec, L: 0
0503 19:55:48.126865 (+ 89us) write_op.cc:270] Start()
0503 19:55:48.126877 (+ 12us) write_op.cc:276] Timestamp: P: 1777838145408204 usec, L: 0
0503 19:55:48.126970 (+ 93us) write_op.cc:270] Start()
0503 19:55:48.126982 (+ 12us) write_op.cc:276] Timestamp: P: 1777838145408909 usec, L: 0
0503 19:55:48.127074 (+ 92us) write_op.cc:270] Start()
0503 19:55:48.127086 (+ 12us) write_op.cc:276] Timestamp: P: 1777838145433620 usec, L: 0
0503 19:55:48.127168 (+ 82us) write_op.cc:270] Start()
0503 19:55:48.127179 (+ 11us) write_op.cc:276] Timestamp: P: 1777838145487109 usec, L: 0
0503 19:55:48.169310 (+ 42131us) write_op.cc:270] Start()
0503 19:55:48.169342 (+ 32us) write_op.cc:276] Timestamp: P: 1777838145500588 usec, L: 0
0503 19:55:48.231906 (+ 62564us) write_op.cc:270] Start()
0503 19:55:48.231956 (+ 50us) write_op.cc:276] Timestamp: P: 1777838145532241 usec, L: 0
0503 19:55:48.232199 (+ 243us) write_op.cc:270] Start()
0503 19:55:48.232222 (+ 23us) write_op.cc:276] Timestamp: P: 1777838145538004 usec, L: 0
0503 19:55:48.232388 (+ 166us) write_op.cc:270] Start()
0503 19:55:48.232406 (+ 18us) write_op.cc:276] Timestamp: P: 1777838145547095 usec, L: 0
0503 19:55:48.232574 (+ 168us) write_op.cc:270] Start()
0503 19:55:48.232610 (+ 36us) write_op.cc:276] Timestamp: P: 1777838145601426 usec, L: 0
0503 19:55:48.232776 (+ 166us) write_op.cc:270] Start()
0503 19:55:48.232793 (+ 17us) write_op.cc:276] Timestamp: P: 1777838145602703 usec, L: 0
0503 19:55:48.232961 (+ 168us) write_op.cc:270] Start()
0503 19:55:48.232978 (+ 17us) write_op.cc:276] Timestamp: P: 1777838145619395 usec, L: 0
0503 19:55:48.233136 (+ 158us) write_op.cc:270] Start()
0503 19:55:48.233153 (+ 17us) write_op.cc:276] Timestamp: P: 1777838145675403 usec, L: 0
0503 19:55:48.233308 (+ 155us) write_op.cc:270] Start()
0503 19:55:48.233337 (+ 29us) write_op.cc:276] Timestamp: P: 1777838145678569 usec, L: 0
0503 19:55:48.233501 (+ 164us) write_op.cc:270] Start()
0503 19:55:48.233518 (+ 17us) write_op.cc:276] Timestamp: P: 1777838145680265 usec, L: 0
0503 19:55:48.233707 (+ 189us) write_op.cc:270] Start()
0503 19:55:48.233723 (+ 16us) write_op.cc:276] Timestamp: P: 1777838145693164 usec, L: 0
0503 19:55:48.233892 (+ 169us) write_op.cc:270] Start()
0503 19:55:48.233909 (+ 17us) write_op.cc:276] Timestamp: P: 1777838145733142 usec, L: 0
0503 19:55:48.234104 (+ 195us) write_op.cc:270] Start()
0503 19:55:48.234121 (+ 17us) write_op.cc:276] Timestamp: P: 1777838145774782 usec, L: 0
0503 19:55:48.234275 (+ 154us) write_op.cc:270] Start()
0503 19:55:48.234291 (+ 16us) write_op.cc:276] Timestamp: P: 1777838145778915 usec, L: 0
0503 19:55:48.234451 (+ 160us) write_op.cc:270] Start()
0503 19:55:48.234467 (+ 16us) write_op.cc:276] Timestamp: P: 1777838145790863 usec, L: 0
0503 19:55:48.234616 (+ 149us) write_op.cc:270] Start()
0503 19:55:48.234633 (+ 17us) write_op.cc:276] Timestamp: P: 1777838145793997 usec, L: 0
0503 19:55:48.234795 (+ 162us) write_op.cc:270] Start()
0503 19:55:48.234813 (+ 18us) write_op.cc:276] Timestamp: P: 1777838145850515 usec, L: 0
0503 19:55:48.234971 (+ 158us) write_op.cc:270] Start()
0503 19:55:48.234990 (+ 19us) write_op.cc:276] Timestamp: P: 1777838145852495 usec, L: 0
0503 19:55:48.235193 (+ 203us) write_op.cc:270] Start()
0503 19:55:48.235215 (+ 22us) write_op.cc:276] Timestamp: P: 1777838145879301 usec, L: 0
0503 19:55:48.235393 (+ 178us) write_op.cc:270] Start()
0503 19:55:48.235415 (+ 22us) write_op.cc:276] Timestamp: P: 1777838145945265 usec, L: 0
0503 19:55:48.235618 (+ 203us) write_op.cc:270] Start()
0503 19:55:48.235670 (+ 52us) write_op.cc:276] Timestamp: P: 1777838145950811 usec, L: 0
0503 19:55:48.296078 (+ 60408us) write_op.cc:270] Start()
0503 19:55:48.296111 (+ 33us) write_op.cc:276] Timestamp: P: 1777838145959871 usec, L: 0
0503 19:55:48.296257 (+ 146us) write_op.cc:270] Start()
0503 19:55:48.296278 (+ 21us) write_op.cc:276] Timestamp: P: 1777838145999850 usec, L: 0
0503 19:55:48.296474 (+ 196us) write_op.cc:270] Start()
0503 19:55:48.296501 (+ 27us) write_op.cc:276] Timestamp: P: 1777838146015856 usec, L: 0
0503 19:55:48.296647 (+ 146us) write_op.cc:270] Start()
0503 19:55:48.296701 (+ 54us) write_op.cc:276] Timestamp: P: 1777838146036306 usec, L: 0
0503 19:55:48.296865 (+ 164us) write_op.cc:270] Start()
0503 19:55:48.296886 (+ 21us) write_op.cc:276] Timestamp: P: 1777838146040256 usec, L: 0
0503 19:55:48.297075 (+ 189us) write_op.cc:270] Start()
0503 19:55:48.297097 (+ 22us) write_op.cc:276] Timestamp: P: 1777838146087799 usec, L: 0
0503 19:55:48.297253 (+ 156us) write_op.cc:270] Start()
0503 19:55:48.297275 (+ 22us) write_op.cc:276] Timestamp: P: 1777838146095014 usec, L: 0
0503 19:55:48.297415 (+ 140us) write_op.cc:270] Start()
0503 19:55:48.297434 (+ 19us) write_op.cc:276] Timestamp: P: 1777838146155558 usec, L: 0
0503 19:55:48.297637 (+ 203us) write_op.cc:270] Start()
0503 19:55:48.297659 (+ 22us) write_op.cc:276] Timestamp: P: 1777838146157110 usec, L: 0
0503 19:55:48.298261 (+ 602us) write_op.cc:270] Start()
0503 19:55:48.298282 (+ 21us) write_op.cc:276] Timestamp: P: 1777838146161759 usec, L: 0
0503 19:55:48.298445 (+ 163us) write_op.cc:270] Start()
0503 19:55:48.298464 (+ 19us) write_op.cc:276] Timestamp: P: 1777838146246984 usec, L: 0
0503 19:55:48.298603 (+ 139us) write_op.cc:270] Start()
0503 19:55:48.298638 (+ 35us) write_op.cc:276] Timestamp: P: 1777838146283721 usec, L: 0
0503 19:55:48.298812 (+ 174us) write_op.cc:270] Start()
0503 19:55:48.298833 (+ 21us) write_op.cc:276] Timestamp: P: 1777838146286845 usec, L: 0
0503 19:55:48.298982 (+ 149us) write_op.cc:270] Start()
0503 19:55:48.299001 (+ 19us) write_op.cc:276] Timestamp: P: 1777838146287757 usec, L: 0
0503 19:55:48.299153 (+ 152us) write_op.cc:270] Start()
0503 19:55:48.299173 (+ 20us) write_op.cc:276] Timestamp: P: 1777838146338131 usec, L: 0
0503 19:55:48.299325 (+ 152us) write_op.cc:270] Start()
0503 19:55:48.299345 (+ 20us) write_op.cc:276] Timestamp: P: 1777838146350309 usec, L: 0
0503 19:55:48.299507 (+ 162us) write_op.cc:270] Start()
0503 19:55:48.299527 (+ 20us) write_op.cc:276] Timestamp: P: 1777838146414379 usec, L: 0
0503 19:55:48.310002 (+ 10475us) write_op.cc:270] Start()
0503 19:55:48.310032 (+ 30us) write_op.cc:276] Timestamp: P: 1777838146442763 usec, L: 0
0503 19:55:48.310227 (+ 195us) write_op.cc:270] Start()
0503 19:55:48.310247 (+ 20us) write_op.cc:276] Timestamp: P: 1777838146505373 usec, L: 0
0503 19:55:48.316095 (+ 5848us) write_op.cc:270] Start()
0503 19:55:48.316150 (+ 55us) write_op.cc:276] Timestamp: P: 1777838146516820 usec, L: 0
0503 19:55:48.316331 (+ 181us) write_op.cc:270] Start()
0503 19:55:48.316356 (+ 25us) write_op.cc:276] Timestamp: P: 1777838146517453 usec, L: 0
0503 19:55:48.316531 (+ 175us) write_op.cc:270] Start()
0503 19:55:48.316552 (+ 21us) write_op.cc:276] Timestamp: P: 1777838146565119 usec, L: 0
0503 19:55:48.316707 (+ 155us) write_op.cc:270] Start()
0503 19:55:48.316728 (+ 21us) write_op.cc:276] Timestamp: P: 1777838146565767 usec, L: 0
0503 19:55:48.328588 (+ 11860us) write_op.cc:270] Start()
0503 19:55:48.328616 (+ 28us) write_op.cc:276] Timestamp: P: 1777838146582792 usec, L: 0
0503 19:55:48.328872 (+ 256us) write_op.cc:270] Start()
0503 19:55:48.328900 (+ 28us) write_op.cc:276] Timestamp: P: 1777838146607436 usec, L: 0
0503 19:55:48.329119 (+ 219us) write_op.cc:270] Start()
0503 19:55:48.329151 (+ 32us) write_op.cc:276] Timestamp: P: 1777838146627408 usec, L: 0
0503 19:55:48.329335 (+ 184us) write_op.cc:270] Start()
0503 19:55:48.329378 (+ 43us) write_op.cc:276] Timestamp: P: 1777838146657374 usec, L: 0
0503 19:55:48.342273 (+ 12895us) write_op.cc:270] Start()
0503 19:55:48.342313 (+ 40us) write_op.cc:276] Timestamp: P: 1777838146676243 usec, L: 0
0503 19:55:48.373374 (+ 31061us) write_op.cc:270] Start()
0503 19:55:48.373416 (+ 42us) write_op.cc:276] Timestamp: P: 1777838146730620 usec, L: 0
0503 19:55:48.373680 (+ 264us) write_op.cc:270] Start()
0503 19:55:48.373707 (+ 27us) write_op.cc:276] Timestamp: P: 1777838146772418 usec, L: 0
0503 19:55:48.389157 (+ 15450us) write_op.cc:270] Start()
0503 19:55:48.389193 (+ 36us) write_op.cc:276] Timestamp: P: 1777838146776844 usec, L: 0
0503 19:55:48.392657 (+ 3464us) write_op.cc:270] Start()
0503 19:55:48.392683 (+ 26us) write_op.cc:276] Timestamp: P: 1777838146786180 usec, L: 0
0503 19:55:48.408337 (+ 15654us) write_op.cc:270] Start()
0503 19:55:48.408376 (+ 39us) write_op.cc:276] Timestamp: P: 1777838146793349 usec, L: 0
0503 19:55:48.420644 (+ 12268us) write_op.cc:270] Start()
0503 19:55:48.420667 (+ 23us) write_op.cc:276] Timestamp: P: 1777838146841289 usec, L: 0
0503 19:55:48.422709 (+ 2042us) write_op.cc:270] Start()
0503 19:55:48.422729 (+ 20us) write_op.cc:276] Timestamp: P: 1777838146896816 usec, L: 0
0503 19:55:48.430362 (+ 7633us) write_op.cc:270] Start()
0503 19:55:48.430392 (+ 30us) write_op.cc:276] Timestamp: P: 1777838146904686 usec, L: 0
0503 19:55:48.430557 (+ 165us) write_op.cc:270] Start()
0503 19:55:48.430573 (+ 16us) write_op.cc:276] Timestamp: P: 1777838146905803 usec, L: 0
0503 19:55:48.436156 (+ 5583us) write_op.cc:270] Start()
0503 19:55:48.436197 (+ 41us) write_op.cc:276] Timestamp: P: 1777838146953038 usec, L: 0
0503 19:55:48.443231 (+ 7034us) write_op.cc:270] Start()
0503 19:55:48.443312 (+ 81us) write_op.cc:276] Timestamp: P: 1777838147008225 usec, L: 0
0503 19:55:48.443863 (+ 551us) write_op.cc:270] Start()
0503 19:55:48.443894 (+ 31us) write_op.cc:276] Timestamp: P: 1777838147008878 usec, L: 0
0503 19:55:48.444362 (+ 468us) write_op.cc:270] Start()
0503 19:55:48.444404 (+ 42us) write_op.cc:276] Timestamp: P: 1777838147009595 usec, L: 0
0503 19:55:48.444558 (+ 154us) write_op.cc:270] Start()
0503 19:55:48.444581 (+ 23us) write_op.cc:276] Timestamp: P: 1777838147058290 usec, L: 0
0503 19:55:48.444907 (+ 326us) write_op.cc:270] Start()
0503 19:55:48.444935 (+ 28us) write_op.cc:276] Timestamp: P: 1777838147074385 usec, L: 0
0503 19:55:48.445534 (+ 599us) write_op.cc:270] Start()
0503 19:55:48.445565 (+ 31us) write_op.cc:276] Timestamp: P: 1777838147088568 usec, L: 0
0503 19:55:48.445764 (+ 199us) write_op.cc:270] Start()
0503 19:55:48.445804 (+ 40us) write_op.cc:276] Timestamp: P: 1777838147092069 usec, L: 0
0503 19:55:48.489465 (+ 43661us) log.cc:844] Serialized 98104 byte log entry
0503 19:55:48.497215 (+ 7750us) raft_consensus.cc:1645] Marking committed up to 795
0503 19:55:48.501270 (+ 4055us) write_op.cc:489] Releasing partition, row and schema locks
0503 19:55:48.501275 (+ 5us) write_op.cc:454] Released schema lock
0503 19:55:48.547564 (+ 46289us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 19:55:48.547629 (+ 65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0503 19:55:48.547644 (+ 15us) raft_consensus.cc:1685] finished
0503 19:55:48.547647 (+ 3us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 19:55:48.547776 (+ 129us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0503 19:55:47.485249 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 1c99d75cb2be4439a1610c0de343d73a
0503 19:55:47.489044 (+ 3795us) write_op.cc:432] Acquiring schema lock in shared mode
0503 19:55:47.489050 (+ 6us) write_op.cc:435] Acquired schema lock
0503 19:55:47.489052 (+ 2us) tablet.cc:662] Decoding operations
0503 19:55:47.490595 (+ 1543us) write_op.cc:620] Acquiring the partition lock for write op
0503 19:55:47.490611 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0503 19:55:47.490615 (+ 4us) tablet.cc:685] Acquiring locks for 10 operations
0503 19:55:47.505135 (+ 14520us) tablet.cc:701] Row locks acquired
0503 19:55:47.505138 (+ 3us) write_op.cc:260] PREPARE: finished
0503 19:55:48.497271 (+992133us) op_driver.cc:464] REPLICATION: finished
0503 19:55:48.497368 (+ 97us) write_op.cc:301] APPLY: starting
0503 19:55:48.497385 (+ 17us) tablet.cc:1367] starting BulkCheckPresence
0503 19:55:48.497444 (+ 59us) tablet.cc:1370] finished BulkCheckPresence
0503 19:55:48.497447 (+ 3us) tablet.cc:1372] starting ApplyRowOperation cycle
0503 19:55:48.497725 (+ 278us) tablet.cc:1383] finished ApplyRowOperation cycle
0503 19:55:48.497800 (+ 75us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0503 19:55:48.497808 (+ 8us) write_op.cc:312] APPLY: finished
0503 19:55:48.497903 (+ 95us) log.cc:844] Serialized 77 byte log entry
0503 19:55:48.499937 (+ 2034us) write_op.cc:489] Releasing partition, row and schema locks
0503 19:55:48.499953 (+ 16us) write_op.cc:454] Released schema lock
0503 19:55:48.499959 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0503 19:55:48.500035 (+ 76us) write_op.cc:489] Releasing partition, row and schema locks
0503 19:55:48.500039 (+ 4us) write_op.cc:454] Released schema lock
Related trace 'op':
0503 19:55:47.505240 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 1c99d75cb2be4439a1610c0de343d73a
0503 19:55:47.505360 (+ 120us) write_op.cc:432] Acquiring schema lock in shared mode
0503 19:55:47.505365 (+ 5us) write_op.cc:435] Acquired schema lock
0503 19:55:47.505367 (+ 2us) tablet.cc:662] Decoding operations
0503 19:55:47.507136 (+ 1769us) write_op.cc:620] Acquiring the partition lock for write op
0503 19:55:47.507149 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0503 19:55:47.507155 (+ 6us) tablet.cc:685] Acquiring locks for 6 operations
0503 19:55:47.511284 (+ 4129us) tablet.cc:701] Row locks acquired
0503 19:55:47.511291 (+ 7us) write_op.cc:260] PREPARE: finished
0503 19:55:48.497355 (+986064us) op_driver.cc:464] REPLICATION: finished
0503 19:55:48.497453 (+ 98us) write_op.cc:301] APPLY: starting
0503 19:55:48.497469 (+ 16us) tablet.cc:1367] starting BulkCheckPresence
0503 19:55:48.497513 (+ 44us) tablet.cc:1370] finished BulkCheckPresence
0503 19:55:48.497515 (+ 2us) tablet.cc:1372] starting ApplyRowOperation cycle
0503 19:55:48.497802 (+ 287us) tablet.cc:1383] finished ApplyRowOperation cycle
0503 19:55:48.497825 (+ 23us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0503 19:55:48.497855 (+ 30us) write_op.cc:312] APPLY: finished
0503 19:55:48.497903 (+ 48us) log.cc:844] Serialized 53 byte log entry
0503 19:55:48.497964 (+ 61us) write_op.cc:489] Releasing partition, row and schema locks
0503 19:55:48.497981 (+ 17us) write_op.cc:454] Released schema lock
0503 19:55:48.497988 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0503 19:55:48.498084 (+ 96us) write_op.cc:489] Releasing partition, row and schema locks
0503 19:55:48.498088 (+ 4us) write_op.cc:454] Released schema lock
Related trace 'op':
0503 19:55:47.511460 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 1c99d75cb2be4439a1610c0de343d73a
0503 19:55:47.511666 (+ 206us) write_op.cc:432] Acquiring schema lock in shared mode
0503 19:55:47.511676 (+ 10us) write_op.cc:435] Acquired schema lock
0503 19:55:47.511681 (+ 5us) tablet.cc:662] Decoding operations
0503 19:55:47.516414 (+ 4733us) write_op.cc:620] Acquiring the partition lock for write op
0503 19:55:47.516429 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0503 19:55:47.516434 (+ 5us) tablet.cc:685] Acquiring locks for 9 operations
0503 19:55:47.516547 (+ 113us) tablet.cc:701] Row locks acquired
0503 19:55:47.516552 (+ 5us) write_op.cc:260] PREPARE: finished
0503 19:55:47.534434 (+ 17882us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x61100008e5d8. stack: 00007f2b5ee49086 00007f2b5ee48e40 00007f2b5de023ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007f2b65dd1e6f 00007f2b6c14ba84 00007f2b6c14a2bd 00007f2b6c149779 00007f2b6c151ba0 00007f2b6c1519ad 0000000000aa4cac 00007f2b5ee8ef6f 00007f2b5ee9228b 00007f2b5ee92108
0503 19:55:48.497410 (+962976us) op_driver.cc:464] REPLICATION: finished
0503 19:55:48.529248 (+ 31838us) write_op.cc:301] APPLY: starting
0503 19:55:48.529294 (+ 46us) tablet.cc:1367] starting BulkCheckPresence
0503 19:55:48.529344 (+ 50us) tablet.cc:1370] finished BulkCheckPresence
0503 19:55:48.529349 (+ 5us) tablet.cc:1372] starting ApplyRowOperation cycle
0503 19:55:48.529601 (+ 252us) tablet.cc:1383] finished ApplyRowOperation cycle
0503 19:55:48.529641 (+ 40us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0503 19:55:48.529649 (+ 8us) write_op.cc:312] APPLY: finished
0503 19:55:48.529734 (+ 85us) log.cc:844] Serialized 71 byte log entry
0503 19:55:48.529819 (+ 85us) write_op.cc:489] Releasing partition, row and schema locks
0503 19:55:48.529842 (+ 23us) write_op.cc:454] Released schema lock
0503 19:55:48.529850 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0503 19:55:48.541587 (+ 11737us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x61100008e5d8. stack: 00007f2b5ee49086 00007f2b5ee48e40 00007f2b5de023ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007f2b65dd486b 00007f2b6c154b36 00007f2b6c150ea6 00007f2b6c14f148 00007f2b6c1521c0 00007f2b6c151fcd 0000000000aa4cac 00007f2b5ee8ef6f 00007f2b5ee9228b 00007f2b5ee92108
0503 19:55:48.541636 (+ 49us) write_op.cc:489] Releasing partition, row and schema locks
0503 19:55:48.541641 (+ 5us) write_op.cc:454] Released schema lock
Related trace
I20260503 19:55:49.928936 1527 raft_consensus.cc:493] T a860805e8df84220ae4be7d3279b75f1 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a1219433b66444d091420ceeab5092ef)
I20260503 19:55:49.929196 1527 raft_consensus.cc:515] T a860805e8df84220ae4be7d3279b75f1 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } }
I20260503 19:55:49.929921 1527 leader_election.cc:290] T a860805e8df84220ae4be7d3279b75f1 P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d99e4f4d5ca48e0bdb54daf8361c5e8 (127.0.105.3:35005), a1219433b66444d091420ceeab5092ef (127.0.105.2:38837)
I20260503 19:55:49.934504 860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860805e8df84220ae4be7d3279b75f1" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 724 } } ignore_live_leader: false dest_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" is_pre_election: true
I20260503 19:55:49.935302 728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860805e8df84220ae4be7d3279b75f1" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 724 } } ignore_live_leader: false dest_uuid: "a1219433b66444d091420ceeab5092ef" is_pre_election: true
I20260503 19:55:49.963768 1356 leader_election.cc:304] T a860805e8df84220ae4be7d3279b75f1 P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e52aa88a17542609e84f0c09fb85d87; no voters: 6d99e4f4d5ca48e0bdb54daf8361c5e8, a1219433b66444d091420ceeab5092ef
I20260503 19:55:49.969846 1527 raft_consensus.cc:2749] T a860805e8df84220ae4be7d3279b75f1 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 19:55:50.057281 1527 raft_consensus.cc:493] T ecf4b80ba8714f24a49387dc8bbe2da3 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a1219433b66444d091420ceeab5092ef)
I20260503 19:55:50.071164 1527 raft_consensus.cc:515] T ecf4b80ba8714f24a49387dc8bbe2da3 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:50.081905 862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf4b80ba8714f24a49387dc8bbe2da3" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 835 } } ignore_live_leader: false dest_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" is_pre_election: true
I20260503 19:55:50.082029 1527 leader_election.cc:290] T ecf4b80ba8714f24a49387dc8bbe2da3 P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1219433b66444d091420ceeab5092ef (127.0.105.2:38837), 6d99e4f4d5ca48e0bdb54daf8361c5e8 (127.0.105.3:35005)
I20260503 19:55:50.083537 729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf4b80ba8714f24a49387dc8bbe2da3" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 835 } } ignore_live_leader: false dest_uuid: "a1219433b66444d091420ceeab5092ef" is_pre_election: true
I20260503 19:55:50.096098 1356 leader_election.cc:304] T ecf4b80ba8714f24a49387dc8bbe2da3 P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e52aa88a17542609e84f0c09fb85d87; no voters: 6d99e4f4d5ca48e0bdb54daf8361c5e8, a1219433b66444d091420ceeab5092ef
I20260503 19:55:50.111471 1527 raft_consensus.cc:2749] T ecf4b80ba8714f24a49387dc8bbe2da3 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260503 19:55:50.373234 665 consensus_peers.cc:597] T 4d80fc29b7a64074b4a2ce4003054d1a P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 121: this message will repeat every 5th retry.
I20260503 19:55:49.684849 1433 rpcz_store.cc:276] 0503 19:55:48.086245 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 19:55:48.086328 (+ 83us) service_pool.cc:224] Handling call
0503 19:55:48.178587 (+ 92259us) raft_consensus.cc:1471] Updating replica for 186 ops
0503 19:55:48.286529 (+107942us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 19:55:48.286535 (+ 6us) raft_consensus.cc:1539] Triggering prepare for 186 ops
0503 19:55:48.286660 (+ 125us) write_op.cc:270] Start()
0503 19:55:48.286686 (+ 26us) write_op.cc:276] Timestamp: P: 1777838143510045 usec, L: 0
0503 19:55:48.286876 (+ 190us) write_op.cc:270] Start()
0503 19:55:48.286898 (+ 22us) write_op.cc:276] Timestamp: P: 1777838143525311 usec, L: 0
0503 19:55:48.287184 (+ 286us) write_op.cc:270] Start()
0503 19:55:48.287206 (+ 22us) write_op.cc:276] Timestamp: P: 1777838143530366 usec, L: 0
0503 19:55:48.287351 (+ 145us) write_op.cc:270] Start()
0503 19:55:48.287373 (+ 22us) write_op.cc:276] Timestamp: P: 1777838143572548 usec, L: 0
0503 19:55:48.287529 (+ 156us) write_op.cc:270] Start()
0503 19:55:48.287557 (+ 28us) write_op.cc:276] Timestamp: P: 1777838143652053 usec, L: 0
0503 19:55:48.287766 (+ 209us) write_op.cc:270] Start()
0503 19:55:48.287787 (+ 21us) write_op.cc:276] Timestamp: P: 1777838143656374 usec, L: 0
0503 19:55:48.287931 (+ 144us) write_op.cc:270] Start()
0503 19:55:48.287984 (+ 53us) write_op.cc:276] Timestamp: P: 1777838143663114 usec, L: 0
0503 19:55:48.288223 (+ 239us) write_op.cc:270] Start()
0503 19:55:48.288271 (+ 48us) write_op.cc:276] Timestamp: P: 1777838143665606 usec, L: 0
0503 19:55:48.288437 (+ 166us) write_op.cc:270] Start()
0503 19:55:48.288457 (+ 20us) write_op.cc:276] Timestamp: P: 1777838143716498 usec, L: 0
0503 19:55:48.288622 (+ 165us) write_op.cc:270] Start()
0503 19:55:48.288643 (+ 21us) write_op.cc:276] Timestamp: P: 1777838143736585 usec, L: 0
0503 19:55:48.288792 (+ 149us) write_op.cc:270] Start()
0503 19:55:48.288813 (+ 21us) write_op.cc:276] Timestamp: P: 1777838143748063 usec, L: 0
0503 19:55:48.289019 (+ 206us) write_op.cc:270] Start()
0503 19:55:48.289051 (+ 32us) write_op.cc:276] Timestamp: P: 1777838143778314 usec, L: 0
0503 19:55:48.289216 (+ 165us) write_op.cc:270] Start()
0503 19:55:48.289243 (+ 27us) write_op.cc:276] Timestamp: P: 1777838143875906 usec, L: 0
0503 19:55:48.289416 (+ 173us) write_op.cc:270] Start()
0503 19:55:48.289436 (+ 20us) write_op.cc:276] Timestamp: P: 1777838143881213 usec, L: 0
0503 19:55:48.289606 (+ 170us) write_op.cc:270] Start()
0503 19:55:48.289630 (+ 24us) write_op.cc:276] Timestamp: P: 1777838143906045 usec, L: 0
0503 19:55:48.289814 (+ 184us) write_op.cc:270] Start()
0503 19:55:48.289834 (+ 20us) write_op.cc:276] Timestamp: P: 1777838143912321 usec, L: 0
0503 19:55:48.290110 (+ 276us) write_op.cc:270] Start()
0503 19:55:48.290134 (+ 24us) write_op.cc:276] Timestamp: P: 1777838143953708 usec, L: 0
0503 19:55:48.290297 (+ 163us) write_op.cc:270] Start()
0503 19:55:48.290318 (+ 21us) write_op.cc:276] Timestamp: P: 1777838143971101 usec, L: 0
0503 19:55:48.302328 (+ 12010us) write_op.cc:270] Start()
0503 19:55:48.302355 (+ 27us) write_op.cc:276] Timestamp: P: 1777838143995008 usec, L: 0
0503 19:55:48.302576 (+ 221us) write_op.cc:270] Start()
0503 19:55:48.302599 (+ 23us) write_op.cc:276] Timestamp: P: 1777838143995764 usec, L: 0
0503 19:55:48.302757 (+ 158us) write_op.cc:270] Start()
0503 19:55:48.302779 (+ 22us) write_op.cc:276] Timestamp: P: 1777838144034608 usec, L: 0
0503 19:55:48.302938 (+ 159us) write_op.cc:270] Start()
0503 19:55:48.302960 (+ 22us) write_op.cc:276] Timestamp: P: 1777838144050427 usec, L: 0
0503 19:55:48.303150 (+ 190us) write_op.cc:270] Start()
0503 19:55:48.303172 (+ 22us) write_op.cc:276] Timestamp: P: 1777838144060904 usec, L: 0
0503 19:55:48.303358 (+ 186us) write_op.cc:270] Start()
0503 19:55:48.303384 (+ 26us) write_op.cc:276] Timestamp: P: 1777838144096010 usec, L: 0
0503 19:55:48.303574 (+ 190us) write_op.cc:270] Start()
0503 19:55:48.303598 (+ 24us) write_op.cc:276] Timestamp: P: 1777838144124143 usec, L: 0
0503 19:55:48.303800 (+ 202us) write_op.cc:270] Start()
0503 19:55:48.303823 (+ 23us) write_op.cc:276] Timestamp: P: 1777838144138033 usec, L: 0
0503 19:55:48.304057 (+ 234us) write_op.cc:270] Start()
0503 19:55:48.304080 (+ 23us) write_op.cc:276] Timestamp: P: 1777838144144741 usec, L: 0
0503 19:55:48.304246 (+ 166us) write_op.cc:270] Start()
0503 19:55:48.304269 (+ 23us) write_op.cc:276] Timestamp: P: 1777838144160123 usec, L: 0
0503 19:55:48.304464 (+ 195us) write_op.cc:270] Start()
0503 19:55:48.304498 (+ 34us) write_op.cc:276] Timestamp: P: 1777838144176041 usec, L: 0
0503 19:55:48.304662 (+ 164us) write_op.cc:270] Start()
0503 19:55:48.304685 (+ 23us) write_op.cc:276] Timestamp: P: 1777838144208546 usec, L: 0
0503 19:55:48.344378 (+ 39693us) write_op.cc:270] Start()
0503 19:55:48.344412 (+ 34us) write_op.cc:276] Timestamp: P: 1777838144237211 usec, L: 0
0503 19:55:48.373868 (+ 29456us) write_op.cc:270] Start()
0503 19:55:48.373890 (+ 22us) write_op.cc:276] Timestamp: P: 1777838144237768 usec, L: 0
0503 19:55:48.389128 (+ 15238us) write_op.cc:270] Start()
0503 19:55:48.389173 (+ 45us) write_op.cc:276] Timestamp: P: 1777838144262546 usec, L: 0
0503 19:55:48.389479 (+ 306us) write_op.cc:270] Start()
0503 19:55:48.389506 (+ 27us) write_op.cc:276] Timestamp: P: 1777838144279658 usec, L: 0
0503 19:55:48.389688 (+ 182us) write_op.cc:270] Start()
0503 19:55:48.389709 (+ 21us) write_op.cc:276] Timestamp: P: 1777838144294964 usec, L: 0
0503 19:55:48.389888 (+ 179us) write_op.cc:270] Start()
0503 19:55:48.389909 (+ 21us) write_op.cc:276] Timestamp: P: 1777838144316267 usec, L: 0
0503 19:55:48.390066 (+ 157us) write_op.cc:270] Start()
0503 19:55:48.390088 (+ 22us) write_op.cc:276] Timestamp: P: 1777838144330946 usec, L: 0
0503 19:55:48.390291 (+ 203us) write_op.cc:270] Start()
0503 19:55:48.390315 (+ 24us) write_op.cc:276] Timestamp: P: 1777838144369924 usec, L: 0
0503 19:55:48.390482 (+ 167us) write_op.cc:270] Start()
0503 19:55:48.390504 (+ 22us) write_op.cc:276] Timestamp: P: 1777838144379441 usec, L: 0
0503 19:55:48.391488 (+ 984us) write_op.cc:270] Start()
0503 19:55:48.391514 (+ 26us) write_op.cc:276] Timestamp: P: 1777838144406133 usec, L: 0
0503 19:55:48.391717 (+ 203us) write_op.cc:270] Start()
0503 19:55:48.391739 (+ 22us) write_op.cc:276] Timestamp: P: 1777838144414788 usec, L: 0
0503 19:55:48.402897 (+ 11158us) write_op.cc:270] Start()
0503 19:55:48.402942 (+ 45us) write_op.cc:276] Timestamp: P: 1777838144450479 usec, L: 0
0503 19:55:48.411508 (+ 8566us) write_op.cc:270] Start()
0503 19:55:48.411549 (+ 41us) write_op.cc:276] Timestamp: P: 1777838144472304 usec, L: 0
0503 19:55:48.411818 (+ 269us) write_op.cc:270] Start()
0503 19:55:48.411845 (+ 27us) write_op.cc:276] Timestamp: P: 1777838144540650 usec, L: 0
0503 19:55:48.412004 (+ 159us) write_op.cc:270] Start()
0503 19:55:48.412024 (+ 20us) write_op.cc:276] Timestamp: P: 1777838144543302 usec, L: 0
0503 19:55:48.412174 (+ 150us) write_op.cc:270] Start()
0503 19:55:48.412194 (+ 20us) write_op.cc:276] Timestamp: P: 1777838144557853 usec, L: 0
0503 19:55:48.412356 (+ 162us) write_op.cc:270] Start()
0503 19:55:48.412379 (+ 23us) write_op.cc:276] Timestamp: P: 1777838144559097 usec, L: 0
0503 19:55:48.412543 (+ 164us) write_op.cc:270] Start()
0503 19:55:48.412562 (+ 19us) write_op.cc:276] Timestamp: P: 1777838144612794 usec, L: 0
0503 19:55:48.412739 (+ 177us) write_op.cc:270] Start()
0503 19:55:48.412759 (+ 20us) write_op.cc:276] Timestamp: P: 1777838144614093 usec, L: 0
0503 19:55:48.412931 (+ 172us) write_op.cc:270] Start()
0503 19:55:48.412955 (+ 24us) write_op.cc:276] Timestamp: P: 1777838144618205 usec, L: 0
0503 19:55:48.413106 (+ 151us) write_op.cc:270] Start()
0503 19:55:48.413126 (+ 20us) write_op.cc:276] Timestamp: P: 1777838144673576 usec, L: 0
0503 19:55:48.413271 (+ 145us) write_op.cc:270] Start()
0503 19:55:48.413292 (+ 21us) write_op.cc:276] Timestamp: P: 1777838144708996 usec, L: 0
0503 19:55:48.413440 (+ 148us) write_op.cc:270] Start()
0503 19:55:48.413461 (+ 21us) write_op.cc:276] Timestamp: P: 1777838144711707 usec, L: 0
0503 19:55:48.413684 (+ 223us) write_op.cc:270] Start()
0503 19:55:48.413705 (+ 21us) write_op.cc:276] Timestamp: P: 1777838144762461 usec, L: 0
0503 19:55:48.413872 (+ 167us) write_op.cc:270] Start()
0503 19:55:48.415582 (+ 1710us) write_op.cc:276] Timestamp: P: 1777838144781812 usec, L: 0
0503 19:55:48.415919 (+ 337us) write_op.cc:270] Start()
0503 19:55:48.416008 (+ 89us) write_op.cc:276] Timestamp: P: 1777838144850548 usec, L: 0
0503 19:55:48.416191 (+ 183us) write_op.cc:270] Start()
0503 19:55:48.416214 (+ 23us) write_op.cc:276] Timestamp: P: 1777838144851418 usec, L: 0
0503 19:55:48.416360 (+ 146us) write_op.cc:270] Start()
0503 19:55:48.416380 (+ 20us) write_op.cc:276] Timestamp: P: 1777838144861183 usec, L: 0
0503 19:55:48.416550 (+ 170us) write_op.cc:270] Start()
0503 19:55:48.416569 (+ 19us) write_op.cc:276] Timestamp: P: 1777838144861850 usec, L: 0
0503 19:55:48.416725 (+ 156us) write_op.cc:270] Start()
0503 19:55:48.416776 (+ 51us) write_op.cc:276] Timestamp: P: 1777838144923183 usec, L: 0
0503 19:55:48.416928 (+ 152us) write_op.cc:270] Start()
0503 19:55:48.416954 (+ 26us) write_op.cc:276] Timestamp: P: 1777838144957580 usec, L: 0
0503 19:55:48.417123 (+ 169us) write_op.cc:270] Start()
0503 19:55:48.417145 (+ 22us) write_op.cc:276] Timestamp: P: 1777838144961207 usec, L: 0
0503 19:55:48.417300 (+ 155us) write_op.cc:270] Start()
0503 19:55:48.417321 (+ 21us) write_op.cc:276] Timestamp: P: 1777838144964236 usec, L: 0
0503 19:55:48.417476 (+ 155us) write_op.cc:270] Start()
0503 19:55:48.417495 (+ 19us) write_op.cc:276] Timestamp: P: 1777838144985500 usec, L: 0
0503 19:55:48.417683 (+ 188us) write_op.cc:270] Start()
0503 19:55:48.417703 (+ 20us) write_op.cc:276] Timestamp: P: 1777838145036753 usec, L: 0
0503 19:55:48.417888 (+ 185us) write_op.cc:270] Start()
0503 19:55:48.417914 (+ 26us) write_op.cc:276] Timestamp: P: 1777838145079764 usec, L: 0
0503 19:55:48.418055 (+ 141us) write_op.cc:270] Start()
0503 19:55:48.418074 (+ 19us) write_op.cc:276] Timestamp: P: 1777838145092971 usec, L: 0
0503 19:55:48.418223 (+ 149us) write_op.cc:270] Start()
0503 19:55:48.418244 (+ 21us) write_op.cc:276] Timestamp: P: 1777838145102098 usec, L: 0
0503 19:55:48.418406 (+ 162us) write_op.cc:270] Start()
0503 19:55:48.418427 (+ 21us) write_op.cc:276] Timestamp: P: 1777838145128492 usec, L: 0
0503 19:55:48.418596 (+ 169us) write_op.cc:270] Start()
0503 19:55:48.418618 (+ 22us) write_op.cc:276] Timestamp: P: 1777838145176199 usec, L: 0
0503 19:55:48.418753 (+ 135us) write_op.cc:270] Start()
0503 19:55:48.418782 (+ 29us) write_op.cc:276] Timestamp: P: 1777838145189504 usec, L: 0
0503 19:55:48.418940 (+ 158us) write_op.cc:270] Start()
0503 19:55:48.418966 (+ 26us) write_op.cc:276] Timestamp: P: 1777838145230539 usec, L: 0
0503 19:55:48.419157 (+ 191us) write_op.cc:270] Start()
0503 19:55:48.419179 (+ 22us) write_op.cc:276] Timestamp: P: 1777838145236855 usec, L: 0
0503 19:55:48.419331 (+ 152us) write_op.cc:270] Start()
0503 19:55:48.419352 (+ 21us) write_op.cc:276] Timestamp: P: 1777838145273764 usec, L: 0
0503 19:55:48.419515 (+ 163us) write_op.cc:270] Start()
0503 19:55:48.419543 (+ 28us) write_op.cc:276] Timestamp: P: 1777838145296319 usec, L: 0
0503 19:55:48.466943 (+ 47400us) write_op.cc:270] Start()
0503 19:55:48.466980 (+ 37us) write_op.cc:276] Timestamp: P: 1777838145413955 usec, L: 0
0503 19:55:48.482287 (+ 15307us) write_op.cc:270] Start()
0503 19:55:48.482324 (+ 37us) write_op.cc:276] Timestamp: P: 1777838145415843 usec, L: 0
0503 19:55:48.482554 (+ 230us) write_op.cc:270] Start()
0503 19:55:48.482572 (+ 18us) write_op.cc:276] Timestamp: P: 1777838145419366 usec, L: 0
0503 19:55:48.539426 (+ 56854us) write_op.cc:270] Start()
0503 19:55:48.539465 (+ 39us) write_op.cc:276] Timestamp: P: 1777838145440421 usec, L: 0
0503 19:55:48.540536 (+ 1071us) write_op.cc:270] Start()
0503 19:55:48.540567 (+ 31us) write_op.cc:276] Timestamp: P: 1777838145494284 usec, L: 0
0503 19:55:48.540741 (+ 174us) write_op.cc:270] Start()
0503 19:55:48.540759 (+ 18us) write_op.cc:276] Timestamp: P: 1777838145502344 usec, L: 0
0503 19:55:48.540909 (+ 150us) write_op.cc:270] Start()
0503 19:55:48.540926 (+ 17us) write_op.cc:276] Timestamp: P: 1777838145557092 usec, L: 0
0503 19:55:48.541040 (+ 114us) write_op.cc:270] Start()
0503 19:55:48.541055 (+ 15us) write_op.cc:276] Timestamp: P: 1777838145564595 usec, L: 0
0503 19:55:48.542502 (+ 1447us) write_op.cc:270] Start()
0503 19:55:48.542526 (+ 24us) write_op.cc:276] Timestamp: P: 1777838145572086 usec, L: 0
0503 19:55:48.548786 (+ 6260us) write_op.cc:270] Start()
0503 19:55:48.548821 (+ 35us) write_op.cc:276] Timestamp: P: 1777838145586388 usec, L: 0
0503 19:55:48.552630 (+ 3809us) write_op.cc:270] Start()
0503 19:55:48.552665 (+ 35us) write_op.cc:276] Timestamp: P: 1777838145590032 usec, L: 0
0503 19:55:48.552900 (+ 235us) write_op.cc:270] Start()
0503 19:55:48.552923 (+ 23us) write_op.cc:276] Timestamp: P: 1777838145613999 usec, L: 0
0503 19:55:48.566037 (+ 13114us) write_op.cc:270] Start()
0503 19:55:48.566069 (+ 32us) write_op.cc:276] Timestamp: P: 1777838145654278 usec, L: 0
0503 19:55:48.567267 (+ 1198us) write_op.cc:270] Start()
0503 19:55:48.567297 (+ 30us) write_op.cc:276] Timestamp: P: 1777838145655516 usec, L: 0
0503 19:55:48.567482 (+ 185us) write_op.cc:270] Start()
0503 19:55:48.567504 (+ 22us) write_op.cc:276] Timestamp: P: 1777838145658032 usec, L: 0
0503 19:55:48.571836 (+ 4332us) write_op.cc:270] Start()
0503 19:55:48.571873 (+ 37us) write_op.cc:276] Timestamp: P: 1777838145676915 usec, L: 0
0503 19:55:48.572073 (+ 200us) write_op.cc:270] Start()
0503 19:55:48.572096 (+ 23us) write_op.cc:276] Timestamp: P: 1777838145722611 usec, L: 0
0503 19:55:48.641779 (+ 69683us) write_op.cc:270] Start()
0503 19:55:48.641816 (+ 37us) write_op.cc:276] Timestamp: P: 1777838145748654 usec, L: 0
0503 19:55:48.651700 (+ 9884us) write_op.cc:270] Start()
0503 19:55:48.651746 (+ 46us) write_op.cc:276] Timestamp: P: 1777838145765004 usec, L: 0
0503 19:55:48.651998 (+ 252us) write_op.cc:270] Start()
0503 19:55:48.652022 (+ 24us) write_op.cc:276] Timestamp: P: 1777838145787038 usec, L: 0
0503 19:55:48.657755 (+ 5733us) write_op.cc:270] Start()
0503 19:55:48.657795 (+ 40us) write_op.cc:276] Timestamp: P: 1777838145789994 usec, L: 0
0503 19:55:48.659534 (+ 1739us) write_op.cc:270] Start()
0503 19:55:48.659569 (+ 35us) write_op.cc:276] Timestamp: P: 1777838145822370 usec, L: 0
0503 19:55:48.660160 (+ 591us) write_op.cc:270] Start()
0503 19:55:48.660185 (+ 25us) write_op.cc:276] Timestamp: P: 1777838145854334 usec, L: 0
0503 19:55:48.662400 (+ 2215us) write_op.cc:270] Start()
0503 19:55:48.662430 (+ 30us) write_op.cc:276] Timestamp: P: 1777838145920899 usec, L: 0
0503 19:55:48.662604 (+ 174us) write_op.cc:270] Start()
0503 19:55:48.662625 (+ 21us) write_op.cc:276] Timestamp: P: 1777838145968436 usec, L: 0
0503 19:55:48.696957 (+ 34332us) write_op.cc:270] Start()
0503 19:55:48.696992 (+ 35us) write_op.cc:276] Timestamp: P: 1777838145975249 usec, L: 0
0503 19:55:48.702177 (+ 5185us) write_op.cc:270] Start()
0503 19:55:48.717204 (+ 15027us) write_op.cc:276] Timestamp: P: 1777838145977298 usec, L: 0
0503 19:55:48.734309 (+ 17105us) write_op.cc:270] Start()
0503 19:55:48.734344 (+ 35us) write_op.cc:276] Timestamp: P: 1777838146013223 usec, L: 0
0503 19:55:48.742015 (+ 7671us) write_op.cc:270] Start()
0503 19:55:48.742060 (+ 45us) write_op.cc:276] Timestamp: P: 1777838146030997 usec, L: 0
0503 19:55:48.833658 (+ 91598us) write_op.cc:270] Start()
0503 19:55:48.833689 (+ 31us) write_op.cc:276] Timestamp: P: 1777838146038359 usec, L: 0
0503 19:55:48.833941 (+ 252us) write_op.cc:270] Start()
0503 19:55:48.833964 (+ 23us) write_op.cc:276] Timestamp: P: 1777838146039117 usec, L: 0
0503 19:55:48.841489 (+ 7525us) write_op.cc:270] Start()
0503 19:55:48.841520 (+ 31us) write_op.cc:276] Timestamp: P: 1777838146073038 usec, L: 0
0503 19:55:48.849774 (+ 8254us) write_op.cc:270] Start()
0503 19:55:48.849809 (+ 35us) write_op.cc:276] Timestamp: P: 1777838146111122 usec, L: 0
0503 19:55:48.852164 (+ 2355us) write_op.cc:270] Start()
0503 19:55:48.852194 (+ 30us) write_op.cc:276] Timestamp: P: 1777838146131199 usec, L: 0
0503 19:55:48.853094 (+ 900us) write_op.cc:270] Start()
0503 19:55:48.853122 (+ 28us) write_op.cc:276] Timestamp: P: 1777838146132647 usec, L: 0
0503 19:55:48.861902 (+ 8780us) write_op.cc:270] Start()
0503 19:55:48.861933 (+ 31us) write_op.cc:276] Timestamp: P: 1777838146146526 usec, L: 0
0503 19:55:48.875327 (+ 13394us) write_op.cc:270] Start()
0503 19:55:48.875357 (+ 30us) write_op.cc:276] Timestamp: P: 1777838146226100 usec, L: 0
0503 19:55:48.877423 (+ 2066us) write_op.cc:270] Start()
0503 19:55:48.877458 (+ 35us) write_op.cc:276] Timestamp: P: 1777838146237329 usec, L: 0
0503 19:55:48.877716 (+ 258us) write_op.cc:270] Start()
0503 19:55:48.877738 (+ 22us) write_op.cc:276] Timestamp: P: 1777838146237953 usec, L: 0
0503 19:55:48.878699 (+ 961us) write_op.cc:270] Start()
0503 19:55:48.878727 (+ 28us) write_op.cc:276] Timestamp: P: 1777838146241200 usec, L: 0
0503 19:55:48.898293 (+ 19566us) write_op.cc:270] Start()
0503 19:55:48.898329 (+ 36us) write_op.cc:276] Timestamp: P: 1777838146348098 usec, L: 0
0503 19:55:48.902770 (+ 4441us) write_op.cc:270] Start()
0503 19:55:48.902796 (+ 26us) write_op.cc:276] Timestamp: P: 1777838146354389 usec, L: 0
0503 19:55:48.907011 (+ 4215us) write_op.cc:270] Start()
0503 19:55:48.907042 (+ 31us) write_op.cc:276] Timestamp: P: 1777838146406647 usec, L: 0
0503 19:55:48.908088 (+ 1046us) write_op.cc:270] Start()
0503 19:55:48.908114 (+ 26us) write_op.cc:276] Timestamp: P: 1777838146427907 usec, L: 0
0503 19:55:48.953591 (+ 45477us) write_op.cc:270] Start()
0503 19:55:48.953625 (+ 34us) write_op.cc:276] Timestamp: P: 1777838146460738 usec, L: 0
0503 19:55:48.977177 (+ 23552us) write_op.cc:270] Start()
0503 19:55:48.977211 (+ 34us) write_op.cc:276] Timestamp: P: 1777838146473403 usec, L: 0
0503 19:55:48.977452 (+ 241us) write_op.cc:270] Start()
0503 19:55:48.977476 (+ 24us) write_op.cc:276] Timestamp: P: 1777838146491090 usec, L: 0
0503 19:55:48.977687 (+ 211us) write_op.cc:270] Start()
0503 19:55:48.977710 (+ 23us) write_op.cc:276] Timestamp: P: 1777838146562025 usec, L: 0
0503 19:55:48.977869 (+ 159us) write_op.cc:270] Start()
0503 19:55:48.977891 (+ 22us) write_op.cc:276] Timestamp: P: 1777838146575675 usec, L: 0
0503 19:55:48.978047 (+ 156us) write_op.cc:270] Start()
0503 19:55:48.978071 (+ 24us) write_op.cc:276] Timestamp: P: 1777838146589574 usec, L: 0
0503 19:55:48.978261 (+ 190us) write_op.cc:270] Start()
0503 19:55:48.978277 (+ 16us) write_op.cc:276] Timestamp: P: 1777838146591715 usec, L: 0
0503 19:55:48.978490 (+ 213us) write_op.cc:270] Start()
0503 19:55:48.978511 (+ 21us) write_op.cc:276] Timestamp: P: 1777838146660840 usec, L: 0
0503 19:55:48.978704 (+ 193us) write_op.cc:270] Start()
0503 19:55:48.978725 (+ 21us) write_op.cc:276] Timestamp: P: 1777838146664762 usec, L: 0
0503 19:55:48.978954 (+ 229us) write_op.cc:270] Start()
0503 19:55:48.978972 (+ 18us) write_op.cc:276] Timestamp: P: 1777838146669036 usec, L: 0
0503 19:55:48.979163 (+ 191us) write_op.cc:270] Start()
0503 19:55:48.979185 (+ 22us) write_op.cc:276] Timestamp: P: 1777838146733877 usec, L: 0
0503 19:55:49.030680 (+ 51495us) write_op.cc:270] Start()
0503 19:55:49.030745 (+ 65us) write_op.cc:276] Timestamp: P: 1777838146796283 usec, L: 0
0503 19:55:49.030965 (+ 220us) write_op.cc:270] Start()
0503 19:55:49.030991 (+ 26us) write_op.cc:276] Timestamp: P: 1777838146796874 usec, L: 0
0503 19:55:49.031172 (+ 181us) write_op.cc:270] Start()
0503 19:55:49.031194 (+ 22us) write_op.cc:276] Timestamp: P: 1777838146801766 usec, L: 0
0503 19:55:49.031390 (+ 196us) write_op.cc:270] Start()
0503 19:55:49.031412 (+ 22us) write_op.cc:276] Timestamp: P: 1777838146812617 usec, L: 0
0503 19:55:49.031588 (+ 176us) write_op.cc:270] Start()
0503 19:55:49.031610 (+ 22us) write_op.cc:276] Timestamp: P: 1777838146844867 usec, L: 0
0503 19:55:49.031979 (+ 369us) write_op.cc:270] Start()
0503 19:55:49.032007 (+ 28us) write_op.cc:276] Timestamp: P: 1777838146891437 usec, L: 0
0503 19:55:49.032187 (+ 180us) write_op.cc:270] Start()
0503 19:55:49.032208 (+ 21us) write_op.cc:276] Timestamp: P: 1777838146894123 usec, L: 0
0503 19:55:49.032346 (+ 138us) write_op.cc:270] Start()
0503 19:55:49.032365 (+ 19us) write_op.cc:276] Timestamp: P: 1777838146894758 usec, L: 0
0503 19:55:49.032528 (+ 163us) write_op.cc:270] Start()
0503 19:55:49.032548 (+ 20us) write_op.cc:276] Timestamp: P: 1777838146943045 usec, L: 0
0503 19:55:49.032744 (+ 196us) write_op.cc:270] Start()
0503 19:55:49.032765 (+ 21us) write_op.cc:276] Timestamp: P: 1777838147002344 usec, L: 0
0503 19:55:49.033004 (+ 239us) write_op.cc:270] Start()
0503 19:55:49.033028 (+ 24us) write_op.cc:276] Timestamp: P: 1777838147005879 usec, L: 0
0503 19:55:49.033250 (+ 222us) write_op.cc:270] Start()
0503 19:55:49.033277 (+ 27us) write_op.cc:276] Timestamp: P: 1777838147012734 usec, L: 0
0503 19:55:49.033471 (+ 194us) write_op.cc:270] Start()
0503 19:55:49.033495 (+ 24us) write_op.cc:276] Timestamp: P: 1777838147070124 usec, L: 0
0503 19:55:49.033666 (+ 171us) write_op.cc:270] Start()
0503 19:55:49.033686 (+ 20us) write_op.cc:276] Timestamp: P: 1777838147072665 usec, L: 0
0503 19:55:49.033848 (+ 162us) write_op.cc:270] Start()
0503 19:55:49.033867 (+ 19us) write_op.cc:276] Timestamp: P: 1777838147077587 usec, L: 0
0503 19:55:49.034006 (+ 139us) write_op.cc:270] Start()
0503 19:55:49.034025 (+ 19us) write_op.cc:276] Timestamp: P: 1777838147078214 usec, L: 0
0503 19:55:49.034203 (+ 178us) write_op.cc:270] Start()
0503 19:55:49.034224 (+ 21us) write_op.cc:276] Timestamp: P: 1777838147157411 usec, L: 0
0503 19:55:49.034395 (+ 171us) write_op.cc:270] Start()
0503 19:55:49.034415 (+ 20us) write_op.cc:276] Timestamp: P: 1777838147172839 usec, L: 0
0503 19:55:49.034546 (+ 131us) write_op.cc:270] Start()
0503 19:55:49.034567 (+ 21us) write_op.cc:276] Timestamp: P: 1777838147179162 usec, L: 0
0503 19:55:49.034719 (+ 152us) write_op.cc:270] Start()
0503 19:55:49.034741 (+ 22us) write_op.cc:276] Timestamp: P: 1777838147186996 usec, L: 0
0503 19:55:49.034911 (+ 170us) write_op.cc:270] Start()
0503 19:55:49.034932 (+ 21us) write_op.cc:276] Timestamp: P: 1777838147206865 usec, L: 0
0503 19:55:49.050386 (+ 15454us) write_op.cc:270] Start()
0503 19:55:49.050418 (+ 32us) write_op.cc:276] Timestamp: P: 1777838147208753 usec, L: 0
0503 19:55:49.063863 (+ 13445us) write_op.cc:270] Start()
0503 19:55:49.063893 (+ 30us) write_op.cc:276] Timestamp: P: 1777838147268641 usec, L: 0
0503 19:55:49.072329 (+ 8436us) write_op.cc:270] Start()
0503 19:55:49.072366 (+ 37us) write_op.cc:276] Timestamp: P: 1777838147272799 usec, L: 0
0503 19:55:49.073947 (+ 1581us) write_op.cc:270] Start()
0503 19:55:49.073983 (+ 36us) write_op.cc:276] Timestamp: P: 1777838147274211 usec, L: 0
0503 19:55:49.090409 (+ 16426us) write_op.cc:270] Start()
0503 19:55:49.090453 (+ 44us) write_op.cc:276] Timestamp: P: 1777838147275566 usec, L: 0
0503 19:55:49.096739 (+ 6286us) write_op.cc:270] Start()
0503 19:55:49.096770 (+ 31us) write_op.cc:276] Timestamp: P: 1777838147357407 usec, L: 0
0503 19:55:49.112214 (+ 15444us) write_op.cc:270] Start()
0503 19:55:49.112241 (+ 27us) write_op.cc:276] Timestamp: P: 1777838147380365 usec, L: 0
0503 19:55:49.112447 (+ 206us) write_op.cc:270] Start()
0503 19:55:49.112469 (+ 22us) write_op.cc:276] Timestamp: P: 1777838147383411 usec, L: 0
0503 19:55:49.118935 (+ 6466us) write_op.cc:270] Start()
0503 19:55:49.118972 (+ 37us) write_op.cc:276] Timestamp: P: 1777838147387148 usec, L: 0
0503 19:55:49.119194 (+ 222us) write_op.cc:270] Start()
0503 19:55:49.119215 (+ 21us) write_op.cc:276] Timestamp: P: 1777838147468557 usec, L: 0
0503 19:55:49.119351 (+ 136us) write_op.cc:270] Start()
0503 19:55:49.119367 (+ 16us) write_op.cc:276] Timestamp: P: 1777838147478684 usec, L: 0
0503 19:55:49.145973 (+ 26606us) write_op.cc:270] Start()
0503 19:55:49.146024 (+ 51us) write_op.cc:276] Timestamp: P: 1777838147520608 usec, L: 0
0503 19:55:49.147589 (+ 1565us) write_op.cc:270] Start()
0503 19:55:49.147621 (+ 32us) write_op.cc:276] Timestamp: P: 1777838147559134 usec, L: 0
0503 19:55:49.152419 (+ 4798us) write_op.cc:270] Start()
0503 19:55:49.152449 (+ 30us) write_op.cc:276] Timestamp: P: 1777838147577833 usec, L: 0
0503 19:55:49.182927 (+ 30478us) write_op.cc:270] Start()
0503 19:55:49.182962 (+ 35us) write_op.cc:276] Timestamp: P: 1777838147583216 usec, L: 0
0503 19:55:49.201143 (+ 18181us) write_op.cc:270] Start()
0503 19:55:49.201196 (+ 53us) write_op.cc:276] Timestamp: P: 1777838147610661 usec, L: 0
0503 19:55:49.210867 (+ 9671us) write_op.cc:270] Start()
0503 19:55:49.210939 (+ 72us) write_op.cc:276] Timestamp: P: 1777838147612787 usec, L: 0
0503 19:55:49.212474 (+ 1535us) write_op.cc:270] Start()
0503 19:55:49.212508 (+ 34us) write_op.cc:276] Timestamp: P: 1777838147621745 usec, L: 0
0503 19:55:49.216504 (+ 3996us) write_op.cc:270] Start()
0503 19:55:49.216539 (+ 35us) write_op.cc:276] Timestamp: P: 1777838147643085 usec, L: 0
0503 19:55:49.239435 (+ 22896us) write_op.cc:270] Start()
0503 19:55:49.239483 (+ 48us) write_op.cc:276] Timestamp: P: 1777838147694647 usec, L: 0
0503 19:55:49.245488 (+ 6005us) write_op.cc:270] Start()
0503 19:55:49.245523 (+ 35us) write_op.cc:276] Timestamp: P: 1777838147705138 usec, L: 0
0503 19:55:49.245800 (+ 277us) write_op.cc:270] Start()
0503 19:55:49.245826 (+ 26us) write_op.cc:276] Timestamp: P: 1777838147727736 usec, L: 0
0503 19:55:49.262318 (+ 16492us) write_op.cc:270] Start()
0503 19:55:49.262357 (+ 39us) write_op.cc:276] Timestamp: P: 1777838147776513 usec, L: 0
0503 19:55:49.274069 (+ 11712us) write_op.cc:270] Start()
0503 19:55:49.274108 (+ 39us) write_op.cc:276] Timestamp: P: 1777838147828848 usec, L: 0
0503 19:55:49.276274 (+ 2166us) write_op.cc:270] Start()
0503 19:55:49.276306 (+ 32us) write_op.cc:276] Timestamp: P: 1777838147837132 usec, L: 0
0503 19:55:49.276533 (+ 227us) write_op.cc:270] Start()
0503 19:55:49.276555 (+ 22us) write_op.cc:276] Timestamp: P: 1777838147840179 usec, L: 0
0503 19:55:49.276707 (+ 152us) write_op.cc:270] Start()
0503 19:55:49.276728 (+ 21us) write_op.cc:276] Timestamp: P: 1777838147861755 usec, L: 0
0503 19:55:49.276895 (+ 167us) write_op.cc:270] Start()
0503 19:55:49.276916 (+ 21us) write_op.cc:276] Timestamp: P: 1777838147901621 usec, L: 0
0503 19:55:49.277067 (+ 151us) write_op.cc:270] Start()
0503 19:55:49.277088 (+ 21us) write_op.cc:276] Timestamp: P: 1777838147908667 usec, L: 0
0503 19:55:49.277238 (+ 150us) write_op.cc:270] Start()
0503 19:55:49.277260 (+ 22us) write_op.cc:276] Timestamp: P: 1777838147914830 usec, L: 0
0503 19:55:49.278511 (+ 1251us) write_op.cc:270] Start()
0503 19:55:49.278538 (+ 27us) write_op.cc:276] Timestamp: P: 1777838147917467 usec, L: 0
0503 19:55:49.278730 (+ 192us) write_op.cc:270] Start()
0503 19:55:49.278767 (+ 37us) write_op.cc:276] Timestamp: P: 1777838147948036 usec, L: 0
0503 19:55:49.278943 (+ 176us) write_op.cc:270] Start()
0503 19:55:49.278965 (+ 22us) write_op.cc:276] Timestamp: P: 1777838147974663 usec, L: 0
0503 19:55:49.279134 (+ 169us) write_op.cc:270] Start()
0503 19:55:49.279156 (+ 22us) write_op.cc:276] Timestamp: P: 1777838147990538 usec, L: 0
0503 19:55:49.279308 (+ 152us) write_op.cc:270] Start()
0503 19:55:49.279329 (+ 21us) write_op.cc:276] Timestamp: P: 1777838148014249 usec, L: 0
0503 19:55:49.451554 (+172225us) log.cc:844] Serialized 124146 byte log entry
0503 19:55:49.573907 (+122353us) raft_consensus.cc:1645] Marking committed up to 835
0503 19:55:49.607997 (+ 34090us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 19:55:49.613626 (+ 5629us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0503 19:55:49.613640 (+ 14us) raft_consensus.cc:1685] finished
0503 19:55:49.613642 (+ 2us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 19:55:49.613743 (+ 101us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0503 19:55:48.287066 (+ 0us) write_op.cc:183] PREPARE: starting on tablet ecf4b80ba8714f24a49387dc8bbe2da3
0503 19:55:48.287207 (+ 141us) write_op.cc:432] Acquiring schema lock in shared mode
0503 19:55:48.287212 (+ 5us) write_op.cc:435] Acquired schema lock
0503 19:55:48.287214 (+ 2us) tablet.cc:662] Decoding operations
0503 19:55:48.287409 (+ 195us) write_op.cc:620] Acquiring the partition lock for write op
0503 19:55:48.287428 (+ 19us) write_op.cc:641] Partition lock acquired for write op
0503 19:55:48.287432 (+ 4us) tablet.cc:685] Acquiring locks for 10 operations
0503 19:55:48.287600 (+ 168us) tablet.cc:701] Row locks acquired
0503 19:55:48.287602 (+ 2us) write_op.cc:260] PREPARE: finished
0503 19:55:49.573964 (+1286362us) op_driver.cc:464] REPLICATION: finished
Related trace 'op':
0503 19:55:48.287742 (+ 0us) write_op.cc:183] PREPARE: starting on tablet ecf4b80ba8714f24a49387dc8bbe2da3
0503 19:55:48.287846 (+ 104us) write_op.cc:432] Acquiring schema lock in shared mo
I20260503 19:55:50.547752 1537 raft_consensus.cc:493] T ecf4b80ba8714f24a49387dc8bbe2da3 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a1219433b66444d091420ceeab5092ef)
I20260503 19:55:50.557608 1537 raft_consensus.cc:515] T ecf4b80ba8714f24a49387dc8bbe2da3 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:50.592532 862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf4b80ba8714f24a49387dc8bbe2da3" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 835 } } ignore_live_leader: false dest_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" is_pre_election: true
I20260503 19:55:50.596228 1537 leader_election.cc:290] T ecf4b80ba8714f24a49387dc8bbe2da3 P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1219433b66444d091420ceeab5092ef (127.0.105.2:38837), 6d99e4f4d5ca48e0bdb54daf8361c5e8 (127.0.105.3:35005)
I20260503 19:55:50.622833 728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf4b80ba8714f24a49387dc8bbe2da3" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 835 } } ignore_live_leader: false dest_uuid: "a1219433b66444d091420ceeab5092ef" is_pre_election: true
I20260503 19:55:50.635972 1356 leader_election.cc:304] T ecf4b80ba8714f24a49387dc8bbe2da3 P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e52aa88a17542609e84f0c09fb85d87; no voters: 6d99e4f4d5ca48e0bdb54daf8361c5e8, a1219433b66444d091420ceeab5092ef
I20260503 19:55:51.037963 1540 raft_consensus.cc:493] T a860805e8df84220ae4be7d3279b75f1 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a1219433b66444d091420ceeab5092ef)
I20260503 19:55:51.059232 1540 raft_consensus.cc:515] T a860805e8df84220ae4be7d3279b75f1 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } }
I20260503 19:55:51.065966 1540 leader_election.cc:290] T a860805e8df84220ae4be7d3279b75f1 P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d99e4f4d5ca48e0bdb54daf8361c5e8 (127.0.105.3:35005), a1219433b66444d091420ceeab5092ef (127.0.105.2:38837)
I20260503 19:55:51.065953 862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860805e8df84220ae4be7d3279b75f1" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 724 } } ignore_live_leader: false dest_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" is_pre_election: true
I20260503 19:55:51.086436 729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860805e8df84220ae4be7d3279b75f1" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 724 } } ignore_live_leader: false dest_uuid: "a1219433b66444d091420ceeab5092ef" is_pre_election: true
I20260503 19:55:51.091202 1356 leader_election.cc:304] T a860805e8df84220ae4be7d3279b75f1 P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e52aa88a17542609e84f0c09fb85d87; no voters: 6d99e4f4d5ca48e0bdb54daf8361c5e8, a1219433b66444d091420ceeab5092ef
I20260503 19:55:51.092660 1540 raft_consensus.cc:2749] T a860805e8df84220ae4be7d3279b75f1 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 19:55:51.378693 1527 raft_consensus.cc:493] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d99e4f4d5ca48e0bdb54daf8361c5e8)
I20260503 19:55:51.378942 1527 raft_consensus.cc:515] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:51.379936 1527 leader_election.cc:290] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1219433b66444d091420ceeab5092ef (127.0.105.2:38837), 6d99e4f4d5ca48e0bdb54daf8361c5e8 (127.0.105.3:35005)
I20260503 19:55:51.380869 857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c99d75cb2be4439a1610c0de343d73a" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 923 } } ignore_live_leader: false dest_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" is_pre_election: true
I20260503 19:55:51.381314 729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c99d75cb2be4439a1610c0de343d73a" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 923 } } ignore_live_leader: false dest_uuid: "a1219433b66444d091420ceeab5092ef" is_pre_election: true
I20260503 19:55:51.392719 1435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.105.3:47337 (request call id 20) took 1453 ms. Trace:
I20260503 19:55:51.418772 1356 leader_election.cc:304] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e52aa88a17542609e84f0c09fb85d87; no voters: 6d99e4f4d5ca48e0bdb54daf8361c5e8, a1219433b66444d091420ceeab5092ef
W20260503 19:55:51.421905 796 consensus_peers.cc:597] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 131: this message will repeat every 5th retry.
I20260503 19:55:51.432518 1527 raft_consensus.cc:2749] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 19:55:51.432794 1537 raft_consensus.cc:2749] T ecf4b80ba8714f24a49387dc8bbe2da3 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 19:55:51.443207 1387 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:58682 (request call id 17) took 1467 ms. Trace:
I20260503 19:55:51.443365 1387 rpcz_store.cc:276] 0503 19:55:49.966383 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 19:55:49.966454 (+ 71us) service_pool.cc:224] Handling call
0503 19:55:51.380242 (+1413788us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x616000018a54. stack: 00007f2b5ee49086 00007f2b5ee48e40 00007f2b5de023ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007f2b6ad5b8c0 00007f2b6ec16eaf 00007f2b6902ec36 00007f2b6902e965 00007f2b65e3c10e 00007f2b65e3afee 00007f2b65e41228 00007f2b65e41b8f 00007f2b65e419b8 0000000000aa4cac
0503 19:55:51.433137 (+ 52895us) spinlock_profiling.cc:243] Waited 52.5 ms on lock 0x616000019054. stack: 00007f2b5ee49086 00007f2b5ee48e40 00007f2b5de023ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007f2b6ad5b8c0 00007f2b6ec16eaf 00007f2b6902ec36 00007f2b6902e965 00007f2b65e3c10e 00007f2b65e3afee 00007f2b65e41228 00007f2b65e41b8f 00007f2b65e419b8 0000000000aa4cac
0503 19:55:51.433356 (+ 219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3349978368}
I20260503 19:55:51.584378 1362 tablet_bootstrap.cc:492] T 3983c88812214bc0bfaaa35c08c38875 P 0e52aa88a17542609e84f0c09fb85d87: Bootstrap replayed 1/1 log segments. Stats: ops{read=163 overwritten=0 applied=159 ignored=0} inserts{seen=1357 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 4 replicates
I20260503 19:55:51.667860 1362 tablet_bootstrap.cc:492] T 3983c88812214bc0bfaaa35c08c38875 P 0e52aa88a17542609e84f0c09fb85d87: Bootstrap complete.
I20260503 19:55:51.669234 1362 ts_tablet_manager.cc:1403] T 3983c88812214bc0bfaaa35c08c38875 P 0e52aa88a17542609e84f0c09fb85d87: Time spent bootstrapping tablet: real 5.840s user 0.331s sys 0.079s
I20260503 19:55:51.695722 1362 raft_consensus.cc:359] T 3983c88812214bc0bfaaa35c08c38875 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Replica starting. Triggering 4 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:51.761245 1362 raft_consensus.cc:740] T 3983c88812214bc0bfaaa35c08c38875 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e52aa88a17542609e84f0c09fb85d87, State: Initialized, Role: FOLLOWER
I20260503 19:55:51.772576 1362 consensus_queue.cc:260] T 3983c88812214bc0bfaaa35c08c38875 P 0e52aa88a17542609e84f0c09fb85d87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 159, Last appended: 1.163, Last appended by leader: 163, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:51.773257 1362 ts_tablet_manager.cc:1434] T 3983c88812214bc0bfaaa35c08c38875 P 0e52aa88a17542609e84f0c09fb85d87: Time spent starting tablet: real 0.104s user 0.000s sys 0.004s
I20260503 19:55:51.775380 1362 tablet_bootstrap.cc:492] T 4d80fc29b7a64074b4a2ce4003054d1a P 0e52aa88a17542609e84f0c09fb85d87: Bootstrap starting.
I20260503 19:55:51.835861 1537 raft_consensus.cc:493] T ecf4b80ba8714f24a49387dc8bbe2da3 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a1219433b66444d091420ceeab5092ef)
I20260503 19:55:51.836125 1537 raft_consensus.cc:515] T ecf4b80ba8714f24a49387dc8bbe2da3 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:51.838235 1537 leader_election.cc:290] T ecf4b80ba8714f24a49387dc8bbe2da3 P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1219433b66444d091420ceeab5092ef (127.0.105.2:38837), 6d99e4f4d5ca48e0bdb54daf8361c5e8 (127.0.105.3:35005)
I20260503 19:55:51.838304 862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf4b80ba8714f24a49387dc8bbe2da3" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 986 } } ignore_live_leader: false dest_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" is_pre_election: true
I20260503 19:55:51.839112 729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf4b80ba8714f24a49387dc8bbe2da3" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 986 } } ignore_live_leader: false dest_uuid: "a1219433b66444d091420ceeab5092ef" is_pre_election: true
I20260503 19:55:51.847267 1356 leader_election.cc:304] T ecf4b80ba8714f24a49387dc8bbe2da3 P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e52aa88a17542609e84f0c09fb85d87; no voters: 6d99e4f4d5ca48e0bdb54daf8361c5e8, a1219433b66444d091420ceeab5092ef
I20260503 19:55:51.848184 1537 raft_consensus.cc:2749] T ecf4b80ba8714f24a49387dc8bbe2da3 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 19:55:51.878916 1537 raft_consensus.cc:493] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d99e4f4d5ca48e0bdb54daf8361c5e8)
I20260503 19:55:51.879128 1537 raft_consensus.cc:515] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:51.885450 728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c99d75cb2be4439a1610c0de343d73a" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 923 } } ignore_live_leader: false dest_uuid: "a1219433b66444d091420ceeab5092ef" is_pre_election: true
I20260503 19:55:51.885867 1537 leader_election.cc:290] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1219433b66444d091420ceeab5092ef (127.0.105.2:38837), 6d99e4f4d5ca48e0bdb54daf8361c5e8 (127.0.105.3:35005)
I20260503 19:55:51.886353 859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c99d75cb2be4439a1610c0de343d73a" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 923 } } ignore_live_leader: false dest_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" is_pre_election: true
I20260503 19:55:51.887058 1358 leader_election.cc:304] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e52aa88a17542609e84f0c09fb85d87; no voters: 6d99e4f4d5ca48e0bdb54daf8361c5e8, a1219433b66444d091420ceeab5092ef
I20260503 19:55:51.895304 1537 raft_consensus.cc:2749] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260503 19:55:52.000325 665 consensus_peers.cc:597] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 121: this message will repeat every 5th retry.
I20260503 19:55:52.103667 1537 raft_consensus.cc:493] T 3983c88812214bc0bfaaa35c08c38875 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 19:55:52.103894 1537 raft_consensus.cc:515] T 3983c88812214bc0bfaaa35c08c38875 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:52.104624 1537 leader_election.cc:290] T 3983c88812214bc0bfaaa35c08c38875 P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1219433b66444d091420ceeab5092ef (127.0.105.2:38837), 6d99e4f4d5ca48e0bdb54daf8361c5e8 (127.0.105.3:35005)
I20260503 19:55:52.106225 862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3983c88812214bc0bfaaa35c08c38875" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 163 } } ignore_live_leader: false dest_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" is_pre_election: true
I20260503 19:55:52.109366 728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3983c88812214bc0bfaaa35c08c38875" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 163 } } ignore_live_leader: false dest_uuid: "a1219433b66444d091420ceeab5092ef" is_pre_election: true
I20260503 19:55:52.110266 1356 leader_election.cc:304] T 3983c88812214bc0bfaaa35c08c38875 P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e52aa88a17542609e84f0c09fb85d87; no voters: 6d99e4f4d5ca48e0bdb54daf8361c5e8, a1219433b66444d091420ceeab5092ef
I20260503 19:55:52.112669 1537 raft_consensus.cc:2749] T 3983c88812214bc0bfaaa35c08c38875 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 19:55:51.392891 1435 rpcz_store.cc:276] 0503 19:55:49.933819 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 19:55:49.934046 (+ 227us) service_pool.cc:224] Handling call
0503 19:55:49.974103 (+ 40057us) raft_consensus.cc:1471] Updating replica for 128 ops
0503 19:55:50.010174 (+ 36071us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 19:55:50.010180 (+ 6us) raft_consensus.cc:1539] Triggering prepare for 128 ops
0503 19:55:50.010353 (+ 173us) write_op.cc:270] Start()
0503 19:55:50.010394 (+ 41us) write_op.cc:276] Timestamp: P: 1777838147162537 usec, L: 0
0503 19:55:50.190071 (+179677us) write_op.cc:270] Start()
0503 19:55:50.190102 (+ 31us) write_op.cc:276] Timestamp: P: 1777838147165284 usec, L: 0
0503 19:55:50.192791 (+ 2689us) write_op.cc:270] Start()
0503 19:55:50.192824 (+ 33us) write_op.cc:276] Timestamp: P: 1777838147181779 usec, L: 0
0503 19:55:50.243104 (+ 50280us) write_op.cc:270] Start()
0503 19:55:50.249940 (+ 6836us) write_op.cc:276] Timestamp: P: 1777838147187975 usec, L: 0
0503 19:55:50.253912 (+ 3972us) write_op.cc:270] Start()
0503 19:55:50.253949 (+ 37us) write_op.cc:276] Timestamp: P: 1777838147219946 usec, L: 0
0503 19:55:50.257155 (+ 3206us) write_op.cc:270] Start()
0503 19:55:50.257195 (+ 40us) write_op.cc:276] Timestamp: P: 1777838147233152 usec, L: 0
0503 19:55:50.257494 (+ 299us) write_op.cc:270] Start()
0503 19:55:50.257529 (+ 35us) write_op.cc:276] Timestamp: P: 1777838147286398 usec, L: 0
0503 19:55:50.262360 (+ 4831us) write_op.cc:270] Start()
0503 19:55:50.262396 (+ 36us) write_op.cc:276] Timestamp: P: 1777838147287083 usec, L: 0
0503 19:55:50.269473 (+ 7077us) write_op.cc:270] Start()
0503 19:55:50.269512 (+ 39us) write_op.cc:276] Timestamp: P: 1777838147289322 usec, L: 0
0503 19:55:50.270208 (+ 696us) write_op.cc:270] Start()
0503 19:55:50.270239 (+ 31us) write_op.cc:276] Timestamp: P: 1777838147339175 usec, L: 0
0503 19:55:50.279978 (+ 9739us) write_op.cc:270] Start()
0503 19:55:50.280016 (+ 38us) write_op.cc:276] Timestamp: P: 1777838147341496 usec, L: 0
0503 19:55:50.283064 (+ 3048us) write_op.cc:270] Start()
0503 19:55:50.283098 (+ 34us) write_op.cc:276] Timestamp: P: 1777838147398314 usec, L: 0
0503 19:55:50.283830 (+ 732us) write_op.cc:270] Start()
0503 19:55:50.283855 (+ 25us) write_op.cc:276] Timestamp: P: 1777838147400426 usec, L: 0
0503 19:55:50.284474 (+ 619us) write_op.cc:270] Start()
0503 19:55:50.284498 (+ 24us) write_op.cc:276] Timestamp: P: 1777838147404830 usec, L: 0
0503 19:55:50.285166 (+ 668us) write_op.cc:270] Start()
0503 19:55:50.285230 (+ 64us) write_op.cc:276] Timestamp: P: 1777838147441176 usec, L: 0
0503 19:55:50.285915 (+ 685us) write_op.cc:270] Start()
0503 19:55:50.285948 (+ 33us) write_op.cc:276] Timestamp: P: 1777838147442068 usec, L: 0
0503 19:55:50.311188 (+ 25240us) write_op.cc:270] Start()
0503 19:55:50.311228 (+ 40us) write_op.cc:276] Timestamp: P: 1777838147488183 usec, L: 0
0503 19:55:50.319158 (+ 7930us) write_op.cc:270] Start()
0503 19:55:50.319201 (+ 43us) write_op.cc:276] Timestamp: P: 1777838147531247 usec, L: 0
0503 19:55:50.332082 (+ 12881us) write_op.cc:270] Start()
0503 19:55:50.332121 (+ 39us) write_op.cc:276] Timestamp: P: 1777838147538425 usec, L: 0
0503 19:55:50.334479 (+ 2358us) write_op.cc:270] Start()
0503 19:55:50.340394 (+ 5915us) write_op.cc:276] Timestamp: P: 1777838147560190 usec, L: 0
0503 19:55:50.347741 (+ 7347us) write_op.cc:270] Start()
0503 19:55:50.347785 (+ 44us) write_op.cc:276] Timestamp: P: 1777838147596085 usec, L: 0
0503 19:55:50.354621 (+ 6836us) write_op.cc:270] Start()
0503 19:55:50.354659 (+ 38us) write_op.cc:276] Timestamp: P: 1777838147614692 usec, L: 0
0503 19:55:50.361296 (+ 6637us) write_op.cc:270] Start()
0503 19:55:50.361333 (+ 37us) write_op.cc:276] Timestamp: P: 1777838147638612 usec, L: 0
0503 19:55:50.361570 (+ 237us) write_op.cc:270] Start()
0503 19:55:50.361589 (+ 19us) write_op.cc:276] Timestamp: P: 1777838147677836 usec, L: 0
0503 19:55:50.386887 (+ 25298us) write_op.cc:270] Start()
0503 19:55:50.386955 (+ 68us) write_op.cc:276] Timestamp: P: 1777838147719549 usec, L: 0
0503 19:55:50.387270 (+ 315us) write_op.cc:270] Start()
0503 19:55:50.387290 (+ 20us) write_op.cc:276] Timestamp: P: 1777838147722871 usec, L: 0
0503 19:55:50.399215 (+ 11925us) write_op.cc:270] Start()
0503 19:55:50.399277 (+ 62us) write_op.cc:276] Timestamp: P: 1777838147725450 usec, L: 0
0503 19:55:50.402597 (+ 3320us) write_op.cc:270] Start()
0503 19:55:50.402634 (+ 37us) write_op.cc:276] Timestamp: P: 1777838147781643 usec, L: 0
0503 19:55:50.410535 (+ 7901us) write_op.cc:270] Start()
0503 19:55:50.410585 (+ 50us) write_op.cc:276] Timestamp: P: 1777838147815203 usec, L: 0
0503 19:55:50.413665 (+ 3080us) write_op.cc:270] Start()
0503 19:55:50.413692 (+ 27us) write_op.cc:276] Timestamp: P: 1777838147825317 usec, L: 0
0503 19:55:50.422682 (+ 8990us) write_op.cc:270] Start()
0503 19:55:50.422719 (+ 37us) write_op.cc:276] Timestamp: P: 1777838147825981 usec, L: 0
0503 19:55:50.426605 (+ 3886us) write_op.cc:270] Start()
0503 19:55:50.426646 (+ 41us) write_op.cc:276] Timestamp: P: 1777838147829500 usec, L: 0
0503 19:55:50.432956 (+ 6310us) write_op.cc:270] Start()
0503 19:55:50.432991 (+ 35us) write_op.cc:276] Timestamp: P: 1777838147876551 usec, L: 0
0503 19:55:50.433233 (+ 242us) write_op.cc:270] Start()
0503 19:55:50.433257 (+ 24us) write_op.cc:276] Timestamp: P: 1777838147880013 usec, L: 0
0503 19:55:50.438683 (+ 5426us) write_op.cc:270] Start()
0503 19:55:50.438723 (+ 40us) write_op.cc:276] Timestamp: P: 1777838147894937 usec, L: 0
0503 19:55:50.453298 (+ 14575us) write_op.cc:270] Start()
0503 19:55:50.453337 (+ 39us) write_op.cc:276] Timestamp: P: 1777838147924823 usec, L: 0
0503 19:55:50.453539 (+ 202us) write_op.cc:270] Start()
0503 19:55:50.453557 (+ 18us) write_op.cc:276] Timestamp: P: 1777838147953663 usec, L: 0
0503 19:55:50.457339 (+ 3782us) write_op.cc:270] Start()
0503 19:55:50.457373 (+ 34us) write_op.cc:276] Timestamp: P: 1777838147991838 usec, L: 0
0503 19:55:50.457582 (+ 209us) write_op.cc:270] Start()
0503 19:55:50.457604 (+ 22us) write_op.cc:276] Timestamp: P: 1777838147996328 usec, L: 0
0503 19:55:50.457778 (+ 174us) write_op.cc:270] Start()
0503 19:55:50.457802 (+ 24us) write_op.cc:276] Timestamp: P: 1777838148041281 usec, L: 0
0503 19:55:50.493724 (+ 35922us) write_op.cc:270] Start()
0503 19:55:50.505205 (+ 11481us) write_op.cc:276] Timestamp: P: 1777838148075878 usec, L: 0
0503 19:55:50.519866 (+ 14661us) write_op.cc:270] Start()
0503 19:55:50.519905 (+ 39us) write_op.cc:276] Timestamp: P: 1777838148077104 usec, L: 0
0503 19:55:50.524421 (+ 4516us) write_op.cc:270] Start()
0503 19:55:50.524467 (+ 46us) write_op.cc:276] Timestamp: P: 1777838148088199 usec, L: 0
0503 19:55:50.528506 (+ 4039us) write_op.cc:270] Start()
0503 19:55:50.528568 (+ 62us) write_op.cc:276] Timestamp: P: 1777838148088862 usec, L: 0
0503 19:55:50.533245 (+ 4677us) write_op.cc:270] Start()
0503 19:55:50.533291 (+ 46us) write_op.cc:276] Timestamp: P: 1777838148134272 usec, L: 0
0503 19:55:50.558446 (+ 25155us) write_op.cc:270] Start()
0503 19:55:50.558476 (+ 30us) write_op.cc:276] Timestamp: P: 1777838148147290 usec, L: 0
0503 19:55:50.558674 (+ 198us) write_op.cc:270] Start()
0503 19:55:50.558692 (+ 18us) write_op.cc:276] Timestamp: P: 1777838148148228 usec, L: 0
0503 19:55:50.570119 (+ 11427us) write_op.cc:270] Start()
0503 19:55:50.570153 (+ 34us) write_op.cc:276] Timestamp: P: 1777838148184671 usec, L: 0
0503 19:55:50.587615 (+ 17462us) write_op.cc:270] Start()
0503 19:55:50.587672 (+ 57us) write_op.cc:276] Timestamp: P: 1777838148241847 usec, L: 0
0503 19:55:50.596631 (+ 8959us) write_op.cc:270] Start()
0503 19:55:50.596670 (+ 39us) write_op.cc:276] Timestamp: P: 1777838148244314 usec, L: 0
0503 19:55:50.601682 (+ 5012us) write_op.cc:270] Start()
0503 19:55:50.601722 (+ 40us) write_op.cc:276] Timestamp: P: 1777838148246854 usec, L: 0
0503 19:55:50.603037 (+ 1315us) write_op.cc:270] Start()
0503 19:55:50.603068 (+ 31us) write_op.cc:276] Timestamp: P: 1777838148254585 usec, L: 0
0503 19:55:50.607695 (+ 4627us) write_op.cc:270] Start()
0503 19:55:50.607729 (+ 34us) write_op.cc:276] Timestamp: P: 1777838148303385 usec, L: 0
0503 19:55:50.610990 (+ 3261us) write_op.cc:270] Start()
0503 19:55:50.611023 (+ 33us) write_op.cc:276] Timestamp: P: 1777838148318487 usec, L: 0
0503 19:55:50.612117 (+ 1094us) write_op.cc:270] Start()
0503 19:55:50.612175 (+ 58us) write_op.cc:276] Timestamp: P: 1777838148352307 usec, L: 0
0503 19:55:50.618277 (+ 6102us) write_op.cc:270] Start()
0503 19:55:50.618317 (+ 40us) write_op.cc:276] Timestamp: P: 1777838148363100 usec, L: 0
0503 19:55:50.646093 (+ 27776us) write_op.cc:270] Start()
0503 19:55:50.646126 (+ 33us) write_op.cc:276] Timestamp: P: 1777838148403378 usec, L: 0
0503 19:55:50.653291 (+ 7165us) write_op.cc:270] Start()
0503 19:55:50.653324 (+ 33us) write_op.cc:276] Timestamp: P: 1777838148411585 usec, L: 0
0503 19:55:50.662412 (+ 9088us) write_op.cc:270] Start()
0503 19:55:50.662447 (+ 35us) write_op.cc:276] Timestamp: P: 1777838148427298 usec, L: 0
0503 19:55:50.670113 (+ 7666us) write_op.cc:270] Start()
0503 19:55:50.671678 (+ 1565us) write_op.cc:276] Timestamp: P: 1777838148447089 usec, L: 0
0503 19:55:50.671945 (+ 267us) write_op.cc:270] Start()
0503 19:55:50.671970 (+ 25us) write_op.cc:276] Timestamp: P: 1777838148487460 usec, L: 0
0503 19:55:50.675329 (+ 3359us) write_op.cc:270] Start()
0503 19:55:50.675360 (+ 31us) write_op.cc:276] Timestamp: P: 1777838148505589 usec, L: 0
0503 19:55:50.692757 (+ 17397us) write_op.cc:270] Start()
0503 19:55:50.692798 (+ 41us) write_op.cc:276] Timestamp: P: 1777838148512740 usec, L: 0
0503 19:55:50.701591 (+ 8793us) write_op.cc:270] Start()
0503 19:55:50.701629 (+ 38us) write_op.cc:276] Timestamp: P: 1777838148522293 usec, L: 0
0503 19:55:50.727275 (+ 25646us) write_op.cc:270] Start()
0503 19:55:50.727306 (+ 31us) write_op.cc:276] Timestamp: P: 1777838148578857 usec, L: 0
0503 19:55:50.727498 (+ 192us) write_op.cc:270] Start()
0503 19:55:50.727518 (+ 20us) write_op.cc:276] Timestamp: P: 1777838148579434 usec, L: 0
0503 19:55:50.772015 (+ 44497us) write_op.cc:270] Start()
0503 19:55:50.772038 (+ 23us) write_op.cc:276] Timestamp: P: 1777838148582456 usec, L: 0
0503 19:55:50.805229 (+ 33191us) write_op.cc:270] Start()
0503 19:55:50.805266 (+ 37us) write_op.cc:276] Timestamp: P: 1777838148583064 usec, L: 0
0503 19:55:50.805485 (+ 219us) write_op.cc:270] Start()
0503 19:55:50.805506 (+ 21us) write_op.cc:276] Timestamp: P: 1777838148628053 usec, L: 0
0503 19:55:50.812099 (+ 6593us) write_op.cc:270] Start()
0503 19:55:50.812134 (+ 35us) write_op.cc:276] Timestamp: P: 1777838148628753 usec, L: 0
0503 19:55:50.813478 (+ 1344us) write_op.cc:270] Start()
0503 19:55:50.813506 (+ 28us) write_op.cc:276] Timestamp: P: 1777838148641116 usec, L: 0
0503 19:55:50.816115 (+ 2609us) write_op.cc:270] Start()
0503 19:55:50.816144 (+ 29us) write_op.cc:276] Timestamp: P: 1777838148676099 usec, L: 0
0503 19:55:50.816314 (+ 170us) write_op.cc:270] Start()
0503 19:55:50.816331 (+ 17us) write_op.cc:276] Timestamp: P: 1777838148676841 usec, L: 0
0503 19:55:50.816441 (+ 110us) write_op.cc:270] Start()
0503 19:55:50.816456 (+ 15us) write_op.cc:276] Timestamp: P: 1777838148762789 usec, L: 0
0503 19:55:50.816599 (+ 143us) write_op.cc:270] Start()
0503 19:55:50.816614 (+ 15us) write_op.cc:276] Timestamp: P: 1777838148766522 usec, L: 0
0503 19:55:50.816719 (+ 105us) write_op.cc:270] Start()
0503 19:55:50.816735 (+ 16us) write_op.cc:276] Timestamp: P: 1777838148817846 usec, L: 0
0503 19:55:50.817262 (+ 527us) write_op.cc:270] Start()
0503 19:55:50.817294 (+ 32us) write_op.cc:276] Timestamp: P: 1777838148820934 usec, L: 0
0503 19:55:50.817494 (+ 200us) write_op.cc:270] Start()
0503 19:55:50.817511 (+ 17us) write_op.cc:276] Timestamp: P: 1777838148846180 usec, L: 0
0503 19:55:50.817625 (+ 114us) write_op.cc:270] Start()
0503 19:55:50.817640 (+ 15us) write_op.cc:276] Timestamp: P: 1777838148850392 usec, L: 0
0503 19:55:50.817762 (+ 122us) write_op.cc:270] Start()
0503 19:55:50.817777 (+ 15us) write_op.cc:276] Timestamp: P: 1777838148895356 usec, L: 0
0503 19:55:50.817918 (+ 141us) write_op.cc:270] Start()
0503 19:55:50.817934 (+ 16us) write_op.cc:276] Timestamp: P: 1777838148898720 usec, L: 0
0503 19:55:50.818038 (+ 104us) write_op.cc:270] Start()
0503 19:55:50.818053 (+ 15us) write_op.cc:276] Timestamp: P: 1777838148920054 usec, L: 0
0503 19:55:50.818163 (+ 110us) write_op.cc:270] Start()
0503 19:55:50.818179 (+ 16us) write_op.cc:276] Timestamp: P: 1777838148935658 usec, L: 0
0503 19:55:50.839160 (+ 20981us) write_op.cc:270] Start()
0503 19:55:50.839182 (+ 22us) write_op.cc:276] Timestamp: P: 1777838148955031 usec, L: 0
0503 19:55:50.839339 (+ 157us) write_op.cc:270] Start()
0503 19:55:50.839359 (+ 20us) write_op.cc:276] Timestamp: P: 1777838149000091 usec, L: 0
0503 19:55:50.839508 (+ 149us) write_op.cc:270] Start()
0503 19:55:50.839534 (+ 26us) write_op.cc:276] Timestamp: P: 1777838149007058 usec, L: 0
0503 19:55:50.839713 (+ 179us) write_op.cc:270] Start()
0503 19:55:50.839734 (+ 21us) write_op.cc:276] Timestamp: P: 1777838149008330 usec, L: 0
0503 19:55:50.839895 (+ 161us) write_op.cc:270] Start()
0503 19:55:50.839914 (+ 19us) write_op.cc:276] Timestamp: P: 1777838149051072 usec, L: 0
0503 19:55:50.847314 (+ 7400us) write_op.cc:270] Start()
0503 19:55:50.847357 (+ 43us) write_op.cc:276] Timestamp: P: 1777838149094461 usec, L: 0
0503 19:55:50.877015 (+ 29658us) write_op.cc:270] Start()
0503 19:55:50.877056 (+ 41us) write_op.cc:276] Timestamp: P: 1777838149095262 usec, L: 0
0503 19:55:50.877236 (+ 180us) write_op.cc:270] Start()
0503 19:55:50.877257 (+ 21us) write_op.cc:276] Timestamp: P: 1777838149096334 usec, L: 0
0503 19:55:50.877410 (+ 153us) write_op.cc:270] Start()
0503 19:55:50.877430 (+ 20us) write_op.cc:276] Timestamp: P: 1777838149106818 usec, L: 0
0503 19:55:50.877576 (+ 146us) write_op.cc:270] Start()
0503 19:55:50.877595 (+ 19us) write_op.cc:276] Timestamp: P: 1777838149151523 usec, L: 0
0503 19:55:50.877756 (+ 161us) write_op.cc:270] Start()
0503 19:55:50.877776 (+ 20us) write_op.cc:276] Timestamp: P: 1777838149171455 usec, L: 0
0503 19:55:50.877920 (+ 144us) write_op.cc:270] Start()
0503 19:55:50.877940 (+ 20us) write_op.cc:276] Timestamp: P: 1777838149184987 usec, L: 0
0503 19:55:50.878125 (+ 185us) write_op.cc:270] Start()
0503 19:55:50.878152 (+ 27us) write_op.cc:276] Timestamp: P: 1777838149187471 usec, L: 0
0503 19:55:50.878302 (+ 150us) write_op.cc:270] Start()
0503 19:55:50.878321 (+ 19us) write_op.cc:276] Timestamp: P: 1777838149203245 usec, L: 0
0503 19:55:50.878474 (+ 153us) write_op.cc:270] Start()
0503 19:55:50.878493 (+ 19us) write_op.cc:276] Timestamp: P: 1777838149237558 usec, L: 0
0503 19:55:50.878664 (+ 171us) write_op.cc:270] Start()
0503 19:55:50.878684 (+ 20us) write_op.cc:276] Timestamp: P: 1777838149278192 usec, L: 0
0503 19:55:50.878851 (+ 167us) write_op.cc:270] Start()
0503 19:55:50.878872 (+ 21us) write_op.cc:276] Timestamp: P: 1777838149282647 usec, L: 0
0503 19:55:50.879005 (+ 133us) write_op.cc:270] Start()
0503 19:55:50.879024 (+ 19us) write_op.cc:276] Timestamp: P: 1777838149311721 usec, L: 0
0503 19:55:50.879182 (+ 158us) write_op.cc:270] Start()
0503 19:55:50.879201 (+ 19us) write_op.cc:276] Timestamp: P: 1777838149335531 usec, L: 0
0503 19:55:50.879350 (+ 149us) write_op.cc:270] Start()
0503 19:55:50.879369 (+ 19us) write_op.cc:276] Timestamp: P: 1777838149337130 usec, L: 0
0503 19:55:50.879507 (+ 138us) write_op.cc:270] Start()
0503 19:55:50.879528 (+ 21us) write_op.cc:276] Timestamp: P: 1777838149399486 usec, L: 0
0503 19:55:50.885924 (+ 6396us) write_op.cc:270] Start()
0503 19:55:50.885959 (+ 35us) write_op.cc:276] Timestamp: P: 1777838149424467 usec, L: 0
0503 19:55:50.894603 (+ 8644us) write_op.cc:270] Start()
0503 19:55:50.894641 (+ 38us) write_op.cc:276] Timestamp: P: 1777838149427896 usec, L: 0
0503 19:55:50.894892 (+ 251us) write_op.cc:270] Start()
0503 19:55:50.894918 (+ 26us) write_op.cc:276] Timestamp: P: 1777838149441191 usec, L: 0
0503 19:55:50.899116 (+ 4198us) write_op.cc:270] Start()
0503 19:55:50.899151 (+ 35us) write_op.cc:276] Timestamp: P: 1777838149488277 usec, L: 0
0503 19:55:50.899354 (+ 203us) write_op.cc:270] Start()
0503 19:55:50.899375 (+ 21us) write_op.cc:276] Timestamp: P: 1777838149498626 usec, L: 0
0503 19:55:50.927470 (+ 28095us) write_op.cc:270] Start()
0503 19:55:50.927500 (+ 30us) write_op.cc:276] Timestamp: P: 1777838149513356 usec, L: 0
0503 19:55:50.929401 (+ 1901us) write_op.cc:270] Start()
0503 19:55:50.929433 (+ 32us) write_op.cc:276] Timestamp: P: 1777838149540918 usec, L: 0
0503 19:55:50.933070 (+ 3637us) write_op.cc:270] Start()
0503 19:55:50.933101 (+ 31us) write_op.cc:276] Timestamp: P: 1777838149568966 usec, L: 0
0503 19:55:50.933265 (+ 164us) write_op.cc:270] Start()
0503 19:55:50.933278 (+ 13us) write_op.cc:276] Timestamp: P: 1777838149571059 usec, L: 0
0503 19:55:50.937222 (+ 3944us) write_op.cc:270] Start()
0503 19:55:50.937254 (+ 32us) write_op.cc:276] Timestamp: P: 1777838149638015 usec, L: 0
0503 19:55:50.939662 (+ 2408us) write_op.cc:270] Start()
0503 19:55:50.939692 (+ 30us) write_op.cc:276] Timestamp: P: 1777838149639479 usec, L: 0
0503 19:55:50.939911 (+ 219us) write_op.cc:270] Start()
0503 19:55:50.939934 (+ 23us) write_op.cc:276] Timestamp: P: 1777838149656617 usec, L: 0
0503 19:55:50.940097 (+ 163us) write_op.cc:270] Start()
0503 19:55:50.940119 (+ 22us) write_op.cc:276] Timestamp: P: 1777838149658084 usec, L: 0
0503 19:55:50.940294 (+ 175us) write_op.cc:270] Start()
0503 19:55:50.940787 (+ 493us) write_op.cc:276] Timestamp: P: 1777838149696958 usec, L: 0
0503 19:55:51.000264 (+ 59477us) write_op.cc:270] Start()
0503 19:55:51.000303 (+ 39us) write_op.cc:276] Timestamp: P: 1777838149698071 usec, L: 0
0503 19:55:51.010932 (+ 10629us) write_op.cc:270] Start()
0503 19:55:51.010966 (+ 34us) write_op.cc:276] Timestamp: P: 1777838149734953 usec, L: 0
0503 19:55:51.012283 (+ 1317us) write_op.cc:270] Start()
0503 19:55:51.012313 (+ 30us) write_op.cc:276] Timestamp: P: 1777838149748230 usec, L: 0
0503 19:55:51.024247 (+ 11934us) write_op.cc:270] Start()
0503 19:55:51.024276 (+ 29us) write_op.cc:276] Timestamp: P: 1777838149792632 usec, L: 0
0503 19:55:51.024461 (+ 185us) write_op.cc:270] Start()
0503 19:55:51.024482 (+ 21us) write_op.cc:276] Timestamp: P: 1777838149815760 usec, L: 0
0503 19:55:51.035190 (+ 10708us) write_op.cc:270] Start()
0503 19:55:51.035222 (+ 32us) write_op.cc:276] Timestamp: P: 1777838149817098 usec, L: 0
0503 19:55:51.037048 (+ 1826us) write_op.cc:270] Start()
0503 19:55:51.037076 (+ 28us) write_op.cc:276] Timestamp: P: 1777838149817700 usec, L: 0
0503 19:55:51.039323 (+ 2247us) write_op.cc:270] Start()
0503 19:55:51.039351 (+ 28us) write_op.cc:276] Timestamp: P: 1777838149874482 usec, L: 0
0503 19:55:51.040044 (+ 693us) write_op.cc:270] Start()
0503 19:55:51.040073 (+ 29us) write_op.cc:276] Timestamp: P: 1777838149886969 usec, L: 0
0503 19:55:51.040269 (+ 196us) write_op.cc:270] Start()
0503 19:55:51.040292 (+ 23us) write_op.cc:276] Timestamp: P: 1777838149889706 usec, L: 0
0503 19:55:51.070819 (+ 30527us) log.cc:844] Serialized 88509 byte log entry
0503 19:55:51.178423 (+107604us) raft_consensus.cc:1645] Marking committed up to 923
0503 19:55:51.373979 (+195556us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 19:55:51.374064 (+ 85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0503 19:55:51.374079 (+ 15us) raft_consensus.cc:1685] finished
0503 19:55:51.387592 (+ 13513us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 19:55:51.387708 (+ 116us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0503 19:55:50.013994 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 1c99d75cb2be4439a1610c0de343d73a
0503 19:55:50.014131 (+ 137us) write_op.cc:432] Acquiring schema lock in shared mode
0503 19:55:50.014139 (+ 8us) write_op.cc:435] Acquired schema lock
0503 19:55:50.014141 (+ 2us) tablet.cc:662] Decoding operations
0503 19:55:50.016354 (+ 2213us) write_op.cc:620] Acquiring the partition lock for write op
0503 19:55:50.016375 (+ 21us) write_op.cc:641] Partition lock acquired for write op
0503 19:55:50.016380 (+ 5us) tablet.cc:685] Acquiring locks for 8 operations
0503 19:55:50.049438 (+ 33058us) tablet.cc:701] Row locks acquired
0503 19:55:50.049443 (+ 5us) write_op.cc:260] PREPARE: finished
0503 19:55:51.178484 (+1129041us) op_driver.cc:464] REPLICATION: finished
0503 19:55:51.201117 (+ 22633us) write_op.cc:301] APPLY: starting
0503 19:55:51.201132 (+ 15us) tablet.cc:1367] starting BulkCheckPresence
0503 19:55:51.201206 (+ 74us) tablet.cc:1370] finished BulkCheckPresence
0503 19:55:51.201209 (+ 3us) tablet.cc:1372] starting ApplyRowOperation cycle
0503 19:55:51.201454 (+ 245us) tablet.cc:1383] finished ApplyRowOperation cycle
0503 19:55:51.201503 (+ 49us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0503 19:55:51.201570 (+ 67us) write_op.cc:312] APPLY: finished
0503 19:55:51.201980 (+ 410us) log.cc:844] Serialized 65 byte log entry
0503 19:55:51.202095 (+ 115us) write_op.cc:489] Releasing partition, row and schema locks
0503 19:55:51.202125 (+ 30us) write_op.cc:454] Released schema lock
0503 19:55:51.202137 (+ 12us) write_op.cc:341] FINISH: Updating metrics
0503 19:55:51.202281 (+ 144us) write_op.cc:489] Releasing partition, row and schema locks
0503 19:55:51.202285 (+ 4us) write_op.cc:454] Released schema lock
Related trace 'op':
0503 19:55:50.190262 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 1c99d75cb2be4439a1610c0de343d73a
0503 19:55:50.190394 (+ 132us) write_op.cc:432] Acquiring schema lock in shared mode
0503 19:55:50.190399 (+ 5us) write_op.cc:435] Acquired schema lock
0503 19:55:50.190401 (+ 2us) tablet.cc:662] Decoding operations
0503 19:55:50.191013 (+ 612us) write_op.cc:620] Acquiring the partition lock for write op
0503 19:55:50.191028 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0503 19:55:50.191033 (+ 5us) tablet.cc:685] Acquiring locks for 8 operations
0503 19:55:50.191130 (+ 97us) tablet.cc:701] Row locks acquired
0503 19:55:50.191133 (+ 3us) write_op.cc:260] PREPARE: finished
0503 19:55:51.178536 (+987403us) op_driver.cc:464] REPLICATION: finished
0503 19:55:51.207797 (+ 29261us) write_op.cc:301] APPLY: starting
0503 19:55:51.207820 (+ 23us) tablet.cc:1367] starting BulkCheckPresence
0503 19:55:51.210988 (+ 3168us) tablet.cc:1370] finished BulkCheckPresence
0503 19:55:51.210991 (+ 3us) tablet.cc:1372] starting ApplyRowOperation cycle
0503 19:55:51.211215 (+ 224us) tablet.cc:1383] finished ApplyRowOperation cycle
0503 19:55:51.211254 (+ 39us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0503 19:55:51.211284 (+ 30us) write_op.cc:312] APPLY: finished
0503 19:55:51.211353 (+ 69us) log.cc:844] Serialized 65 byte log entry
0503 19:55:51.211418 (+ 65us) write_op.cc:489] Releasing partition, row and schema locks
0503 19:55:51.211435 (+ 17us) write_op.cc:454] Released schema lock
0503 19:55:51.211441 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0503 19:55:51.221770 (+ 10329us) spinlock_profiling.cc:243] Waited 3.08 ms on lock 0x61100008e5d8. stack: 00007f2b5ee49086 00007f2b5ee48e40 00007f2b5de023ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007f2b65dd486b 00007f2b6c154b36 00007f2b6c150ea6 00007f2b6c14f148 00007f2b6c1521c0 00007f2b6c151fcd 0000000000aa4cac 00007f2b5ee8ef6f 00007f2b5ee9228b 00007f2b5ee92108
0503 19:55:51.221852 (+ 82us) write_op.cc:489] Releasing partition, row and schema locks
0503 19:55:51.221859 (+ 7us) write_op.cc:454] Released schema lock
Related trace 'op':
0503 19:55:50.214893 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 1c99d75cb2be4439a1610c0de343d73a
0503 19:55:50.215023 (+ 130us) write_op.cc:432] Acquiring schema lock in shared mode
0503 19:55:50.215030 (+ 7us) write_op.cc:435] Acquired schema lock
0503 19:55:50.215033 (+ 3us) tablet.cc:662] Decoding operations
0503 19:55:50.217072 (+ 2039us) write_op.cc:620] Acquiring the partition lock for write op
0503 19:55:50.217085 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0503 19:55:50.217090 (+ 5us) tablet.cc:685] Acquiring locks for 8 operations
0503 19:55:50.217180 (+ 90us) tablet.cc:701] Row locks acquired
0503 19:55:50.217183 (+ 3us) write_op.cc:260] PREPARE: finished
0503 19:55:51.178568 (+961385us) op_driver.cc:464] REPLICATION: finished
0503 19:55:51.205601 (+ 27033us) write_op.cc:301] APPLY: starting
0503 19:55:51.205618 (+ 17us) tablet.cc:1367] starting BulkCheckPresence
0503 19:55:51.205693 (+ 75us) tablet.cc:1370] finished BulkCheckPresence
0503 19:55:51.205697 (+ 4us) tablet.cc:1372] starting ApplyRowOperation cycle
0503 19:55:51.205972 (+ 275us) tablet.cc:1383] finished ApplyRowOperation cycle
0503 19:55:51.206013 (+ 41us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0503 19:55:51.206048 (+ 35us) write_op.cc:312] APPLY: finished
0503 19:55:51.206170 (+ 122us) log.cc:844] Serialized 65 byte log entry
0503 19:55:51.206215 (+ 45us) write_op.cc:489] Releasing partition, row and schema locks
0503 19:55:51.206235 (+ 20us) write_op.cc:454] Released schema lock
0503 19:55:51.206242 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0503 19:55:51.206328 (+ 86us) write_op.cc:489] Releasing partition, row and schema locks
0503 19:55:51.206332 (+ 4us) write_op.cc:454] Released schema lock
Related trace 'op':
0503 19:55:50.250107 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 1c99d75cb2be4439a1610c0de343d73a
0503 19:55:50.250221 (+ 114us) write_op.cc:432] Acquiring schema lock in shared mode
0503 19:55:50.250226 (+ 5us) write_op.cc:435] Acquired schema lock
0503 19:55:50.250228 (+ 2us) tablet.cc:662] Decoding operations
0503 19:55:50.253371 (+ 3143us) write_op.cc:620] Acquiring the partition lock for write op
0503 19:55:50.253389 (+ 18us) write_op.cc:641] Partition lock acquired for write op
0503 19:55:50.253393 (+ 4us) tablet.cc:685] Acquiring locks for 10 operations
0503 19:55:50.253495 (+ 102us) tablet.cc:701] Row locks acquired
0503 19:55:50.253497 (+ 2us) write_op.cc:260] PREPARE: finished
0503 19:55:51.178599 (+925102us) op_driver.cc:464] REPLICATION: finished
0503 19:55:51.206404 (+ 27805us) write_op.cc:301] APPLY: starting
0503 19:55:51.206415 (+ 11us) tablet.cc:1367] starting BulkCheckPresence
0503 19:55:51.206483 (+ 68us) tablet.cc:1370] finished BulkCheckPresence
0503 19:55:51.206486 (+ 3us) tablet.cc:1372] starting ApplyRowOperation cycle
0503 19:55:51.206739 (+ 253us) tablet.cc:1383] finished ApplyRowOperation cycle
0503 19:55:51.206813 (+ 74us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0503 19:55:51.206821 (+ 8us) write_op.cc:312] APPLY: finished
0503 19:55:51.206898 (+ 77us) log.cc:844] Serialized 77 byte log entry
0503 19:55:51.206944 (+ 46us) write_op.cc:489] Releasing partition, row and schema locks
0503 19:55:51.206962 (+ 18us) write_op.cc:454] Released schema lock
0503 19:55:51.206968 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0503 19:55:51.207043 (+ 75us) write_op.cc:489] Releasing partition, row and schema locks
0503 19:55:51.207046 (+ 3us) write_op.cc:454] Released schema lock
Related trace 'op':
0503 19:55:50.254092 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 1c99d75cb2be4439a1610c0de343d73a
0503 19:55:50.255793 (+ 1701us) write_op.cc:432] Acquiring schema lock in shared mode
0503 19:55:50.255799 (+ 6us) write_op.cc:435] Acquired schema lock
0503 19:55:50.255801 (+ 2us) tablet.cc:662] Decoding operations
0503 19:55:50.255945 (+ 144us) write_op.cc:620] Acquiring the partition lock for write op
0503 19:55:50.255956 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0503 19:55:50.255961 (+ 5us) tablet.cc:685] Acquiring locks for 10 operations
0503 19:55:50.256056 (+ 95us) tablet.cc:701] Row locks acquired
0503 19:55:50.256059 (+ 3us) write_op.cc:260] PREPARE: finished
0503 19:55:51.178629 (+922570us) op_driver.cc:464] REPLICATION: finished
0503 19:55:51.207133 (+ 28504us) write_op.cc:301] APPLY: starting
0503 19:55:51.207143 (+ 10us) tablet.cc:1367] starting BulkCheckPresence
0503 19:55:51.207185 (+ 42us) tablet.cc:1370] finished BulkCheckPresence
0503 19:55:51.207188 (+ 3us) tablet.cc:1372] starting ApplyRowOperation cycle
0503 19:55:51.207422 (+ 234us) tablet.cc:1383] finished ApplyRowOperation cycle
0503 19:55:51.210105 (+ 2683us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0503 19:55:51.210114 (+ 9us) write_op.cc:312] APPLY: finished
0503 19:55:51.210184 (+ 70us) log.cc:844] Serialized 77 byte log entry
0503 19:55:51.210220 (+ 36us) write_op.cc:489] Releasing partition, row and schema locks
0503 19:55:51.210236 (+ 16us) write_op.cc:454] Released schema lock
0503 19:55:51.210242 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0503 19:55:51.210306 (+ 64us) write_op.cc:489] Releasing partition, row and schema locks
050
I20260503 19:55:48.860572 1431 rpcz_store.cc:276] 0503 19:55:45.440290 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 19:55:45.440350 (+ 60us) service_pool.cc:224] Handling call
0503 19:55:45.811186 (+370836us) raft_consensus.cc:1471] Updating replica for 564 ops
0503 19:55:46.149616 (+338430us) raft_consensus.cc:1534] Early marking committed up to index 163
0503 19:55:46.158462 (+ 8846us) raft_consensus.cc:1539] Triggering prepare for 561 ops
0503 19:55:46.158685 (+ 223us) write_op.cc:270] Start()
0503 19:55:46.158721 (+ 36us) write_op.cc:276] Timestamp: P: 1777838130503306 usec, L: 0
0503 19:55:46.159151 (+ 430us) write_op.cc:270] Start()
0503 19:55:46.159177 (+ 26us) write_op.cc:276] Timestamp: P: 1777838130505174 usec, L: 0
0503 19:55:46.159375 (+ 198us) write_op.cc:270] Start()
0503 19:55:46.159396 (+ 21us) write_op.cc:276] Timestamp: P: 1777838131217942 usec, L: 0
0503 19:55:46.163732 (+ 4336us) write_op.cc:270] Start()
0503 19:55:46.163766 (+ 34us) write_op.cc:276] Timestamp: P: 1777838131270304 usec, L: 0
0503 19:55:46.164007 (+ 241us) write_op.cc:270] Start()
0503 19:55:46.164028 (+ 21us) write_op.cc:276] Timestamp: P: 1777838131302769 usec, L: 0
0503 19:55:46.165079 (+ 1051us) write_op.cc:270] Start()
0503 19:55:46.165103 (+ 24us) write_op.cc:276] Timestamp: P: 1777838131310882 usec, L: 0
0503 19:55:46.165281 (+ 178us) write_op.cc:270] Start()
0503 19:55:46.165317 (+ 36us) write_op.cc:276] Timestamp: P: 1777838131322206 usec, L: 0
0503 19:55:46.174199 (+ 8882us) write_op.cc:270] Start()
0503 19:55:46.174230 (+ 31us) write_op.cc:276] Timestamp: P: 1777838131342845 usec, L: 0
0503 19:55:46.175185 (+ 955us) write_op.cc:270] Start()
0503 19:55:46.175208 (+ 23us) write_op.cc:276] Timestamp: P: 1777838131375054 usec, L: 0
0503 19:55:46.175395 (+ 187us) write_op.cc:270] Start()
0503 19:55:46.175418 (+ 23us) write_op.cc:276] Timestamp: P: 1777838131384283 usec, L: 0
0503 19:55:46.176958 (+ 1540us) write_op.cc:270] Start()
0503 19:55:46.176985 (+ 27us) write_op.cc:276] Timestamp: P: 1777838131401748 usec, L: 0
0503 19:55:46.177164 (+ 179us) write_op.cc:270] Start()
0503 19:55:46.177186 (+ 22us) write_op.cc:276] Timestamp: P: 1777838131430958 usec, L: 0
0503 19:55:46.189322 (+ 12136us) write_op.cc:270] Start()
0503 19:55:46.189380 (+ 58us) write_op.cc:276] Timestamp: P: 1777838131447895 usec, L: 0
0503 19:55:46.197125 (+ 7745us) write_op.cc:270] Start()
0503 19:55:46.197179 (+ 54us) write_op.cc:276] Timestamp: P: 1777838131463080 usec, L: 0
0503 19:55:46.197462 (+ 283us) write_op.cc:270] Start()
0503 19:55:46.197486 (+ 24us) write_op.cc:276] Timestamp: P: 1777838131472825 usec, L: 0
0503 19:55:46.203123 (+ 5637us) write_op.cc:270] Start()
0503 19:55:46.203158 (+ 35us) write_op.cc:276] Timestamp: P: 1777838131497270 usec, L: 0
0503 19:55:46.224550 (+ 21392us) write_op.cc:270] Start()
0503 19:55:46.224600 (+ 50us) write_op.cc:276] Timestamp: P: 1777838131530612 usec, L: 0
0503 19:55:46.232234 (+ 7634us) write_op.cc:270] Start()
0503 19:55:46.233122 (+ 888us) write_op.cc:276] Timestamp: P: 1777838131538739 usec, L: 0
0503 19:55:46.233495 (+ 373us) write_op.cc:270] Start()
0503 19:55:46.233531 (+ 36us) write_op.cc:276] Timestamp: P: 1777838131560016 usec, L: 0
0503 19:55:46.236391 (+ 2860us) write_op.cc:270] Start()
0503 19:55:46.236428 (+ 37us) write_op.cc:276] Timestamp: P: 1777838131560696 usec, L: 0
0503 19:55:46.238117 (+ 1689us) write_op.cc:270] Start()
0503 19:55:46.238152 (+ 35us) write_op.cc:276] Timestamp: P: 1777838131574387 usec, L: 0
0503 19:55:46.238704 (+ 552us) write_op.cc:270] Start()
0503 19:55:46.238731 (+ 27us) write_op.cc:276] Timestamp: P: 1777838131585372 usec, L: 0
0503 19:55:46.240552 (+ 1821us) write_op.cc:270] Start()
0503 19:55:46.240579 (+ 27us) write_op.cc:276] Timestamp: P: 1777838131618492 usec, L: 0
0503 19:55:46.241264 (+ 685us) write_op.cc:270] Start()
0503 19:55:46.241288 (+ 24us) write_op.cc:276] Timestamp: P: 1777838131620776 usec, L: 0
0503 19:55:46.242401 (+ 1113us) write_op.cc:270] Start()
0503 19:55:46.242439 (+ 38us) write_op.cc:276] Timestamp: P: 1777838131653497 usec, L: 0
0503 19:55:46.244001 (+ 1562us) write_op.cc:270] Start()
0503 19:55:46.244027 (+ 26us) write_op.cc:276] Timestamp: P: 1777838131671201 usec, L: 0
0503 19:55:46.244201 (+ 174us) write_op.cc:270] Start()
0503 19:55:46.244221 (+ 20us) write_op.cc:276] Timestamp: P: 1777838131672873 usec, L: 0
0503 19:55:46.245586 (+ 1365us) write_op.cc:270] Start()
0503 19:55:46.245636 (+ 50us) write_op.cc:276] Timestamp: P: 1777838131686515 usec, L: 0
0503 19:55:46.246798 (+ 1162us) write_op.cc:270] Start()
0503 19:55:46.246826 (+ 28us) write_op.cc:276] Timestamp: P: 1777838131722280 usec, L: 0
0503 19:55:46.248851 (+ 2025us) write_op.cc:270] Start()
0503 19:55:46.248890 (+ 39us) write_op.cc:276] Timestamp: P: 1777838131727938 usec, L: 0
0503 19:55:46.249093 (+ 203us) write_op.cc:270] Start()
0503 19:55:46.249117 (+ 24us) write_op.cc:276] Timestamp: P: 1777838131729569 usec, L: 0
0503 19:55:46.250459 (+ 1342us) write_op.cc:270] Start()
0503 19:55:46.250486 (+ 27us) write_op.cc:276] Timestamp: P: 1777838131769863 usec, L: 0
0503 19:55:46.251246 (+ 760us) write_op.cc:270] Start()
0503 19:55:46.251273 (+ 27us) write_op.cc:276] Timestamp: P: 1777838131793882 usec, L: 0
0503 19:55:46.251935 (+ 662us) write_op.cc:270] Start()
0503 19:55:46.252000 (+ 65us) write_op.cc:276] Timestamp: P: 1777838131799401 usec, L: 0
0503 19:55:46.252290 (+ 290us) write_op.cc:270] Start()
0503 19:55:46.252322 (+ 32us) write_op.cc:276] Timestamp: P: 1777838131805807 usec, L: 0
0503 19:55:46.253768 (+ 1446us) write_op.cc:270] Start()
0503 19:55:46.253797 (+ 29us) write_op.cc:276] Timestamp: P: 1777838131829827 usec, L: 0
0503 19:55:46.254613 (+ 816us) write_op.cc:270] Start()
0503 19:55:46.254637 (+ 24us) write_op.cc:276] Timestamp: P: 1777838131852428 usec, L: 0
0503 19:55:46.255265 (+ 628us) write_op.cc:270] Start()
0503 19:55:46.255292 (+ 27us) write_op.cc:276] Timestamp: P: 1777838131874203 usec, L: 0
0503 19:55:46.255457 (+ 165us) write_op.cc:270] Start()
0503 19:55:46.255474 (+ 17us) write_op.cc:276] Timestamp: P: 1777838131895911 usec, L: 0
0503 19:55:46.256646 (+ 1172us) write_op.cc:270] Start()
0503 19:55:46.256670 (+ 24us) write_op.cc:276] Timestamp: P: 1777838131901866 usec, L: 0
0503 19:55:46.257262 (+ 592us) write_op.cc:270] Start()
0503 19:55:46.257288 (+ 26us) write_op.cc:276] Timestamp: P: 1777838131902953 usec, L: 0
0503 19:55:46.258632 (+ 1344us) write_op.cc:270] Start()
0503 19:55:46.258660 (+ 28us) write_op.cc:276] Timestamp: P: 1777838131976579 usec, L: 0
0503 19:55:46.258865 (+ 205us) write_op.cc:270] Start()
0503 19:55:46.258887 (+ 22us) write_op.cc:276] Timestamp: P: 1777838131980758 usec, L: 0
0503 19:55:46.266666 (+ 7779us) write_op.cc:270] Start()
0503 19:55:46.266722 (+ 56us) write_op.cc:276] Timestamp: P: 1777838131983407 usec, L: 0
0503 19:55:46.267875 (+ 1153us) write_op.cc:270] Start()
0503 19:55:46.267920 (+ 45us) write_op.cc:276] Timestamp: P: 1777838131997447 usec, L: 0
0503 19:55:46.268154 (+ 234us) write_op.cc:270] Start()
0503 19:55:46.268177 (+ 23us) write_op.cc:276] Timestamp: P: 1777838132026499 usec, L: 0
0503 19:55:46.269669 (+ 1492us) write_op.cc:270] Start()
0503 19:55:46.269706 (+ 37us) write_op.cc:276] Timestamp: P: 1777838132048043 usec, L: 0
0503 19:55:46.271772 (+ 2066us) write_op.cc:270] Start()
0503 19:55:46.271810 (+ 38us) write_op.cc:276] Timestamp: P: 1777838132050964 usec, L: 0
0503 19:55:46.272060 (+ 250us) write_op.cc:270] Start()
0503 19:55:46.272094 (+ 34us) write_op.cc:276] Timestamp: P: 1777838132052218 usec, L: 0
0503 19:55:46.273664 (+ 1570us) write_op.cc:270] Start()
0503 19:55:46.273695 (+ 31us) write_op.cc:276] Timestamp: P: 1777838132101372 usec, L: 0
0503 19:55:46.273963 (+ 268us) write_op.cc:270] Start()
0503 19:55:46.273988 (+ 25us) write_op.cc:276] Timestamp: P: 1777838132107829 usec, L: 0
0503 19:55:46.275741 (+ 1753us) write_op.cc:270] Start()
0503 19:55:46.275770 (+ 29us) write_op.cc:276] Timestamp: P: 1777838132109133 usec, L: 0
0503 19:55:46.276683 (+ 913us) write_op.cc:270] Start()
0503 19:55:46.276805 (+ 122us) write_op.cc:276] Timestamp: P: 1777838132124972 usec, L: 0
0503 19:55:46.277222 (+ 417us) write_op.cc:270] Start()
0503 19:55:46.277250 (+ 28us) write_op.cc:276] Timestamp: P: 1777838132161601 usec, L: 0
0503 19:55:46.278401 (+ 1151us) write_op.cc:270] Start()
0503 19:55:46.278426 (+ 25us) write_op.cc:276] Timestamp: P: 1777838132166561 usec, L: 0
0503 19:55:46.283172 (+ 4746us) write_op.cc:270] Start()
0503 19:55:46.283210 (+ 38us) write_op.cc:276] Timestamp: P: 1777838132170786 usec, L: 0
0503 19:55:46.283438 (+ 228us) write_op.cc:270] Start()
0503 19:55:46.283460 (+ 22us) write_op.cc:276] Timestamp: P: 1777838132178244 usec, L: 0
0503 19:55:46.294634 (+ 11174us) write_op.cc:270] Start()
0503 19:55:46.294664 (+ 30us) write_op.cc:276] Timestamp: P: 1777838132233330 usec, L: 0
0503 19:55:46.296529 (+ 1865us) write_op.cc:270] Start()
0503 19:55:46.296561 (+ 32us) write_op.cc:276] Timestamp: P: 1777838132234163 usec, L: 0
0503 19:55:46.298231 (+ 1670us) write_op.cc:270] Start()
0503 19:55:46.299510 (+ 1279us) write_op.cc:276] Timestamp: P: 1777838132236048 usec, L: 0
0503 19:55:46.311400 (+ 11890us) write_op.cc:270] Start()
0503 19:55:46.311429 (+ 29us) write_op.cc:276] Timestamp: P: 1777838132239496 usec, L: 0
0503 19:55:46.347341 (+ 35912us) write_op.cc:270] Start()
0503 19:55:46.347525 (+ 184us) write_op.cc:276] Timestamp: P: 1777838132275656 usec, L: 0
0503 19:55:46.354509 (+ 6984us) write_op.cc:270] Start()
0503 19:55:46.354551 (+ 42us) write_op.cc:276] Timestamp: P: 1777838132289313 usec, L: 0
0503 19:55:46.363222 (+ 8671us) write_op.cc:270] Start()
0503 19:55:46.363265 (+ 43us) write_op.cc:276] Timestamp: P: 1777838132292881 usec, L: 0
0503 19:55:46.374765 (+ 11500us) write_op.cc:270] Start()
0503 19:55:46.374805 (+ 40us) write_op.cc:276] Timestamp: P: 1777838132304954 usec, L: 0
0503 19:55:46.376429 (+ 1624us) write_op.cc:270] Start()
0503 19:55:46.376460 (+ 31us) write_op.cc:276] Timestamp: P: 1777838132333762 usec, L: 0
0503 19:55:46.385091 (+ 8631us) write_op.cc:270] Start()
0503 19:55:46.385143 (+ 52us) write_op.cc:276] Timestamp: P: 1777838132351922 usec, L: 0
0503 19:55:46.385366 (+ 223us) write_op.cc:270] Start()
0503 19:55:46.385388 (+ 22us) write_op.cc:276] Timestamp: P: 1777838132372094 usec, L: 0
0503 19:55:46.417140 (+ 31752us) write_op.cc:270] Start()
0503 19:55:46.417189 (+ 49us) write_op.cc:276] Timestamp: P: 1777838132373078 usec, L: 0
0503 19:55:46.419007 (+ 1818us) write_op.cc:270] Start()
0503 19:55:46.419117 (+ 110us) write_op.cc:276] Timestamp: P: 1777838132413221 usec, L: 0
0503 19:55:46.427069 (+ 7952us) write_op.cc:270] Start()
0503 19:55:46.427113 (+ 44us) write_op.cc:276] Timestamp: P: 1777838132414201 usec, L: 0
0503 19:55:46.429073 (+ 1960us) write_op.cc:270] Start()
0503 19:55:46.429120 (+ 47us) write_op.cc:276] Timestamp: P: 1777838132459932 usec, L: 0
0503 19:55:46.437215 (+ 8095us) write_op.cc:270] Start()
0503 19:55:46.437249 (+ 34us) write_op.cc:276] Timestamp: P: 1777838132463549 usec, L: 0
0503 19:55:46.439412 (+ 2163us) write_op.cc:270] Start()
0503 19:55:46.439448 (+ 36us) write_op.cc:276] Timestamp: P: 1777838132480692 usec, L: 0
0503 19:55:46.439735 (+ 287us) write_op.cc:270] Start()
0503 19:55:46.439762 (+ 27us) write_op.cc:276] Timestamp: P: 1777838132487342 usec, L: 0
0503 19:55:46.441229 (+ 1467us) write_op.cc:270] Start()
0503 19:55:46.441304 (+ 75us) write_op.cc:276] Timestamp: P: 1777838132491100 usec, L: 0
0503 19:55:46.443487 (+ 2183us) write_op.cc:270] Start()
0503 19:55:46.443517 (+ 30us) write_op.cc:276] Timestamp: P: 1777838132496680 usec, L: 0
0503 19:55:46.444295 (+ 778us) write_op.cc:270] Start()
0503 19:55:46.444319 (+ 24us) write_op.cc:276] Timestamp: P: 1777838132518873 usec, L: 0
0503 19:55:46.447735 (+ 3416us) write_op.cc:270] Start()
0503 19:55:46.447773 (+ 38us) write_op.cc:276] Timestamp: P: 1777838132545898 usec, L: 0
0503 19:55:46.452660 (+ 4887us) write_op.cc:270] Start()
0503 19:55:46.452687 (+ 27us) write_op.cc:276] Timestamp: P: 1777838132552104 usec, L: 0
0503 19:55:46.452898 (+ 211us) write_op.cc:270] Start()
0503 19:55:46.452921 (+ 23us) write_op.cc:276] Timestamp: P: 1777838132571672 usec, L: 0
0503 19:55:46.453942 (+ 1021us) write_op.cc:270] Start()
0503 19:55:46.453966 (+ 24us) write_op.cc:276] Timestamp: P: 1777838132584826 usec, L: 0
0503 19:55:46.463789 (+ 9823us) write_op.cc:270] Start()
0503 19:55:46.463824 (+ 35us) write_op.cc:276] Timestamp: P: 1777838132614467 usec, L: 0
0503 19:55:46.464117 (+ 293us) write_op.cc:270] Start()
0503 19:55:46.464142 (+ 25us) write_op.cc:276] Timestamp: P: 1777838132616116 usec, L: 0
0503 19:55:46.464356 (+ 214us) write_op.cc:270] Start()
0503 19:55:46.464379 (+ 23us) write_op.cc:276] Timestamp: P: 1777838132622124 usec, L: 0
0503 19:55:46.464586 (+ 207us) write_op.cc:270] Start()
0503 19:55:46.464609 (+ 23us) write_op.cc:276] Timestamp: P: 1777838132655306 usec, L: 0
0503 19:55:46.464836 (+ 227us) write_op.cc:270] Start()
0503 19:55:46.464859 (+ 23us) write_op.cc:276] Timestamp: P: 1777838132671083 usec, L: 0
0503 19:55:46.465154 (+ 295us) write_op.cc:270] Start()
0503 19:55:46.465179 (+ 25us) write_op.cc:276] Timestamp: P: 1777838132676256 usec, L: 0
0503 19:55:46.465399 (+ 220us) write_op.cc:270] Start()
0503 19:55:46.465422 (+ 23us) write_op.cc:276] Timestamp: P: 1777838132693359 usec, L: 0
0503 19:55:46.465645 (+ 223us) write_op.cc:270] Start()
0503 19:55:46.465669 (+ 24us) write_op.cc:276] Timestamp: P: 1777838132727886 usec, L: 0
0503 19:55:46.465903 (+ 234us) write_op.cc:270] Start()
0503 19:55:46.465926 (+ 23us) write_op.cc:276] Timestamp: P: 1777838132771066 usec, L: 0
0503 19:55:46.466194 (+ 268us) write_op.cc:270] Start()
0503 19:55:46.466219 (+ 25us) write_op.cc:276] Timestamp: P: 1777838132771853 usec, L: 0
0503 19:55:46.466441 (+ 222us) write_op.cc:270] Start()
0503 19:55:46.466464 (+ 23us) write_op.cc:276] Timestamp: P: 1777838132781998 usec, L: 0
0503 19:55:46.466661 (+ 197us) write_op.cc:270] Start()
0503 19:55:46.466683 (+ 22us) write_op.cc:276] Timestamp: P: 1777838132798153 usec, L: 0
0503 19:55:46.466926 (+ 243us) write_op.cc:270] Start()
0503 19:55:46.466950 (+ 24us) write_op.cc:276] Timestamp: P: 1777838132833356 usec, L: 0
0503 19:55:46.467233 (+ 283us) write_op.cc:270] Start()
0503 19:55:46.467258 (+ 25us) write_op.cc:276] Timestamp: P: 1777838132838302 usec, L: 0
0503 19:55:46.516053 (+ 48795us) write_op.cc:270] Start()
0503 19:55:46.516089 (+ 36us) write_op.cc:276] Timestamp: P: 1777838132848011 usec, L: 0
0503 19:55:46.521647 (+ 5558us) write_op.cc:270] Start()
0503 19:55:46.521680 (+ 33us) write_op.cc:276] Timestamp: P: 1777838132850149 usec, L: 0
0503 19:55:46.526500 (+ 4820us) write_op.cc:270] Start()
0503 19:55:46.526544 (+ 44us) write_op.cc:276] Timestamp: P: 1777838132869153 usec, L: 0
0503 19:55:46.553276 (+ 26732us) write_op.cc:270] Start()
0503 19:55:46.553309 (+ 33us) write_op.cc:276] Timestamp: P: 1777838132903863 usec, L: 0
0503 19:55:46.554512 (+ 1203us) write_op.cc:270] Start()
0503 19:55:46.554540 (+ 28us) write_op.cc:276] Timestamp: P: 1777838132936763 usec, L: 0
0503 19:55:46.581790 (+ 27250us) write_op.cc:270] Start()
0503 19:55:46.581830 (+ 40us) write_op.cc:276] Timestamp: P: 1777838132938158 usec, L: 0
0503 19:55:46.582110 (+ 280us) write_op.cc:270] Start()
0503 19:55:46.582134 (+ 24us) write_op.cc:276] Timestamp: P: 1777838132944710 usec, L: 0
0503 19:55:46.582321 (+ 187us) write_op.cc:270] Start()
0503 19:55:46.582340 (+ 19us) write_op.cc:276] Timestamp: P: 1777838132960139 usec, L: 0
0503 19:55:46.594030 (+ 11690us) write_op.cc:270] Start()
0503 19:55:46.594059 (+ 29us) write_op.cc:276] Timestamp: P: 1777838132993530 usec, L: 0
0503 19:55:46.595868 (+ 1809us) write_op.cc:270] Start()
0503 19:55:46.595899 (+ 31us) write_op.cc:276] Timestamp: P: 1777838133013674 usec, L: 0
0503 19:55:46.612437 (+ 16538us) write_op.cc:270] Start()
0503 19:55:46.612474 (+ 37us) write_op.cc:276] Timestamp: P: 1777838133021573 usec, L: 0
0503 19:55:46.612741 (+ 267us) write_op.cc:270] Start()
0503 19:55:46.612846 (+ 105us) write_op.cc:276] Timestamp: P: 1777838133044941 usec, L: 0
0503 19:55:46.620190 (+ 7344us) write_op.cc:270] Start()
0503 19:55:46.620228 (+ 38us) write_op.cc:276] Timestamp: P: 1777838133067647 usec, L: 0
0503 19:55:46.620476 (+ 248us) write_op.cc:270] Start()
0503 19:55:46.620500 (+ 24us) write_op.cc:276] Timestamp: P: 1777838133100873 usec, L: 0
0503 19:55:46.620680 (+ 180us) write_op.cc:270] Start()
0503 19:55:46.620702 (+ 22us) write_op.cc:276] Timestamp: P: 1777838133103749 usec, L: 0
0503 19:55:46.620888 (+ 186us) write_op.cc:270] Start()
0503 19:55:46.620912 (+ 24us) write_op.cc:276] Timestamp: P: 1777838133106243 usec, L: 0
0503 19:55:46.621080 (+ 168us) write_op.cc:270] Start()
0503 19:55:46.621105 (+ 25us) write_op.cc:276] Timestamp: P: 1777838133121718 usec, L: 0
0503 19:55:46.621273 (+ 168us) write_op.cc:270] Start()
0503 19:55:46.621294 (+ 21us) write_op.cc:276] Timestamp: P: 1777838133154721 usec, L: 0
0503 19:55:46.621439 (+ 145us) write_op.cc:270] Start()
0503 19:55:46.621459 (+ 20us) write_op.cc:276] Timestamp: P: 1777838133173412 usec, L: 0
0503 19:55:46.621601 (+ 142us) write_op.cc:270] Start()
0503 19:55:46.621622 (+ 21us) write_op.cc:276] Timestamp: P: 1777838133197674 usec, L: 0
0503 19:55:46.621780 (+ 158us) write_op.cc:270] Start()
0503 19:55:46.621802 (+ 22us) write_op.cc:276] Timestamp: P: 1777838133206123 usec, L: 0
0503 19:55:46.621983 (+ 181us) write_op.cc:270] Start()
0503 19:55:46.622003 (+ 20us) write_op.cc:276] Timestamp: P: 1777838133242301 usec, L: 0
0503 19:55:46.622149 (+ 146us) write_op.cc:270] Start()
0503 19:55:46.622178 (+ 29us) write_op.cc:276] Timestamp: P: 1777838133266441 usec, L: 0
0503 19:55:46.622345 (+ 167us) write_op.cc:270] Start()
0503 19:55:46.622366 (+ 21us) write_op.cc:276] Timestamp: P: 1777838133273173 usec, L: 0
0503 19:55:46.622505 (+ 139us) write_op.cc:270] Start()
0503 19:55:46.622527 (+ 22us) write_op.cc:276] Timestamp: P: 1777838133307743 usec, L: 0
0503 19:55:46.622683 (+ 156us) write_op.cc:270] Start()
0503 19:55:46.622703 (+ 20us) write_op.cc:276] Timestamp: P: 1777838133311672 usec, L: 0
0503 19:55:46.622882 (+ 179us) write_op.cc:270] Start()
0503 19:55:46.622904 (+ 22us) write_op.cc:276] Timestamp: P: 1777838133337647 usec, L: 0
0503 19:55:46.623048 (+ 144us) write_op.cc:270] Start()
0503 19:55:46.623067 (+ 19us) write_op.cc:276] Timestamp: P: 1777838133339180 usec, L: 0
0503 19:55:46.623218 (+ 151us) write_op.cc:270] Start()
0503 19:55:46.623239 (+ 21us) write_op.cc:276] Timestamp: P: 1777838133367607 usec, L: 0
0503 19:55:46.623396 (+ 157us) write_op.cc:270] Start()
0503 19:55:46.623417 (+ 21us) write_op.cc:276] Timestamp: P: 1777838133384174 usec, L: 0
0503 19:55:46.623557 (+ 140us) write_op.cc:270] Start()
0503 19:55:46.623576 (+ 19us) write_op.cc:276] Timestamp: P: 1777838133408507 usec, L: 0
0503 19:55:46.629616 (+ 6040us) write_op.cc:270] Start()
0503 19:55:46.629659 (+ 43us) write_op.cc:276] Timestamp: P: 1777838133409456 usec, L: 0
0503 19:55:46.636126 (+ 6467us) write_op.cc:270] Start()
0503 19:55:46.636164 (+ 38us) write_op.cc:276] Timestamp: P: 1777838133435237 usec, L: 0
0503 19:55:46.643469 (+ 7305us) write_op.cc:270] Start()
0503 19:55:46.643507 (+ 38us) write_op.cc:276] Timestamp: P: 1777838133468450 usec, L: 0
0503 19:55:46.644992 (+ 1485us) write_op.cc:270] Start()
0503 19:55:46.648576 (+ 3584us) write_op.cc:276] Timestamp: P: 1777838133471010 usec, L: 0
0503 19:55:46.655809 (+ 7233us) write_op.cc:270] Start()
0503 19:55:46.655848 (+ 39us) write_op.cc:276] Timestamp: P: 1777838133509642 usec, L: 0
0503 19:55:46.686726 (+ 30878us) write_op.cc:270] Start()
0503 19:55:46.686772 (+ 46us) write_op.cc:276] Timestamp: P: 1777838133514302 usec, L: 0
0503 19:55:46.690404 (+ 3632us) write_op.cc:270] Start()
0503 19:55:46.690442 (+ 38us) write_op.cc:276] Timestamp: P: 1777838133530307 usec, L: 0
0503 19:55:46.690666 (+ 224us) write_op.cc:270] Start()
0503 19:55:46.690689 (+ 23us) write_op.cc:276] Timestamp: P: 1777838133551597 usec, L: 0
0503 19:55:46.697176 (+ 6487us) write_op.cc:270] Start()
0503 19:55:46.697212 (+ 36us) write_op.cc:276] Timestamp: P: 1777838133575071 usec, L: 0
0503 19:55:46.700372 (+ 3160us) write_op.cc:270] Start()
0503 19:55:46.700407 (+ 35us) write_op.cc:276] Timestamp: P: 1777838133580513 usec, L: 0
0503 19:55:46.701649 (+ 1242us) write_op.cc:270] Start()
0503 19:55:46.701674 (+ 25us) write_op.cc:276] Timestamp: P: 1777838133624298 usec, L: 0
0503 19:55:46.712213 (+ 10539us) write_op.cc:270] Start()
0503 19:55:46.712244 (+ 31us) write_op.cc:276] Timestamp: P: 1777838133631818 usec, L: 0
0503 19:55:46.712905 (+ 661us) write_op.cc:270] Start()
0503 19:55:46.712932 (+ 27us) write_op.cc:276] Timestamp: P: 1777838133640537 usec, L: 0
0503 19:55:46.719718 (+ 6786us) write_op.cc:270] Start()
0503 19:55:46.719757 (+ 39us) write_op.cc:276] Timestamp: P: 1777838133655525 usec, L: 0
0503 19:55:46.720008 (+ 251us) write_op.cc:270] Start()
0503 19:55:46.720030 (+ 22us) write_op.cc:276] Timestamp: P: 1777838133687286 usec, L: 0
0503 19:55:46.720205 (+ 175us) write_op.cc:270] Start()
0503 19:55:46.720225 (+ 20us) write_op.cc:276] Timestamp: P: 1777838133700831 usec, L: 0
0503 19:55:46.720388 (+ 163us) write_op.cc:270] Start()
0503 19:55:46.720411 (+ 23us) write_op.cc:276] Timestamp: P: 1777838133724480 usec, L: 0
0503 19:55:46.720591 (+ 180us) write_op.cc:270] Start()
0503 19:55:46.720611 (+ 20us) write_op.cc:276] Timestamp: P: 1777838133737254 usec, L: 0
0503 19:55:46.721513 (+ 902us) write_op.cc:270] Start()
0503 19:55:46.721537 (+ 24us) write_op.cc:276] Timestamp: P: 1777838133748012 usec, L: 0
0503 19:55:46.721886 (+ 349us) write_op.cc:270] Start()
0503 19:55:46.721908 (+ 22us) write_op.cc:276] Timestamp: P: 1777838133778478 usec, L: 0
0503 19:55:46.722431 (+ 523us) write_op.cc:270] Start()
0503 19:55:46.722452 (+ 21us) write_op.cc:276] Timestamp: P: 1777838133810052 usec, L: 0
0503 19:55:46.722784 (+ 332us) write_op.cc:270] Start()
0503 19:55:46.722807 (+ 23us) write_op.cc:276] Timestamp: P: 1777838133851260 usec, L: 0
0503 19:55:46.723040 (+ 233us) write_op.cc:270] Start()
0503 19:55:46.723061 (+ 21us) write_op.cc:276] Timestamp: P: 1777838133882892 usec, L: 0
0503 19:55:46.736682 (+ 13621us) write_op.cc:270] Start()
0503 19:55:46.736719 (+ 37us) write_op.cc:276] Timestamp: P: 1777838133899733 usec, L: 0
0503 19:55:46.736987 (+ 268us) write_op.cc:270] Start()
0503 19:55:46.737024 (+ 37us) write_op.cc:276] Timestamp: P: 1777838133907216 usec, L: 0
0503 19:55:46.746333 (+ 9309us) write_op.cc:270] Start()
0503 19:55:46.746572 (+ 239us) write_op.cc:276] Timestamp: P: 1777838133921680 usec, L: 0
0503 19:55:46.768367 (+ 21795us) write_op.cc:270] Start()
0503 19:55:46.768412 (+ 45us) write_op.cc:276] Timestamp: P: 1777838133933671 usec, L: 0
0503 19:55:46.768725 (+ 313us) write_op.cc:270] Start()
0503 19:55:46.768747 (+ 22us) write_op.cc:276] Timestamp: P: 1777838133975861 usec, L: 0
0503 19:55:46.768907 (+ 160us) write_op.cc:270] Start()
0503 19:55:46.768929 (+ 22us) write_op.cc:276] Timestamp: P: 1777838133982977 usec, L: 0
0503 19:55:46.769137 (+ 208us) write_op.cc:270] Start()
0503 19:55:46.769158 (+ 21us) write_op.cc:276] Timestamp: P: 1777838133986095 usec, L: 0
0503 19:55:46.769322 (+ 164us) write_op.cc:270] Start()
0503 19:55:46.769343 (+ 21us) write_op.cc:276] Timestamp: P: 1777838134025832 usec, L: 0
0503 19:55:46.771302 (+ 1959us) write_op.cc:270] Start()
0503 19:55:46.771325 (+ 23us) write_op.cc:276] Timestamp: P: 1777838134057467 usec, L: 0
0503 19:55:46.773075 (+ 1750us) write_op.cc:270] Start()
0503 19:55:46.773106 (+ 31us) write_op.cc:276] Timestamp: P: 1777838134073074 usec, L: 0
0503 19:55:46.790975 (+ 17869us) write_op.cc:270] Start()
0503 19:55:46.791030 (+ 55us) write_op.cc:276] Timestamp: P: 1777838134079318 usec, L: 0
0503 19:55:46.801717 (+ 10687us) write_op.cc:270] Start()
0503 19:55:46.801754 (+ 37us) write_op.cc:276] Timestamp: P: 1777838134095762 usec, L: 0
0503 19:55:46.806357 (+ 4603us) write_op.cc:270] Start()
0503 19:55:46.806395 (+ 38us) write_op.cc:276] Timestamp: P: 1777838134135395 usec, L: 0
0503 19:55:46.810167 (+ 3772us) write_op.cc:270] Start()
0503 19:55:46.811896 (+ 1729us) write_op.cc:276] Timestamp: P: 1777838134142754 usec, L: 0
0503 19:55:46.812223 (+ 327us) write_op.cc:270] Start()
0503 19:55:46.812247 (+ 24us) write_op.cc:276] Timestamp: P: 1777838134166614 usec, L: 0
0503 19:55:46.812414 (+ 167us) write_op.cc:270] Start()
0503 19:55:46.812435 (+ 21us) write_op.cc:276] Timestamp: P: 1777838134198045 usec, L: 0
0503 19:55:46.812613 (+ 178us) write_op.cc:270] Start()
0503 19:55:46.812633 (+ 20us) write_op.cc:276] Timestamp: P: 1777838134214138 usec, L: 0
0503 19:55:46.812781 (+ 148us) write_op.cc:270] Start()
0503 19:55:46.812799 (+ 18us) write_op.cc:276] Timestamp: P: 1777838134254179 usec, L: 0
0503 19:55:46.812959 (+ 160us) write_op.cc:270] Start()
0503 19:55:46.812980 (+ 21us) write_op.cc:276] Timestamp: P: 1777838134259362 usec, L: 0
0503 19:55:46.813132 (+ 152us) write_op.cc:270] Start()
0503 19:55:46.813152 (+ 20us) write_op.cc:276] Timestamp: P: 1777838134289954 usec, L: 0
0503 19:55:46.813297 (+ 145us) write_op.cc:270] Start()
0503 19:55:46.813317 (+ 20us) write_op.cc:276] Timestamp: P: 1777838134339589 usec, L: 0
0503 19:55:46.813451 (+ 134us) write_op.cc:270] Start()
0503 19:55:46.813469 (+ 18us) write_op.cc:276] Timestamp: P: 1777838134342766 usec, L: 0
0503 19:55:46.813978 (+ 509us) write_op.cc:270] Start()
0503 19:55:46.814016 (+ 38us) write_op.cc:276] Timestamp: P: 1777838134360052 usec, L: 0
0503 19:55:46.819699 (+ 5683us) write_op.cc:270] Start()
0503 19:55:46.819751 (+ 52us) write_op.cc:276] Timestamp: P: 1777838134397672 usec, L: 0
0503 19:55:46.823241 (+ 3490us) write_op.cc:270] Start()
0503 19:55:46.823282 (+ 41us) write_op.cc:276] Timestamp: P: 1777838134424980 usec, L: 0
0503 19:55:46.824683 (+ 1401us) write_op.cc:270] Start()
0503 19:55:46.824720 (+ 37us) write_op.cc:276] Timestamp: P: 1777838134460690 usec, L: 0
0503 19:55:46.825515 (+ 795us) write_op.cc:270] Start()
0503 19:55:46.825543 (+ 28us) write_op.cc:276] Timestamp: P: 1777838134479946 usec, L: 0
0503 19:55:46.832034 (+ 6491us) write_op.cc:270] Start()
0503 19:55:46.832087 (+ 53us) write_op.cc:276] Timestamp: P: 1777838134486062 usec, L: 0
0503 19:55:46.871365 (+ 39278us) write_op.cc:270] Start()
0503 19:55:46.871395 (+ 30us) write_op.cc:276] Timestamp: P: 1777838134507208 usec, L: 0
0503 19:55:46.871697 (+ 302us) write_op.cc:270] Start()
0503 19:55:46.871720 (+ 23us) write_op.cc:276] Timestamp: P: 1777838134539020 usec, L: 0
0503 19:55:46.871928 (+ 208us) write_op.cc:270] Start()
0503 19:55:46.871948 (+ 20us) write_op.cc:276] Timestamp: P: 1777838134557424 usec, L: 0
0503 19:55:46.872147 (+ 199us) write_op.cc:270] Start()
0503 19:55:46.872168 (+ 21us) write_op.cc:276] Timestamp: P: 1777838134569118 usec, L: 0
0503 19:55:46.872354 (+ 186us) write_op.cc:270] Start()
0503 19:55:46.872373 (+ 19us) write_op.cc:276] Timestamp: P: 1777838134576734 usec, L: 0
0503 19:55:46.872594 (+ 221us) write_op.cc:270] Start()
0503 19:55:46.872615 (+ 21us) write_op.cc:276] Timestamp: P: 1777838134608508 usec, L: 0
0503 19:55:46.872805 (+ 190us) write_op.cc:270] Start()
0503 19:55:46.872826 (+ 21us) write_op.cc:276] Timestamp: P: 1777838134635169 usec, L: 0
0503 19:55:46.872999 (+ 173us) write_op.cc:270] Start()
0503 19:55:46.873019 (+ 20us) write_op.cc:276] Timestamp: P: 1777838134673314 usec, L: 0
0503 19:55:46.873220 (+ 201us) write_op.cc:270] Start()
0503 19:55:46.873240 (+ 20us) write_op.cc:276] Timestamp: P: 1777838134698945 usec, L: 0
0503 19:55:46.873417 (+ 177us) write_op.cc:270] Start()
0503 19:55:46.873439 (+ 22us) write_op.cc:276] Timestamp: P: 1777838134724059 usec, L: 0
0503 19:55:46.873650 (+ 211us) write_op.cc:270] Start()
0503 19:55:46.873671 (+ 21us) write_op.cc:276] Timestamp: P: 1777838134734222 usec, L: 0
0503 19:55:46.873962 (+ 291us) write_op.cc:270] Start()
0503 19:55:46.873988 (+ 26us) write_op.cc:276] Timestamp: P: 1777838134762938 usec, L: 0
0503 19:55:46.874217 (+ 229us) write_op.cc:270] Start()
0503 19:55:46.874239 (+ 22us) write_op.cc:276] Timestamp: P: 1777838134768092 usec, L: 0
0503 19:55:46.874458 (+ 219us) write_op.cc:270] Start()
0503 19:55:46.874478 (+ 20us) write_op.cc:276] Timestamp: P: 1777838134844391 usec, L: 0
0503 19:55:46.874696 (+ 218us) write_op.cc:270] Start()
0503 19:55:46.874717 (+ 21us) write_op.cc:276] Timestamp: P: 1777838134871111 usec, L: 0
0503 19:55:46.874921 (+ 204us) write_op.cc:270] Start()
0503 19:55:46.874942 (+ 21us) write_op.cc:276] Timestamp: P: 1777838134906183 usec, L: 0
0503 19:55:46.875173 (+ 231us) write_op.cc:270] Start()
0503 19:55:46.875199 (+ 26us) write_op.cc:276] Timestamp: P: 1777838134908993 usec, L: 0
0503 19:55:46.875443 (+ 244us) write_op.cc:270] Start()
0503 19:55:46.875465 (+ 22us) write_op.cc:276] Timestamp: P: 1777838134932907 usec, L: 0
0503 19:55:46.875745 (+ 280us) write_op.cc:270] Start()
0503 19:55:46.875768 (+ 23us) write_op.cc:276] Timestamp: P: 177783
I20260503 19:55:52.843918 1548 raft_consensus.cc:493] T ecf4b80ba8714f24a49387dc8bbe2da3 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a1219433b66444d091420ceeab5092ef)
I20260503 19:55:52.844189 1548 raft_consensus.cc:515] T ecf4b80ba8714f24a49387dc8bbe2da3 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:52.845163 1548 leader_election.cc:290] T ecf4b80ba8714f24a49387dc8bbe2da3 P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1219433b66444d091420ceeab5092ef (127.0.105.2:38837), 6d99e4f4d5ca48e0bdb54daf8361c5e8 (127.0.105.3:35005)
I20260503 19:55:52.846086 857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf4b80ba8714f24a49387dc8bbe2da3" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1037 } } ignore_live_leader: false dest_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" is_pre_election: true
I20260503 19:55:52.847051 728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf4b80ba8714f24a49387dc8bbe2da3" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1037 } } ignore_live_leader: false dest_uuid: "a1219433b66444d091420ceeab5092ef" is_pre_election: true
I20260503 19:55:52.852531 1356 leader_election.cc:304] T ecf4b80ba8714f24a49387dc8bbe2da3 P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e52aa88a17542609e84f0c09fb85d87; no voters: 6d99e4f4d5ca48e0bdb54daf8361c5e8, a1219433b66444d091420ceeab5092ef
I20260503 19:55:52.854102 1548 raft_consensus.cc:2749] T ecf4b80ba8714f24a49387dc8bbe2da3 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 19:55:52.910372 1429 raft_consensus.cc:1217] T 3983c88812214bc0bfaaa35c08c38875 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.159->[1.160-1.989] Dedup: 1.163->[1.164-1.989]
W20260503 19:55:53.009840 666 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.3:35005, user_credentials={real_user=slave}} blocked reactor thread for 50005.3us
I20260503 19:55:53.036191 1537 raft_consensus.cc:493] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d99e4f4d5ca48e0bdb54daf8361c5e8)
I20260503 19:55:53.036438 1537 raft_consensus.cc:515] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:53.037393 1537 leader_election.cc:290] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1219433b66444d091420ceeab5092ef (127.0.105.2:38837), 6d99e4f4d5ca48e0bdb54daf8361c5e8 (127.0.105.3:35005)
I20260503 19:55:53.039372 857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c99d75cb2be4439a1610c0de343d73a" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1024 } } ignore_live_leader: false dest_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" is_pre_election: true
I20260503 19:55:53.039414 729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c99d75cb2be4439a1610c0de343d73a" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1024 } } ignore_live_leader: false dest_uuid: "a1219433b66444d091420ceeab5092ef" is_pre_election: true
I20260503 19:55:53.041076 1356 leader_election.cc:304] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e52aa88a17542609e84f0c09fb85d87; no voters: 6d99e4f4d5ca48e0bdb54daf8361c5e8, a1219433b66444d091420ceeab5092ef
I20260503 19:55:53.042071 1537 raft_consensus.cc:2749] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260503 19:55:53.839550 665 consensus_peers.cc:597] T 4d80fc29b7a64074b4a2ce4003054d1a P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 126: this message will repeat every 5th retry.
I20260503 19:55:54.550096 1547 raft_consensus.cc:493] T a860805e8df84220ae4be7d3279b75f1 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a1219433b66444d091420ceeab5092ef)
I20260503 19:55:54.580247 1431 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.105.2:39423 (request call id 71) took 2124 ms. Trace:
I20260503 19:55:54.550331 1547 raft_consensus.cc:515] T a860805e8df84220ae4be7d3279b75f1 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } }
I20260503 19:55:54.611472 728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860805e8df84220ae4be7d3279b75f1" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1032 } } ignore_live_leader: false dest_uuid: "a1219433b66444d091420ceeab5092ef" is_pre_election: true
I20260503 19:55:54.613332 860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860805e8df84220ae4be7d3279b75f1" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1032 } } ignore_live_leader: false dest_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" is_pre_election: true
I20260503 19:55:54.627003 1358 leader_election.cc:304] T a860805e8df84220ae4be7d3279b75f1 P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e52aa88a17542609e84f0c09fb85d87; no voters: 6d99e4f4d5ca48e0bdb54daf8361c5e8, a1219433b66444d091420ceeab5092ef
I20260503 19:55:54.646426 1547 leader_election.cc:290] T a860805e8df84220ae4be7d3279b75f1 P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d99e4f4d5ca48e0bdb54daf8361c5e8 (127.0.105.3:35005), a1219433b66444d091420ceeab5092ef (127.0.105.2:38837)
I20260503 19:55:54.650629 1547 raft_consensus.cc:2749] T a860805e8df84220ae4be7d3279b75f1 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260503 19:55:54.663733 1358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.3:35005, user_credentials={real_user=slave}} blocked reactor thread for 45971.9us
I20260503 19:55:55.024138 1557 raft_consensus.cc:493] T a860805e8df84220ae4be7d3279b75f1 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a1219433b66444d091420ceeab5092ef)
I20260503 19:55:55.039152 1557 raft_consensus.cc:515] T a860805e8df84220ae4be7d3279b75f1 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } }
I20260503 19:55:55.052994 862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860805e8df84220ae4be7d3279b75f1" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1032 } } ignore_live_leader: false dest_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" is_pre_election: true
I20260503 19:55:55.055312 728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860805e8df84220ae4be7d3279b75f1" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1032 } } ignore_live_leader: false dest_uuid: "a1219433b66444d091420ceeab5092ef" is_pre_election: true
I20260503 19:55:55.062820 1356 leader_election.cc:304] T a860805e8df84220ae4be7d3279b75f1 P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e52aa88a17542609e84f0c09fb85d87; no voters: 6d99e4f4d5ca48e0bdb54daf8361c5e8, a1219433b66444d091420ceeab5092ef
I20260503 19:55:55.059477 1557 leader_election.cc:290] T a860805e8df84220ae4be7d3279b75f1 P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d99e4f4d5ca48e0bdb54daf8361c5e8 (127.0.105.3:35005), a1219433b66444d091420ceeab5092ef (127.0.105.2:38837)
I20260503 19:55:55.066553 1547 raft_consensus.cc:2749] T a860805e8df84220ae4be7d3279b75f1 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260503 19:55:55.116765 665 consensus_peers.cc:597] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 126: this message will repeat every 5th retry.
I20260503 19:55:55.550248 1547 raft_consensus.cc:493] T a860805e8df84220ae4be7d3279b75f1 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a1219433b66444d091420ceeab5092ef)
I20260503 19:55:55.550491 1547 raft_consensus.cc:515] T a860805e8df84220ae4be7d3279b75f1 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } }
I20260503 19:55:55.551218 1547 leader_election.cc:290] T a860805e8df84220ae4be7d3279b75f1 P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d99e4f4d5ca48e0bdb54daf8361c5e8 (127.0.105.3:35005), a1219433b66444d091420ceeab5092ef (127.0.105.2:38837)
I20260503 19:55:55.552644 862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860805e8df84220ae4be7d3279b75f1" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1032 } } ignore_live_leader: false dest_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" is_pre_election: true
I20260503 19:55:55.564546 728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860805e8df84220ae4be7d3279b75f1" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1032 } } ignore_live_leader: false dest_uuid: "a1219433b66444d091420ceeab5092ef" is_pre_election: true
I20260503 19:55:55.565517 1356 leader_election.cc:304] T a860805e8df84220ae4be7d3279b75f1 P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e52aa88a17542609e84f0c09fb85d87; no voters: 6d99e4f4d5ca48e0bdb54daf8361c5e8, a1219433b66444d091420ceeab5092ef
I20260503 19:55:55.566435 1547 raft_consensus.cc:2749] T a860805e8df84220ae4be7d3279b75f1 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 19:55:54.584398 1431 rpcz_store.cc:276] 0503 19:55:52.418833 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 19:55:52.418890 (+ 57us) service_pool.cc:224] Handling call
0503 19:55:52.638008 (+219118us) raft_consensus.cc:1471] Updating replica for 308 ops
0503 19:55:52.880272 (+242264us) raft_consensus.cc:1534] Early marking committed up to index 724
0503 19:55:52.880390 (+ 118us) raft_consensus.cc:1539] Triggering prepare for 308 ops
0503 19:55:52.880602 (+ 212us) write_op.cc:270] Start()
0503 19:55:52.880683 (+ 81us) write_op.cc:276] Timestamp: P: 1777838145405427 usec, L: 0
0503 19:55:52.881479 (+ 796us) write_op.cc:270] Start()
0503 19:55:52.881511 (+ 32us) write_op.cc:276] Timestamp: P: 1777838145417244 usec, L: 0
0503 19:55:52.881762 (+ 251us) write_op.cc:270] Start()
0503 19:55:52.881785 (+ 23us) write_op.cc:276] Timestamp: P: 1777838145427548 usec, L: 0
0503 19:55:52.881957 (+ 172us) write_op.cc:270] Start()
0503 19:55:52.881979 (+ 22us) write_op.cc:276] Timestamp: P: 1777838145441876 usec, L: 0
0503 19:55:52.882155 (+ 176us) write_op.cc:270] Start()
0503 19:55:52.882176 (+ 21us) write_op.cc:276] Timestamp: P: 1777838145459454 usec, L: 0
0503 19:55:52.882321 (+ 145us) write_op.cc:270] Start()
0503 19:55:52.882340 (+ 19us) write_op.cc:276] Timestamp: P: 1777838145504520 usec, L: 0
0503 19:55:52.882483 (+ 143us) write_op.cc:270] Start()
0503 19:55:52.882535 (+ 52us) write_op.cc:276] Timestamp: P: 1777838145557231 usec, L: 0
0503 19:55:52.882690 (+ 155us) write_op.cc:270] Start()
0503 19:55:52.882711 (+ 21us) write_op.cc:276] Timestamp: P: 1777838145575068 usec, L: 0
0503 19:55:52.882884 (+ 173us) write_op.cc:270] Start()
0503 19:55:52.882906 (+ 22us) write_op.cc:276] Timestamp: P: 1777838145581653 usec, L: 0
0503 19:55:52.883071 (+ 165us) write_op.cc:270] Start()
0503 19:55:52.883094 (+ 23us) write_op.cc:276] Timestamp: P: 1777838145585992 usec, L: 0
0503 19:55:52.883277 (+ 183us) write_op.cc:270] Start()
0503 19:55:52.883299 (+ 22us) write_op.cc:276] Timestamp: P: 1777838145588252 usec, L: 0
0503 19:55:52.883546 (+ 247us) write_op.cc:270] Start()
0503 19:55:52.883580 (+ 34us) write_op.cc:276] Timestamp: P: 1777838145612275 usec, L: 0
0503 19:55:52.910942 (+ 27362us) write_op.cc:270] Start()
0503 19:55:52.910969 (+ 27us) write_op.cc:276] Timestamp: P: 1777838145648847 usec, L: 0
0503 19:55:52.911128 (+ 159us) write_op.cc:270] Start()
0503 19:55:52.911150 (+ 22us) write_op.cc:276] Timestamp: P: 1777838145649477 usec, L: 0
0503 19:55:52.911295 (+ 145us) write_op.cc:270] Start()
0503 19:55:52.911313 (+ 18us) write_op.cc:276] Timestamp: P: 1777838145655436 usec, L: 0
0503 19:55:52.911474 (+ 161us) write_op.cc:270] Start()
0503 19:55:52.911492 (+ 18us) write_op.cc:276] Timestamp: P: 1777838145676515 usec, L: 0
0503 19:55:52.911660 (+ 168us) write_op.cc:270] Start()
0503 19:55:52.911702 (+ 42us) write_op.cc:276] Timestamp: P: 1777838145718388 usec, L: 0
0503 19:55:52.911876 (+ 174us) write_op.cc:270] Start()
0503 19:55:52.911896 (+ 20us) write_op.cc:276] Timestamp: P: 1777838145732592 usec, L: 0
0503 19:55:52.912081 (+ 185us) write_op.cc:270] Start()
0503 19:55:52.912102 (+ 21us) write_op.cc:276] Timestamp: P: 1777838145753183 usec, L: 0
0503 19:55:52.912247 (+ 145us) write_op.cc:270] Start()
0503 19:55:52.912271 (+ 24us) write_op.cc:276] Timestamp: P: 1777838145771466 usec, L: 0
0503 19:55:52.912458 (+ 187us) write_op.cc:270] Start()
0503 19:55:52.912479 (+ 21us) write_op.cc:276] Timestamp: P: 1777838145772406 usec, L: 0
0503 19:55:52.912713 (+ 234us) write_op.cc:270] Start()
0503 19:55:52.912739 (+ 26us) write_op.cc:276] Timestamp: P: 1777838145820580 usec, L: 0
0503 19:55:52.912924 (+ 185us) write_op.cc:270] Start()
0503 19:55:52.912944 (+ 20us) write_op.cc:276] Timestamp: P: 1777838145918530 usec, L: 0
0503 19:55:52.913084 (+ 140us) write_op.cc:270] Start()
0503 19:55:52.913103 (+ 19us) write_op.cc:276] Timestamp: P: 1777838145921045 usec, L: 0
0503 19:55:52.913297 (+ 194us) write_op.cc:270] Start()
0503 19:55:52.913319 (+ 22us) write_op.cc:276] Timestamp: P: 1777838145966324 usec, L: 0
0503 19:55:52.913480 (+ 161us) write_op.cc:270] Start()
0503 19:55:52.913499 (+ 19us) write_op.cc:276] Timestamp: P: 1777838145973654 usec, L: 0
0503 19:55:52.913698 (+ 199us) write_op.cc:270] Start()
0503 19:55:52.913719 (+ 21us) write_op.cc:276] Timestamp: P: 1777838145982614 usec, L: 0
0503 19:55:52.913997 (+ 278us) write_op.cc:270] Start()
0503 19:55:52.914027 (+ 30us) write_op.cc:276] Timestamp: P: 1777838146006936 usec, L: 0
0503 19:55:52.914201 (+ 174us) write_op.cc:270] Start()
0503 19:55:52.914223 (+ 22us) write_op.cc:276] Timestamp: P: 1777838146012654 usec, L: 0
0503 19:55:52.914423 (+ 200us) write_op.cc:270] Start()
0503 19:55:52.914446 (+ 23us) write_op.cc:276] Timestamp: P: 1777838146032142 usec, L: 0
0503 19:55:52.914591 (+ 145us) write_op.cc:270] Start()
0503 19:55:52.914609 (+ 18us) write_op.cc:276] Timestamp: P: 1777838146034271 usec, L: 0
0503 19:55:52.914766 (+ 157us) write_op.cc:270] Start()
0503 19:55:52.914786 (+ 20us) write_op.cc:276] Timestamp: P: 1777838146070118 usec, L: 0
0503 19:55:52.914958 (+ 172us) write_op.cc:270] Start()
0503 19:55:52.914979 (+ 21us) write_op.cc:276] Timestamp: P: 1777838146111393 usec, L: 0
0503 19:55:52.915107 (+ 128us) write_op.cc:270] Start()
0503 19:55:52.915126 (+ 19us) write_op.cc:276] Timestamp: P: 1777838146118218 usec, L: 0
0503 19:55:52.915278 (+ 152us) write_op.cc:270] Start()
0503 19:55:52.915295 (+ 17us) write_op.cc:276] Timestamp: P: 1777838146131927 usec, L: 0
0503 19:55:52.915481 (+ 186us) write_op.cc:270] Start()
0503 19:55:52.915502 (+ 21us) write_op.cc:276] Timestamp: P: 1777838146144573 usec, L: 0
0503 19:55:52.915649 (+ 147us) write_op.cc:270] Start()
0503 19:55:52.944574 (+ 28925us) write_op.cc:276] Timestamp: P: 1777838146224489 usec, L: 0
0503 19:55:52.945219 (+ 645us) write_op.cc:270] Start()
0503 19:55:52.945256 (+ 37us) write_op.cc:276] Timestamp: P: 1777838146228035 usec, L: 0
0503 19:55:52.945461 (+ 205us) write_op.cc:270] Start()
0503 19:55:52.945482 (+ 21us) write_op.cc:276] Timestamp: P: 1777838146228731 usec, L: 0
0503 19:55:52.945661 (+ 179us) write_op.cc:270] Start()
0503 19:55:52.945682 (+ 21us) write_op.cc:276] Timestamp: P: 1777838146230547 usec, L: 0
0503 19:55:52.948271 (+ 2589us) write_op.cc:270] Start()
0503 19:55:52.948310 (+ 39us) write_op.cc:276] Timestamp: P: 1777838146348109 usec, L: 0
0503 19:55:52.948504 (+ 194us) write_op.cc:270] Start()
0503 19:55:52.948523 (+ 19us) write_op.cc:276] Timestamp: P: 1777838146355362 usec, L: 0
0503 19:55:52.948669 (+ 146us) write_op.cc:270] Start()
0503 19:55:52.948690 (+ 21us) write_op.cc:276] Timestamp: P: 1777838146410107 usec, L: 0
0503 19:55:52.948840 (+ 150us) write_op.cc:270] Start()
0503 19:55:52.948863 (+ 23us) write_op.cc:276] Timestamp: P: 1777838146432109 usec, L: 0
0503 19:55:52.949583 (+ 720us) write_op.cc:270] Start()
0503 19:55:52.949625 (+ 42us) write_op.cc:276] Timestamp: P: 1777838146457678 usec, L: 0
0503 19:55:52.950069 (+ 444us) write_op.cc:270] Start()
0503 19:55:52.950158 (+ 89us) write_op.cc:276] Timestamp: P: 1777838146472594 usec, L: 0
0503 19:55:52.950354 (+ 196us) write_op.cc:270] Start()
0503 19:55:52.950378 (+ 24us) write_op.cc:276] Timestamp: P: 1777838146490236 usec, L: 0
0503 19:55:52.950572 (+ 194us) write_op.cc:270] Start()
0503 19:55:52.950593 (+ 21us) write_op.cc:276] Timestamp: P: 1777838146565906 usec, L: 0
0503 19:55:52.950765 (+ 172us) write_op.cc:270] Start()
0503 19:55:52.950792 (+ 27us) write_op.cc:276] Timestamp: P: 1777838146571474 usec, L: 0
0503 19:55:52.951031 (+ 239us) write_op.cc:270] Start()
0503 19:55:52.951054 (+ 23us) write_op.cc:276] Timestamp: P: 1777838146576542 usec, L: 0
0503 19:55:52.951230 (+ 176us) write_op.cc:270] Start()
0503 19:55:52.951251 (+ 21us) write_op.cc:276] Timestamp: P: 1777838146590339 usec, L: 0
0503 19:55:52.951441 (+ 190us) write_op.cc:270] Start()
0503 19:55:52.951464 (+ 23us) write_op.cc:276] Timestamp: P: 1777838146661487 usec, L: 0
0503 19:55:52.964136 (+ 12672us) write_op.cc:270] Start()
0503 19:55:52.964200 (+ 64us) write_op.cc:276] Timestamp: P: 1777838146664645 usec, L: 0
0503 19:55:52.977985 (+ 13785us) write_op.cc:270] Start()
0503 19:55:52.978048 (+ 63us) write_op.cc:276] Timestamp: P: 1777838146668037 usec, L: 0
0503 19:55:52.978912 (+ 864us) write_op.cc:270] Start()
0503 19:55:52.978960 (+ 48us) write_op.cc:276] Timestamp: P: 1777838146742053 usec, L: 0
0503 19:55:52.981551 (+ 2591us) write_op.cc:270] Start()
0503 19:55:52.981587 (+ 36us) write_op.cc:276] Timestamp: P: 1777838146783909 usec, L: 0
0503 19:55:52.981790 (+ 203us) write_op.cc:270] Start()
0503 19:55:52.981810 (+ 20us) write_op.cc:276] Timestamp: P: 1777838146793932 usec, L: 0
0503 19:55:52.981993 (+ 183us) write_op.cc:270] Start()
0503 19:55:52.982016 (+ 23us) write_op.cc:276] Timestamp: P: 1777838146801646 usec, L: 0
0503 19:55:52.982404 (+ 388us) write_op.cc:270] Start()
0503 19:55:52.982474 (+ 70us) write_op.cc:276] Timestamp: P: 1777838146807251 usec, L: 0
0503 19:55:52.982849 (+ 375us) write_op.cc:270] Start()
0503 19:55:52.982916 (+ 67us) write_op.cc:276] Timestamp: P: 1777838146839999 usec, L: 0
0503 19:55:52.983313 (+ 397us) write_op.cc:270] Start()
0503 19:55:52.983345 (+ 32us) write_op.cc:276] Timestamp: P: 1777838146892465 usec, L: 0
0503 19:55:52.983508 (+ 163us) write_op.cc:270] Start()
0503 19:55:52.983527 (+ 19us) write_op.cc:276] Timestamp: P: 1777838146894267 usec, L: 0
0503 19:55:53.005089 (+ 21562us) write_op.cc:270] Start()
0503 19:55:53.005158 (+ 69us) write_op.cc:276] Timestamp: P: 1777838146895124 usec, L: 0
0503 19:55:53.005462 (+ 304us) write_op.cc:270] Start()
0503 19:55:53.005486 (+ 24us) write_op.cc:276] Timestamp: P: 1777838146939459 usec, L: 0
0503 19:55:53.005767 (+ 281us) write_op.cc:270] Start()
0503 19:55:53.005792 (+ 25us) write_op.cc:276] Timestamp: P: 1777838146997440 usec, L: 0
0503 19:55:53.005967 (+ 175us) write_op.cc:270] Start()
0503 19:55:53.005991 (+ 24us) write_op.cc:276] Timestamp: P: 1777838146998456 usec, L: 0
0503 19:55:53.006168 (+ 177us) write_op.cc:270] Start()
0503 19:55:53.006189 (+ 21us) write_op.cc:276] Timestamp: P: 1777838147023666 usec, L: 0
0503 19:55:53.006339 (+ 150us) write_op.cc:270] Start()
0503 19:55:53.006360 (+ 21us) write_op.cc:276] Timestamp: P: 1777838147071912 usec, L: 0
0503 19:55:53.006502 (+ 142us) write_op.cc:270] Start()
0503 19:55:53.006521 (+ 19us) write_op.cc:276] Timestamp: P: 1777838147073379 usec, L: 0
0503 19:55:53.006658 (+ 137us) write_op.cc:270] Start()
0503 19:55:53.006685 (+ 27us) write_op.cc:276] Timestamp: P: 1777838147075005 usec, L: 0
0503 19:55:53.006845 (+ 160us) write_op.cc:270] Start()
0503 19:55:53.006865 (+ 20us) write_op.cc:276] Timestamp: P: 1777838147075732 usec, L: 0
0503 19:55:53.061893 (+ 55028us) write_op.cc:270] Start()
0503 19:55:53.061939 (+ 46us) write_op.cc:276] Timestamp: P: 1777838147156620 usec, L: 0
0503 19:55:53.087109 (+ 25170us) write_op.cc:270] Start()
0503 19:55:53.087156 (+ 47us) write_op.cc:276] Timestamp: P: 1777838147172184 usec, L: 0
0503 19:55:53.087383 (+ 227us) write_op.cc:270] Start()
0503 19:55:53.087408 (+ 25us) write_op.cc:276] Timestamp: P: 1777838147173649 usec, L: 0
0503 19:55:53.087706 (+ 298us) write_op.cc:270] Start()
0503 19:55:53.087735 (+ 29us) write_op.cc:276] Timestamp: P: 1777838147184391 usec, L: 0
0503 19:55:53.092052 (+ 4317us) write_op.cc:270] Start()
0503 19:55:53.092120 (+ 68us) write_op.cc:276] Timestamp: P: 1777838147207484 usec, L: 0
0503 19:55:53.113917 (+ 21797us) write_op.cc:270] Start()
0503 19:55:53.143192 (+ 29275us) write_op.cc:276] Timestamp: P: 1777838147209829 usec, L: 0
0503 19:55:53.221101 (+ 77909us) write_op.cc:270] Start()
0503 19:55:53.221152 (+ 51us) write_op.cc:276] Timestamp: P: 1777838147270511 usec, L: 0
0503 19:55:53.251749 (+ 30597us) write_op.cc:270] Start()
0503 19:55:53.251781 (+ 32us) write_op.cc:276] Timestamp: P: 1777838147272153 usec, L: 0
0503 19:55:53.260489 (+ 8708us) write_op.cc:270] Start()
0503 19:55:53.260525 (+ 36us) write_op.cc:276] Timestamp: P: 1777838147274550 usec, L: 0
0503 19:55:53.304265 (+ 43740us) write_op.cc:270] Start()
0503 19:55:53.304293 (+ 28us) write_op.cc:276] Timestamp: P: 1777838147332650 usec, L: 0
0503 19:55:53.304492 (+ 199us) write_op.cc:270] Start()
0503 19:55:53.304516 (+ 24us) write_op.cc:276] Timestamp: P: 1777838147360282 usec, L: 0
0503 19:55:53.304685 (+ 169us) write_op.cc:270] Start()
0503 19:55:53.304706 (+ 21us) write_op.cc:276] Timestamp: P: 1777838147373905 usec, L: 0
0503 19:55:53.304877 (+ 171us) write_op.cc:270] Start()
0503 19:55:53.304924 (+ 47us) write_op.cc:276] Timestamp: P: 1777838147378564 usec, L: 0
0503 19:55:53.311055 (+ 6131us) write_op.cc:270] Start()
0503 19:55:53.311084 (+ 29us) write_op.cc:276] Timestamp: P: 1777838147382309 usec, L: 0
0503 19:55:53.311309 (+ 225us) write_op.cc:270] Start()
0503 19:55:53.311333 (+ 24us) write_op.cc:276] Timestamp: P: 1777838147448944 usec, L: 0
0503 19:55:53.311488 (+ 155us) write_op.cc:270] Start()
0503 19:55:53.311510 (+ 22us) write_op.cc:276] Timestamp: P: 1777838147458949 usec, L: 0
0503 19:55:53.311690 (+ 180us) write_op.cc:270] Start()
0503 19:55:53.311712 (+ 22us) write_op.cc:276] Timestamp: P: 1777838147481809 usec, L: 0
0503 19:55:53.311902 (+ 190us) write_op.cc:270] Start()
0503 19:55:53.311928 (+ 26us) write_op.cc:276] Timestamp: P: 1777838147561429 usec, L: 0
0503 19:55:53.312075 (+ 147us) write_op.cc:270] Start()
0503 19:55:53.312095 (+ 20us) write_op.cc:276] Timestamp: P: 1777838147574080 usec, L: 0
0503 19:55:53.312247 (+ 152us) write_op.cc:270] Start()
0503 19:55:53.312267 (+ 20us) write_op.cc:276] Timestamp: P: 1777838147584796 usec, L: 0
0503 19:55:53.312441 (+ 174us) write_op.cc:270] Start()
0503 19:55:53.312466 (+ 25us) write_op.cc:276] Timestamp: P: 1777838147611115 usec, L: 0
0503 19:55:53.312620 (+ 154us) write_op.cc:270] Start()
0503 19:55:53.312672 (+ 52us) write_op.cc:276] Timestamp: P: 1777838147612182 usec, L: 0
0503 19:55:53.318461 (+ 5789us) write_op.cc:270] Start()
0503 19:55:53.318868 (+ 407us) write_op.cc:276] Timestamp: P: 1777838147622411 usec, L: 0
0503 19:55:53.381918 (+ 63050us) write_op.cc:270] Start()
0503 19:55:53.381953 (+ 35us) write_op.cc:276] Timestamp: P: 1777838147643392 usec, L: 0
0503 19:55:53.382294 (+ 341us) write_op.cc:270] Start()
0503 19:55:53.382319 (+ 25us) write_op.cc:276] Timestamp: P: 1777838147696138 usec, L: 0
0503 19:55:53.382510 (+ 191us) write_op.cc:270] Start()
0503 19:55:53.382536 (+ 26us) write_op.cc:276] Timestamp: P: 1777838147704532 usec, L: 0
0503 19:55:53.382693 (+ 157us) write_op.cc:270] Start()
0503 19:55:53.382714 (+ 21us) write_op.cc:276] Timestamp: P: 1777838147728092 usec, L: 0
0503 19:55:53.382871 (+ 157us) write_op.cc:270] Start()
0503 19:55:53.382894 (+ 23us) write_op.cc:276] Timestamp: P: 1777838147769464 usec, L: 0
0503 19:55:53.384423 (+ 1529us) write_op.cc:270] Start()
0503 19:55:53.384455 (+ 32us) write_op.cc:276] Timestamp: P: 1777838147826172 usec, L: 0
0503 19:55:53.384672 (+ 217us) write_op.cc:270] Start()
0503 19:55:53.384696 (+ 24us) write_op.cc:276] Timestamp: P: 1777838147828231 usec, L: 0
0503 19:55:53.385189 (+ 493us) write_op.cc:270] Start()
0503 19:55:53.385216 (+ 27us) write_op.cc:276] Timestamp: P: 1777838147830633 usec, L: 0
0503 19:55:53.389582 (+ 4366us) write_op.cc:270] Start()
0503 19:55:53.389610 (+ 28us) write_op.cc:276] Timestamp: P: 1777838147837286 usec, L: 0
0503 19:55:53.389944 (+ 334us) write_op.cc:270] Start()
0503 19:55:53.389978 (+ 34us) write_op.cc:276] Timestamp: P: 1777838147874265 usec, L: 0
0503 19:55:53.390230 (+ 252us) write_op.cc:270] Start()
0503 19:55:53.390254 (+ 24us) write_op.cc:276] Timestamp: P: 1777838147902458 usec, L: 0
0503 19:55:53.390395 (+ 141us) write_op.cc:270] Start()
0503 19:55:53.390414 (+ 19us) write_op.cc:276] Timestamp: P: 1777838147914161 usec, L: 0
0503 19:55:53.390567 (+ 153us) write_op.cc:270] Start()
0503 19:55:53.390584 (+ 17us) write_op.cc:276] Timestamp: P: 1777838147916265 usec, L: 0
0503 19:55:53.390734 (+ 150us) write_op.cc:270] Start()
0503 19:55:53.390751 (+ 17us) write_op.cc:276] Timestamp: P: 1777838147944689 usec, L: 0
0503 19:55:53.390874 (+ 123us) write_op.cc:270] Start()
0503 19:55:53.390891 (+ 17us) write_op.cc:276] Timestamp: P: 1777838147974443 usec, L: 0
0503 19:55:53.391052 (+ 161us) write_op.cc:270] Start()
0503 19:55:53.391069 (+ 17us) write_op.cc:276] Timestamp: P: 1777838147976338 usec, L: 0
0503 19:55:53.391193 (+ 124us) write_op.cc:270] Start()
0503 19:55:53.391208 (+ 15us) write_op.cc:276] Timestamp: P: 1777838148008929 usec, L: 0
0503 19:55:53.391320 (+ 112us) write_op.cc:270] Start()
0503 19:55:53.391334 (+ 14us) write_op.cc:276] Timestamp: P: 1777838148039767 usec, L: 0
0503 19:55:53.391476 (+ 142us) write_op.cc:270] Start()
0503 19:55:53.391492 (+ 16us) write_op.cc:276] Timestamp: P: 1777838148068395 usec, L: 0
0503 19:55:53.391610 (+ 118us) write_op.cc:270] Start()
0503 19:55:53.391626 (+ 16us) write_op.cc:276] Timestamp: P: 1777838148069591 usec, L: 0
0503 19:55:53.391799 (+ 173us) write_op.cc:270] Start()
0503 19:55:53.391817 (+ 18us) write_op.cc:276] Timestamp: P: 1777838148113908 usec, L: 0
0503 19:55:53.391936 (+ 119us) write_op.cc:270] Start()
0503 19:55:53.391951 (+ 15us) write_op.cc:276] Timestamp: P: 1777838148154616 usec, L: 0
0503 19:55:53.392063 (+ 112us) write_op.cc:270] Start()
0503 19:55:53.392078 (+ 15us) write_op.cc:276] Timestamp: P: 1777838148156895 usec, L: 0
0503 19:55:53.392340 (+ 262us) write_op.cc:270] Start()
0503 19:55:53.392367 (+ 27us) write_op.cc:276] Timestamp: P: 1777838148157508 usec, L: 0
0503 19:55:53.392524 (+ 157us) write_op.cc:270] Start()
0503 19:55:53.392543 (+ 19us) write_op.cc:276] Timestamp: P: 1777838148161110 usec, L: 0
0503 19:55:53.392670 (+ 127us) write_op.cc:270] Start()
0503 19:55:53.392687 (+ 17us) write_op.cc:276] Timestamp: P: 1777838148226526 usec, L: 0
0503 19:55:53.392810 (+ 123us) write_op.cc:270] Start()
0503 19:55:53.392827 (+ 17us) write_op.cc:276] Timestamp: P: 1777838148232237 usec, L: 0
0503 19:55:53.392973 (+ 146us) write_op.cc:270] Start()
0503 19:55:53.392997 (+ 24us) write_op.cc:276] Timestamp: P: 1777838148235995 usec, L: 0
0503 19:55:53.417604 (+ 24607us) write_op.cc:270] Start()
0503 19:55:53.417630 (+ 26us) write_op.cc:276] Timestamp: P: 1777838148256439 usec, L: 0
0503 19:55:53.427476 (+ 9846us) write_op.cc:270] Start()
0503 19:55:53.427509 (+ 33us) write_op.cc:276] Timestamp: P: 1777838148315210 usec, L: 0
0503 19:55:53.427735 (+ 226us) write_op.cc:270] Start()
0503 19:55:53.427758 (+ 23us) write_op.cc:276] Timestamp: P: 1777838148328152 usec, L: 0
0503 19:55:53.427921 (+ 163us) write_op.cc:270] Start()
0503 19:55:53.427940 (+ 19us) write_op.cc:276] Timestamp: P: 1777838148354036 usec, L: 0
0503 19:55:53.428126 (+ 186us) write_op.cc:270] Start()
0503 19:55:53.428149 (+ 23us) write_op.cc:276] Timestamp: P: 1777838148359469 usec, L: 0
0503 19:55:53.432778 (+ 4629us) write_op.cc:270] Start()
0503 19:55:53.432812 (+ 34us) write_op.cc:276] Timestamp: P: 1777838148405199 usec, L: 0
0503 19:55:53.467377 (+ 34565us) write_op.cc:270] Start()
0503 19:55:53.467412 (+ 35us) write_op.cc:276] Timestamp: P: 1777838148410022 usec, L: 0
0503 19:55:53.468146 (+ 734us) write_op.cc:270] Start()
0503 19:55:53.468179 (+ 33us) write_op.cc:276] Timestamp: P: 1777838148452897 usec, L: 0
0503 19:55:53.468400 (+ 221us) write_op.cc:270] Start()
0503 19:55:53.468449 (+ 49us) write_op.cc:276] Timestamp: P: 1777838148458299 usec, L: 0
0503 19:55:53.468639 (+ 190us) write_op.cc:270] Start()
0503 19:55:53.468669 (+ 30us) write_op.cc:276] Timestamp: P: 1777838148508128 usec, L: 0
0503 19:55:53.468919 (+ 250us) write_op.cc:270] Start()
0503 19:55:53.468973 (+ 54us) write_op.cc:276] Timestamp: P: 1777838148509269 usec, L: 0
0503 19:55:53.469778 (+ 805us) write_op.cc:270] Start()
0503 19:55:53.469802 (+ 24us) write_op.cc:276] Timestamp: P: 1777838148509929 usec, L: 0
0503 19:55:53.473708 (+ 3906us) write_op.cc:270] Start()
0503 19:55:53.473746 (+ 38us) write_op.cc:276] Timestamp: P: 1777838148519936 usec, L: 0
0503 19:55:53.476121 (+ 2375us) write_op.cc:270] Start()
0503 19:55:53.476148 (+ 27us) write_op.cc:276] Timestamp: P: 1777838148563511 usec, L: 0
0503 19:55:53.477591 (+ 1443us) write_op.cc:270] Start()
0503 19:55:53.477608 (+ 17us) write_op.cc:276] Timestamp: P: 1777838148569853 usec, L: 0
0503 19:55:53.480404 (+ 2796us) write_op.cc:270] Start()
0503 19:55:53.480443 (+ 39us) write_op.cc:276] Timestamp: P: 1777838148591314 usec, L: 0
0503 19:55:53.484314 (+ 3871us) write_op.cc:270] Start()
0503 19:55:53.484344 (+ 30us) write_op.cc:276] Timestamp: P: 1777838148595796 usec, L: 0
0503 19:55:53.491692 (+ 7348us) write_op.cc:270] Start()
0503 19:55:53.491722 (+ 30us) write_op.cc:276] Timestamp: P: 1777838148626118 usec, L: 0
0503 19:55:53.491963 (+ 241us) write_op.cc:270] Start()
0503 19:55:53.491985 (+ 22us) write_op.cc:276] Timestamp: P: 1777838148628846 usec, L: 0
0503 19:55:53.496310 (+ 4325us) write_op.cc:270] Start()
0503 19:55:53.496334 (+ 24us) write_op.cc:276] Timestamp: P: 1777838148649723 usec, L: 0
0503 19:55:53.498989 (+ 2655us) write_op.cc:270] Start()
0503 19:55:53.499016 (+ 27us) write_op.cc:276] Timestamp: P: 1777838148674194 usec, L: 0
0503 19:55:53.502055 (+ 3039us) write_op.cc:270] Start()
0503 19:55:53.502091 (+ 36us) write_op.cc:276] Timestamp: P: 1777838148682505 usec, L: 0
0503 19:55:53.514310 (+ 12219us) write_op.cc:270] Start()
0503 19:55:53.514335 (+ 25us) write_op.cc:276] Timestamp: P: 1777838148770678 usec, L: 0
0503 19:55:53.516939 (+ 2604us) write_op.cc:270] Start()
0503 19:55:53.516963 (+ 24us) write_op.cc:276] Timestamp: P: 1777838148772109 usec, L: 0
0503 19:55:53.525746 (+ 8783us) write_op.cc:270] Start()
0503 19:55:53.525774 (+ 28us) write_op.cc:276] Timestamp: P: 1777838148798006 usec, L: 0
0503 19:55:53.533013 (+ 7239us) write_op.cc:270] Start()
0503 19:55:53.533045 (+ 32us) write_op.cc:276] Timestamp: P: 1777838148799556 usec, L: 0
0503 19:55:53.533264 (+ 219us) write_op.cc:270] Start()
0503 19:55:53.533285 (+ 21us) write_op.cc:276] Timestamp: P: 1777838148839288 usec, L: 0
0503 19:55:53.544920 (+ 11635us) write_op.cc:270] Start()
0503 19:55:53.544955 (+ 35us) write_op.cc:276] Timestamp: P: 1777838148846169 usec, L: 0
0503 19:55:53.550132 (+ 5177us) write_op.cc:270] Start()
0503 19:55:53.550175 (+ 43us) write_op.cc:276] Timestamp: P: 1777838148891298 usec, L: 0
0503 19:55:53.552437 (+ 2262us) write_op.cc:270] Start()
0503 19:55:53.552485 (+ 48us) write_op.cc:276] Timestamp: P: 1777838148902692 usec, L: 0
0503 19:55:53.555028 (+ 2543us) write_op.cc:270] Start()
0503 19:55:53.555065 (+ 37us) write_op.cc:276] Timestamp: P: 1777838148935385 usec, L: 0
0503 19:55:53.559123 (+ 4058us) write_op.cc:270] Start()
0503 19:55:53.559156 (+ 33us) write_op.cc:276] Timestamp: P: 1777838148939373 usec, L: 0
0503 19:55:53.559470 (+ 314us) write_op.cc:270] Start()
0503 19:55:53.559504 (+ 34us) write_op.cc:276] Timestamp: P: 1777838148971933 usec, L: 0
0503 19:55:53.559716 (+ 212us) write_op.cc:270] Start()
0503 19:55:53.559738 (+ 22us) write_op.cc:276] Timestamp: P: 1777838148998864 usec, L: 0
0503 19:55:53.559913 (+ 175us) write_op.cc:270] Start()
0503 19:55:53.559935 (+ 22us) write_op.cc:276] Timestamp: P: 1777838149004194 usec, L: 0
0503 19:55:53.560075 (+ 140us) write_op.cc:270] Start()
0503 19:55:53.560095 (+ 20us) write_op.cc:276] Timestamp: P: 1777838149010181 usec, L: 0
0503 19:55:53.560257 (+ 162us) write_op.cc:270] Start()
0503 19:55:53.560281 (+ 24us) write_op.cc:276] Timestamp: P: 1777838149041752 usec, L: 0
0503 19:55:53.560408 (+ 127us) write_op.cc:270] Start()
0503 19:55:53.560422 (+ 14us) write_op.cc:276] Timestamp: P: 1777838149082682 usec, L: 0
0503 19:55:53.560516 (+ 94us) write_op.cc:270] Start()
0503 19:55:53.560528 (+ 12us) write_op.cc:276] Timestamp: P: 1777838149088195 usec, L: 0
0503 19:55:53.560690 (+ 162us) write_op.cc:270] Start()
0503 19:55:53.560705 (+ 15us) write_op.cc:276] Timestamp: P: 1777838149088881 usec, L: 0
0503 19:55:53.560930 (+ 225us) write_op.cc:270] Start()
0503 19:55:53.560948 (+ 18us) write_op.cc:276] Timestamp: P: 1777838149109769 usec, L: 0
0503 19:55:53.561122 (+ 174us) write_op.cc:270] Start()
0503 19:55:53.561137 (+ 15us) write_op.cc:276] Timestamp: P: 1777838149156024 usec, L: 0
0503 19:55:53.561315 (+ 178us) write_op.cc:270] Start()
0503 19:55:53.561329 (+ 14us) write_op.cc:276] Timestamp: P: 1777838149178855 usec, L: 0
0503 19:55:53.561828 (+ 499us) write_op.cc:270] Start()
0503 19:55:53.561854 (+ 26us) write_op.cc:276] Timestamp: P: 1777838149191685 usec, L: 0
0503 19:55:53.562069 (+ 215us) write_op.cc:270] Start()
0503 19:55:53.562093 (+ 24us) write_op.cc:276] Timestamp: P: 1777838149196557 usec, L: 0
0503 19:55:53.562280 (+ 187us) write_op.cc:270] Start()
0503 19:55:53.562301 (+ 21us) write_op.cc:276] Timestamp: P: 1777838149223719 usec, L: 0
0503 19:55:53.562487 (+ 186us) write_op.cc:270] Start()
0503 19:55:53.562507 (+ 20us) write_op.cc:276] Timestamp: P: 1777838149231614 usec, L: 0
0503 19:55:53.562650 (+ 143us) write_op.cc:270] Start()
0503 19:55:53.562665 (+ 15us) write_op.cc:276] Timestamp: P: 1777838149253148 usec, L: 0
0503 19:55:53.562822 (+ 157us) write_op.cc:270] Start()
0503 19:55:53.562837 (+ 15us) write_op.cc:276] Timestamp: P: 1777838149300042 usec, L: 0
0503 19:55:53.563009 (+ 172us) write_op.cc:270] Start()
0503 19:55:53.563031 (+ 22us) write_op.cc:276] Timestamp: P: 1777838149325462 usec, L: 0
0503 19:55:53.563279 (+ 248us) write_op.cc:270] Start()
0503 19:55:53.563295 (+ 16us) write_op.cc:276] Timestamp: P: 1777838149345031 usec, L: 0
0503 19:55:53.563471 (+ 176us) write_op.cc:270] Start()
0503 19:55:53.563485 (+ 14us) write_op.cc:276] Timestamp: P: 1777838149345684 usec, L: 0
0503 19:55:53.563708 (+ 223us) write_op.cc:270] Start()
0503 19:55:53.563739 (+ 31us) write_op.cc:276] Timestamp: P: 1777838149367705 usec, L: 0
0503 19:55:53.563910 (+ 171us) write_op.cc:270] Start()
0503 19:55:53.563933 (+ 23us) write_op.cc:276] Timestamp: P: 1777838149408192 usec, L: 0
0503 19:55:53.564080 (+ 147us) write_op.cc:270] Start()
0503 19:55:53.564097 (+ 17us) write_op.cc:276] Timestamp: P: 1777838149412036 usec, L: 0
0503 19:55:53.564261 (+ 164us) write_op.cc:270] Start()
0503 19:55:53.564279 (+ 18us) write_op.cc:276] Timestamp: P: 1777838149420063 usec, L: 0
0503 19:55:53.565095 (+ 816us) write_op.cc:270] Start()
0503 19:55:53.565116 (+ 21us) write_op.cc:276] Timestamp: P: 1777838149511899 usec, L: 0
0503 19:55:53.565328 (+ 212us) write_op.cc:270] Start()
0503 19:55:53.565348 (+ 20us) write_op.cc:276] Timestamp: P: 1777838149519508 usec, L: 0
0503 19:55:53.565524 (+ 176us) write_op.cc:270] Start()
0503 19:55:53.565544 (+ 20us) write_op.cc:276] Timestamp: P: 1777838149528242 usec, L: 0
0503 19:55:53.565750 (+ 206us) write_op.cc:270] Start()
0503 19:55:53.565770 (+ 20us) write_op.cc:276] Timestamp: P: 1777838149549290 usec, L: 0
0503 19:55:53.584164 (+ 18394us) write_op.cc:270] Start()
0503 19:55:53.584207 (+ 43us) write_op.cc:276] Timestamp: P: 1777838149552794 usec, L: 0
0503 19:55:53.584458 (+ 251us) write_op.cc:270] Start()
0503 19:55:53.584482 (+ 24us) write_op.cc:276] Timestamp: P: 1777838149557308 usec, L: 0
0503 19:55:53.594520 (+ 10038us) write_op.cc:270] Start()
0503 19:55:53.594558 (+ 38us) write_op.cc:276] Timestamp: P: 1777838149617335 usec, L: 0
0503 19:55:53.607764 (+ 13206us) write_op.cc:270] Start()
0503 19:55:53.607800 (+ 36us) write_op.cc:276] Timestamp: P: 1777838149618099 usec, L: 0
0503 19:55:53.622547 (+ 14747us) write_op.cc:270] Start()
0503 19:55:53.622589 (+ 42us) write_op.cc:276] Timestamp: P: 1777838149649325 usec, L: 0
0503 19:55:53.648290 (+ 25701us) write_op.cc:270] Start()
0503 19:55:53.648315 (+ 25us) write_op.cc:276] Timestamp: P: 1777838149666828 usec, L: 0
0503 19:55:53.650036 (+ 1721us) write_op.cc:270] Start()
0503 19:55:53.650064 (+ 28us) write_op.cc:276] Timestamp: P: 1777838149679210 usec, L: 0
0503 19:55:53.650427 (+ 363us) write_op.cc:270] Start()
0503 19:55:53.650457 (+ 30us) write_op.cc:276] Timestamp: P: 1777838149680480 usec, L: 0
0503 19:55:53.650664 (+ 207us) write_op.cc:270] Start()
0503 19:55:53.650686 (+ 22us) write_op.cc:276] Timestamp: P: 1777838149710027 usec, L: 0
0503 19:55:53.654698 (+ 4012us) write_op.cc:270] Start()
0503 19:55:53.654740 (+ 42us) write_op.cc:276] Timestamp: P: 1777838149737713 usec, L: 0
0503 19:55:53.730243 (+ 75503us) write_op.cc:270] Start()
0503 19:55:53.730278 (+ 35us) write_op.cc:276] Timestamp: P: 1777838149798556 usec, L: 0
0503 19:55:53.731364 (+ 1086us) write_op.cc:270] Start()
0503 19:55:53.731398 (+ 34us) write_op.cc:276] Timestamp: P: 1777838149799230 usec, L: 0
0503 19:55:53.731564 (+ 166us) write_op.cc:270] Start()
0503 19:55:53.731582 (+ 18us) write_op.cc:276] Timestamp: P: 1777838149808646 usec, L: 0
0503 19:55:53.778501 (+ 46919us) write_op.cc:270] Start()
0503 19:55:53.778532 (+ 31us) write_op.cc:276] Timestamp: P: 1777838149809538 usec, L: 0
0503 19:55:53.792803 (+ 14271us) write_op.cc:270] Start()
0503 19:55:53.792843 (+ 40us) write_op.cc:276] Timestamp: P: 177783
I20260503 19:55:55.936347 1362 tablet_bootstrap.cc:492] T 4d80fc29b7a64074b4a2ce4003054d1a P 0e52aa88a17542609e84f0c09fb85d87: Bootstrap replayed 1/1 log segments. Stats: ops{read=163 overwritten=0 applied=159 ignored=0} inserts{seen=1325 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 4 replicates
I20260503 19:55:55.946643 1362 tablet_bootstrap.cc:492] T 4d80fc29b7a64074b4a2ce4003054d1a P 0e52aa88a17542609e84f0c09fb85d87: Bootstrap complete.
I20260503 19:55:55.948120 1362 ts_tablet_manager.cc:1403] T 4d80fc29b7a64074b4a2ce4003054d1a P 0e52aa88a17542609e84f0c09fb85d87: Time spent bootstrapping tablet: real 4.175s user 0.356s sys 0.127s
I20260503 19:55:56.010707 1362 raft_consensus.cc:359] T 4d80fc29b7a64074b4a2ce4003054d1a P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Replica starting. Triggering 4 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:56.028307 1362 raft_consensus.cc:740] T 4d80fc29b7a64074b4a2ce4003054d1a P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e52aa88a17542609e84f0c09fb85d87, State: Initialized, Role: FOLLOWER
I20260503 19:55:56.028630 1362 consensus_queue.cc:260] T 4d80fc29b7a64074b4a2ce4003054d1a P 0e52aa88a17542609e84f0c09fb85d87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 159, Last appended: 1.163, Last appended by leader: 163, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:56.030124 1362 ts_tablet_manager.cc:1434] T 4d80fc29b7a64074b4a2ce4003054d1a P 0e52aa88a17542609e84f0c09fb85d87: Time spent starting tablet: real 0.080s user 0.003s sys 0.001s
I20260503 19:55:56.030619 1362 tablet_bootstrap.cc:492] T d2bf53fe00c2417b872db2ecd4ede593 P 0e52aa88a17542609e84f0c09fb85d87: Bootstrap starting.
I20260503 19:55:56.505636 1544 raft_consensus.cc:493] T 3983c88812214bc0bfaaa35c08c38875 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d99e4f4d5ca48e0bdb54daf8361c5e8)
I20260503 19:55:56.505826 1544 raft_consensus.cc:515] T 3983c88812214bc0bfaaa35c08c38875 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:56.506917 1544 leader_election.cc:290] T 3983c88812214bc0bfaaa35c08c38875 P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1219433b66444d091420ceeab5092ef (127.0.105.2:38837), 6d99e4f4d5ca48e0bdb54daf8361c5e8 (127.0.105.3:35005)
I20260503 19:55:56.508186 857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3983c88812214bc0bfaaa35c08c38875" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 989 } } ignore_live_leader: false dest_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" is_pre_election: true
I20260503 19:55:56.511083 731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3983c88812214bc0bfaaa35c08c38875" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 989 } } ignore_live_leader: false dest_uuid: "a1219433b66444d091420ceeab5092ef" is_pre_election: true
I20260503 19:55:56.511812 1356 leader_election.cc:304] T 3983c88812214bc0bfaaa35c08c38875 P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e52aa88a17542609e84f0c09fb85d87; no voters: 6d99e4f4d5ca48e0bdb54daf8361c5e8, a1219433b66444d091420ceeab5092ef
I20260503 19:55:56.512424 1544 raft_consensus.cc:2749] T 3983c88812214bc0bfaaa35c08c38875 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 19:55:56.564986 1547 raft_consensus.cc:493] T a860805e8df84220ae4be7d3279b75f1 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a1219433b66444d091420ceeab5092ef)
I20260503 19:55:56.565338 1547 raft_consensus.cc:515] T a860805e8df84220ae4be7d3279b75f1 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } }
I20260503 19:55:56.567613 1547 leader_election.cc:290] T a860805e8df84220ae4be7d3279b75f1 P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d99e4f4d5ca48e0bdb54daf8361c5e8 (127.0.105.3:35005), a1219433b66444d091420ceeab5092ef (127.0.105.2:38837)
I20260503 19:55:56.571751 731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860805e8df84220ae4be7d3279b75f1" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1179 } } ignore_live_leader: false dest_uuid: "a1219433b66444d091420ceeab5092ef" is_pre_election: true
I20260503 19:55:56.575834 859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860805e8df84220ae4be7d3279b75f1" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1179 } } ignore_live_leader: false dest_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" is_pre_election: true
I20260503 19:55:56.576683 1358 leader_election.cc:304] T a860805e8df84220ae4be7d3279b75f1 P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e52aa88a17542609e84f0c09fb85d87; no voters: 6d99e4f4d5ca48e0bdb54daf8361c5e8, a1219433b66444d091420ceeab5092ef
I20260503 19:55:56.634042 1547 raft_consensus.cc:2749] T a860805e8df84220ae4be7d3279b75f1 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 19:55:56.684245 1429 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.105.3:47337 (request call id 23) took 5136 ms. Trace:
I20260503 19:55:56.906599 1544 raft_consensus.cc:493] T 3983c88812214bc0bfaaa35c08c38875 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d99e4f4d5ca48e0bdb54daf8361c5e8)
I20260503 19:55:56.906790 1544 raft_consensus.cc:515] T 3983c88812214bc0bfaaa35c08c38875 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:56.907465 1544 leader_election.cc:290] T 3983c88812214bc0bfaaa35c08c38875 P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1219433b66444d091420ceeab5092ef (127.0.105.2:38837), 6d99e4f4d5ca48e0bdb54daf8361c5e8 (127.0.105.3:35005)
I20260503 19:55:56.912248 859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3983c88812214bc0bfaaa35c08c38875" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 989 } } ignore_live_leader: false dest_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" is_pre_election: true
I20260503 19:55:56.912990 731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3983c88812214bc0bfaaa35c08c38875" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 989 } } ignore_live_leader: false dest_uuid: "a1219433b66444d091420ceeab5092ef" is_pre_election: true
I20260503 19:55:56.915392 1358 leader_election.cc:304] T 3983c88812214bc0bfaaa35c08c38875 P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e52aa88a17542609e84f0c09fb85d87; no voters: 6d99e4f4d5ca48e0bdb54daf8361c5e8, a1219433b66444d091420ceeab5092ef
I20260503 19:55:56.920396 1544 raft_consensus.cc:2749] T 3983c88812214bc0bfaaa35c08c38875 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 19:55:56.684437 1429 rpcz_store.cc:276] 0503 19:55:51.547268 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 19:55:51.547355 (+ 87us) service_pool.cc:224] Handling call
0503 19:55:52.317567 (+770212us) raft_consensus.cc:1471] Updating replica for 830 ops
0503 19:55:52.911584 (+594017us) raft_consensus.cc:1534] Early marking committed up to index 163
0503 19:55:52.913589 (+ 2005us) write_op.cc:489] Releasing partition, row and schema locks
0503 19:55:52.913596 (+ 7us) write_op.cc:454] Released schema lock
0503 19:55:52.931108 (+ 17512us) write_op.cc:489] Releasing partition, row and schema locks
0503 19:55:52.931113 (+ 5us) write_op.cc:454] Released schema lock
0503 19:55:52.931215 (+ 102us) raft_consensus.cc:1539] Triggering prepare for 826 ops
0503 19:55:52.931409 (+ 194us) write_op.cc:270] Start()
0503 19:55:52.931448 (+ 39us) write_op.cc:276] Timestamp: P: 1777838130498570 usec, L: 0
0503 19:55:52.985193 (+ 53745us) write_op.cc:270] Start()
0503 19:55:52.985217 (+ 24us) write_op.cc:276] Timestamp: P: 1777838130508666 usec, L: 0
0503 19:55:52.985432 (+ 215us) write_op.cc:270] Start()
0503 19:55:52.985455 (+ 23us) write_op.cc:276] Timestamp: P: 1777838131225060 usec, L: 0
0503 19:55:52.985653 (+ 198us) write_op.cc:270] Start()
0503 19:55:52.985672 (+ 19us) write_op.cc:276] Timestamp: P: 1777838131269360 usec, L: 0
0503 19:55:52.985845 (+ 173us) write_op.cc:270] Start()
0503 19:55:52.985865 (+ 20us) write_op.cc:276] Timestamp: P: 1777838131292904 usec, L: 0
0503 19:55:52.986243 (+ 378us) write_op.cc:270] Start()
0503 19:55:52.986268 (+ 25us) write_op.cc:276] Timestamp: P: 1777838131311494 usec, L: 0
0503 19:55:52.989552 (+ 3284us) write_op.cc:270] Start()
0503 19:55:52.989594 (+ 42us) write_op.cc:276] Timestamp: P: 1777838131348727 usec, L: 0
0503 19:55:52.989879 (+ 285us) write_op.cc:270] Start()
0503 19:55:52.989902 (+ 23us) write_op.cc:276] Timestamp: P: 1777838131366632 usec, L: 0
0503 19:55:52.990108 (+ 206us) write_op.cc:270] Start()
0503 19:55:52.990130 (+ 22us) write_op.cc:276] Timestamp: P: 1777838131382488 usec, L: 0
0503 19:55:52.990324 (+ 194us) write_op.cc:270] Start()
0503 19:55:52.990349 (+ 25us) write_op.cc:276] Timestamp: P: 1777838131383236 usec, L: 0
0503 19:55:52.990499 (+ 150us) write_op.cc:270] Start()
0503 19:55:52.990519 (+ 20us) write_op.cc:276] Timestamp: P: 1777838131398571 usec, L: 0
0503 19:55:52.990686 (+ 167us) write_op.cc:270] Start()
0503 19:55:52.990707 (+ 21us) write_op.cc:276] Timestamp: P: 1777838131428371 usec, L: 0
0503 19:55:52.990901 (+ 194us) write_op.cc:270] Start()
0503 19:55:52.990922 (+ 21us) write_op.cc:276] Timestamp: P: 1777838131454900 usec, L: 0
0503 19:55:52.991354 (+ 432us) write_op.cc:270] Start()
0503 19:55:52.991383 (+ 29us) write_op.cc:276] Timestamp: P: 1777838131469516 usec, L: 0
0503 19:55:52.991592 (+ 209us) write_op.cc:270] Start()
0503 19:55:52.991616 (+ 24us) write_op.cc:276] Timestamp: P: 1777838131476389 usec, L: 0
0503 19:55:52.991863 (+ 247us) write_op.cc:270] Start()
0503 19:55:52.991889 (+ 26us) write_op.cc:276] Timestamp: P: 1777838131495929 usec, L: 0
0503 19:55:52.992074 (+ 185us) write_op.cc:270] Start()
0503 19:55:52.992116 (+ 42us) write_op.cc:276] Timestamp: P: 1777838131517460 usec, L: 0
0503 19:55:53.019602 (+ 27486us) write_op.cc:270] Start()
0503 19:55:53.019682 (+ 80us) write_op.cc:276] Timestamp: P: 1777838131523088 usec, L: 0
0503 19:55:53.020143 (+ 461us) write_op.cc:270] Start()
0503 19:55:53.020174 (+ 31us) write_op.cc:276] Timestamp: P: 1777838131531406 usec, L: 0
0503 19:55:53.020916 (+ 742us) write_op.cc:270] Start()
0503 19:55:53.020944 (+ 28us) write_op.cc:276] Timestamp: P: 1777838131532311 usec, L: 0
0503 19:55:53.021540 (+ 596us) write_op.cc:270] Start()
0503 19:55:53.021596 (+ 56us) write_op.cc:276] Timestamp: P: 1777838131581015 usec, L: 0
0503 19:55:53.021854 (+ 258us) write_op.cc:270] Start()
0503 19:55:53.021910 (+ 56us) write_op.cc:276] Timestamp: P: 1777838131587806 usec, L: 0
0503 19:55:53.022157 (+ 247us) write_op.cc:270] Start()
0503 19:55:53.022181 (+ 24us) write_op.cc:276] Timestamp: P: 1777838131608040 usec, L: 0
0503 19:55:53.022381 (+ 200us) write_op.cc:270] Start()
0503 19:55:53.022409 (+ 28us) write_op.cc:276] Timestamp: P: 1777838131608842 usec, L: 0
0503 19:55:53.022592 (+ 183us) write_op.cc:270] Start()
0503 19:55:53.022613 (+ 21us) write_op.cc:276] Timestamp: P: 1777838131646700 usec, L: 0
0503 19:55:53.022946 (+ 333us) write_op.cc:270] Start()
0503 19:55:53.022970 (+ 24us) write_op.cc:276] Timestamp: P: 1777838131647407 usec, L: 0
0503 19:55:53.023224 (+ 254us) write_op.cc:270] Start()
0503 19:55:53.023246 (+ 22us) write_op.cc:276] Timestamp: P: 1777838131656834 usec, L: 0
0503 19:55:53.023486 (+ 240us) write_op.cc:270] Start()
0503 19:55:53.023508 (+ 22us) write_op.cc:276] Timestamp: P: 1777838131689623 usec, L: 0
0503 19:55:53.023890 (+ 382us) write_op.cc:270] Start()
0503 19:55:53.023915 (+ 25us) write_op.cc:276] Timestamp: P: 1777838131735156 usec, L: 0
0503 19:55:53.024152 (+ 237us) write_op.cc:270] Start()
0503 19:55:53.024177 (+ 25us) write_op.cc:276] Timestamp: P: 1777838131737103 usec, L: 0
0503 19:55:53.024375 (+ 198us) write_op.cc:270] Start()
0503 19:55:53.024396 (+ 21us) write_op.cc:276] Timestamp: P: 1777838131739223 usec, L: 0
0503 19:55:53.024618 (+ 222us) write_op.cc:270] Start()
0503 19:55:53.024640 (+ 22us) write_op.cc:276] Timestamp: P: 1777838131751884 usec, L: 0
0503 19:55:53.024938 (+ 298us) write_op.cc:270] Start()
0503 19:55:53.024961 (+ 23us) write_op.cc:276] Timestamp: P: 1777838131788024 usec, L: 0
0503 19:55:53.025210 (+ 249us) write_op.cc:270] Start()
0503 19:55:53.025232 (+ 22us) write_op.cc:276] Timestamp: P: 1777838131796195 usec, L: 0
0503 19:55:53.025423 (+ 191us) write_op.cc:270] Start()
0503 19:55:53.025446 (+ 23us) write_op.cc:276] Timestamp: P: 1777838131820882 usec, L: 0
0503 19:55:53.025659 (+ 213us) write_op.cc:270] Start()
0503 19:55:53.025681 (+ 22us) write_op.cc:276] Timestamp: P: 1777838131822691 usec, L: 0
0503 19:55:53.030356 (+ 4675us) write_op.cc:270] Start()
0503 19:55:53.030412 (+ 56us) write_op.cc:276] Timestamp: P: 1777838131860441 usec, L: 0
0503 19:55:53.030701 (+ 289us) write_op.cc:270] Start()
0503 19:55:53.030730 (+ 29us) write_op.cc:276] Timestamp: P: 1777838131869778 usec, L: 0
0503 19:55:53.030936 (+ 206us) write_op.cc:270] Start()
0503 19:55:53.030958 (+ 22us) write_op.cc:276] Timestamp: P: 1777838131888076 usec, L: 0
0503 19:55:53.031456 (+ 498us) write_op.cc:270] Start()
0503 19:55:53.031480 (+ 24us) write_op.cc:276] Timestamp: P: 1777838131911663 usec, L: 0
0503 19:55:53.052297 (+ 20817us) write_op.cc:270] Start()
0503 19:55:53.052345 (+ 48us) write_op.cc:276] Timestamp: P: 1777838131912665 usec, L: 0
0503 19:55:53.073988 (+ 21643us) write_op.cc:270] Start()
0503 19:55:53.074049 (+ 61us) write_op.cc:276] Timestamp: P: 1777838131954974 usec, L: 0
0503 19:55:53.075365 (+ 1316us) write_op.cc:270] Start()
0503 19:55:53.075397 (+ 32us) write_op.cc:276] Timestamp: P: 1777838131966264 usec, L: 0
0503 19:55:53.075673 (+ 276us) write_op.cc:270] Start()
0503 19:55:53.075701 (+ 28us) write_op.cc:276] Timestamp: P: 1777838131976177 usec, L: 0
0503 19:55:53.075919 (+ 218us) write_op.cc:270] Start()
0503 19:55:53.075943 (+ 24us) write_op.cc:276] Timestamp: P: 1777838131994178 usec, L: 0
0503 19:55:53.083522 (+ 7579us) write_op.cc:270] Start()
0503 19:55:53.083561 (+ 39us) write_op.cc:276] Timestamp: P: 1777838132020956 usec, L: 0
0503 19:55:53.083840 (+ 279us) write_op.cc:270] Start()
0503 19:55:53.083861 (+ 21us) write_op.cc:276] Timestamp: P: 1777838132039921 usec, L: 0
0503 19:55:53.150976 (+ 67115us) write_op.cc:270] Start()
0503 19:55:53.151006 (+ 30us) write_op.cc:276] Timestamp: P: 1777838132041351 usec, L: 0
0503 19:55:53.151244 (+ 238us) write_op.cc:270] Start()
0503 19:55:53.151267 (+ 23us) write_op.cc:276] Timestamp: P: 1777838132060923 usec, L: 0
0503 19:55:53.151452 (+ 185us) write_op.cc:270] Start()
0503 19:55:53.151473 (+ 21us) write_op.cc:276] Timestamp: P: 1777838132097934 usec, L: 0
0503 19:55:53.243048 (+ 91575us) write_op.cc:270] Start()
0503 19:55:53.243079 (+ 31us) write_op.cc:276] Timestamp: P: 1777838132099207 usec, L: 0
0503 19:55:53.243297 (+ 218us) write_op.cc:270] Start()
0503 19:55:53.243319 (+ 22us) write_op.cc:276] Timestamp: P: 1777838132112468 usec, L: 0
0503 19:55:53.253355 (+ 10036us) write_op.cc:270] Start()
0503 19:55:53.253385 (+ 30us) write_op.cc:276] Timestamp: P: 1777838132113496 usec, L: 0
0503 19:55:53.263513 (+ 10128us) write_op.cc:270] Start()
0503 19:55:53.263546 (+ 33us) write_op.cc:276] Timestamp: P: 1777838132159052 usec, L: 0
0503 19:55:53.304730 (+ 41184us) write_op.cc:270] Start()
0503 19:55:53.304762 (+ 32us) write_op.cc:276] Timestamp: P: 1777838132164430 usec, L: 0
0503 19:55:53.304976 (+ 214us) write_op.cc:270] Start()
0503 19:55:53.305013 (+ 37us) write_op.cc:276] Timestamp: P: 1777838132167189 usec, L: 0
0503 19:55:53.305211 (+ 198us) write_op.cc:270] Start()
0503 19:55:53.305233 (+ 22us) write_op.cc:276] Timestamp: P: 1777838132169687 usec, L: 0
0503 19:55:53.305460 (+ 227us) write_op.cc:270] Start()
0503 19:55:53.305485 (+ 25us) write_op.cc:276] Timestamp: P: 1777838132207838 usec, L: 0
0503 19:55:53.305666 (+ 181us) write_op.cc:270] Start()
0503 19:55:53.305688 (+ 22us) write_op.cc:276] Timestamp: P: 1777838132225146 usec, L: 0
0503 19:55:53.305883 (+ 195us) write_op.cc:270] Start()
0503 19:55:53.305907 (+ 24us) write_op.cc:276] Timestamp: P: 1777838132231352 usec, L: 0
0503 19:55:53.306083 (+ 176us) write_op.cc:270] Start()
0503 19:55:53.306102 (+ 19us) write_op.cc:276] Timestamp: P: 1777838132233090 usec, L: 0
0503 19:55:53.306245 (+ 143us) write_op.cc:270] Start()
0503 19:55:53.306266 (+ 21us) write_op.cc:276] Timestamp: P: 1777838132285162 usec, L: 0
0503 19:55:53.306392 (+ 126us) write_op.cc:270] Start()
0503 19:55:53.306410 (+ 18us) write_op.cc:276] Timestamp: P: 1777838132286338 usec, L: 0
0503 19:55:53.306562 (+ 152us) write_op.cc:270] Start()
0503 19:55:53.306582 (+ 20us) write_op.cc:276] Timestamp: P: 1777838132302502 usec, L: 0
0503 19:55:53.311042 (+ 4460us) write_op.cc:270] Start()
0503 19:55:53.311073 (+ 31us) write_op.cc:276] Timestamp: P: 1777838132307193 usec, L: 0
0503 19:55:53.311261 (+ 188us) write_op.cc:270] Start()
0503 19:55:53.311283 (+ 22us) write_op.cc:276] Timestamp: P: 1777838132343446 usec, L: 0
0503 19:55:53.311424 (+ 141us) write_op.cc:270] Start()
0503 19:55:53.311440 (+ 16us) write_op.cc:276] Timestamp: P: 1777838132358656 usec, L: 0
0503 19:55:53.311559 (+ 119us) write_op.cc:270] Start()
0503 19:55:53.311575 (+ 16us) write_op.cc:276] Timestamp: P: 1777838132360612 usec, L: 0
0503 19:55:53.311774 (+ 199us) write_op.cc:270] Start()
0503 19:55:53.311796 (+ 22us) write_op.cc:276] Timestamp: P: 1777838132361874 usec, L: 0
0503 19:55:53.312004 (+ 208us) write_op.cc:270] Start()
0503 19:55:53.312052 (+ 48us) write_op.cc:276] Timestamp: P: 1777838132409570 usec, L: 0
0503 19:55:53.312232 (+ 180us) write_op.cc:270] Start()
0503 19:55:53.312307 (+ 75us) write_op.cc:276] Timestamp: P: 1777838132420000 usec, L: 0
0503 19:55:53.312519 (+ 212us) write_op.cc:270] Start()
0503 19:55:53.312544 (+ 25us) write_op.cc:276] Timestamp: P: 1777838132425991 usec, L: 0
0503 19:55:53.386436 (+ 73892us) write_op.cc:270] Start()
0503 19:55:53.386464 (+ 28us) write_op.cc:276] Timestamp: P: 1777838132426770 usec, L: 0
0503 19:55:53.386676 (+ 212us) write_op.cc:270] Start()
0503 19:55:53.386698 (+ 22us) write_op.cc:276] Timestamp: P: 1777838132459484 usec, L: 0
0503 19:55:53.386884 (+ 186us) write_op.cc:270] Start()
0503 19:55:53.386906 (+ 22us) write_op.cc:276] Timestamp: P: 1777838132473864 usec, L: 0
0503 19:55:53.396062 (+ 9156us) write_op.cc:270] Start()
0503 19:55:53.396096 (+ 34us) write_op.cc:276] Timestamp: P: 1777838132499196 usec, L: 0
0503 19:55:53.402102 (+ 6006us) write_op.cc:270] Start()
0503 19:55:53.402135 (+ 33us) write_op.cc:276] Timestamp: P: 1777838132526613 usec, L: 0
0503 19:55:53.402358 (+ 223us) write_op.cc:270] Start()
0503 19:55:53.402383 (+ 25us) write_op.cc:276] Timestamp: P: 1777838132530732 usec, L: 0
0503 19:55:53.402545 (+ 162us) write_op.cc:270] Start()
0503 19:55:53.404298 (+ 1753us) write_op.cc:276] Timestamp: P: 1777838132531420 usec, L: 0
0503 19:55:53.404572 (+ 274us) write_op.cc:270] Start()
0503 19:55:53.404600 (+ 28us) write_op.cc:276] Timestamp: P: 1777838132550203 usec, L: 0
0503 19:55:53.404768 (+ 168us) write_op.cc:270] Start()
0503 19:55:53.404789 (+ 21us) write_op.cc:276] Timestamp: P: 1777838132575223 usec, L: 0
0503 19:55:53.404957 (+ 168us) write_op.cc:270] Start()
0503 19:55:53.404978 (+ 21us) write_op.cc:276] Timestamp: P: 1777838132595199 usec, L: 0
0503 19:55:53.405121 (+ 143us) write_op.cc:270] Start()
0503 19:55:53.405140 (+ 19us) write_op.cc:276] Timestamp: P: 1777838132608685 usec, L: 0
0503 19:55:53.408812 (+ 3672us) write_op.cc:270] Start()
0503 19:55:53.408864 (+ 52us) write_op.cc:276] Timestamp: P: 1777838132626284 usec, L: 0
0503 19:55:53.409098 (+ 234us) write_op.cc:270] Start()
0503 19:55:53.409128 (+ 30us) write_op.cc:276] Timestamp: P: 1777838132630991 usec, L: 0
0503 19:55:53.414147 (+ 5019us) write_op.cc:270] Start()
0503 19:55:53.414186 (+ 39us) write_op.cc:276] Timestamp: P: 1777838132658653 usec, L: 0
0503 19:55:53.417320 (+ 3134us) write_op.cc:270] Start()
0503 19:55:53.417360 (+ 40us) write_op.cc:276] Timestamp: P: 1777838132673065 usec, L: 0
0503 19:55:53.422872 (+ 5512us) write_op.cc:270] Start()
0503 19:55:53.422916 (+ 44us) write_op.cc:276] Timestamp: P: 1777838132674564 usec, L: 0
0503 19:55:53.423822 (+ 906us) write_op.cc:270] Start()
0503 19:55:53.423853 (+ 31us) write_op.cc:276] Timestamp: P: 1777838132692501 usec, L: 0
0503 19:55:53.455540 (+ 31687us) write_op.cc:270] Start()
0503 19:55:53.455570 (+ 30us) write_op.cc:276] Timestamp: P: 1777838132738397 usec, L: 0
0503 19:55:53.457528 (+ 1958us) write_op.cc:270] Start()
0503 19:55:53.457560 (+ 32us) write_op.cc:276] Timestamp: P: 1777838132754058 usec, L: 0
0503 19:55:53.459993 (+ 2433us) write_op.cc:270] Start()
0503 19:55:53.460021 (+ 28us) write_op.cc:276] Timestamp: P: 1777838132770891 usec, L: 0
0503 19:55:53.466595 (+ 6574us) write_op.cc:270] Start()
0503 19:55:53.468017 (+ 1422us) write_op.cc:276] Timestamp: P: 1777838132792554 usec, L: 0
0503 19:55:53.468245 (+ 228us) write_op.cc:270] Start()
0503 19:55:53.468268 (+ 23us) write_op.cc:276] Timestamp: P: 1777838132805108 usec, L: 0
0503 19:55:53.468451 (+ 183us) write_op.cc:270] Start()
0503 19:55:53.468481 (+ 30us) write_op.cc:276] Timestamp: P: 1777838132830719 usec, L: 0
0503 19:55:53.468650 (+ 169us) write_op.cc:270] Start()
0503 19:55:53.468671 (+ 21us) write_op.cc:276] Timestamp: P: 1777838132848944 usec, L: 0
0503 19:55:53.468848 (+ 177us) write_op.cc:270] Start()
0503 19:55:53.468869 (+ 21us) write_op.cc:276] Timestamp: P: 1777838132873339 usec, L: 0
0503 19:55:53.469043 (+ 174us) write_op.cc:270] Start()
0503 19:55:53.469064 (+ 21us) write_op.cc:276] Timestamp: P: 1777838132874174 usec, L: 0
0503 19:55:53.469290 (+ 226us) write_op.cc:270] Start()
0503 19:55:53.469312 (+ 22us) write_op.cc:276] Timestamp: P: 1777838132884986 usec, L: 0
0503 19:55:53.469764 (+ 452us) write_op.cc:270] Start()
0503 19:55:53.469786 (+ 22us) write_op.cc:276] Timestamp: P: 1777838132899597 usec, L: 0
0503 19:55:53.469967 (+ 181us) write_op.cc:270] Start()
0503 19:55:53.469988 (+ 21us) write_op.cc:276] Timestamp: P: 1777838132946000 usec, L: 0
0503 19:55:53.481023 (+ 11035us) write_op.cc:270] Start()
0503 19:55:53.481051 (+ 28us) write_op.cc:276] Timestamp: P: 1777838132947835 usec, L: 0
0503 19:55:53.481285 (+ 234us) write_op.cc:270] Start()
0503 19:55:53.481311 (+ 26us) write_op.cc:276] Timestamp: P: 1777838132951001 usec, L: 0
0503 19:55:53.483875 (+ 2564us) write_op.cc:270] Start()
0503 19:55:53.483898 (+ 23us) write_op.cc:276] Timestamp: P: 1777838132956309 usec, L: 0
0503 19:55:53.484641 (+ 743us) write_op.cc:270] Start()
0503 19:55:53.484664 (+ 23us) write_op.cc:276] Timestamp: P: 1777838133004955 usec, L: 0
0503 19:55:53.486668 (+ 2004us) write_op.cc:270] Start()
0503 19:55:53.486696 (+ 28us) write_op.cc:276] Timestamp: P: 1777838133010520 usec, L: 0
0503 19:55:53.490642 (+ 3946us) write_op.cc:270] Start()
0503 19:55:53.490673 (+ 31us) write_op.cc:276] Timestamp: P: 1777838133017538 usec, L: 0
0503 19:55:53.497750 (+ 7077us) write_op.cc:270] Start()
0503 19:55:53.497776 (+ 26us) write_op.cc:276] Timestamp: P: 1777838133034447 usec, L: 0
0503 19:55:53.502562 (+ 4786us) write_op.cc:270] Start()
0503 19:55:53.502594 (+ 32us) write_op.cc:276] Timestamp: P: 1777838133061786 usec, L: 0
0503 19:55:53.502839 (+ 245us) write_op.cc:270] Start()
0503 19:55:53.502863 (+ 24us) write_op.cc:276] Timestamp: P: 1777838133081249 usec, L: 0
0503 19:55:53.503127 (+ 264us) write_op.cc:270] Start()
0503 19:55:53.503156 (+ 29us) write_op.cc:276] Timestamp: P: 1777838133088979 usec, L: 0
0503 19:55:53.503325 (+ 169us) write_op.cc:270] Start()
0503 19:55:53.503345 (+ 20us) write_op.cc:276] Timestamp: P: 1777838133109112 usec, L: 0
0503 19:55:53.503511 (+ 166us) write_op.cc:270] Start()
0503 19:55:53.503534 (+ 23us) write_op.cc:276] Timestamp: P: 1777838133121712 usec, L: 0
0503 19:55:53.513967 (+ 10433us) write_op.cc:270] Start()
0503 19:55:53.514005 (+ 38us) write_op.cc:276] Timestamp: P: 1777838133162315 usec, L: 0
0503 19:55:53.516815 (+ 2810us) write_op.cc:270] Start()
0503 19:55:53.516846 (+ 31us) write_op.cc:276] Timestamp: P: 1777838133176724 usec, L: 0
0503 19:55:53.517762 (+ 916us) write_op.cc:270] Start()
0503 19:55:53.517789 (+ 27us) write_op.cc:276] Timestamp: P: 1777838133191759 usec, L: 0
0503 19:55:53.517975 (+ 186us) write_op.cc:270] Start()
0503 19:55:53.517996 (+ 21us) write_op.cc:276] Timestamp: P: 1777838133192622 usec, L: 0
0503 19:55:53.518150 (+ 154us) write_op.cc:270] Start()
0503 19:55:53.518170 (+ 20us) write_op.cc:276] Timestamp: P: 1777838133240191 usec, L: 0
0503 19:55:53.518329 (+ 159us) write_op.cc:270] Start()
0503 19:55:53.518354 (+ 25us) write_op.cc:276] Timestamp: P: 1777838133246428 usec, L: 0
0503 19:55:53.518501 (+ 147us) write_op.cc:270] Start()
0503 19:55:53.518521 (+ 20us) write_op.cc:276] Timestamp: P: 1777838133282738 usec, L: 0
0503 19:55:53.518647 (+ 126us) write_op.cc:270] Start()
0503 19:55:53.518665 (+ 18us) write_op.cc:276] Timestamp: P: 1777838133283537 usec, L: 0
0503 19:55:53.533453 (+ 14788us) write_op.cc:270] Start()
0503 19:55:53.533476 (+ 23us) write_op.cc:276] Timestamp: P: 1777838133304282 usec, L: 0
0503 19:55:53.545362 (+ 11886us) write_op.cc:270] Start()
0503 19:55:53.545388 (+ 26us) write_op.cc:276] Timestamp: P: 1777838133344378 usec, L: 0
0503 19:55:53.545549 (+ 161us) write_op.cc:270] Start()
0503 19:55:53.545566 (+ 17us) write_op.cc:276] Timestamp: P: 1777838133347477 usec, L: 0
0503 19:55:53.551380 (+ 5814us) write_op.cc:270] Start()
0503 19:55:53.551405 (+ 25us) write_op.cc:276] Timestamp: P: 1777838133379087 usec, L: 0
0503 19:55:53.552741 (+ 1336us) write_op.cc:270] Start()
0503 19:55:53.552764 (+ 23us) write_op.cc:276] Timestamp: P: 1777838133379989 usec, L: 0
0503 19:55:53.552926 (+ 162us) write_op.cc:270] Start()
0503 19:55:53.552946 (+ 20us) write_op.cc:276] Timestamp: P: 1777838133411378 usec, L: 0
0503 19:55:53.563829 (+ 10883us) write_op.cc:270] Start()
0503 19:55:53.563857 (+ 28us) write_op.cc:276] Timestamp: P: 1777838133415036 usec, L: 0
0503 19:55:53.564076 (+ 219us) write_op.cc:270] Start()
0503 19:55:53.564097 (+ 21us) write_op.cc:276] Timestamp: P: 1777838133428076 usec, L: 0
0503 19:55:53.564263 (+ 166us) write_op.cc:270] Start()
0503 19:55:53.564279 (+ 16us) write_op.cc:276] Timestamp: P: 1777838133474444 usec, L: 0
0503 19:55:53.564491 (+ 212us) write_op.cc:270] Start()
0503 19:55:53.564512 (+ 21us) write_op.cc:276] Timestamp: P: 1777838133475981 usec, L: 0
0503 19:55:53.564663 (+ 151us) write_op.cc:270] Start()
0503 19:55:53.564683 (+ 20us) write_op.cc:276] Timestamp: P: 1777838133486069 usec, L: 0
0503 19:55:53.564831 (+ 148us) write_op.cc:270] Start()
0503 19:55:53.564853 (+ 22us) write_op.cc:276] Timestamp: P: 1777838133493932 usec, L: 0
0503 19:55:53.572954 (+ 8101us) write_op.cc:270] Start()
0503 19:55:53.572989 (+ 35us) write_op.cc:276] Timestamp: P: 1777838133540099 usec, L: 0
0503 19:55:53.573997 (+ 1008us) write_op.cc:270] Start()
0503 19:55:53.574028 (+ 31us) write_op.cc:276] Timestamp: P: 1777838133542450 usec, L: 0
0503 19:55:53.584993 (+ 10965us) write_op.cc:270] Start()
0503 19:55:53.585024 (+ 31us) write_op.cc:276] Timestamp: P: 1777838133570073 usec, L: 0
0503 19:55:53.605794 (+ 20770us) write_op.cc:270] Start()
0503 19:55:53.605845 (+ 51us) write_op.cc:276] Timestamp: P: 1777838133574773 usec, L: 0
0503 19:55:53.613819 (+ 7974us) write_op.cc:270] Start()
0503 19:55:53.613862 (+ 43us) write_op.cc:276] Timestamp: P: 1777838133615199 usec, L: 0
0503 19:55:53.623767 (+ 9905us) write_op.cc:270] Start()
0503 19:55:53.632970 (+ 9203us) write_op.cc:276] Timestamp: P: 1777838133621010 usec, L: 0
0503 19:55:53.633156 (+ 186us) write_op.cc:270] Start()
0503 19:55:53.633182 (+ 26us) write_op.cc:276] Timestamp: P: 1777838133635721 usec, L: 0
0503 19:55:53.636219 (+ 3037us) write_op.cc:270] Start()
0503 19:55:53.636253 (+ 34us) write_op.cc:276] Timestamp: P: 1777838133654890 usec, L: 0
0503 19:55:53.637899 (+ 1646us) write_op.cc:270] Start()
0503 19:55:53.637932 (+ 33us) write_op.cc:276] Timestamp: P: 1777838133676573 usec, L: 0
0503 19:55:53.642618 (+ 4686us) write_op.cc:270] Start()
0503 19:55:53.642648 (+ 30us) write_op.cc:276] Timestamp: P: 1777838133722282 usec, L: 0
0503 19:55:53.648034 (+ 5386us) write_op.cc:270] Start()
0503 19:55:53.673334 (+ 25300us) write_op.cc:276] Timestamp: P: 1777838133723083 usec, L: 0
0503 19:55:53.688546 (+ 15212us) write_op.cc:270] Start()
0503 19:55:53.688572 (+ 26us) write_op.cc:276] Timestamp: P: 1777838133724329 usec, L: 0
0503 19:55:53.694483 (+ 5911us) write_op.cc:270] Start()
0503 19:55:53.694539 (+ 56us) write_op.cc:276] Timestamp: P: 1777838133754316 usec, L: 0
0503 19:55:53.694784 (+ 245us) write_op.cc:270] Start()
0503 19:55:53.694809 (+ 25us) write_op.cc:276] Timestamp: P: 1777838133787331 usec, L: 0
0503 19:55:53.694990 (+ 181us) write_op.cc:270] Start()
0503 19:55:53.695013 (+ 23us) write_op.cc:276] Timestamp: P: 1777838133809681 usec, L: 0
0503 19:55:53.695325 (+ 312us) write_op.cc:270] Start()
0503 19:55:53.695354 (+ 29us) write_op.cc:276] Timestamp: P: 1777838133855667 usec, L: 0
0503 19:55:53.695542 (+ 188us) write_op.cc:270] Start()
0503 19:55:53.695571 (+ 29us) write_op.cc:276] Timestamp: P: 1777838133892767 usec, L: 0
0503 19:55:53.695777 (+ 206us) write_op.cc:270] Start()
0503 19:55:53.695805 (+ 28us) write_op.cc:276] Timestamp: P: 1777838133912453 usec, L: 0
0503 19:55:53.696930 (+ 1125us) write_op.cc:270] Start()
0503 19:55:53.696957 (+ 27us) write_op.cc:276] Timestamp: P: 1777838133913825 usec, L: 0
0503 19:55:53.701423 (+ 4466us) write_op.cc:270] Start()
0503 19:55:53.701458 (+ 35us) write_op.cc:276] Timestamp: P: 1777838133931326 usec, L: 0
0503 19:55:53.725212 (+ 23754us) write_op.cc:270] Start()
0503 19:55:53.725258 (+ 46us) write_op.cc:276] Timestamp: P: 1777838133942256 usec, L: 0
0503 19:55:53.755891 (+ 30633us) write_op.cc:270] Start()
0503 19:55:53.780019 (+ 24128us) write_op.cc:276] Timestamp: P: 1777838133992325 usec, L: 0
0503 19:55:53.782163 (+ 2144us) write_op.cc:270] Start()
0503 19:55:53.782197 (+ 34us) write_op.cc:276] Timestamp: P: 1777838133993672 usec, L: 0
0503 19:55:53.782434 (+ 237us) write_op.cc:270] Start()
0503 19:55:53.782458 (+ 24us) write_op.cc:276] Timestamp: P: 1777838133994348 usec, L: 0
0503 19:55:53.792379 (+ 9921us) write_op.cc:270] Start()
0503 19:55:53.792407 (+ 28us) write_op.cc:276] Timestamp: P: 1777838134035099 usec, L: 0
0503 19:55:53.793080 (+ 673us) write_op.cc:270] Start()
0503 19:55:53.793104 (+ 24us) write_op.cc:276] Timestamp: P: 1777838134051843 usec, L: 0
0503 19:55:53.819987 (+ 26883us) write_op.cc:270] Start()
0503 19:55:53.820017 (+ 30us) write_op.cc:276] Timestamp: P: 1777838134070832 usec, L: 0
0503 19:55:53.840748 (+ 20731us) write_op.cc:270] Start()
0503 19:55:53.840778 (+ 30us) write_op.cc:276] Timestamp: P: 1777838134098912 usec, L: 0
0503 19:55:53.844245 (+ 3467us) write_op.cc:270] Start()
0503 19:55:53.844271 (+ 26us) write_op.cc:276] Timestamp: P: 1777838134100368 usec, L: 0
0503 19:55:53.850941 (+ 6670us) write_op.cc:270] Start()
0503 19:55:53.850976 (+ 35us) write_op.cc:276] Timestamp: P: 1777838134154202 usec, L: 0
0503 19:55:53.867596 (+ 16620us) write_op.cc:270] Start()
0503 19:55:53.873056 (+ 5460us) write_op.cc:276] Timestamp: P: 1777838134159164 usec, L: 0
0503 19:55:53.873368 (+ 312us) write_op.cc:270] Start()
0503 19:55:53.873403 (+ 35us) write_op.cc:276] Timestamp: P: 1777838134163181 usec, L: 0
0503 19:55:53.873580 (+ 177us) write_op.cc:270] Start()
0503 19:55:53.873605 (+ 25us) write_op.cc:276] Timestamp: P: 1777838134197732 usec, L: 0
0503 19:55:53.873766 (+ 161us) write_op.cc:270] Start()
0503 19:55:53.901392 (+ 27626us) write_op.cc:276] Timestamp: P: 1777838134239117 usec, L: 0
0503 19:55:53.904708 (+ 3316us) write_op.cc:270] Start()
0503 19:55:53.904742 (+ 34us) write_op.cc:276] Timestamp: P: 1777838134275258 usec, L: 0
0503 19:55:53.918021 (+ 13279us) write_op.cc:270] Start()
0503 19:55:53.918062 (+ 41us) write_op.cc:276] Timestamp: P: 1777838134276130 usec, L: 0
0503 19:55:53.918288 (+ 226us) write_op.cc:270] Start()
0503 19:55:53.918308 (+ 20us) write_op.cc:276] Timestamp: P: 1777838134292762 usec, L: 0
0503 19:55:53.918768 (+ 460us) write_op.cc:270] Start()
0503 19:55:53.918830 (+ 62us) write_op.cc:276] Timestamp: P: 1777838134336401 usec, L: 0
0503 19:55:53.922299 (+ 3469us) write_op.cc:270] Start()
0503 19:55:53.922337 (+ 38us) write_op.cc:276] Timestamp: P: 1777838134337210 usec, L: 0
0503 19:55:53.927775 (+ 5438us) write_op.cc:270] Start()
0503 19:55:53.927808 (+ 33us) write_op.cc:276] Timestamp: P: 1777838134353945 usec, L: 0
0503 19:55:53.934756 (+ 6948us) write_op.cc:270] Start()
0503 19:55:53.934796 (+ 40us) write_op.cc:276] Timestamp: P: 1777838134369813 usec, L: 0
0503 19:55:53.936642 (+ 1846us) write_op.cc:270] Start()
0503 19:55:53.936670 (+ 28us) write_op.cc:276] Timestamp: P: 1777838134418928 usec, L: 0
0503 19:55:53.936897 (+ 227us) write_op.cc:270] Start()
0503 19:55:53.936921 (+ 24us) write_op.cc:276] Timestamp: P: 1777838134446127 usec, L: 0
0503 19:55:53.937100 (+ 179us) write_op.cc:270] Start()
0503 19:55:53.937126 (+ 26us) write_op.cc:276] Timestamp: P: 1777838134450234 usec, L: 0
0503 19:55:53.943222 (+ 6096us) write_op.cc:270] Start()
0503 19:55:53.943246 (+ 24us) write_op.cc:276] Timestamp: P: 1777838134463154 usec, L: 0
0503 19:55:53.948323 (+ 5077us) write_op.cc:270] Start()
0503 19:55:53.948376 (+ 53us) write_op.cc:276] Timestamp: P: 1777838134504014 usec, L: 0
0503 19:55:53.948611 (+ 235us) write_op.cc:270] Start()
0503 19:55:53.948636 (+ 25us) write_op.cc:276] Timestamp: P: 1777838134530872 usec, L: 0
0503 19:55:53.948805 (+ 169us) write_op.cc:270] Start()
0503 19:55:53.948826 (+ 21us) write_op.cc:276] Timestamp: P: 1777838134547400 usec, L: 0
0503 19:55:53.949067 (+ 241us) write_op.cc:270] Start()
0503 19:55:53.949090 (+ 23us) write_op.cc:276] Timestamp: P: 1777838134548201 usec, L: 0
0503 19:55:53.952410 (+ 3320us) write_op.cc:270] Start()
0503 19:55:53.952441 (+ 31us) write_op.cc:276] Timestamp: P: 1777838134553567 usec, L: 0
0503 19:55:53.952681 (+ 240us) write_op.cc:270] Start()
0503 19:55:53.952707 (+ 26us) write_op.cc:276] Timestamp: P: 1777838134596311 usec, L: 0
0503 19:55:53.952885 (+ 178us) write_op.cc:270] Start()
0503 19:55:53.952908 (+ 23us) write_op.cc:276] Timestamp: P: 1777838134619150 usec, L: 0
0503 19:55:53.953059 (+ 151us) write_op.cc:270] Start()
0503 19:55:53.953078 (+ 19us) write_op.cc:276] Timestamp: P: 1777838134663826 usec, L: 0
0503 19:55:53.953878 (+ 800us) write_op.cc:270] Start()
0503 19:55:53.954116 (+ 238us) write_op.cc:276] Timestamp: P: 1777838134696135 usec, L: 0
0503 19:55:53.995742 (+ 41626us) write_op.cc:270] Start()
0503 19:55:53.995824 (+ 82us) write_op.cc:276] Timestamp: P: 1777838134702556 usec, L: 0
0503 19:55:53.996079 (+ 255us) write_op.cc:270] Start()
0503 19:55:53.996102 (+ 23us) write_op.cc:276] Timestamp: P: 1777838134703303 usec, L: 0
0503 19:55:53.997264 (+ 1162us) write_op.cc:270] Start()
0503 19:55:53.997293 (+ 29us) write_op.cc:276] Timestamp: P: 1777838134758435 usec, L: 0
0503 19:55:53.997494 (+ 201us) write_op.cc:270] Start()
0503 19:55:53.997518 (+ 24us) write_op.cc:276] Timestamp: P: 1777838134782179 usec, L: 0
0503 19:55:53.997678 (+ 160us) write_op.cc:270] Start()
0503 19:55:53.997701 (+ 23us) write_op.cc:276] Timestamp: P: 1777838134854670 usec, L: 0
0503 19:55:53.997853 (+ 152us) write_op.cc:270] Start()
0503 19:55:53.997883 (+ 30us) write_op.cc:276] Timestamp: P: 1777838134872365 usec, L: 0
0503 19:55:54.016760 (+ 18877us) write_op.cc:270] Start()
0503 19:55:54.016791 (+ 31us) write_op.cc:276] Timestamp: P: 1777838134887962 usec, L: 0
0503 19:55:54.021602 (+ 4811us) write_op.cc:270] Start()
0503 19:55:54.021671 (+ 69us) write_op.cc
I20260503 19:55:57.599833 1565 raft_consensus.cc:493] T 3983c88812214bc0bfaaa35c08c38875 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d99e4f4d5ca48e0bdb54daf8361c5e8)
I20260503 19:55:57.600039 1565 raft_consensus.cc:515] T 3983c88812214bc0bfaaa35c08c38875 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:57.605147 1565 leader_election.cc:290] T 3983c88812214bc0bfaaa35c08c38875 P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1219433b66444d091420ceeab5092ef (127.0.105.2:38837), 6d99e4f4d5ca48e0bdb54daf8361c5e8 (127.0.105.3:35005)
I20260503 19:55:57.609059 859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3983c88812214bc0bfaaa35c08c38875" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 989 } } ignore_live_leader: false dest_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" is_pre_election: true
I20260503 19:55:57.624433 729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3983c88812214bc0bfaaa35c08c38875" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 989 } } ignore_live_leader: false dest_uuid: "a1219433b66444d091420ceeab5092ef" is_pre_election: true
I20260503 19:55:57.625186 1356 leader_election.cc:304] T 3983c88812214bc0bfaaa35c08c38875 P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e52aa88a17542609e84f0c09fb85d87; no voters: 6d99e4f4d5ca48e0bdb54daf8361c5e8, a1219433b66444d091420ceeab5092ef
I20260503 19:55:57.628829 1565 raft_consensus.cc:2749] T 3983c88812214bc0bfaaa35c08c38875 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260503 19:55:57.909337 665 consensus_peers.cc:597] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 131: this message will repeat every 5th retry.
W20260503 19:55:58.422739 916 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.105.2:38837, user_credentials={real_user=slave}} blocked reactor thread for 52175.2us
W20260503 19:55:58.771798 1362 log.cc:927] Time spent T d2bf53fe00c2417b872db2ecd4ede593 P 0e52aa88a17542609e84f0c09fb85d87: Append to log took a long time: real 0.064s user 0.004s sys 0.000s
W20260503 19:55:58.790674 666 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.3:35005, user_credentials={real_user=slave}} blocked reactor thread for 114802us
W20260503 19:55:58.931095 666 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.3:35005, user_credentials={real_user=slave}} blocked reactor thread for 78128.2us
W20260503 19:55:59.290560 1362 log.cc:927] Time spent T d2bf53fe00c2417b872db2ecd4ede593 P 0e52aa88a17542609e84f0c09fb85d87: Append to log took a long time: real 0.067s user 0.001s sys 0.000s
I20260503 19:55:59.359575 1429 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.105.3:47337 (request call id 134) took 1765 ms. Trace:
I20260503 19:55:59.359997 1567 raft_consensus.cc:493] T 3983c88812214bc0bfaaa35c08c38875 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d99e4f4d5ca48e0bdb54daf8361c5e8)
I20260503 19:55:59.360159 1567 raft_consensus.cc:515] T 3983c88812214bc0bfaaa35c08c38875 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:59.363471 1567 leader_election.cc:290] T 3983c88812214bc0bfaaa35c08c38875 P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1219433b66444d091420ceeab5092ef (127.0.105.2:38837), 6d99e4f4d5ca48e0bdb54daf8361c5e8 (127.0.105.3:35005)
I20260503 19:55:59.364022 857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3983c88812214bc0bfaaa35c08c38875" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1225 } } ignore_live_leader: false dest_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" is_pre_election: true
I20260503 19:55:59.364593 728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3983c88812214bc0bfaaa35c08c38875" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1225 } } ignore_live_leader: false dest_uuid: "a1219433b66444d091420ceeab5092ef" is_pre_election: true
I20260503 19:55:59.365672 1356 leader_election.cc:304] T 3983c88812214bc0bfaaa35c08c38875 P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e52aa88a17542609e84f0c09fb85d87; no voters: 6d99e4f4d5ca48e0bdb54daf8361c5e8, a1219433b66444d091420ceeab5092ef
I20260503 19:55:59.366282 1567 raft_consensus.cc:2749] T 3983c88812214bc0bfaaa35c08c38875 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 19:55:59.359777 1429 rpcz_store.cc:276] 0503 19:55:57.593656 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 19:55:57.593713 (+ 57us) service_pool.cc:224] Handling call
0503 19:55:57.647593 (+ 53880us) raft_consensus.cc:1471] Updating replica for 236 ops
0503 19:55:57.929787 (+282194us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 19:55:57.929793 (+ 6us) raft_consensus.cc:1539] Triggering prepare for 236 ops
0503 19:55:58.010797 (+ 81004us) write_op.cc:270] Start()
0503 19:55:58.010823 (+ 26us) write_op.cc:276] Timestamp: P: 1777838151530995 usec, L: 0
0503 19:55:58.011020 (+ 197us) write_op.cc:270] Start()
0503 19:55:58.011041 (+ 21us) write_op.cc:276] Timestamp: P: 1777838151550440 usec, L: 0
0503 19:55:58.011263 (+ 222us) write_op.cc:270] Start()
0503 19:55:58.011285 (+ 22us) write_op.cc:276] Timestamp: P: 1777838151554092 usec, L: 0
0503 19:55:58.011435 (+ 150us) write_op.cc:270] Start()
0503 19:55:58.011455 (+ 20us) write_op.cc:276] Timestamp: P: 1777838151603742 usec, L: 0
0503 19:55:58.051383 (+ 39928us) write_op.cc:270] Start()
0503 19:55:58.051408 (+ 25us) write_op.cc:276] Timestamp: P: 1777838151604849 usec, L: 0
0503 19:55:58.057144 (+ 5736us) write_op.cc:270] Start()
0503 19:55:58.057178 (+ 34us) write_op.cc:276] Timestamp: P: 1777838151628600 usec, L: 0
0503 19:55:58.074752 (+ 17574us) write_op.cc:270] Start()
0503 19:55:58.085912 (+ 11160us) write_op.cc:276] Timestamp: P: 1777838151629459 usec, L: 0
0503 19:55:58.095495 (+ 9583us) write_op.cc:270] Start()
0503 19:55:58.095535 (+ 40us) write_op.cc:276] Timestamp: P: 1777838151659031 usec, L: 0
0503 19:55:58.102442 (+ 6907us) write_op.cc:270] Start()
0503 19:55:58.102472 (+ 30us) write_op.cc:276] Timestamp: P: 1777838151704628 usec, L: 0
0503 19:55:58.128322 (+ 25850us) write_op.cc:270] Start()
0503 19:55:58.128366 (+ 44us) write_op.cc:276] Timestamp: P: 1777838151729664 usec, L: 0
0503 19:55:58.128642 (+ 276us) write_op.cc:270] Start()
0503 19:55:58.128668 (+ 26us) write_op.cc:276] Timestamp: P: 1777838151734701 usec, L: 0
0503 19:55:58.128866 (+ 198us) write_op.cc:270] Start()
0503 19:55:58.128886 (+ 20us) write_op.cc:276] Timestamp: P: 1777838151765877 usec, L: 0
0503 19:55:58.129066 (+ 180us) write_op.cc:270] Start()
0503 19:55:58.129085 (+ 19us) write_op.cc:276] Timestamp: P: 1777838151798267 usec, L: 0
0503 19:55:58.129268 (+ 183us) write_op.cc:270] Start()
0503 19:55:58.129289 (+ 21us) write_op.cc:276] Timestamp: P: 1777838151822265 usec, L: 0
0503 19:55:58.130553 (+ 1264us) write_op.cc:270] Start()
0503 19:55:58.130592 (+ 39us) write_op.cc:276] Timestamp: P: 1777838151850888 usec, L: 0
0503 19:55:58.135555 (+ 4963us) write_op.cc:270] Start()
0503 19:55:58.135626 (+ 71us) write_op.cc:276] Timestamp: P: 1777838151851611 usec, L: 0
0503 19:55:58.146486 (+ 10860us) write_op.cc:270] Start()
0503 19:55:58.146547 (+ 61us) write_op.cc:276] Timestamp: P: 1777838151877073 usec, L: 0
0503 19:55:58.148247 (+ 1700us) write_op.cc:270] Start()
0503 19:55:58.148281 (+ 34us) write_op.cc:276] Timestamp: P: 1777838151906000 usec, L: 0
0503 19:55:58.185683 (+ 37402us) write_op.cc:270] Start()
0503 19:55:58.185729 (+ 46us) write_op.cc:276] Timestamp: P: 1777838151950619 usec, L: 0
0503 19:55:58.186329 (+ 600us) write_op.cc:270] Start()
0503 19:55:58.186361 (+ 32us) write_op.cc:276] Timestamp: P: 1777838151958703 usec, L: 0
0503 19:55:58.189602 (+ 3241us) write_op.cc:270] Start()
0503 19:55:58.189639 (+ 37us) write_op.cc:276] Timestamp: P: 1777838151977437 usec, L: 0
0503 19:55:58.196066 (+ 6427us) write_op.cc:270] Start()
0503 19:55:58.196107 (+ 41us) write_op.cc:276] Timestamp: P: 1777838151978167 usec, L: 0
0503 19:55:58.196344 (+ 237us) write_op.cc:270] Start()
0503 19:55:58.196365 (+ 21us) write_op.cc:276] Timestamp: P: 1777838152011389 usec, L: 0
0503 19:55:58.196542 (+ 177us) write_op.cc:270] Start()
0503 19:55:58.196569 (+ 27us) write_op.cc:276] Timestamp: P: 1777838152036565 usec, L: 0
0503 19:55:58.196752 (+ 183us) write_op.cc:270] Start()
0503 19:55:58.196775 (+ 23us) write_op.cc:276] Timestamp: P: 1777838152038068 usec, L: 0
0503 19:55:58.196943 (+ 168us) write_op.cc:270] Start()
0503 19:55:58.196967 (+ 24us) write_op.cc:276] Timestamp: P: 1777838152061995 usec, L: 0
0503 19:55:58.197145 (+ 178us) write_op.cc:270] Start()
0503 19:55:58.197167 (+ 22us) write_op.cc:276] Timestamp: P: 1777838152066643 usec, L: 0
0503 19:55:58.198786 (+ 1619us) write_op.cc:270] Start()
0503 19:55:58.198815 (+ 29us) write_op.cc:276] Timestamp: P: 1777838152128904 usec, L: 0
0503 19:55:58.199325 (+ 510us) write_op.cc:270] Start()
0503 19:55:58.199353 (+ 28us) write_op.cc:276] Timestamp: P: 1777838152138121 usec, L: 0
0503 19:55:58.242154 (+ 42801us) write_op.cc:270] Start()
0503 19:55:58.242198 (+ 44us) write_op.cc:276] Timestamp: P: 1777838152149058 usec, L: 0
0503 19:55:58.242468 (+ 270us) write_op.cc:270] Start()
0503 19:55:58.242495 (+ 27us) write_op.cc:276] Timestamp: P: 1777838152163674 usec, L: 0
0503 19:55:58.244477 (+ 1982us) write_op.cc:270] Start()
0503 19:55:58.244554 (+ 77us) write_op.cc:276] Timestamp: P: 1777838152232850 usec, L: 0
0503 19:55:58.245564 (+ 1010us) write_op.cc:270] Start()
0503 19:55:58.245604 (+ 40us) write_op.cc:276] Timestamp: P: 1777838152235650 usec, L: 0
0503 19:55:58.246044 (+ 440us) write_op.cc:270] Start()
0503 19:55:58.246067 (+ 23us) write_op.cc:276] Timestamp: P: 1777838152238513 usec, L: 0
0503 19:55:58.246269 (+ 202us) write_op.cc:270] Start()
0503 19:55:58.246290 (+ 21us) write_op.cc:276] Timestamp: P: 1777838152239377 usec, L: 0
0503 19:55:58.246470 (+ 180us) write_op.cc:270] Start()
0503 19:55:58.246491 (+ 21us) write_op.cc:276] Timestamp: P: 1777838152274172 usec, L: 0
0503 19:55:58.246675 (+ 184us) write_op.cc:270] Start()
0503 19:55:58.246695 (+ 20us) write_op.cc:276] Timestamp: P: 1777838152284368 usec, L: 0
0503 19:55:58.270134 (+ 23439us) write_op.cc:270] Start()
0503 19:55:58.270459 (+ 325us) write_op.cc:276] Timestamp: P: 1777838152296976 usec, L: 0
0503 19:55:58.277096 (+ 6637us) write_op.cc:270] Start()
0503 19:55:58.277130 (+ 34us) write_op.cc:276] Timestamp: P: 1777838152332252 usec, L: 0
0503 19:55:58.309339 (+ 32209us) write_op.cc:270] Start()
0503 19:55:58.309375 (+ 36us) write_op.cc:276] Timestamp: P: 1777838152334210 usec, L: 0
0503 19:55:58.335193 (+ 25818us) write_op.cc:270] Start()
0503 19:55:58.335231 (+ 38us) write_op.cc:276] Timestamp: P: 1777838152374527 usec, L: 0
0503 19:55:58.335474 (+ 243us) write_op.cc:270] Start()
0503 19:55:58.335501 (+ 27us) write_op.cc:276] Timestamp: P: 1777838152379369 usec, L: 0
0503 19:55:58.337876 (+ 2375us) write_op.cc:270] Start()
0503 19:55:58.337913 (+ 37us) write_op.cc:276] Timestamp: P: 1777838152429249 usec, L: 0
0503 19:55:58.344425 (+ 6512us) write_op.cc:270] Start()
0503 19:55:58.344493 (+ 68us) write_op.cc:276] Timestamp: P: 1777838152434389 usec, L: 0
0503 19:55:58.378930 (+ 34437us) write_op.cc:270] Start()
0503 19:55:58.378956 (+ 26us) write_op.cc:276] Timestamp: P: 1777838152477201 usec, L: 0
0503 19:55:58.398573 (+ 19617us) write_op.cc:270] Start()
0503 19:55:58.398613 (+ 40us) write_op.cc:276] Timestamp: P: 1777838152479479 usec, L: 0
0503 19:55:58.399588 (+ 975us) write_op.cc:270] Start()
0503 19:55:58.399623 (+ 35us) write_op.cc:276] Timestamp: P: 1777838152491519 usec, L: 0
0503 19:55:58.400040 (+ 417us) write_op.cc:270] Start()
0503 19:55:58.400092 (+ 52us) write_op.cc:276] Timestamp: P: 1777838152500703 usec, L: 0
0503 19:55:58.400291 (+ 199us) write_op.cc:270] Start()
0503 19:55:58.400316 (+ 25us) write_op.cc:276] Timestamp: P: 1777838152567341 usec, L: 0
0503 19:55:58.400490 (+ 174us) write_op.cc:270] Start()
0503 19:55:58.400515 (+ 25us) write_op.cc:276] Timestamp: P: 1777838152568760 usec, L: 0
0503 19:55:58.400727 (+ 212us) write_op.cc:270] Start()
0503 19:55:58.400752 (+ 25us) write_op.cc:276] Timestamp: P: 1777838152569596 usec, L: 0
0503 19:55:58.400948 (+ 196us) write_op.cc:270] Start()
0503 19:55:58.400973 (+ 25us) write_op.cc:276] Timestamp: P: 1777838152604104 usec, L: 0
0503 19:55:58.401138 (+ 165us) write_op.cc:270] Start()
0503 19:55:58.401160 (+ 22us) write_op.cc:276] Timestamp: P: 1777838152617270 usec, L: 0
0503 19:55:58.401376 (+ 216us) write_op.cc:270] Start()
0503 19:55:58.401420 (+ 44us) write_op.cc:276] Timestamp: P: 1777838152649907 usec, L: 0
0503 19:55:58.401594 (+ 174us) write_op.cc:270] Start()
0503 19:55:58.401617 (+ 23us) write_op.cc:276] Timestamp: P: 1777838152663971 usec, L: 0
0503 19:55:58.409985 (+ 8368us) write_op.cc:270] Start()
0503 19:55:58.410019 (+ 34us) write_op.cc:276] Timestamp: P: 1777838152697824 usec, L: 0
0503 19:55:58.410272 (+ 253us) write_op.cc:270] Start()
0503 19:55:58.410295 (+ 23us) write_op.cc:276] Timestamp: P: 1777838152714326 usec, L: 0
0503 19:55:58.413802 (+ 3507us) write_op.cc:270] Start()
0503 19:55:58.413956 (+ 154us) write_op.cc:276] Timestamp: P: 1777838152748566 usec, L: 0
0503 19:55:58.430349 (+ 16393us) write_op.cc:270] Start()
0503 19:55:58.430387 (+ 38us) write_op.cc:276] Timestamp: P: 1777838152776026 usec, L: 0
0503 19:55:58.430717 (+ 330us) write_op.cc:270] Start()
0503 19:55:58.450469 (+ 19752us) write_op.cc:276] Timestamp: P: 1777838152794796 usec, L: 0
0503 19:55:58.450746 (+ 277us) write_op.cc:270] Start()
0503 19:55:58.450775 (+ 29us) write_op.cc:276] Timestamp: P: 1777838152798655 usec, L: 0
0503 19:55:58.450988 (+ 213us) write_op.cc:270] Start()
0503 19:55:58.451011 (+ 23us) write_op.cc:276] Timestamp: P: 1777838152872186 usec, L: 0
0503 19:55:58.451167 (+ 156us) write_op.cc:270] Start()
0503 19:55:58.451189 (+ 22us) write_op.cc:276] Timestamp: P: 1777838152872885 usec, L: 0
0503 19:55:58.454453 (+ 3264us) write_op.cc:270] Start()
0503 19:55:58.468061 (+ 13608us) write_op.cc:276] Timestamp: P: 1777838152904636 usec, L: 0
0503 19:55:58.498852 (+ 30791us) write_op.cc:270] Start()
0503 19:55:58.499127 (+ 275us) write_op.cc:276] Timestamp: P: 1777838152942457 usec, L: 0
0503 19:55:58.499779 (+ 652us) write_op.cc:270] Start()
0503 19:55:58.499814 (+ 35us) write_op.cc:276] Timestamp: P: 1777838152970125 usec, L: 0
0503 19:55:58.516264 (+ 16450us) write_op.cc:270] Start()
0503 19:55:58.516293 (+ 29us) write_op.cc:276] Timestamp: P: 1777838152975017 usec, L: 0
0503 19:55:58.536478 (+ 20185us) write_op.cc:270] Start()
0503 19:55:58.536527 (+ 49us) write_op.cc:276] Timestamp: P: 1777838153032865 usec, L: 0
0503 19:55:58.536880 (+ 353us) write_op.cc:270] Start()
0503 19:55:58.537159 (+ 279us) write_op.cc:276] Timestamp: P: 1777838153095636 usec, L: 0
0503 19:55:58.537436 (+ 277us) write_op.cc:270] Start()
0503 19:55:58.537461 (+ 25us) write_op.cc:276] Timestamp: P: 1777838153118850 usec, L: 0
0503 19:55:58.537652 (+ 191us) write_op.cc:270] Start()
0503 19:55:58.537675 (+ 23us) write_op.cc:276] Timestamp: P: 1777838153139158 usec, L: 0
0503 19:55:58.537868 (+ 193us) write_op.cc:270] Start()
0503 19:55:58.537904 (+ 36us) write_op.cc:276] Timestamp: P: 1777838153162458 usec, L: 0
0503 19:55:58.538084 (+ 180us) write_op.cc:270] Start()
0503 19:55:58.538104 (+ 20us) write_op.cc:276] Timestamp: P: 1777838153187623 usec, L: 0
0503 19:55:58.538280 (+ 176us) write_op.cc:270] Start()
0503 19:55:58.538302 (+ 22us) write_op.cc:276] Timestamp: P: 1777838153213696 usec, L: 0
0503 19:55:58.538620 (+ 318us) write_op.cc:270] Start()
0503 19:55:58.538648 (+ 28us) write_op.cc:276] Timestamp: P: 1777838153217144 usec, L: 0
0503 19:55:58.538858 (+ 210us) write_op.cc:270] Start()
0503 19:55:58.538949 (+ 91us) write_op.cc:276] Timestamp: P: 1777838153257796 usec, L: 0
0503 19:55:58.539360 (+ 411us) write_op.cc:270] Start()
0503 19:55:58.539440 (+ 80us) write_op.cc:276] Timestamp: P: 1777838153261109 usec, L: 0
0503 19:55:58.540963 (+ 1523us) write_op.cc:270] Start()
0503 19:55:58.540994 (+ 31us) write_op.cc:276] Timestamp: P: 1777838153261735 usec, L: 0
0503 19:55:58.576738 (+ 35744us) write_op.cc:270] Start()
0503 19:55:58.576770 (+ 32us) write_op.cc:276] Timestamp: P: 1777838153337191 usec, L: 0
0503 19:55:58.578301 (+ 1531us) write_op.cc:270] Start()
0503 19:55:58.578354 (+ 53us) write_op.cc:276] Timestamp: P: 1777838153362612 usec, L: 0
0503 19:55:58.672927 (+ 94573us) write_op.cc:270] Start()
0503 19:55:58.672998 (+ 71us) write_op.cc:276] Timestamp: P: 1777838153372960 usec, L: 0
0503 19:55:58.678245 (+ 5247us) write_op.cc:270] Start()
0503 19:55:58.678279 (+ 34us) write_op.cc:276] Timestamp: P: 1777838153374990 usec, L: 0
0503 19:55:58.743454 (+ 65175us) write_op.cc:270] Start()
0503 19:55:58.743485 (+ 31us) write_op.cc:276] Timestamp: P: 1777838153435565 usec, L: 0
0503 19:55:58.743780 (+ 295us) write_op.cc:270] Start()
0503 19:55:58.743807 (+ 27us) write_op.cc:276] Timestamp: P: 1777838153455381 usec, L: 0
0503 19:55:58.744207 (+ 400us) write_op.cc:270] Start()
0503 19:55:58.744239 (+ 32us) write_op.cc:276] Timestamp: P: 1777838153456143 usec, L: 0
0503 19:55:58.744439 (+ 200us) write_op.cc:270] Start()
0503 19:55:58.744460 (+ 21us) write_op.cc:276] Timestamp: P: 1777838153462967 usec, L: 0
0503 19:55:58.760061 (+ 15601us) write_op.cc:270] Start()
0503 19:55:58.760105 (+ 44us) write_op.cc:276] Timestamp: P: 1777838153536157 usec, L: 0
0503 19:55:58.762214 (+ 2109us) write_op.cc:270] Start()
0503 19:55:58.762252 (+ 38us) write_op.cc:276] Timestamp: P: 1777838153536771 usec, L: 0
0503 19:55:58.762517 (+ 265us) write_op.cc:270] Start()
0503 19:55:58.762543 (+ 26us) write_op.cc:276] Timestamp: P: 1777838153537678 usec, L: 0
0503 19:55:58.762740 (+ 197us) write_op.cc:270] Start()
0503 19:55:58.762762 (+ 22us) write_op.cc:276] Timestamp: P: 1777838153540485 usec, L: 0
0503 19:55:58.782393 (+ 19631us) write_op.cc:270] Start()
0503 19:55:58.782443 (+ 50us) write_op.cc:276] Timestamp: P: 1777838153589388 usec, L: 0
0503 19:55:58.782819 (+ 376us) write_op.cc:270] Start()
0503 19:55:58.782924 (+ 105us) write_op.cc:276] Timestamp: P: 1777838153590076 usec, L: 0
0503 19:55:58.783497 (+ 573us) write_op.cc:270] Start()
0503 19:55:58.783536 (+ 39us) write_op.cc:276] Timestamp: P: 1777838153596733 usec, L: 0
0503 19:55:58.783856 (+ 320us) write_op.cc:270] Start()
0503 19:55:58.783884 (+ 28us) write_op.cc:276] Timestamp: P: 1777838153612444 usec, L: 0
0503 19:55:58.784136 (+ 252us) write_op.cc:270] Start()
0503 19:55:58.784163 (+ 27us) write_op.cc:276] Timestamp: P: 1777838153653274 usec, L: 0
0503 19:55:58.799293 (+ 15130us) write_op.cc:270] Start()
0503 19:55:58.799347 (+ 54us) write_op.cc:276] Timestamp: P: 1777838153653986 usec, L: 0
0503 19:55:58.803010 (+ 3663us) write_op.cc:270] Start()
0503 19:55:58.803042 (+ 32us) write_op.cc:276] Timestamp: P: 1777838153679493 usec, L: 0
0503 19:55:58.804017 (+ 975us) write_op.cc:270] Start()
0503 19:55:58.804042 (+ 25us) write_op.cc:276] Timestamp: P: 1777838153696864 usec, L: 0
0503 19:55:58.804540 (+ 498us) write_op.cc:270] Start()
0503 19:55:58.804562 (+ 22us) write_op.cc:276] Timestamp: P: 1777838153728571 usec, L: 0
0503 19:55:58.805099 (+ 537us) write_op.cc:270] Start()
0503 19:55:58.805124 (+ 25us) write_op.cc:276] Timestamp: P: 1777838153733301 usec, L: 0
0503 19:55:58.805532 (+ 408us) write_op.cc:270] Start()
0503 19:55:58.805554 (+ 22us) write_op.cc:276] Timestamp: P: 1777838153781164 usec, L: 0
0503 19:55:58.806024 (+ 470us) write_op.cc:270] Start()
0503 19:55:58.806046 (+ 22us) write_op.cc:276] Timestamp: P: 1777838153785232 usec, L: 0
0503 19:55:58.806549 (+ 503us) write_op.cc:270] Start()
0503 19:55:58.806570 (+ 21us) write_op.cc:276] Timestamp: P: 1777838153790305 usec, L: 0
0503 19:55:58.806783 (+ 213us) write_op.cc:270] Start()
0503 19:55:58.806806 (+ 23us) write_op.cc:276] Timestamp: P: 1777838153826607 usec, L: 0
0503 19:55:58.808007 (+ 1201us) write_op.cc:270] Start()
0503 19:55:58.808031 (+ 24us) write_op.cc:276] Timestamp: P: 1777838153851987 usec, L: 0
0503 19:55:58.810944 (+ 2913us) write_op.cc:270] Start()
0503 19:55:58.810970 (+ 26us) write_op.cc:276] Timestamp: P: 1777838153859352 usec, L: 0
0503 19:55:58.811489 (+ 519us) write_op.cc:270] Start()
0503 19:55:58.811510 (+ 21us) write_op.cc:276] Timestamp: P: 1777838153916755 usec, L: 0
0503 19:55:58.812332 (+ 822us) write_op.cc:270] Start()
0503 19:55:58.812390 (+ 58us) write_op.cc:276] Timestamp: P: 1777838153918640 usec, L: 0
0503 19:55:58.813849 (+ 1459us) write_op.cc:270] Start()
0503 19:55:58.813875 (+ 26us) write_op.cc:276] Timestamp: P: 1777838153956855 usec, L: 0
0503 19:55:58.814547 (+ 672us) write_op.cc:270] Start()
0503 19:55:58.814569 (+ 22us) write_op.cc:276] Timestamp: P: 1777838153958933 usec, L: 0
0503 19:55:58.824938 (+ 10369us) write_op.cc:270] Start()
0503 19:55:58.824971 (+ 33us) write_op.cc:276] Timestamp: P: 1777838153985080 usec, L: 0
0503 19:55:58.825249 (+ 278us) write_op.cc:270] Start()
0503 19:55:58.825274 (+ 25us) write_op.cc:276] Timestamp: P: 1777838154025104 usec, L: 0
0503 19:55:58.825960 (+ 686us) write_op.cc:270] Start()
0503 19:55:58.825987 (+ 27us) write_op.cc:276] Timestamp: P: 1777838154049186 usec, L: 0
0503 19:55:58.826474 (+ 487us) write_op.cc:270] Start()
0503 19:55:58.826501 (+ 27us) write_op.cc:276] Timestamp: P: 1777838154064425 usec, L: 0
0503 19:55:58.832129 (+ 5628us) write_op.cc:270] Start()
0503 19:55:58.832154 (+ 25us) write_op.cc:276] Timestamp: P: 1777838154067977 usec, L: 0
0503 19:55:58.832401 (+ 247us) write_op.cc:270] Start()
0503 19:55:58.832424 (+ 23us) write_op.cc:276] Timestamp: P: 1777838154108777 usec, L: 0
0503 19:55:58.832876 (+ 452us) write_op.cc:270] Start()
0503 19:55:58.832911 (+ 35us) write_op.cc:276] Timestamp: P: 1777838154171030 usec, L: 0
0503 19:55:58.833385 (+ 474us) write_op.cc:270] Start()
0503 19:55:58.833408 (+ 23us) write_op.cc:276] Timestamp: P: 1777838154186737 usec, L: 0
0503 19:55:58.835698 (+ 2290us) write_op.cc:270] Start()
0503 19:55:58.835731 (+ 33us) write_op.cc:276] Timestamp: P: 1777838154196952 usec, L: 0
0503 19:55:58.838521 (+ 2790us) write_op.cc:270] Start()
0503 19:55:58.838547 (+ 26us) write_op.cc:276] Timestamp: P: 1777838154217317 usec, L: 0
0503 19:55:58.838855 (+ 308us) write_op.cc:270] Start()
0503 19:55:58.838883 (+ 28us) write_op.cc:276] Timestamp: P: 1777838154255531 usec, L: 0
0503 19:55:58.839712 (+ 829us) write_op.cc:270] Start()
0503 19:55:58.839743 (+ 31us) write_op.cc:276] Timestamp: P: 1777838154256193 usec, L: 0
0503 19:55:58.840813 (+ 1070us) write_op.cc:270] Start()
0503 19:55:58.840840 (+ 27us) write_op.cc:276] Timestamp: P: 1777838154260337 usec, L: 0
0503 19:55:58.842531 (+ 1691us) write_op.cc:270] Start()
0503 19:55:58.842564 (+ 33us) write_op.cc:276] Timestamp: P: 1777838154278469 usec, L: 0
0503 19:55:58.843332 (+ 768us) write_op.cc:270] Start()
0503 19:55:58.843393 (+ 61us) write_op.cc:276] Timestamp: P: 1777838154344061 usec, L: 0
0503 19:55:58.850675 (+ 7282us) write_op.cc:270] Start()
0503 19:55:58.850703 (+ 28us) write_op.cc:276] Timestamp: P: 1777838154365613 usec, L: 0
0503 19:55:58.851225 (+ 522us) write_op.cc:270] Start()
0503 19:55:58.851246 (+ 21us) write_op.cc:276] Timestamp: P: 1777838154374594 usec, L: 0
0503 19:55:58.851718 (+ 472us) write_op.cc:270] Start()
0503 19:55:58.851742 (+ 24us) write_op.cc:276] Timestamp: P: 1777838154392119 usec, L: 0
0503 19:55:58.852580 (+ 838us) write_op.cc:270] Start()
0503 19:55:58.852608 (+ 28us) write_op.cc:276] Timestamp: P: 1777838154413767 usec, L: 0
0503 19:55:58.856852 (+ 4244us) write_op.cc:270] Start()
0503 19:55:58.856882 (+ 30us) write_op.cc:276] Timestamp: P: 1777838154464641 usec, L: 0
0503 19:55:58.901374 (+ 44492us) write_op.cc:270] Start()
0503 19:55:58.901486 (+ 112us) write_op.cc:276] Timestamp: P: 1777838154493175 usec, L: 0
0503 19:55:58.903475 (+ 1989us) write_op.cc:270] Start()
0503 19:55:58.903527 (+ 52us) write_op.cc:276] Timestamp: P: 1777838154510702 usec, L: 0
0503 19:55:58.909408 (+ 5881us) write_op.cc:270] Start()
0503 19:55:58.909457 (+ 49us) write_op.cc:276] Timestamp: P: 1777838154574883 usec, L: 0
0503 19:55:58.909741 (+ 284us) write_op.cc:270] Start()
0503 19:55:58.909760 (+ 19us) write_op.cc:276] Timestamp: P: 1777838154577821 usec, L: 0
0503 19:55:58.909909 (+ 149us) write_op.cc:270] Start()
0503 19:55:58.909928 (+ 19us) write_op.cc:276] Timestamp: P: 1777838154587893 usec, L: 0
0503 19:55:58.910103 (+ 175us) write_op.cc:270] Start()
0503 19:55:58.910120 (+ 17us) write_op.cc:276] Timestamp: P: 1777838154625783 usec, L: 0
0503 19:55:58.910594 (+ 474us) write_op.cc:270] Start()
0503 19:55:58.910644 (+ 50us) write_op.cc:276] Timestamp: P: 1777838154675903 usec, L: 0
0503 19:55:58.910938 (+ 294us) write_op.cc:270] Start()
0503 19:55:58.910957 (+ 19us) write_op.cc:276] Timestamp: P: 1777838154676509 usec, L: 0
0503 19:55:58.912357 (+ 1400us) write_op.cc:270] Start()
0503 19:55:58.912380 (+ 23us) write_op.cc:276] Timestamp: P: 1777838154699173 usec, L: 0
0503 19:55:58.912544 (+ 164us) write_op.cc:270] Start()
0503 19:55:58.912563 (+ 19us) write_op.cc:276] Timestamp: P: 1777838154699873 usec, L: 0
0503 19:55:58.912845 (+ 282us) write_op.cc:270] Start()
0503 19:55:58.912868 (+ 23us) write_op.cc:276] Timestamp: P: 1777838154719101 usec, L: 0
0503 19:55:58.913079 (+ 211us) write_op.cc:270] Start()
0503 19:55:58.913099 (+ 20us) write_op.cc:276] Timestamp: P: 1777838154755189 usec, L: 0
0503 19:55:58.915818 (+ 2719us) write_op.cc:270] Start()
0503 19:55:58.915891 (+ 73us) write_op.cc:276] Timestamp: P: 1777838154755859 usec, L: 0
0503 19:55:58.916371 (+ 480us) write_op.cc:270] Start()
0503 19:55:58.916399 (+ 28us) write_op.cc:276] Timestamp: P: 1777838154805089 usec, L: 0
0503 19:55:58.916617 (+ 218us) write_op.cc:270] Start()
0503 19:55:58.916637 (+ 20us) write_op.cc:276] Timestamp: P: 1777838154809142 usec, L: 0
0503 19:55:58.916896 (+ 259us) write_op.cc:270] Start()
0503 19:55:58.916916 (+ 20us) write_op.cc:276] Timestamp: P: 1777838154847684 usec, L: 0
0503 19:55:58.918207 (+ 1291us) write_op.cc:270] Start()
0503 19:55:58.918237 (+ 30us) write_op.cc:276] Timestamp: P: 1777838154851052 usec, L: 0
0503 19:55:58.918439 (+ 202us) write_op.cc:270] Start()
0503 19:55:58.918458 (+ 19us) write_op.cc:276] Timestamp: P: 1777838154896273 usec, L: 0
0503 19:55:58.918604 (+ 146us) write_op.cc:270] Start()
0503 19:55:58.918620 (+ 16us) write_op.cc:276] Timestamp: P: 1777838154898112 usec, L: 0
0503 19:55:58.932014 (+ 13394us) write_op.cc:270] Start()
0503 19:55:58.932057 (+ 43us) write_op.cc:276] Timestamp: P: 1777838154916937 usec, L: 0
0503 19:55:58.964632 (+ 32575us) write_op.cc:270] Start()
0503 19:55:58.964667 (+ 35us) write_op.cc:276] Timestamp: P: 1777838154940555 usec, L: 0
0503 19:55:58.965554 (+ 887us) write_op.cc:270] Start()
0503 19:55:58.965582 (+ 28us) write_op.cc:276] Timestamp: P: 1777838154963439 usec, L: 0
0503 19:55:58.966630 (+ 1048us) write_op.cc:270] Start()
0503 19:55:58.974509 (+ 7879us) write_op.cc:276] Timestamp: P: 1777838154969236 usec, L: 0
0503 19:55:58.974788 (+ 279us) write_op.cc:270] Start()
0503 19:55:58.974819 (+ 31us) write_op.cc:276] Timestamp: P: 1777838155008498 usec, L: 0
0503 19:55:58.975011 (+ 192us) write_op.cc:270] Start()
0503 19:55:58.975031 (+ 20us) write_op.cc:276] Timestamp: P: 1777838155021995 usec, L: 0
0503 19:55:58.975207 (+ 176us) write_op.cc:270] Start()
0503 19:55:58.975225 (+ 18us) write_op.cc:276] Timestamp: P: 1777838155061005 usec, L: 0
0503 19:55:58.975401 (+ 176us) write_op.cc:270] Start()
0503 19:55:58.975417 (+ 16us) write_op.cc:276] Timestamp: P: 1777838155067152 usec, L: 0
0503 19:55:58.975609 (+ 192us) write_op.cc:270] Start()
0503 19:55:58.975629 (+ 20us) write_op.cc:276] Timestamp: P: 1777838155082242 usec, L: 0
0503 19:55:58.975832 (+ 203us) write_op.cc:270] Start()
0503 19:55:58.975852 (+ 20us) write_op.cc:276] Timestamp: P: 1777838155108379 usec, L: 0
0503 19:55:58.976026 (+ 174us) write_op.cc:270] Start()
0503 19:55:58.976044 (+ 18us) write_op.cc:276] Timestamp: P: 1777838155134674 usec, L: 0
0503 19:55:58.976232 (+ 188us) write_op.cc:270] Start()
0503 19:55:58.976250 (+ 18us) write_op.cc:276] Timestamp: P: 1777838155157220 usec, L: 0
0503 19:55:58.976696 (+ 446us) write_op.cc:270] Start()
0503 19:55:58.976727 (+ 31us) write_op.cc:276] Timestamp: P: 1777838155204906 usec, L: 0
0503 19:55:58.977196 (+ 469us) write_op.cc:270] Start()
0503 19:55:58.977223 (+ 27us) write_op.cc:276] Timestamp: P: 1777838155206661 usec, L: 0
0503 19:55:58.977448 (+ 225us) write_op.cc:270] Start()
0503 19:55:58.977470 (+ 22us) write_op.cc:276] Timestamp: P: 1777838155241411 usec, L: 0
0503 19:55:58.977919 (+ 449us) write_op.cc:270] Start()
0503 19:55:58.977949 (+ 30us) write_op.cc:276] Timestamp: P: 1777838155253847 usec, L: 0
0503 19:55:58.978202 (+ 253us) write_op.cc:270] Start()
0503 19:55:58.978227 (+ 25us) write_op.cc:276] Timestamp: P: 1777838155307653 usec, L: 0
0503 19:55:58.978518 (+ 291us) write_op.cc:270] Start()
0503 19:55:58.978546 (+ 28us) write_op.cc:276] Timestamp: P: 1777838155323290 usec, L: 0
0503 19:55:58.978762 (+ 216us) write_op.cc:270] Start()
0503 19:55:58.978787 (+ 25us) write_op.cc:276] Timestamp: P: 1777838155324390 usec, L: 0
0503 19:55:58.983885 (+ 5098us) write_op.cc:270] Start()
0503 19:55:58.983922 (+ 37us) write_op.cc:276] Timestamp: P: 1777838155352311 usec, L: 0
0503 19:55:58.984364 (+ 442us) write_op.cc:270] Start()
0503 19:55:58.984428 (+ 64us) write_op.cc:276] Timestamp: P: 1777838155398353 usec, L: 0
0503 19:55:58.984889 (+ 461us) write_op.cc:270] Start()
0503 19:55:58.985491 (+ 602us) write_op.cc:276] Timestamp: P: 1777838155427584 usec, L: 0
0503 19:55:58.986257 (+ 766us) write_op.cc:270] Start()
0503 19:55:58.986285 (+ 28us) write_op.cc:276] Timestamp: P: 1777838155428651 usec, L: 0
0503 19:55:58.986466 (+ 181us) write_op.cc:270] Start()
0503 19:55:58.986488 (+ 22us) write_op.cc:276] Timestamp: P: 1777838155460796 usec, L: 0
0503 19:55:58.986636 (+ 148us) write_op.cc:270] Start()
0503 19:55:58.986656 (+ 20us) write_op.cc:276] Timestamp: P: 1777838155492710 usec, L: 0
0503 19:55:58.986816 (+ 160us) write_op.cc:270] Start()
0503 19:55:58.987081 (+ 265us) write_op.cc:276] Timestamp: P: 1777838155497953 usec, L: 0
0503 19:55:59.051865 (+ 64784us) write_op.cc:270] Start()
0503 19:55:59.051907 (+ 42us) write_op.cc:276] Timestamp: P: 1777838155524531 usec, L: 0
0503 19:55:59.052116 (+ 209us) write_op.cc:270] Start()
0503 19:55:59.052134 (+ 18us) write_op.cc:276] Timestamp: P: 1777838155530473 usec, L: 0
0503 19:55:59.052330 (+ 196us) write_op.cc:270] Start()
0503 19:55:59.052348 (+ 18us) write_op.cc:276] Timestamp: P: 1777838155577652 usec, L: 0
0503 19:55:59.052494 (+ 146us) write_op.cc:270] Start()
0503 19:55:59.052511 (+ 17us) write_op.cc:276] Timestamp: P: 1777838155580834 usec, L: 0
0503 19:55:59.052660 (+ 149us) write_op.cc:270] Start()
0503 19:55:59.052678 (+ 18us) write_op.cc:276] Timestamp: P: 1777838155623981 usec, L: 0
0503 19:55:59.052832 (+ 154us) write_op.cc:270] Start()
0503 19:55:59.052869 (+ 37us) write_op.cc:276] Timestamp: P: 1777838155634937 usec, L: 0
0503 19:55:59.053031 (+ 162us) write_op.cc:270] Start()
0503 19:55:59.053050 (+ 19us) write_op.cc:276] Timestamp: P: 1777838155636491 usec, L: 0
0503 19:55:59.053239 (+ 189us) write_op.cc:270] Start()
0503 19:55:59.053259 (+ 20us) write_op.cc:276] Timestamp: P: 1777838155678228 usec, L: 0
0503 19:55:59.053408 (+ 149us) write_op.cc:270] Start()
0503 19:55:59.053427 (+ 19us) write_op.cc:276] Timestamp: P: 1777838155738687 usec, L: 0
0503 19:55:59.053578 (+ 151us) write_op.cc:270] Start()
0503 19:55:59.053595 (+ 17us) write_op.cc:276] Timestamp: P: 1777838155741362 usec, L: 0
0503 19:55:59.053729 (+ 134us) write_op.cc:270] Start()
0503 19:55:59.053747 (+ 18us) write_op.cc:276] Timestamp: P: 1777838155779463 usec, L: 0
0503 19:55:59.053884 (+ 137us) write_op.cc:270] Start()
0503 19:55:59.053913 (+ 29us) write_op.cc:276] Timestamp: P: 1777838155787633 usec, L: 0
0503 19:55:59.054071 (+ 158us) write_op.cc:270] Start()
0503 19:55:59.054091 (+ 20us) write_op.cc:276] Timestamp: P: 1777838155897336 usec, L: 0
0503 19:55:59.054277 (+ 186us) write_op.cc:270] Start()
0503 19:55:59.054296 (+ 19us) write_op.cc:276] Timestamp: P: 1777838155899998 usec, L: 0
0503 19:55:59.054433 (+ 137us) write_op.cc:270] Start()
0503 19:55:59.054452 (+ 19us) write_op.cc:276] Timestamp: P: 1777838155925268 usec, L: 0
0503 19:55:59.054601 (+ 149us) write_op.cc:270] Start()
0503 19:55:59.054619 (+ 18us) write_op.cc:276] Timestamp: P: 1777838155937486 usec, L: 0
0503 19:55:59.054845 (+ 226us) write_op.cc:270] Start()
0503 19:55:59.054865 (+ 20us) write_op.cc:276] Timestamp: P: 1777838155991583 usec, L: 0
0503 19:55:59.055059 (+ 194us) write_op.cc:270] Start()
0503 19:55:59.055077 (+ 18us) write_op.cc:276] Timestamp: P: 1777838155995898 usec, L: 0
0503 19:55:59.055264 (+ 187us) write_op.cc:270] Start()
0503 19:55:59.055286 (+ 22us) write_op.cc:276] Timestamp: P: 1777838156026493 usec, L: 0
0503 19:55:59.055463 (+ 177us) write_op.cc:270] Start()
0503 19:55:59.055481 (+ 18us) write_op.cc:276] Timestamp: P: 1777838156030127 usec, L: 0
0503 19:55:59.064716 (+ 9235us) write_op.cc:270] Start()
0503 19:55:59.064752 (+ 36us) write_op.cc:276] Timestamp: P: 1777838156066490 usec, L: 0
0503 19:55:59.065511 (+ 759us) write_op.cc:270] Start()
0503 19:55:59.065544 (+ 33us) write_op.cc:276] Timestamp: P: 17778381
I20260503 19:55:59.954977 1362 tablet_bootstrap.cc:492] T d2bf53fe00c2417b872db2ecd4ede593 P 0e52aa88a17542609e84f0c09fb85d87: Bootstrap replayed 1/1 log segments. Stats: ops{read=163 overwritten=0 applied=161 ignored=0} inserts{seen=1336 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 2 replicates
I20260503 19:55:59.955559 1362 tablet_bootstrap.cc:492] T d2bf53fe00c2417b872db2ecd4ede593 P 0e52aa88a17542609e84f0c09fb85d87: Bootstrap complete.
I20260503 19:55:59.956977 1362 ts_tablet_manager.cc:1403] T d2bf53fe00c2417b872db2ecd4ede593 P 0e52aa88a17542609e84f0c09fb85d87: Time spent bootstrapping tablet: real 3.926s user 0.384s sys 0.029s
I20260503 19:55:59.957764 1362 raft_consensus.cc:359] T d2bf53fe00c2417b872db2ecd4ede593 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Replica starting. Triggering 2 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:55:59.958505 1362 raft_consensus.cc:740] T d2bf53fe00c2417b872db2ecd4ede593 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e52aa88a17542609e84f0c09fb85d87, State: Initialized, Role: FOLLOWER
I20260503 19:55:59.958753 1362 consensus_queue.cc:260] T d2bf53fe00c2417b872db2ecd4ede593 P 0e52aa88a17542609e84f0c09fb85d87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 161, Last appended: 1.163, Last appended by leader: 163, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:56:00.009522 1362 ts_tablet_manager.cc:1434] T d2bf53fe00c2417b872db2ecd4ede593 P 0e52aa88a17542609e84f0c09fb85d87: Time spent starting tablet: real 0.052s user 0.005s sys 0.000s
I20260503 19:56:00.171814 1436 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.105.2:39423 (request call id 174) took 4099 ms. Trace:
I20260503 19:56:00.174294 1547 raft_consensus.cc:493] T 4d80fc29b7a64074b4a2ce4003054d1a P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a1219433b66444d091420ceeab5092ef)
I20260503 19:56:00.174444 1547 raft_consensus.cc:515] T 4d80fc29b7a64074b4a2ce4003054d1a P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:56:00.177589 1547 leader_election.cc:290] T 4d80fc29b7a64074b4a2ce4003054d1a P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1219433b66444d091420ceeab5092ef (127.0.105.2:38837), 6d99e4f4d5ca48e0bdb54daf8361c5e8 (127.0.105.3:35005)
I20260503 19:56:00.178316 857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d80fc29b7a64074b4a2ce4003054d1a" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1180 } } ignore_live_leader: false dest_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" is_pre_election: true
I20260503 19:56:00.179090 728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d80fc29b7a64074b4a2ce4003054d1a" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1180 } } ignore_live_leader: false dest_uuid: "a1219433b66444d091420ceeab5092ef" is_pre_election: true
I20260503 19:56:00.179801 1356 leader_election.cc:304] T 4d80fc29b7a64074b4a2ce4003054d1a P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e52aa88a17542609e84f0c09fb85d87; no voters: 6d99e4f4d5ca48e0bdb54daf8361c5e8, a1219433b66444d091420ceeab5092ef
I20260503 19:56:00.180091 1547 raft_consensus.cc:2749] T 4d80fc29b7a64074b4a2ce4003054d1a P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 19:56:00.228133 1387 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:58682 (request call id 31) took 7707 ms. Trace:
I20260503 19:56:00.228266 1387 rpcz_store.cc:276] 0503 19:55:52.520347 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 19:55:52.520405 (+ 58us) service_pool.cc:224] Handling call
0503 19:55:56.505263 (+3984858us) spinlock_profiling.cc:243] Waited 3.98 s on lock 0x616000019c54. stack: 00007f2b5ee49086 00007f2b5ee48e40 00007f2b5de023ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007f2b6ad5b8c0 00007f2b6ec16eaf 00007f2b6902ec36 00007f2b6902e965 00007f2b65e3c10e 00007f2b65e3afee 00007f2b65e41228 00007f2b65e41b8f 00007f2b65e419b8 0000000000aa4cac
0503 19:55:56.569322 (+ 64059us) spinlock_profiling.cc:243] Waited 63.7 ms on lock 0x616000019654. stack: 00007f2b5ee49086 00007f2b5ee48e40 00007f2b5de023ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007f2b6ad5b8c0 00007f2b6ec16eaf 00007f2b6902ec36 00007f2b6902e965 00007f2b65e3c10e 00007f2b65e3afee 00007f2b65e41228 00007f2b65e41b8f 00007f2b65e419b8 0000000000aa4cac
0503 19:56:00.175756 (+3606434us) spinlock_profiling.cc:243] Waited 3.6 s on lock 0x61600001a254. stack: 00007f2b5ee49086 00007f2b5ee48e40 00007f2b5de023ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007f2b6ad5b8c0 00007f2b6ec16eaf 00007f2b6902ec36 00007f2b6902e965 00007f2b65e3c10e 00007f2b65e3afee 00007f2b65e41228 00007f2b65e41b8f 00007f2b65e419b8 0000000000aa4cac
0503 19:56:00.227826 (+ 52070us) spinlock_profiling.cc:243] Waited 14.5 ms on lock 0x616000019054. stack: 00007f2b5ee49086 00007f2b5ee48e40 00007f2b5de023ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007f2b6ad5b8c0 00007f2b6ec16eaf 00007f2b6902ec36 00007f2b6902e965 00007f2b65e3c10e 00007f2b65e3afee 00007f2b65e41228 00007f2b65e41b8f 00007f2b65e419b8 0000000000aa4cac
0503 19:56:00.228097 (+ 271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17626097408}
I20260503 19:56:00.462224 1430 raft_consensus.cc:3060] T d2bf53fe00c2417b872db2ecd4ede593 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Advancing to term 2
I20260503 19:56:00.543807 1582 raft_consensus.cc:493] T 4d80fc29b7a64074b4a2ce4003054d1a P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a1219433b66444d091420ceeab5092ef)
I20260503 19:56:00.544036 1582 raft_consensus.cc:515] T 4d80fc29b7a64074b4a2ce4003054d1a P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:56:00.545038 1582 leader_election.cc:290] T 4d80fc29b7a64074b4a2ce4003054d1a P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1219433b66444d091420ceeab5092ef (127.0.105.2:38837), 6d99e4f4d5ca48e0bdb54daf8361c5e8 (127.0.105.3:35005)
I20260503 19:56:00.545346 858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d80fc29b7a64074b4a2ce4003054d1a" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1180 } } ignore_live_leader: false dest_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" is_pre_election: true
I20260503 19:56:00.546240 728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d80fc29b7a64074b4a2ce4003054d1a" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1180 } } ignore_live_leader: false dest_uuid: "a1219433b66444d091420ceeab5092ef" is_pre_election: true
I20260503 19:56:00.546741 1356 leader_election.cc:304] T 4d80fc29b7a64074b4a2ce4003054d1a P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e52aa88a17542609e84f0c09fb85d87; no voters: 6d99e4f4d5ca48e0bdb54daf8361c5e8, a1219433b66444d091420ceeab5092ef
I20260503 19:56:00.555817 1582 raft_consensus.cc:2749] T 4d80fc29b7a64074b4a2ce4003054d1a P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 19:56:00.565083 1430 pending_rounds.cc:85] T d2bf53fe00c2417b872db2ecd4ede593 P 0e52aa88a17542609e84f0c09fb85d87: Aborting all ops after (but not including) 162
I20260503 19:56:00.617746 1430 pending_rounds.cc:107] T d2bf53fe00c2417b872db2ecd4ede593 P 0e52aa88a17542609e84f0c09fb85d87: Aborting uncommitted WRITE_OP operation due to leader change: 1.163
I20260503 19:56:01.104669 1582 raft_consensus.cc:493] T 4d80fc29b7a64074b4a2ce4003054d1a P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a1219433b66444d091420ceeab5092ef)
I20260503 19:56:01.104856 1582 raft_consensus.cc:515] T 4d80fc29b7a64074b4a2ce4003054d1a P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:56:01.105554 1582 leader_election.cc:290] T 4d80fc29b7a64074b4a2ce4003054d1a P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1219433b66444d091420ceeab5092ef (127.0.105.2:38837), 6d99e4f4d5ca48e0bdb54daf8361c5e8 (127.0.105.3:35005)
I20260503 19:56:01.106568 862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d80fc29b7a64074b4a2ce4003054d1a" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1180 } } ignore_live_leader: false dest_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" is_pre_election: true
I20260503 19:56:01.107546 728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d80fc29b7a64074b4a2ce4003054d1a" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1180 } } ignore_live_leader: false dest_uuid: "a1219433b66444d091420ceeab5092ef" is_pre_election: true
I20260503 19:56:01.108232 1356 leader_election.cc:304] T 4d80fc29b7a64074b4a2ce4003054d1a P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e52aa88a17542609e84f0c09fb85d87; no voters: 6d99e4f4d5ca48e0bdb54daf8361c5e8, a1219433b66444d091420ceeab5092ef
I20260503 19:56:01.109465 1582 raft_consensus.cc:2749] T 4d80fc29b7a64074b4a2ce4003054d1a P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 19:56:00.174028 1436 rpcz_store.cc:276] 0503 19:55:56.072576 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 19:55:56.073445 (+ 869us) service_pool.cc:224] Handling call
0503 19:55:56.155675 (+ 82230us) raft_consensus.cc:1471] Updating replica for 1017 ops
0503 19:55:56.345502 (+189827us) raft_consensus.cc:1534] Early marking committed up to index 163
0503 19:55:56.360773 (+ 15271us) write_op.cc:489] Releasing partition, row and schema locks
0503 19:55:56.360782 (+ 9us) write_op.cc:454] Released schema lock
0503 19:55:56.369246 (+ 8464us) write_op.cc:489] Releasing partition, row and schema locks
0503 19:55:56.369250 (+ 4us) write_op.cc:454] Released schema lock
0503 19:55:56.369416 (+ 166us) raft_consensus.cc:1539] Triggering prepare for 1017 ops
0503 19:55:56.373369 (+ 3953us) write_op.cc:270] Start()
0503 19:55:56.373403 (+ 34us) write_op.cc:276] Timestamp: P: 1777838130496960 usec, L: 0
0503 19:55:56.374196 (+ 793us) write_op.cc:270] Start()
0503 19:55:56.374223 (+ 27us) write_op.cc:276] Timestamp: P: 1777838130500156 usec, L: 0
0503 19:55:56.374902 (+ 679us) write_op.cc:270] Start()
0503 19:55:56.374929 (+ 27us) write_op.cc:276] Timestamp: P: 1777838131210209 usec, L: 0
0503 19:55:56.376218 (+ 1289us) write_op.cc:270] Start()
0503 19:55:56.376254 (+ 36us) write_op.cc:276] Timestamp: P: 1777838131256332 usec, L: 0
0503 19:55:56.377284 (+ 1030us) write_op.cc:270] Start()
0503 19:55:56.377317 (+ 33us) write_op.cc:276] Timestamp: P: 1777838131301090 usec, L: 0
0503 19:55:56.378238 (+ 921us) write_op.cc:270] Start()
0503 19:55:56.378267 (+ 29us) write_op.cc:276] Timestamp: P: 1777838131312847 usec, L: 0
0503 19:55:56.379502 (+ 1235us) write_op.cc:270] Start()
0503 19:55:56.379537 (+ 35us) write_op.cc:276] Timestamp: P: 1777838131323672 usec, L: 0
0503 19:55:56.385532 (+ 5995us) write_op.cc:270] Start()
0503 19:55:56.385577 (+ 45us) write_op.cc:276] Timestamp: P: 1777838131346749 usec, L: 0
0503 19:55:56.391772 (+ 6195us) write_op.cc:270] Start()
0503 19:55:56.391805 (+ 33us) write_op.cc:276] Timestamp: P: 1777838131365086 usec, L: 0
0503 19:55:56.400690 (+ 8885us) write_op.cc:270] Start()
0503 19:55:56.400724 (+ 34us) write_op.cc:276] Timestamp: P: 1777838131380866 usec, L: 0
0503 19:55:56.403231 (+ 2507us) write_op.cc:270] Start()
0503 19:55:56.403260 (+ 29us) write_op.cc:276] Timestamp: P: 1777838131395290 usec, L: 0
0503 19:55:56.403447 (+ 187us) write_op.cc:270] Start()
0503 19:55:56.403471 (+ 24us) write_op.cc:276] Timestamp: P: 1777838131419165 usec, L: 0
0503 19:55:56.413369 (+ 9898us) write_op.cc:270] Start()
0503 19:55:56.413416 (+ 47us) write_op.cc:276] Timestamp: P: 1777838131455589 usec, L: 0
0503 19:55:56.413750 (+ 334us) write_op.cc:270] Start()
0503 19:55:56.413778 (+ 28us) write_op.cc:276] Timestamp: P: 1777838131463029 usec, L: 0
0503 19:55:56.414025 (+ 247us) write_op.cc:270] Start()
0503 19:55:56.414050 (+ 25us) write_op.cc:276] Timestamp: P: 1777838131467461 usec, L: 0
0503 19:55:56.414208 (+ 158us) write_op.cc:270] Start()
0503 19:55:56.414228 (+ 20us) write_op.cc:276] Timestamp: P: 1777838131493784 usec, L: 0
0503 19:55:56.414402 (+ 174us) write_op.cc:270] Start()
0503 19:55:56.414434 (+ 32us) write_op.cc:276] Timestamp: P: 1777838131532051 usec, L: 0
0503 19:55:56.414583 (+ 149us) write_op.cc:270] Start()
0503 19:55:56.414608 (+ 25us) write_op.cc:276] Timestamp: P: 1777838131540619 usec, L: 0
0503 19:55:56.414744 (+ 136us) write_op.cc:270] Start()
0503 19:55:56.414762 (+ 18us) write_op.cc:276] Timestamp: P: 1777838131541345 usec, L: 0
0503 19:55:56.414883 (+ 121us) write_op.cc:270] Start()
0503 19:55:56.414902 (+ 19us) write_op.cc:276] Timestamp: P: 1777838131545895 usec, L: 0
0503 19:55:56.415063 (+ 161us) write_op.cc:270] Start()
0503 19:55:56.415083 (+ 20us) write_op.cc:276] Timestamp: P: 1777838131586847 usec, L: 0
0503 19:55:56.415256 (+ 173us) write_op.cc:270] Start()
0503 19:55:56.415297 (+ 41us) write_op.cc:276] Timestamp: P: 1777838131589473 usec, L: 0
0503 19:55:56.415469 (+ 172us) write_op.cc:270] Start()
0503 19:55:56.415490 (+ 21us) write_op.cc:276] Timestamp: P: 1777838131611314 usec, L: 0
0503 19:55:56.435260 (+ 19770us) write_op.cc:270] Start()
0503 19:55:56.435306 (+ 46us) write_op.cc:276] Timestamp: P: 1777838131616638 usec, L: 0
0503 19:55:56.435546 (+ 240us) write_op.cc:270] Start()
0503 19:55:56.435571 (+ 25us) write_op.cc:276] Timestamp: P: 1777838131656150 usec, L: 0
0503 19:55:56.435782 (+ 211us) write_op.cc:270] Start()
0503 19:55:56.435804 (+ 22us) write_op.cc:276] Timestamp: P: 1777838131661034 usec, L: 0
0503 19:55:56.435967 (+ 163us) write_op.cc:270] Start()
0503 19:55:56.435987 (+ 20us) write_op.cc:276] Timestamp: P: 1777838131667504 usec, L: 0
0503 19:55:56.436131 (+ 144us) write_op.cc:270] Start()
0503 19:55:56.436152 (+ 21us) write_op.cc:276] Timestamp: P: 1777838131686506 usec, L: 0
0503 19:55:56.436320 (+ 168us) write_op.cc:270] Start()
0503 19:55:56.436341 (+ 21us) write_op.cc:276] Timestamp: P: 1777838131724448 usec, L: 0
0503 19:55:56.436479 (+ 138us) write_op.cc:270] Start()
0503 19:55:56.436499 (+ 20us) write_op.cc:276] Timestamp: P: 1777838131727769 usec, L: 0
0503 19:55:56.436652 (+ 153us) write_op.cc:270] Start()
0503 19:55:56.436673 (+ 21us) write_op.cc:276] Timestamp: P: 1777838131730713 usec, L: 0
0503 19:55:56.436808 (+ 135us) write_op.cc:270] Start()
0503 19:55:56.436831 (+ 23us) write_op.cc:276] Timestamp: P: 1777838131768267 usec, L: 0
0503 19:55:56.437016 (+ 185us) write_op.cc:270] Start()
0503 19:55:56.437042 (+ 26us) write_op.cc:276] Timestamp: P: 1777838131792630 usec, L: 0
0503 19:55:56.437206 (+ 164us) write_op.cc:270] Start()
0503 19:55:56.437227 (+ 21us) write_op.cc:276] Timestamp: P: 1777838131798846 usec, L: 0
0503 19:55:56.437373 (+ 146us) write_op.cc:270] Start()
0503 19:55:56.437394 (+ 21us) write_op.cc:276] Timestamp: P: 1777838131809637 usec, L: 0
0503 19:55:56.437530 (+ 136us) write_op.cc:270] Start()
0503 19:55:56.437551 (+ 21us) write_op.cc:276] Timestamp: P: 1777838131833719 usec, L: 0
0503 19:55:56.437685 (+ 134us) write_op.cc:270] Start()
0503 19:55:56.437716 (+ 31us) write_op.cc:276] Timestamp: P: 1777838131854853 usec, L: 0
0503 19:55:56.437866 (+ 150us) write_op.cc:270] Start()
0503 19:55:56.437888 (+ 22us) write_op.cc:276] Timestamp: P: 1777838131865143 usec, L: 0
0503 19:55:56.438060 (+ 172us) write_op.cc:270] Start()
0503 19:55:56.438086 (+ 26us) write_op.cc:276] Timestamp: P: 1777838131885463 usec, L: 0
0503 19:55:56.438394 (+ 308us) write_op.cc:270] Start()
0503 19:55:56.438421 (+ 27us) write_op.cc:276] Timestamp: P: 1777838131909359 usec, L: 0
0503 19:55:56.445167 (+ 6746us) write_op.cc:270] Start()
0503 19:55:56.445202 (+ 35us) write_op.cc:276] Timestamp: P: 1777838131911434 usec, L: 0
0503 19:55:56.445376 (+ 174us) write_op.cc:270] Start()
0503 19:55:56.445400 (+ 24us) write_op.cc:276] Timestamp: P: 1777838131979326 usec, L: 0
0503 19:55:56.445555 (+ 155us) write_op.cc:270] Start()
0503 19:55:56.445576 (+ 21us) write_op.cc:276] Timestamp: P: 1777838131981239 usec, L: 0
0503 19:55:56.445748 (+ 172us) write_op.cc:270] Start()
0503 19:55:56.445771 (+ 23us) write_op.cc:276] Timestamp: P: 1777838131982274 usec, L: 0
0503 19:55:56.446221 (+ 450us) write_op.cc:270] Start()
0503 19:55:56.446249 (+ 28us) write_op.cc:276] Timestamp: P: 1777838131991055 usec, L: 0
0503 19:55:56.446553 (+ 304us) write_op.cc:270] Start()
0503 19:55:56.446586 (+ 33us) write_op.cc:276] Timestamp: P: 1777838132036717 usec, L: 0
0503 19:55:56.503826 (+ 57240us) write_op.cc:270] Start()
0503 19:55:56.503881 (+ 55us) write_op.cc:276] Timestamp: P: 1777838132047226 usec, L: 0
0503 19:55:56.504231 (+ 350us) write_op.cc:270] Start()
0503 19:55:56.504260 (+ 29us) write_op.cc:276] Timestamp: P: 1777838132048726 usec, L: 0
0503 19:55:56.504451 (+ 191us) write_op.cc:270] Start()
0503 19:55:56.504474 (+ 23us) write_op.cc:276] Timestamp: P: 1777838132050250 usec, L: 0
0503 19:55:56.504626 (+ 152us) write_op.cc:270] Start()
0503 19:55:56.504648 (+ 22us) write_op.cc:276] Timestamp: P: 1777838132088959 usec, L: 0
0503 19:55:56.504781 (+ 133us) write_op.cc:270] Start()
0503 19:55:56.504800 (+ 19us) write_op.cc:276] Timestamp: P: 1777838132104742 usec, L: 0
0503 19:55:56.504948 (+ 148us) write_op.cc:270] Start()
0503 19:55:56.504977 (+ 29us) write_op.cc:276] Timestamp: P: 1777838132105535 usec, L: 0
0503 19:55:56.505186 (+ 209us) write_op.cc:270] Start()
0503 19:55:56.505209 (+ 23us) write_op.cc:276] Timestamp: P: 1777838132123700 usec, L: 0
0503 19:55:56.505382 (+ 173us) write_op.cc:270] Start()
0503 19:55:56.505403 (+ 21us) write_op.cc:276] Timestamp: P: 1777838132161911 usec, L: 0
0503 19:55:56.505545 (+ 142us) write_op.cc:270] Start()
0503 19:55:56.505563 (+ 18us) write_op.cc:276] Timestamp: P: 1777838132166431 usec, L: 0
0503 19:55:56.505698 (+ 135us) write_op.cc:270] Start()
0503 19:55:56.505718 (+ 20us) write_op.cc:276] Timestamp: P: 1777838132169035 usec, L: 0
0503 19:55:56.505856 (+ 138us) write_op.cc:270] Start()
0503 19:55:56.505876 (+ 20us) write_op.cc:276] Timestamp: P: 1777838132179041 usec, L: 0
0503 19:55:56.506050 (+ 174us) write_op.cc:270] Start()
0503 19:55:56.506077 (+ 27us) write_op.cc:276] Timestamp: P: 1777838132216619 usec, L: 0
0503 19:55:56.506260 (+ 183us) write_op.cc:270] Start()
0503 19:55:56.506288 (+ 28us) write_op.cc:276] Timestamp: P: 1777838132218926 usec, L: 0
0503 19:55:56.506482 (+ 194us) write_op.cc:270] Start()
0503 19:55:56.506503 (+ 21us) write_op.cc:276] Timestamp: P: 1777838132239905 usec, L: 0
0503 19:55:56.506647 (+ 144us) write_op.cc:270] Start()
0503 19:55:56.506668 (+ 21us) write_op.cc:276] Timestamp: P: 1777838132240559 usec, L: 0
0503 19:55:56.506842 (+ 174us) write_op.cc:270] Start()
0503 19:55:56.506873 (+ 31us) write_op.cc:276] Timestamp: P: 1777838132274863 usec, L: 0
0503 19:55:56.507065 (+ 192us) write_op.cc:270] Start()
0503 19:55:56.507088 (+ 23us) write_op.cc:276] Timestamp: P: 1777838132287167 usec, L: 0
0503 19:55:56.507285 (+ 197us) write_op.cc:270] Start()
0503 19:55:56.507312 (+ 27us) write_op.cc:276] Timestamp: P: 1777838132291118 usec, L: 0
0503 19:55:56.507532 (+ 220us) write_op.cc:270] Start()
0503 19:55:56.507555 (+ 23us) write_op.cc:276] Timestamp: P: 1777838132305259 usec, L: 0
0503 19:55:56.568708 (+ 61153us) write_op.cc:270] Start()
0503 19:55:56.568765 (+ 57us) write_op.cc:276] Timestamp: P: 1777838132329985 usec, L: 0
0503 19:55:56.569148 (+ 383us) write_op.cc:270] Start()
0503 19:55:56.569174 (+ 26us) write_op.cc:276] Timestamp: P: 1777838132358026 usec, L: 0
0503 19:55:56.583478 (+ 14304us) write_op.cc:270] Start()
0503 19:55:56.583514 (+ 36us) write_op.cc:276] Timestamp: P: 1777838132371860 usec, L: 0
0503 19:55:56.612050 (+ 28536us) write_op.cc:270] Start()
0503 19:55:56.612073 (+ 23us) write_op.cc:276] Timestamp: P: 1777838132372544 usec, L: 0
0503 19:55:56.612247 (+ 174us) write_op.cc:270] Start()
0503 19:55:56.612270 (+ 23us) write_op.cc:276] Timestamp: P: 1777838132412790 usec, L: 0
0503 19:55:56.612415 (+ 145us) write_op.cc:270] Start()
0503 19:55:56.612436 (+ 21us) write_op.cc:276] Timestamp: P: 1777838132413475 usec, L: 0
0503 19:55:56.612665 (+ 229us) write_op.cc:270] Start()
0503 19:55:56.612709 (+ 44us) write_op.cc:276] Timestamp: P: 1777838132418793 usec, L: 0
0503 19:55:56.615754 (+ 3045us) write_op.cc:270] Start()
0503 19:55:56.615786 (+ 32us) write_op.cc:276] Timestamp: P: 1777838132423118 usec, L: 0
0503 19:55:56.616475 (+ 689us) write_op.cc:270] Start()
0503 19:55:56.616505 (+ 30us) write_op.cc:276] Timestamp: P: 1777838132456797 usec, L: 0
0503 19:55:56.616708 (+ 203us) write_op.cc:270] Start()
0503 19:55:56.616735 (+ 27us) write_op.cc:276] Timestamp: P: 1777838132470078 usec, L: 0
0503 19:55:56.619361 (+ 2626us) write_op.cc:270] Start()
0503 19:55:56.619392 (+ 31us) write_op.cc:276] Timestamp: P: 1777838132497574 usec, L: 0
0503 19:55:56.672734 (+ 53342us) write_op.cc:270] Start()
0503 19:55:56.672779 (+ 45us) write_op.cc:276] Timestamp: P: 1777838132514012 usec, L: 0
0503 19:55:56.687024 (+ 14245us) write_op.cc:270] Start()
0503 19:55:56.687064 (+ 40us) write_op.cc:276] Timestamp: P: 1777838132514956 usec, L: 0
0503 19:55:56.687317 (+ 253us) write_op.cc:270] Start()
0503 19:55:56.687376 (+ 59us) write_op.cc:276] Timestamp: P: 1777838132540287 usec, L: 0
0503 19:55:56.687718 (+ 342us) write_op.cc:270] Start()
0503 19:55:56.687744 (+ 26us) write_op.cc:276] Timestamp: P: 1777838132551466 usec, L: 0
0503 19:55:56.687983 (+ 239us) write_op.cc:270] Start()
0503 19:55:56.688020 (+ 37us) write_op.cc:276] Timestamp: P: 1777838132573129 usec, L: 0
0503 19:55:56.688206 (+ 186us) write_op.cc:270] Start()
0503 19:55:56.688228 (+ 22us) write_op.cc:276] Timestamp: P: 1777838132588703 usec, L: 0
0503 19:55:56.688380 (+ 152us) write_op.cc:270] Start()
0503 19:55:56.688400 (+ 20us) write_op.cc:276] Timestamp: P: 1777838132613182 usec, L: 0
0503 19:55:56.688556 (+ 156us) write_op.cc:270] Start()
0503 19:55:56.688578 (+ 22us) write_op.cc:276] Timestamp: P: 1777838132616047 usec, L: 0
0503 19:55:56.688730 (+ 152us) write_op.cc:270] Start()
0503 19:55:56.688750 (+ 20us) write_op.cc:276] Timestamp: P: 1777838132623149 usec, L: 0
0503 19:55:56.688909 (+ 159us) write_op.cc:270] Start()
0503 19:55:56.688930 (+ 21us) write_op.cc:276] Timestamp: P: 1777838132662525 usec, L: 0
0503 19:55:56.689113 (+ 183us) write_op.cc:270] Start()
0503 19:55:56.689151 (+ 38us) write_op.cc:276] Timestamp: P: 1777838132670287 usec, L: 0
0503 19:55:56.689305 (+ 154us) write_op.cc:270] Start()
0503 19:55:56.689326 (+ 21us) write_op.cc:276] Timestamp: P: 1777838132671896 usec, L: 0
0503 19:55:56.689465 (+ 139us) write_op.cc:270] Start()
0503 19:55:56.689484 (+ 19us) write_op.cc:276] Timestamp: P: 1777838132690065 usec, L: 0
0503 19:55:56.690559 (+ 1075us) write_op.cc:270] Start()
0503 19:55:56.690598 (+ 39us) write_op.cc:276] Timestamp: P: 1777838132727850 usec, L: 0
0503 19:55:56.691014 (+ 416us) write_op.cc:270] Start()
0503 19:55:56.691056 (+ 42us) write_op.cc:276] Timestamp: P: 1777838132767645 usec, L: 0
0503 19:55:56.691351 (+ 295us) write_op.cc:270] Start()
0503 19:55:56.691378 (+ 27us) write_op.cc:276] Timestamp: P: 1777838132772896 usec, L: 0
0503 19:55:56.691552 (+ 174us) write_op.cc:270] Start()
0503 19:55:56.691597 (+ 45us) write_op.cc:276] Timestamp: P: 1777838132782445 usec, L: 0
0503 19:55:56.691794 (+ 197us) write_op.cc:270] Start()
0503 19:55:56.691815 (+ 21us) write_op.cc:276] Timestamp: P: 1777838132795916 usec, L: 0
0503 19:55:56.691978 (+ 163us) write_op.cc:270] Start()
0503 19:55:56.691996 (+ 18us) write_op.cc:276] Timestamp: P: 1777838132835253 usec, L: 0
0503 19:55:56.692128 (+ 132us) write_op.cc:270] Start()
0503 19:55:56.692146 (+ 18us) write_op.cc:276] Timestamp: P: 1777838132840946 usec, L: 0
0503 19:55:56.710757 (+ 18611us) write_op.cc:270] Start()
0503 19:55:56.710790 (+ 33us) write_op.cc:276] Timestamp: P: 1777838132848932 usec, L: 0
0503 19:55:56.711163 (+ 373us) write_op.cc:270] Start()
0503 19:55:56.711190 (+ 27us) write_op.cc:276] Timestamp: P: 1777838132853182 usec, L: 0
0503 19:55:56.711343 (+ 153us) write_op.cc:270] Start()
0503 19:55:56.711361 (+ 18us) write_op.cc:276] Timestamp: P: 1777838132869463 usec, L: 0
0503 19:55:56.711520 (+ 159us) write_op.cc:270] Start()
0503 19:55:56.711546 (+ 26us) write_op.cc:276] Timestamp: P: 1777838132905191 usec, L: 0
0503 19:55:56.711750 (+ 204us) write_op.cc:270] Start()
0503 19:55:56.711772 (+ 22us) write_op.cc:276] Timestamp: P: 1777838132936741 usec, L: 0
0503 19:55:56.711934 (+ 162us) write_op.cc:270] Start()
0503 19:55:56.711957 (+ 23us) write_op.cc:276] Timestamp: P: 1777838132938638 usec, L: 0
0503 19:55:56.712099 (+ 142us) write_op.cc:270] Start()
0503 19:55:56.712121 (+ 22us) write_op.cc:276] Timestamp: P: 1777838132942392 usec, L: 0
0503 19:55:56.712279 (+ 158us) write_op.cc:270] Start()
0503 19:55:56.712308 (+ 29us) write_op.cc:276] Timestamp: P: 1777838132957153 usec, L: 0
0503 19:55:56.712461 (+ 153us) write_op.cc:270] Start()
0503 19:55:56.712485 (+ 24us) write_op.cc:276] Timestamp: P: 1777838132993486 usec, L: 0
0503 19:55:56.712666 (+ 181us) write_op.cc:270] Start()
0503 19:55:56.712711 (+ 45us) write_op.cc:276] Timestamp: P: 1777838133012842 usec, L: 0
0503 19:55:56.712903 (+ 192us) write_op.cc:270] Start()
0503 19:55:56.712927 (+ 24us) write_op.cc:276] Timestamp: P: 1777838133015602 usec, L: 0
0503 19:55:56.713096 (+ 169us) write_op.cc:270] Start()
0503 19:55:56.713120 (+ 24us) write_op.cc:276] Timestamp: P: 1777838133042300 usec, L: 0
0503 19:55:56.713323 (+ 203us) write_op.cc:270] Start()
0503 19:55:56.713347 (+ 24us) write_op.cc:276] Timestamp: P: 1777838133068448 usec, L: 0
0503 19:55:56.713492 (+ 145us) write_op.cc:270] Start()
0503 19:55:56.713514 (+ 22us) write_op.cc:276] Timestamp: P: 1777838133098317 usec, L: 0
0503 19:55:56.713655 (+ 141us) write_op.cc:270] Start()
0503 19:55:56.713679 (+ 24us) write_op.cc:276] Timestamp: P: 1777838133104168 usec, L: 0
0503 19:55:56.713826 (+ 147us) write_op.cc:270] Start()
0503 19:55:56.713849 (+ 23us) write_op.cc:276] Timestamp: P: 1777838133107181 usec, L: 0
0503 19:55:56.714030 (+ 181us) write_op.cc:270] Start()
0503 19:55:56.714051 (+ 21us) write_op.cc:276] Timestamp: P: 1777838133132654 usec, L: 0
0503 19:55:56.714193 (+ 142us) write_op.cc:270] Start()
0503 19:55:56.714212 (+ 19us) write_op.cc:276] Timestamp: P: 1777838133180236 usec, L: 0
0503 19:55:56.714350 (+ 138us) write_op.cc:270] Start()
0503 19:55:56.714369 (+ 19us) write_op.cc:276] Timestamp: P: 1777838133182156 usec, L: 0
0503 19:55:56.714541 (+ 172us) write_op.cc:270] Start()
0503 19:55:56.714561 (+ 20us) write_op.cc:276] Timestamp: P: 1777838133184491 usec, L: 0
0503 19:55:56.714747 (+ 186us) write_op.cc:270] Start()
0503 19:55:56.714768 (+ 21us) write_op.cc:276] Timestamp: P: 1777838133188828 usec, L: 0
0503 19:55:56.714952 (+ 184us) write_op.cc:270] Start()
0503 19:55:56.714977 (+ 25us) write_op.cc:276] Timestamp: P: 1777838133241393 usec, L: 0
0503 19:55:56.715145 (+ 168us) write_op.cc:270] Start()
0503 19:55:56.715167 (+ 22us) write_op.cc:276] Timestamp: P: 1777838133249385 usec, L: 0
0503 19:55:56.715322 (+ 155us) write_op.cc:270] Start()
0503 19:55:56.715342 (+ 20us) write_op.cc:276] Timestamp: P: 1777838133267759 usec, L: 0
0503 19:55:56.733725 (+ 18383us) write_op.cc:270] Start()
0503 19:55:56.733770 (+ 45us) write_op.cc:276] Timestamp: P: 1777838133307324 usec, L: 0
0503 19:55:56.734285 (+ 515us) write_op.cc:270] Start()
0503 19:55:56.734322 (+ 37us) write_op.cc:276] Timestamp: P: 1777838133311218 usec, L: 0
0503 19:55:56.801408 (+ 67086us) write_op.cc:270] Start()
0503 19:55:56.801443 (+ 35us) write_op.cc:276] Timestamp: P: 1777838133336862 usec, L: 0
0503 19:55:56.805910 (+ 4467us) write_op.cc:270] Start()
0503 19:55:56.805973 (+ 63us) write_op.cc:276] Timestamp: P: 1777838133338772 usec, L: 0
0503 19:55:56.809933 (+ 3960us) write_op.cc:270] Start()
0503 19:55:56.809972 (+ 39us) write_op.cc:276] Timestamp: P: 1777838133369047 usec, L: 0
0503 19:55:56.834281 (+ 24309us) write_op.cc:270] Start()
0503 19:55:56.834320 (+ 39us) write_op.cc:276] Timestamp: P: 1777838133384548 usec, L: 0
0503 19:55:56.842079 (+ 7759us) write_op.cc:270] Start()
0503 19:55:56.842107 (+ 28us) write_op.cc:276] Timestamp: P: 1777838133405718 usec, L: 0
0503 19:55:56.844560 (+ 2453us) write_op.cc:270] Start()
0503 19:55:56.844586 (+ 26us) write_op.cc:276] Timestamp: P: 1777838133410941 usec, L: 0
0503 19:55:56.845020 (+ 434us) write_op.cc:270] Start()
0503 19:55:56.845047 (+ 27us) write_op.cc:276] Timestamp: P: 1777838133430173 usec, L: 0
0503 19:55:56.848800 (+ 3753us) write_op.cc:270] Start()
0503 19:55:56.848839 (+ 39us) write_op.cc:276] Timestamp: P: 1777838133463941 usec, L: 0
0503 19:55:56.849539 (+ 700us) write_op.cc:270] Start()
0503 19:55:56.849567 (+ 28us) write_op.cc:276] Timestamp: P: 1777838133470327 usec, L: 0
0503 19:55:56.849729 (+ 162us) write_op.cc:270] Start()
0503 19:55:56.849746 (+ 17us) write_op.cc:276] Timestamp: P: 1777838133512532 usec, L: 0
0503 19:55:56.849917 (+ 171us) write_op.cc:270] Start()
0503 19:55:56.849937 (+ 20us) write_op.cc:276] Timestamp: P: 1777838133515150 usec, L: 0
0503 19:55:56.850096 (+ 159us) write_op.cc:270] Start()
0503 19:55:56.850114 (+ 18us) write_op.cc:276] Timestamp: P: 1777838133538947 usec, L: 0
0503 19:55:56.850265 (+ 151us) write_op.cc:270] Start()
0503 19:55:56.850284 (+ 19us) write_op.cc:276] Timestamp: P: 1777838133547183 usec, L: 0
0503 19:55:56.850489 (+ 205us) write_op.cc:270] Start()
0503 19:55:56.850513 (+ 24us) write_op.cc:276] Timestamp: P: 1777838133579725 usec, L: 0
0503 19:55:56.850731 (+ 218us) write_op.cc:270] Start()
0503 19:55:56.850755 (+ 24us) write_op.cc:276] Timestamp: P: 1777838133581379 usec, L: 0
0503 19:55:56.851034 (+ 279us) write_op.cc:270] Start()
0503 19:55:56.851058 (+ 24us) write_op.cc:276] Timestamp: P: 1777838133618390 usec, L: 0
0503 19:55:56.851246 (+ 188us) write_op.cc:270] Start()
0503 19:55:56.851267 (+ 21us) write_op.cc:276] Timestamp: P: 1777838133636931 usec, L: 0
0503 19:55:56.855500 (+ 4233us) write_op.cc:270] Start()
0503 19:55:56.855528 (+ 28us) write_op.cc:276] Timestamp: P: 1777838133659444 usec, L: 0
0503 19:55:56.861672 (+ 6144us) write_op.cc:270] Start()
0503 19:55:56.861701 (+ 29us) write_op.cc:276] Timestamp: P: 1777838133660485 usec, L: 0
0503 19:55:56.862259 (+ 558us) write_op.cc:270] Start()
0503 19:55:56.862326 (+ 67us) write_op.cc:276] Timestamp: P: 1777838133689470 usec, L: 0
0503 19:55:56.862652 (+ 326us) write_op.cc:270] Start()
0503 19:55:56.862675 (+ 23us) write_op.cc:276] Timestamp: P: 1777838133715567 usec, L: 0
0503 19:55:56.863218 (+ 543us) write_op.cc:270] Start()
0503 19:55:56.863255 (+ 37us) write_op.cc:276] Timestamp: P: 1777838133727423 usec, L: 0
0503 19:55:56.869571 (+ 6316us) write_op.cc:270] Start()
0503 19:55:56.869608 (+ 37us) write_op.cc:276] Timestamp: P: 1777838133755804 usec, L: 0
0503 19:55:56.869850 (+ 242us) write_op.cc:270] Start()
0503 19:55:56.869874 (+ 24us) write_op.cc:276] Timestamp: P: 1777838133761243 usec, L: 0
0503 19:55:56.870393 (+ 519us) write_op.cc:270] Start()
0503 19:55:56.870460 (+ 67us) write_op.cc:276] Timestamp: P: 1777838133777334 usec, L: 0
0503 19:55:56.870875 (+ 415us) write_op.cc:270] Start()
0503 19:55:56.870903 (+ 28us) write_op.cc:276] Timestamp: P: 1777838133821898 usec, L: 0
0503 19:55:56.871198 (+ 295us) write_op.cc:270] Start()
0503 19:55:56.871223 (+ 25us) write_op.cc:276] Timestamp: P: 1777838133853011 usec, L: 0
0503 19:55:56.871454 (+ 231us) write_op.cc:270] Start()
0503 19:55:56.871478 (+ 24us) write_op.cc:276] Timestamp: P: 1777838133883217 usec, L: 0
0503 19:55:56.875472 (+ 3994us) write_op.cc:270] Start()
0503 19:55:56.875504 (+ 32us) write_op.cc:276] Timestamp: P: 1777838133897205 usec, L: 0
0503 19:55:56.875834 (+ 330us) write_op.cc:270] Start()
0503 19:55:56.875859 (+ 25us) write_op.cc:276] Timestamp: P: 1777838133898306 usec, L: 0
0503 19:55:56.876071 (+ 212us) write_op.cc:270] Start()
0503 19:55:56.876094 (+ 23us) write_op.cc:276] Timestamp: P: 1777838133918221 usec, L: 0
0503 19:55:56.876391 (+ 297us) write_op.cc:270] Start()
0503 19:55:56.878611 (+ 2220us) write_op.cc:276] Timestamp: P: 1777838133937418 usec, L: 0
0503 19:55:56.878859 (+ 248us) write_op.cc:270] Start()
0503 19:55:56.878885 (+ 26us) write_op.cc:276] Timestamp: P: 1777838133975000 usec, L: 0
0503 19:55:56.879100 (+ 215us) write_op.cc:270] Start()
0503 19:55:56.879135 (+ 35us) write_op.cc:276] Timestamp: P: 1777838133982260 usec, L: 0
0503 19:55:56.891909 (+ 12774us) write_op.cc:270] Start()
0503 19:55:56.891957 (+ 48us) write_op.cc:276] Timestamp: P: 1777838133983837 usec, L: 0
0503 19:55:56.895426 (+ 3469us) write_op.cc:270] Start()
0503 19:55:56.895473 (+ 47us) write_op.cc:276] Timestamp: P: 1777838134037191 usec, L: 0
0503 19:55:56.900678 (+ 5205us) write_op.cc:270] Start()
0503 19:55:56.900707 (+ 29us) write_op.cc:276] Timestamp: P: 1777838134060008 usec, L: 0
0503 19:55:56.901549 (+ 842us) write_op.cc:270] Start()
0503 19:55:56.901575 (+ 26us) write_op.cc:276] Timestamp: P: 1777838134066653 usec, L: 0
0503 19:55:56.905506 (+ 3931us) write_op.cc:270] Start()
0503 19:55:56.905536 (+ 30us) write_op.cc:276] Timestamp: P: 1777838134084004 usec, L: 0
0503 19:55:56.905757 (+ 221us) write_op.cc:270] Start()
0503 19:55:56.905780 (+ 23us) write_op.cc:276] Timestamp: P: 1777838134094975 usec, L: 0
0503 19:55:56.906793 (+ 1013us) write_op.cc:270] Start()
0503 19:55:56.916550 (+ 9757us) write_op.cc:276] Timestamp: P: 1777838134136232 usec, L: 0
0503 19:55:56.916876 (+ 326us) write_op.cc:270] Start()
0503 19:55:56.916922 (+ 46us) write_op.cc:276] Timestamp: P: 1777838134148997 usec, L: 0
0503 19:55:56.917158 (+ 236us) write_op.cc:270] Start()
0503 19:55:56.917188 (+ 30us) write_op.cc:276] Timestamp: P: 1777838134164900 usec, L: 0
0503 19:55:56.917382 (+ 194us) write_op.cc:270] Start()
0503 19:55:56.917404 (+ 22us) write_op.cc:276] Timestamp: P: 1777838134190531 usec, L: 0
0503 19:55:56.927818 (+ 10414us) write_op.cc:270] Start()
0503 19:55:56.927951 (+ 133us) write_op.cc:276] Timestamp: P: 1777838134214872 usec, L: 0
0503 19:55:56.929339 (+ 1388us) write_op.cc:270] Start()
0503 19:55:56.929386 (+ 47us) write_op.cc:276] Timestamp: P: 1777838134252021 usec, L: 0
0503 19:55:56.935023 (+ 5637us) write_op.cc:270] Start()
0503 19:55:56.935059 (+ 36us) write_op.cc:276] Timestamp: P: 1777838134260477 usec, L: 0
0503 19:55:56.935326 (+ 267us) write_op.cc:270] Start()
0503 19:55:56.935352 (+ 26us) write_op.cc:276] Timestamp: P: 1777838134285528 usec, L: 0
0503 19:55:56.939034 (+ 3682us) write_op.cc:270] Start()
0503 19:55:56.939064 (+ 30us) write_op.cc:276] Timestamp: P: 1777838134339238 usec, L: 0
0503 19:55:56.939306 (+ 242us) write_op.cc:270] Start()
0503 19:55:56.939332 (+ 26us) write_op.cc:276] Timestamp: P: 1777838134342522 usec, L: 0
0503 19:55:56.939524 (+ 192us) write_op.cc:270] Start()
0503 19:55:56.939546 (+ 22us) write_op.cc:276] Timestamp: P: 1777838134358899 usec, L: 0
0503 19:55:56.940542 (+ 996us) write_op.cc:270] Start()
0503 19:55:56.940573 (+ 31us) write_op.cc:276] Timestamp: P: 1777838134389260 usec, L: 0
0503 19:55:56.941184 (+ 611us) write_op.cc:270] Start()
0503 19:55:56.941251 (+ 67us) write_op.cc:276] Timestamp: P: 1777838134430186 usec, L: 0
0503 19:55:56.947874 (+ 6623us) write_op.cc:270] Start()
0503 19:55:56.948286 (+ 412us) write_op.cc:276] Timestamp: P: 1777838134461492 usec, L: 0
0503 19:55:56.961233 (+ 12947us) write_op.cc:270] Start()
0503 19:55:56.967705 (+ 6472us) write_op.cc:276] Timestamp: P: 1777838134480366 usec, L: 0
0503 19:55:56.968499 (+ 794us) write_op.cc:270] Start()
0503 19:55:56.968532 (+ 33us) write_op.cc:276] Timestamp: P: 1777838134492436 usec, L: 0
0503 19:55:56.968768 (+ 236us) write_op.cc:270] Start()
0503 19:55:56.968793 (+ 25us) write_op.cc:276] Timestamp: P: 1777838134498085 usec, L: 0
0503 19:55:56.969527 (+ 734us) write_op.cc:270] Start()
0503 19:55:56.969552 (+ 25us) write_op.cc:276] Timestamp: P: 1777838134550021 usec, L: 0
0503 19:55:56.969785 (+ 233us) write_op.cc:270] Start()
0503 19:55:56.969809 (+ 24us) write_op.cc:276] Timestamp: P: 1777838134553596 usec, L: 0
0503 19:55:56.973558 (+ 3749us) write_op.cc:270] Start()
0503 19:55:56.973593 (+ 35us) write_op.cc:276] Timestamp: P: 1777838134570343 usec, L: 0
0503 19:55:56.983787 (+ 10194us) write_op.cc:270] Start()
0503 19:55:56.983817 (+ 30us) write_op.cc:276] Timestamp: P: 1777838134575828 usec, L: 0
0503 19:55:56.984061 (+ 244us) write_op.cc:270] Start()
0503 19:55:56.984083 (+ 22us) write_op.cc:276] Timestamp: P: 1777838134613323 usec, L: 0
0503 19:55:56.990433 (+ 6350us) write_op.cc:270] Start()
0503 19:55:56.990484 (+ 51us) write_op.cc:276] Timestamp: P: 1777838134650803 usec, L: 0
0503 19:55:56.992586 (+ 2102us) write_op.cc:270] Start()
0503 19:55:56.992622 (+ 36us) write_op.cc:276] Timestamp: P: 1777838134672572 usec, L: 0
0503 19:55:56.994718 (+ 2096us) write_op.cc:270] Start()
0503 19:55:56.994754 (+ 36us) write_op.cc:276] Timestamp: P: 1777838134695673 usec, L: 0
0503 19:55:56.996363 (+ 1609us) write_op.cc:270] Start()
0503 19:55:56.996394 (+ 31us) write_op.cc:276] Timestamp: P: 1777838134700425 usec, L: 0
0503 19:55:56.996635 (+ 241us) write_op.cc:270] Start()
0503 19:55:56.998224 (+ 1589us) write_op.cc:276] Timestamp: P: 1777838134714988 usec, L: 0
0503 19:55:56.998508 (+ 284us) write_op.cc:270] Start()
0503 19:55:56.998536 (+ 28us) write_op.cc:276] Timestamp: P: 1777838134756335 usec, L: 0
0503 19:55:56.998779 (+ 243us) write_op.cc:270] Start()
0503 19:55:56.998808 (+ 29us) write_op.cc:276] Timestamp: P: 1777838134776068 usec, L: 0
0503 19:55:57.000845 (+ 2037us) write_op.cc:270] Start()
0503 19:55:57.000957 (+ 112us) write_op.cc:276] Timestamp: P: 1777838134842559 usec, L: 0
0503 19:55:57.001226 (+ 269us) write_op.cc:270] Start()
0503 19:55:57.001251 (+ 25us) write_op.cc:276] Timestamp: P: 1777838134872340 usec, L: 0
0503 19:55:57.001451 (+ 200us) write_op.cc:270] Start()
0503 19:55:57.001472 (+ 21us) write_op.cc:276] Timestamp: P: 1777838134883582 usec, L: 0
0503 19:55:57.001663 (+ 191us) write_op.cc:270] Start()
0503 19:55:57.001683 (+ 20us) write_op.
I20260503 19:56:02.068185 1590 raft_consensus.cc:493] T 4d80fc29b7a64074b4a2ce4003054d1a P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a1219433b66444d091420ceeab5092ef)
I20260503 19:56:02.068835 1590 raft_consensus.cc:515] T 4d80fc29b7a64074b4a2ce4003054d1a P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:56:02.071447 1590 leader_election.cc:290] T 4d80fc29b7a64074b4a2ce4003054d1a P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1219433b66444d091420ceeab5092ef (127.0.105.2:38837), 6d99e4f4d5ca48e0bdb54daf8361c5e8 (127.0.105.3:35005)
I20260503 19:56:02.072466 728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d80fc29b7a64074b4a2ce4003054d1a" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1180 } } ignore_live_leader: false dest_uuid: "a1219433b66444d091420ceeab5092ef" is_pre_election: true
I20260503 19:56:02.085052 862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d80fc29b7a64074b4a2ce4003054d1a" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1180 } } ignore_live_leader: false dest_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" is_pre_election: true
I20260503 19:56:02.086341 1358 leader_election.cc:304] T 4d80fc29b7a64074b4a2ce4003054d1a P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e52aa88a17542609e84f0c09fb85d87; no voters: 6d99e4f4d5ca48e0bdb54daf8361c5e8, a1219433b66444d091420ceeab5092ef
I20260503 19:56:02.089342 1590 raft_consensus.cc:2749] T 4d80fc29b7a64074b4a2ce4003054d1a P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 19:56:02.568738 1590 raft_consensus.cc:493] T 4d80fc29b7a64074b4a2ce4003054d1a P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a1219433b66444d091420ceeab5092ef)
I20260503 19:56:02.568938 1590 raft_consensus.cc:515] T 4d80fc29b7a64074b4a2ce4003054d1a P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:56:02.569872 1590 leader_election.cc:290] T 4d80fc29b7a64074b4a2ce4003054d1a P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1219433b66444d091420ceeab5092ef (127.0.105.2:38837), 6d99e4f4d5ca48e0bdb54daf8361c5e8 (127.0.105.3:35005)
I20260503 19:56:02.571015 862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d80fc29b7a64074b4a2ce4003054d1a" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1369 } } ignore_live_leader: false dest_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" is_pre_election: true
I20260503 19:56:02.571509 731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d80fc29b7a64074b4a2ce4003054d1a" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1369 } } ignore_live_leader: false dest_uuid: "a1219433b66444d091420ceeab5092ef" is_pre_election: true
I20260503 19:56:02.572393 1358 leader_election.cc:304] T 4d80fc29b7a64074b4a2ce4003054d1a P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e52aa88a17542609e84f0c09fb85d87; no voters: 6d99e4f4d5ca48e0bdb54daf8361c5e8, a1219433b66444d091420ceeab5092ef
I20260503 19:56:02.572677 1590 raft_consensus.cc:2749] T 4d80fc29b7a64074b4a2ce4003054d1a P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 19:56:02.840739 1430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.105.2:39423 (request call id 390) took 2935 ms. Trace:
I20260503 19:56:02.844537 1387 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:58682 (request call id 37) took 2232 ms. Trace:
I20260503 19:56:02.844698 1387 rpcz_store.cc:276] 0503 19:56:00.612272 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 19:56:00.612345 (+ 73us) service_pool.cc:224] Handling call
0503 19:56:02.843387 (+2231042us) spinlock_profiling.cc:243] Waited 2.23 s on lock 0x61600001a854. stack: 00007f2b5ee49086 00007f2b5ee48e40 00007f2b5de023ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007f2b6ad5b8c0 00007f2b6ec16eaf 00007f2b6902ec36 00007f2b6902e965 00007f2b65e3c10e 00007f2b65e3afee 00007f2b65e41228 00007f2b65e41b8f 00007f2b65e419b8 0000000000aa4cac
0503 19:56:02.844478 (+ 1091us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5125059328}
I20260503 19:56:02.847599 1547 raft_consensus.cc:493] T d2bf53fe00c2417b872db2ecd4ede593 P 0e52aa88a17542609e84f0c09fb85d87 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a1219433b66444d091420ceeab5092ef)
I20260503 19:56:02.847851 1547 raft_consensus.cc:515] T d2bf53fe00c2417b872db2ecd4ede593 P 0e52aa88a17542609e84f0c09fb85d87 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:56:02.848752 1547 leader_election.cc:290] T d2bf53fe00c2417b872db2ecd4ede593 P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1219433b66444d091420ceeab5092ef (127.0.105.2:38837), 6d99e4f4d5ca48e0bdb54daf8361c5e8 (127.0.105.3:35005)
I20260503 19:56:02.849756 731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2bf53fe00c2417b872db2ecd4ede593" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 3 candidate_status { last_received { term: 2 index: 1289 } } ignore_live_leader: false dest_uuid: "a1219433b66444d091420ceeab5092ef" is_pre_election: true
I20260503 19:56:02.850136 862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2bf53fe00c2417b872db2ecd4ede593" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 3 candidate_status { last_received { term: 2 index: 1289 } } ignore_live_leader: false dest_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" is_pre_election: true
I20260503 19:56:02.851707 1358 leader_election.cc:304] T d2bf53fe00c2417b872db2ecd4ede593 P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e52aa88a17542609e84f0c09fb85d87; no voters: 6d99e4f4d5ca48e0bdb54daf8361c5e8, a1219433b66444d091420ceeab5092ef
I20260503 19:56:02.853986 1547 raft_consensus.cc:2749] T d2bf53fe00c2417b872db2ecd4ede593 P 0e52aa88a17542609e84f0c09fb85d87 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260503 19:56:03.270402 1547 raft_consensus.cc:493] T d2bf53fe00c2417b872db2ecd4ede593 P 0e52aa88a17542609e84f0c09fb85d87 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a1219433b66444d091420ceeab5092ef)
I20260503 19:56:03.270601 1547 raft_consensus.cc:515] T d2bf53fe00c2417b872db2ecd4ede593 P 0e52aa88a17542609e84f0c09fb85d87 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:56:03.271347 1547 leader_election.cc:290] T d2bf53fe00c2417b872db2ecd4ede593 P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1219433b66444d091420ceeab5092ef (127.0.105.2:38837), 6d99e4f4d5ca48e0bdb54daf8361c5e8 (127.0.105.3:35005)
I20260503 19:56:03.271778 729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2bf53fe00c2417b872db2ecd4ede593" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 3 candidate_status { last_received { term: 2 index: 1289 } } ignore_live_leader: false dest_uuid: "a1219433b66444d091420ceeab5092ef" is_pre_election: true
I20260503 19:56:03.272322 862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2bf53fe00c2417b872db2ecd4ede593" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 3 candidate_status { last_received { term: 2 index: 1289 } } ignore_live_leader: false dest_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" is_pre_election: true
I20260503 19:56:03.275907 1356 leader_election.cc:304] T d2bf53fe00c2417b872db2ecd4ede593 P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e52aa88a17542609e84f0c09fb85d87; no voters: 6d99e4f4d5ca48e0bdb54daf8361c5e8, a1219433b66444d091420ceeab5092ef
I20260503 19:56:03.276247 1547 raft_consensus.cc:2749] T d2bf53fe00c2417b872db2ecd4ede593 P 0e52aa88a17542609e84f0c09fb85d87 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260503 19:56:02.840997 1430 rpcz_store.cc:276] 0503 19:55:59.905479 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 19:55:59.905534 (+ 55us) service_pool.cc:224] Handling call
0503 19:56:00.054251 (+148717us) raft_consensus.cc:1471] Updating replica for 1127 ops
0503 19:56:00.621068 (+566817us) write_op.cc:489] Releasing partition, row and schema locks
0503 19:56:00.621073 (+ 5us) write_op.cc:454] Released schema lock
0503 19:56:00.622409 (+ 1336us) raft_consensus.cc:1534] Early marking committed up to index 162
0503 19:56:00.622556 (+ 147us) raft_consensus.cc:1539] Triggering prepare for 1127 ops
0503 19:56:00.622947 (+ 391us) write_op.cc:270] Start()
0503 19:56:00.623213 (+ 266us) write_op.cc:276] Timestamp: P: 1777838131190254 usec, L: 0
0503 19:56:00.637877 (+ 14664us) write_op.cc:270] Start()
0503 19:56:00.637928 (+ 51us) write_op.cc:276] Timestamp: P: 1777838131238333 usec, L: 0
0503 19:56:00.656559 (+ 18631us) write_op.cc:270] Start()
0503 19:56:00.656592 (+ 33us) write_op.cc:276] Timestamp: P: 1777838131240605 usec, L: 0
0503 19:56:00.657354 (+ 762us) write_op.cc:270] Start()
0503 19:56:00.657382 (+ 28us) write_op.cc:276] Timestamp: P: 1777838131252923 usec, L: 0
0503 19:56:00.658894 (+ 1512us) write_op.cc:270] Start()
0503 19:56:00.658931 (+ 37us) write_op.cc:276] Timestamp: P: 1777838131275759 usec, L: 0
0503 19:56:00.670372 (+ 11441us) write_op.cc:270] Start()
0503 19:56:00.670418 (+ 46us) write_op.cc:276] Timestamp: P: 1777838131291044 usec, L: 0
0503 19:56:00.671169 (+ 751us) write_op.cc:270] Start()
0503 19:56:00.671199 (+ 30us) write_op.cc:276] Timestamp: P: 1777838131313422 usec, L: 0
0503 19:56:00.671841 (+ 642us) write_op.cc:270] Start()
0503 19:56:00.671868 (+ 27us) write_op.cc:276] Timestamp: P: 1777838131329008 usec, L: 0
0503 19:56:00.680331 (+ 8463us) write_op.cc:270] Start()
0503 19:56:00.680363 (+ 32us) write_op.cc:276] Timestamp: P: 1777838131342927 usec, L: 0
0503 19:56:00.681681 (+ 1318us) write_op.cc:270] Start()
0503 19:56:00.681710 (+ 29us) write_op.cc:276] Timestamp: P: 1777838131381835 usec, L: 0
0503 19:56:00.682417 (+ 707us) write_op.cc:270] Start()
0503 19:56:00.682444 (+ 27us) write_op.cc:276] Timestamp: P: 1777838131389894 usec, L: 0
0503 19:56:00.688169 (+ 5725us) write_op.cc:270] Start()
0503 19:56:00.688199 (+ 30us) write_op.cc:276] Timestamp: P: 1777838131403005 usec, L: 0
0503 19:56:00.691503 (+ 3304us) write_op.cc:270] Start()
0503 19:56:00.691529 (+ 26us) write_op.cc:276] Timestamp: P: 1777838131439122 usec, L: 0
0503 19:56:00.695950 (+ 4421us) write_op.cc:270] Start()
0503 19:56:00.695981 (+ 31us) write_op.cc:276] Timestamp: P: 1777838131446783 usec, L: 0
0503 19:56:00.716879 (+ 20898us) write_op.cc:270] Start()
0503 19:56:00.716925 (+ 46us) write_op.cc:276] Timestamp: P: 1777838131458422 usec, L: 0
0503 19:56:00.719879 (+ 2954us) write_op.cc:270] Start()
0503 19:56:00.719930 (+ 51us) write_op.cc:276] Timestamp: P: 1777838131470409 usec, L: 0
0503 19:56:00.721025 (+ 1095us) write_op.cc:270] Start()
0503 19:56:00.721049 (+ 24us) write_op.cc:276] Timestamp: P: 1777838131503445 usec, L: 0
0503 19:56:00.744194 (+ 23145us) write_op.cc:270] Start()
0503 19:56:00.744349 (+ 155us) write_op.cc:276] Timestamp: P: 1777838131533245 usec, L: 0
0503 19:56:00.751463 (+ 7114us) write_op.cc:270] Start()
0503 19:56:00.751494 (+ 31us) write_op.cc:276] Timestamp: P: 1777838131541615 usec, L: 0
0503 19:56:00.751735 (+ 241us) write_op.cc:270] Start()
0503 19:56:00.751757 (+ 22us) write_op.cc:276] Timestamp: P: 1777838131542328 usec, L: 0
0503 19:56:00.754889 (+ 3132us) write_op.cc:270] Start()
0503 19:56:00.754929 (+ 40us) write_op.cc:276] Timestamp: P: 1777838131545088 usec, L: 0
0503 19:56:00.760727 (+ 5798us) write_op.cc:270] Start()
0503 19:56:00.760774 (+ 47us) write_op.cc:276] Timestamp: P: 1777838131584555 usec, L: 0
0503 19:56:00.760992 (+ 218us) write_op.cc:270] Start()
0503 19:56:00.761036 (+ 44us) write_op.cc:276] Timestamp: P: 1777838131586037 usec, L: 0
0503 19:56:00.765415 (+ 4379us) write_op.cc:270] Start()
0503 19:56:00.765454 (+ 39us) write_op.cc:276] Timestamp: P: 1777838131608830 usec, L: 0
0503 19:56:00.770022 (+ 4568us) write_op.cc:270] Start()
0503 19:56:00.770060 (+ 38us) write_op.cc:276] Timestamp: P: 1777838131620428 usec, L: 0
0503 19:56:00.770828 (+ 768us) write_op.cc:270] Start()
0503 19:56:00.770857 (+ 29us) write_op.cc:276] Timestamp: P: 1777838131653654 usec, L: 0
0503 19:56:00.771561 (+ 704us) write_op.cc:270] Start()
0503 19:56:00.771589 (+ 28us) write_op.cc:276] Timestamp: P: 1777838131661999 usec, L: 0
0503 19:56:00.772304 (+ 715us) write_op.cc:270] Start()
0503 19:56:00.772330 (+ 26us) write_op.cc:276] Timestamp: P: 1777838131669099 usec, L: 0
0503 19:56:00.773275 (+ 945us) write_op.cc:270] Start()
0503 19:56:00.773311 (+ 36us) write_op.cc:276] Timestamp: P: 1777838131686729 usec, L: 0
0503 19:56:00.803230 (+ 29919us) write_op.cc:270] Start()
0503 19:56:00.803259 (+ 29us) write_op.cc:276] Timestamp: P: 1777838131725154 usec, L: 0
0503 19:56:00.811986 (+ 8727us) write_op.cc:270] Start()
0503 19:56:00.812032 (+ 46us) write_op.cc:276] Timestamp: P: 1777838131728813 usec, L: 0
0503 19:56:00.817470 (+ 5438us) write_op.cc:270] Start()
0503 19:56:00.817503 (+ 33us) write_op.cc:276] Timestamp: P: 1777838131731782 usec, L: 0
0503 19:56:00.817706 (+ 203us) write_op.cc:270] Start()
0503 19:56:00.817728 (+ 22us) write_op.cc:276] Timestamp: P: 1777838131765086 usec, L: 0
0503 19:56:00.819472 (+ 1744us) write_op.cc:270] Start()
0503 19:56:00.819510 (+ 38us) write_op.cc:276] Timestamp: P: 1777838131798685 usec, L: 0
0503 19:56:00.820268 (+ 758us) write_op.cc:270] Start()
0503 19:56:00.820294 (+ 26us) write_op.cc:276] Timestamp: P: 1777838131799479 usec, L: 0
0503 19:56:00.821398 (+ 1104us) write_op.cc:270] Start()
0503 19:56:00.821445 (+ 47us) write_op.cc:276] Timestamp: P: 1777838131810606 usec, L: 0
0503 19:56:00.827362 (+ 5917us) write_op.cc:270] Start()
0503 19:56:00.827394 (+ 32us) write_op.cc:276] Timestamp: P: 1777838131821192 usec, L: 0
0503 19:56:00.827590 (+ 196us) write_op.cc:270] Start()
0503 19:56:00.827611 (+ 21us) write_op.cc:276] Timestamp: P: 1777838131855612 usec, L: 0
0503 19:56:00.828697 (+ 1086us) write_op.cc:270] Start()
0503 19:56:00.828722 (+ 25us) write_op.cc:276] Timestamp: P: 1777838131866043 usec, L: 0
0503 19:56:00.829424 (+ 702us) write_op.cc:270] Start()
0503 19:56:00.829446 (+ 22us) write_op.cc:276] Timestamp: P: 1777838131890667 usec, L: 0
0503 19:56:00.829603 (+ 157us) write_op.cc:270] Start()
0503 19:56:00.829623 (+ 20us) write_op.cc:276] Timestamp: P: 1777838131902268 usec, L: 0
0503 19:56:00.830924 (+ 1301us) write_op.cc:270] Start()
0503 19:56:00.830950 (+ 26us) write_op.cc:276] Timestamp: P: 1777838131903383 usec, L: 0
0503 19:56:00.831561 (+ 611us) write_op.cc:270] Start()
0503 19:56:00.831586 (+ 25us) write_op.cc:276] Timestamp: P: 1777838131971102 usec, L: 0
0503 19:56:00.832288 (+ 702us) write_op.cc:270] Start()
0503 19:56:00.832312 (+ 24us) write_op.cc:276] Timestamp: P: 1777838131980046 usec, L: 0
0503 19:56:00.832465 (+ 153us) write_op.cc:270] Start()
0503 19:56:00.832485 (+ 20us) write_op.cc:276] Timestamp: P: 1777838131982961 usec, L: 0
0503 19:56:00.833571 (+ 1086us) write_op.cc:270] Start()
0503 19:56:00.833595 (+ 24us) write_op.cc:276] Timestamp: P: 1777838131989344 usec, L: 0
0503 19:56:00.834514 (+ 919us) write_op.cc:270] Start()
0503 19:56:00.834538 (+ 24us) write_op.cc:276] Timestamp: P: 1777838132025773 usec, L: 0
0503 19:56:00.843309 (+ 8771us) write_op.cc:270] Start()
0503 19:56:00.843362 (+ 53us) write_op.cc:276] Timestamp: P: 1777838132050193 usec, L: 0
0503 19:56:00.848422 (+ 5060us) write_op.cc:270] Start()
0503 19:56:00.848447 (+ 25us) write_op.cc:276] Timestamp: P: 1777838132052143 usec, L: 0
0503 19:56:00.853552 (+ 5105us) write_op.cc:270] Start()
0503 19:56:00.853585 (+ 33us) write_op.cc:276] Timestamp: P: 1777838132053092 usec, L: 0
0503 19:56:00.854410 (+ 825us) write_op.cc:270] Start()
0503 19:56:00.854435 (+ 25us) write_op.cc:276] Timestamp: P: 1777838132089620 usec, L: 0
0503 19:56:00.855247 (+ 812us) write_op.cc:270] Start()
0503 19:56:00.855275 (+ 28us) write_op.cc:276] Timestamp: P: 1777838132101548 usec, L: 0
0503 19:56:00.855602 (+ 327us) write_op.cc:270] Start()
0503 19:56:00.855625 (+ 23us) write_op.cc:276] Timestamp: P: 1777838132105487 usec, L: 0
0503 19:56:00.857756 (+ 2131us) write_op.cc:270] Start()
0503 19:56:00.857791 (+ 35us) write_op.cc:276] Timestamp: P: 1777838132124515 usec, L: 0
0503 19:56:00.858758 (+ 967us) write_op.cc:270] Start()
0503 19:56:00.858791 (+ 33us) write_op.cc:276] Timestamp: P: 1777838132162308 usec, L: 0
0503 19:56:00.859112 (+ 321us) write_op.cc:270] Start()
0503 19:56:00.859134 (+ 22us) write_op.cc:276] Timestamp: P: 1777838132171167 usec, L: 0
0503 19:56:00.862296 (+ 3162us) write_op.cc:270] Start()
0503 19:56:00.862328 (+ 32us) write_op.cc:276] Timestamp: P: 1777838132180487 usec, L: 0
0503 19:56:00.863176 (+ 848us) write_op.cc:270] Start()
0503 19:56:00.863203 (+ 27us) write_op.cc:276] Timestamp: P: 1777838132182063 usec, L: 0
0503 19:56:00.864310 (+ 1107us) write_op.cc:270] Start()
0503 19:56:00.864334 (+ 24us) write_op.cc:276] Timestamp: P: 1777838132215104 usec, L: 0
0503 19:56:00.864497 (+ 163us) write_op.cc:270] Start()
0503 19:56:00.864522 (+ 25us) write_op.cc:276] Timestamp: P: 1777838132226046 usec, L: 0
0503 19:56:00.870175 (+ 5653us) write_op.cc:270] Start()
0503 19:56:00.870373 (+ 198us) write_op.cc:276] Timestamp: P: 1777838132238290 usec, L: 0
0503 19:56:00.871141 (+ 768us) write_op.cc:270] Start()
0503 19:56:00.871169 (+ 28us) write_op.cc:276] Timestamp: P: 1777838132241636 usec, L: 0
0503 19:56:00.872149 (+ 980us) write_op.cc:270] Start()
0503 19:56:00.872173 (+ 24us) write_op.cc:276] Timestamp: P: 1777838132274872 usec, L: 0
0503 19:56:00.872336 (+ 163us) write_op.cc:270] Start()
0503 19:56:00.872356 (+ 20us) write_op.cc:276] Timestamp: P: 1777838132290063 usec, L: 0
0503 19:56:00.874674 (+ 2318us) write_op.cc:270] Start()
0503 19:56:00.874698 (+ 24us) write_op.cc:276] Timestamp: P: 1777838132294337 usec, L: 0
0503 19:56:00.876068 (+ 1370us) write_op.cc:270] Start()
0503 19:56:00.876094 (+ 26us) write_op.cc:276] Timestamp: P: 1777838132304230 usec, L: 0
0503 19:56:00.876260 (+ 166us) write_op.cc:270] Start()
0503 19:56:00.876280 (+ 20us) write_op.cc:276] Timestamp: P: 1777838132330659 usec, L: 0
0503 19:56:00.878994 (+ 2714us) write_op.cc:270] Start()
0503 19:56:00.879020 (+ 26us) write_op.cc:276] Timestamp: P: 1777838132351445 usec, L: 0
0503 19:56:00.879216 (+ 196us) write_op.cc:270] Start()
0503 19:56:00.879236 (+ 20us) write_op.cc:276] Timestamp: P: 1777838132353567 usec, L: 0
0503 19:56:00.879398 (+ 162us) write_op.cc:270] Start()
0503 19:56:00.879417 (+ 19us) write_op.cc:276] Timestamp: P: 1777838132371079 usec, L: 0
0503 19:56:00.879596 (+ 179us) write_op.cc:270] Start()
0503 19:56:00.879616 (+ 20us) write_op.cc:276] Timestamp: P: 1777838132411754 usec, L: 0
0503 19:56:00.879838 (+ 222us) write_op.cc:270] Start()
0503 19:56:00.879860 (+ 22us) write_op.cc:276] Timestamp: P: 1777838132413451 usec, L: 0
0503 19:56:00.880115 (+ 255us) write_op.cc:270] Start()
0503 19:56:00.880136 (+ 21us) write_op.cc:276] Timestamp: P: 1777838132418844 usec, L: 0
0503 19:56:00.882865 (+ 2729us) write_op.cc:270] Start()
0503 19:56:00.882891 (+ 26us) write_op.cc:276] Timestamp: P: 1777838132419542 usec, L: 0
0503 19:56:00.883514 (+ 623us) write_op.cc:270] Start()
0503 19:56:00.883537 (+ 23us) write_op.cc:276] Timestamp: P: 1777838132458693 usec, L: 0
0503 19:56:00.886571 (+ 3034us) write_op.cc:270] Start()
0503 19:56:00.886597 (+ 26us) write_op.cc:276] Timestamp: P: 1777838132470751 usec, L: 0
0503 19:56:00.887254 (+ 657us) write_op.cc:270] Start()
0503 19:56:00.887279 (+ 25us) write_op.cc:276] Timestamp: P: 1777838132491090 usec, L: 0
0503 19:56:00.887464 (+ 185us) write_op.cc:270] Start()
0503 19:56:00.887516 (+ 52us) write_op.cc:276] Timestamp: P: 1777838132492929 usec, L: 0
0503 19:56:00.887780 (+ 264us) write_op.cc:270] Start()
0503 19:56:00.887803 (+ 23us) write_op.cc:276] Timestamp: P: 1777838132513439 usec, L: 0
0503 19:56:00.888447 (+ 644us) write_op.cc:270] Start()
0503 19:56:00.888470 (+ 23us) write_op.cc:276] Timestamp: P: 1777838132547225 usec, L: 0
0503 19:56:00.888716 (+ 246us) write_op.cc:270] Start()
0503 19:56:00.888739 (+ 23us) write_op.cc:276] Timestamp: P: 1777838132548373 usec, L: 0
0503 19:56:00.897480 (+ 8741us) write_op.cc:270] Start()
0503 19:56:00.897509 (+ 29us) write_op.cc:276] Timestamp: P: 1777838132570911 usec, L: 0
0503 19:56:00.897697 (+ 188us) write_op.cc:270] Start()
0503 19:56:00.897718 (+ 21us) write_op.cc:276] Timestamp: P: 1777838132585048 usec, L: 0
0503 19:56:00.899564 (+ 1846us) write_op.cc:270] Start()
0503 19:56:00.899591 (+ 27us) write_op.cc:276] Timestamp: P: 1777838132612396 usec, L: 0
0503 19:56:00.899817 (+ 226us) write_op.cc:270] Start()
0503 19:56:00.899841 (+ 24us) write_op.cc:276] Timestamp: P: 1777838132616219 usec, L: 0
0503 19:56:00.901166 (+ 1325us) write_op.cc:270] Start()
0503 19:56:00.901193 (+ 27us) write_op.cc:276] Timestamp: P: 1777838132624364 usec, L: 0
0503 19:56:00.903004 (+ 1811us) write_op.cc:270] Start()
0503 19:56:00.903031 (+ 27us) write_op.cc:276] Timestamp: P: 1777838132658319 usec, L: 0
0503 19:56:00.903834 (+ 803us) write_op.cc:270] Start()
0503 19:56:00.903860 (+ 26us) write_op.cc:276] Timestamp: P: 1777838132671830 usec, L: 0
0503 19:56:00.904074 (+ 214us) write_op.cc:270] Start()
0503 19:56:00.904098 (+ 24us) write_op.cc:276] Timestamp: P: 1777838132676713 usec, L: 0
0503 19:56:00.905312 (+ 1214us) write_op.cc:270] Start()
0503 19:56:00.905338 (+ 26us) write_op.cc:276] Timestamp: P: 1777838132695562 usec, L: 0
0503 19:56:00.905907 (+ 569us) write_op.cc:270] Start()
0503 19:56:00.905932 (+ 25us) write_op.cc:276] Timestamp: P: 1777838132726174 usec, L: 0
0503 19:56:00.906486 (+ 554us) write_op.cc:270] Start()
0503 19:56:00.906509 (+ 23us) write_op.cc:276] Timestamp: P: 1777838132766258 usec, L: 0
0503 19:56:00.906673 (+ 164us) write_op.cc:270] Start()
0503 19:56:00.906694 (+ 21us) write_op.cc:276] Timestamp: P: 1777838132771877 usec, L: 0
0503 19:56:00.910566 (+ 3872us) write_op.cc:270] Start()
0503 19:56:00.910613 (+ 47us) write_op.cc:276] Timestamp: P: 1777838132781560 usec, L: 0
0503 19:56:00.911549 (+ 936us) write_op.cc:270] Start()
0503 19:56:00.911573 (+ 24us) write_op.cc:276] Timestamp: P: 1777838132796089 usec, L: 0
0503 19:56:00.912241 (+ 668us) write_op.cc:270] Start()
0503 19:56:00.912269 (+ 28us) write_op.cc:276] Timestamp: P: 1777838132829357 usec, L: 0
0503 19:56:00.912455 (+ 186us) write_op.cc:270] Start()
0503 19:56:00.912476 (+ 21us) write_op.cc:276] Timestamp: P: 1777838132839905 usec, L: 0
0503 19:56:00.913471 (+ 995us) write_op.cc:270] Start()
0503 19:56:00.913494 (+ 23us) write_op.cc:276] Timestamp: P: 1777838132855737 usec, L: 0
0503 19:56:00.914063 (+ 569us) write_op.cc:270] Start()
0503 19:56:00.914085 (+ 22us) write_op.cc:276] Timestamp: P: 1777838132856479 usec, L: 0
0503 19:56:00.914717 (+ 632us) write_op.cc:270] Start()
0503 19:56:00.914740 (+ 23us) write_op.cc:276] Timestamp: P: 1777838132868928 usec, L: 0
0503 19:56:00.914906 (+ 166us) write_op.cc:270] Start()
0503 19:56:00.914926 (+ 20us) write_op.cc:276] Timestamp: P: 1777838132905921 usec, L: 0
0503 19:56:00.919030 (+ 4104us) write_op.cc:270] Start()
0503 19:56:00.919065 (+ 35us) write_op.cc:276] Timestamp: P: 1777838132937402 usec, L: 0
0503 19:56:00.919747 (+ 682us) write_op.cc:270] Start()
0503 19:56:00.919770 (+ 23us) write_op.cc:276] Timestamp: P: 1777838132941999 usec, L: 0
0503 19:56:00.920385 (+ 615us) write_op.cc:270] Start()
0503 19:56:00.920410 (+ 25us) write_op.cc:276] Timestamp: P: 1777838132943221 usec, L: 0
0503 19:56:00.920567 (+ 157us) write_op.cc:270] Start()
0503 19:56:00.920586 (+ 19us) write_op.cc:276] Timestamp: P: 1777838132959981 usec, L: 0
0503 19:56:00.921655 (+ 1069us) write_op.cc:270] Start()
0503 19:56:00.921679 (+ 24us) write_op.cc:276] Timestamp: P: 1777838132993475 usec, L: 0
0503 19:56:00.925815 (+ 4136us) write_op.cc:270] Start()
0503 19:56:00.925840 (+ 25us) write_op.cc:276] Timestamp: P: 1777838133012951 usec, L: 0
0503 19:56:00.926515 (+ 675us) write_op.cc:270] Start()
0503 19:56:00.926537 (+ 22us) write_op.cc:276] Timestamp: P: 1777838133019335 usec, L: 0
0503 19:56:00.926718 (+ 181us) write_op.cc:270] Start()
0503 19:56:00.926738 (+ 20us) write_op.cc:276] Timestamp: P: 1777838133037110 usec, L: 0
0503 19:56:00.927800 (+ 1062us) write_op.cc:270] Start()
0503 19:56:00.927821 (+ 21us) write_op.cc:276] Timestamp: P: 1777838133064302 usec, L: 0
0503 19:56:00.928449 (+ 628us) write_op.cc:270] Start()
0503 19:56:00.928470 (+ 21us) write_op.cc:276] Timestamp: P: 1777838133098734 usec, L: 0
0503 19:56:00.929043 (+ 573us) write_op.cc:270] Start()
0503 19:56:00.929069 (+ 26us) write_op.cc:276] Timestamp: P: 1777838133103121 usec, L: 0
0503 19:56:00.929255 (+ 186us) write_op.cc:270] Start()
0503 19:56:00.929274 (+ 19us) write_op.cc:276] Timestamp: P: 1777838133104526 usec, L: 0
0503 19:56:00.930361 (+ 1087us) write_op.cc:270] Start()
0503 19:56:00.930384 (+ 23us) write_op.cc:276] Timestamp: P: 1777838133125388 usec, L: 0
0503 19:56:00.930989 (+ 605us) write_op.cc:270] Start()
0503 19:56:00.931013 (+ 24us) write_op.cc:276] Timestamp: P: 1777838133171309 usec, L: 0
0503 19:56:00.931614 (+ 601us) write_op.cc:270] Start()
0503 19:56:00.931670 (+ 56us) write_op.cc:276] Timestamp: P: 1777838133174143 usec, L: 0
0503 19:56:00.931831 (+ 161us) write_op.cc:270] Start()
0503 19:56:00.931850 (+ 19us) write_op.cc:276] Timestamp: P: 1777838133200931 usec, L: 0
0503 19:56:00.932978 (+ 1128us) write_op.cc:270] Start()
0503 19:56:00.933002 (+ 24us) write_op.cc:276] Timestamp: P: 1777838133209484 usec, L: 0
0503 19:56:00.933626 (+ 624us) write_op.cc:270] Start()
0503 19:56:00.933650 (+ 24us) write_op.cc:276] Timestamp: P: 1777838133242311 usec, L: 0
0503 19:56:00.934255 (+ 605us) write_op.cc:270] Start()
0503 19:56:00.934278 (+ 23us) write_op.cc:276] Timestamp: P: 1777838133250344 usec, L: 0
0503 19:56:00.934445 (+ 167us) write_op.cc:270] Start()
0503 19:56:00.934465 (+ 20us) write_op.cc:276] Timestamp: P: 1777838133269530 usec, L: 0
0503 19:56:00.935372 (+ 907us) write_op.cc:270] Start()
0503 19:56:00.935395 (+ 23us) write_op.cc:276] Timestamp: P: 1777838133270812 usec, L: 0
0503 19:56:00.936050 (+ 655us) write_op.cc:270] Start()
0503 19:56:00.936074 (+ 24us) write_op.cc:276] Timestamp: P: 1777838133316246 usec, L: 0
0503 19:56:00.936274 (+ 200us) write_op.cc:270] Start()
0503 19:56:00.936296 (+ 22us) write_op.cc:276] Timestamp: P: 1777838133337665 usec, L: 0
0503 19:56:00.937750 (+ 1454us) write_op.cc:270] Start()
0503 19:56:00.937770 (+ 20us) write_op.cc:276] Timestamp: P: 1777838133341066 usec, L: 0
0503 19:56:00.938338 (+ 568us) write_op.cc:270] Start()
0503 19:56:00.938361 (+ 23us) write_op.cc:276] Timestamp: P: 1777838133368208 usec, L: 0
0503 19:56:00.939051 (+ 690us) write_op.cc:270] Start()
0503 19:56:00.939075 (+ 24us) write_op.cc:276] Timestamp: P: 1777838133381686 usec, L: 0
0503 19:56:00.939256 (+ 181us) write_op.cc:270] Start()
0503 19:56:00.939281 (+ 25us) write_op.cc:276] Timestamp: P: 1777838133411859 usec, L: 0
0503 19:56:00.940314 (+ 1033us) write_op.cc:270] Start()
0503 19:56:00.940338 (+ 24us) write_op.cc:276] Timestamp: P: 1777838133414095 usec, L: 0
0503 19:56:00.941018 (+ 680us) write_op.cc:270] Start()
0503 19:56:00.941041 (+ 23us) write_op.cc:276] Timestamp: P: 1777838133431516 usec, L: 0
0503 19:56:00.941691 (+ 650us) write_op.cc:270] Start()
0503 19:56:00.941716 (+ 25us) write_op.cc:276] Timestamp: P: 1777838133466852 usec, L: 0
0503 19:56:00.941962 (+ 246us) write_op.cc:270] Start()
0503 19:56:00.941988 (+ 26us) write_op.cc:276] Timestamp: P: 1777838133479186 usec, L: 0
0503 19:56:00.942932 (+ 944us) write_op.cc:270] Start()
0503 19:56:00.942956 (+ 24us) write_op.cc:276] Timestamp: P: 1777838133505201 usec, L: 0
0503 19:56:00.944476 (+ 1520us) write_op.cc:270] Start()
0503 19:56:00.944519 (+ 43us) write_op.cc:276] Timestamp: P: 1777838133507262 usec, L: 0
0503 19:56:00.944763 (+ 244us) write_op.cc:270] Start()
0503 19:56:00.944786 (+ 23us) write_op.cc:276] Timestamp: P: 1777838133542297 usec, L: 0
0503 19:56:00.946267 (+ 1481us) write_op.cc:270] Start()
0503 19:56:00.946295 (+ 28us) write_op.cc:276] Timestamp: P: 1777838133545335 usec, L: 0
0503 19:56:00.946994 (+ 699us) write_op.cc:270] Start()
0503 19:56:00.947018 (+ 24us) write_op.cc:276] Timestamp: P: 1777838133572608 usec, L: 0
0503 19:56:00.947870 (+ 852us) write_op.cc:270] Start()
0503 19:56:00.947898 (+ 28us) write_op.cc:276] Timestamp: P: 1777838133580163 usec, L: 0
0503 19:56:00.948334 (+ 436us) write_op.cc:270] Start()
0503 19:56:00.948357 (+ 23us) write_op.cc:276] Timestamp: P: 1777838133616073 usec, L: 0
0503 19:56:00.949504 (+ 1147us) write_op.cc:270] Start()
0503 19:56:00.949530 (+ 26us) write_op.cc:276] Timestamp: P: 1777838133624553 usec, L: 0
0503 19:56:00.950321 (+ 791us) write_op.cc:270] Start()
0503 19:56:00.950348 (+ 27us) write_op.cc:276] Timestamp: P: 1777838133648806 usec, L: 0
0503 19:56:00.950908 (+ 560us) write_op.cc:270] Start()
0503 19:56:00.950934 (+ 26us) write_op.cc:276] Timestamp: P: 1777838133653779 usec, L: 0
0503 19:56:00.951589 (+ 655us) write_op.cc:270] Start()
0503 19:56:00.951613 (+ 24us) write_op.cc:276] Timestamp: P: 1777838133690150 usec, L: 0
0503 19:56:00.951820 (+ 207us) write_op.cc:270] Start()
0503 19:56:00.951843 (+ 23us) write_op.cc:276] Timestamp: P: 1777838133713918 usec, L: 0
0503 19:56:00.953109 (+ 1266us) write_op.cc:270] Start()
0503 19:56:00.953135 (+ 26us) write_op.cc:276] Timestamp: P: 1777838133730624 usec, L: 0
0503 19:56:00.954301 (+ 1166us) write_op.cc:270] Start()
0503 19:56:00.954333 (+ 32us) write_op.cc:276] Timestamp: P: 1777838133744584 usec, L: 0
0503 19:56:00.954501 (+ 168us) write_op.cc:270] Start()
0503 19:56:00.954521 (+ 20us) write_op.cc:276] Timestamp: P: 1777838133755791 usec, L: 0
0503 19:56:00.957769 (+ 3248us) write_op.cc:270] Start()
0503 19:56:00.957793 (+ 24us) write_op.cc:276] Timestamp: P: 1777838133780151 usec, L: 0
0503 19:56:00.959570 (+ 1777us) write_op.cc:270] Start()
0503 19:56:00.959597 (+ 27us) write_op.cc:276] Timestamp: P: 1777838133815293 usec, L: 0
0503 19:56:00.959862 (+ 265us) write_op.cc:270] Start()
0503 19:56:00.959884 (+ 22us) write_op.cc:276] Timestamp: P: 1777838133854651 usec, L: 0
0503 19:56:00.960050 (+ 166us) write_op.cc:270] Start()
0503 19:56:00.963252 (+ 3202us) write_op.cc:276] Timestamp: P: 1777838133888840 usec, L: 0
0503 19:56:00.963499 (+ 247us) write_op.cc:270] Start()
0503 19:56:00.963527 (+ 28us) write_op.cc:276] Timestamp: P: 1777838133897569 usec, L: 0
0503 19:56:00.963708 (+ 181us) write_op.cc:270] Start()
0503 19:56:00.963727 (+ 19us) write_op.cc:276] Timestamp: P: 1777838133917392 usec, L: 0
0503 19:56:00.975873 (+ 12146us) write_op.cc:270] Start()
0503 19:56:00.975900 (+ 27us) write_op.cc:276] Timestamp: P: 1777838133920097 usec, L: 0
0503 19:56:00.976096 (+ 196us) write_op.cc:270] Start()
0503 19:56:00.976117 (+ 21us) write_op.cc:276] Timestamp: P: 1777838133947308 usec, L: 0
0503 19:56:00.976327 (+ 210us) write_op.cc:270] Start()
0503 19:56:00.976350 (+ 23us) write_op.cc:276] Timestamp: P: 1777838133975074 usec, L: 0
0503 19:56:00.976564 (+ 214us) write_op.cc:270] Start()
0503 19:56:00.976584 (+ 20us) write_op.cc:276] Timestamp: P: 1777838133976207 usec, L: 0
0503 19:56:00.976780 (+ 196us) write_op.cc:270] Start()
0503 19:56:00.976799 (+ 19us) write_op.cc:276] Timestamp: P: 1777838133989342 usec, L: 0
0503 19:56:00.976999 (+ 200us) write_op.cc:270] Start()
0503 19:56:00.977020 (+ 21us) write_op.cc:276] Timestamp: P: 1777838134035915 usec, L: 0
0503 19:56:00.977229 (+ 209us) write_op.cc:270] Start()
0503 19:56:00.977253 (+ 24us) write_op.cc:276] Timestamp: P: 1777838134050677 usec, L: 0
0503 19:56:00.977470 (+ 217us) write_op.cc:270] Start()
0503 19:56:00.977490 (+ 20us) write_op.cc:276] Timestamp: P: 1777838134056311 usec, L: 0
0503 19:56:00.977676 (+ 186us) write_op.cc:270] Start()
0503 19:56:00.977696 (+ 20us) write_op.cc:276] Timestamp: P: 1777838134069166 usec, L: 0
0503 19:56:00.977867 (+ 171us) write_op.cc:270] Start()
0503 19:56:00.977885 (+ 18us) write_op.cc:276] Timestamp: P: 1777838134079765 usec, L: 0
0503 19:56:00.978099 (+ 214us) write_op.cc:270] Start()
0503 19:56:00.978124 (+ 25us) write_op.cc:276] Timestamp: P: 1777838134137031 usec, L: 0
0503 19:56:00.978309 (+ 185us) write_op.cc:270] Start()
0503 19:56:00.978344 (+ 35us) write_op.cc:276] Timestamp: P: 1777838134160657 usec, L: 0
0503 19:56:00.979246 (+ 902us) write_op.cc:270] Start()
0503 19:56:00.979324 (+ 78us) write_op.cc:276] Timestamp: P: 1777838134166887 usec, L: 0
0503 19:56:00.979558 (+ 234us) write_op.cc:270] Start()
0503 19:56:00.979581 (+ 23us) write_op.cc:276] Timestamp: P: 1777838134191302 usec, L: 0
0503 19:56:00.983787 (+ 4206us) write_op.cc:270] Start()
0503 19:56:00.983810 (+ 23us) write_op.cc:276] Timestamp: P: 1777838134214605 usec, L: 0
0503 19:56:00.985759 (+ 1949us) write_op.cc:270] Start()
0503 19:56:00.985787 (+ 28us) write_op.cc:276] Timestamp: P: 1777838134253661 usec, L: 0
0503 19:56:00.986029 (+ 242us) write_op.cc:270] Start()
0503 19:56:00.986052 (+ 23us) write_op.cc:276] Timestamp: P: 1777838134255184 usec, L: 0
0503 19:56:00.986786 (+ 734us) write_op.cc:270] Start()
0503 19:56:00.986825 (+ 39us) write_op.cc:276] Timestamp: P: 1777838134288880 usec, L: 0
0503 19:56:00.987085 (+ 260us) write_op.cc:270] Start()
0503 19:56:00.987108 (+ 23us) write_op.cc:276] Timestamp: P: 1777838134338556 usec, L: 0
0503 19:56:00.987586 (+ 478us) write_op.cc:270] Start()
0503 19:56:00.987610 (+ 24us) write_op.cc:276] Timestamp: P: 1777838134349195 usec, L: 0
0503 19:56:00.988227 (+ 617us) write_op.cc:270] Start()
0503 19:56:00.988252 (+ 25us) write_op.cc:276] Timestamp: P: 1777838134364764 usec, L: 0
0503 19:56:00.988487 (+ 235us) write_op.cc:270] Start()
0503 19:56:00.988509 (+ 22us) write_op.cc:276] Timestamp: P: 1777838134369808 usec, L: 0
0503 19:56:00.997150 (+ 8641us) write_op.cc:270] Start()
0503 19:56:00.997193 (+ 43us) write_op.cc:276] Timestamp: P: 1777838134428387 usec, L: 0
0503 19:56:00.997415 (+ 222us) write_op.cc:270] Start()
0503 19:56:00.997437 (+ 22us) write_op.cc:276] Timestamp: P: 1777838134438545 usec, L: 0
0503 19:56:00.997653 (+ 216us) write_op.cc:270] Start()
0503 19:56:00.997676 (+ 23us) write_op.cc:276] Timestamp: P: 1777838134453392 usec, L: 0
0503 19:56:00.999059 (+ 1383us) write_op.cc:270] Start()
0503 19:56:00.999084 (+ 25us) write_op.cc:276] Timestamp: P: 1777838134486240 usec, L: 0
0503 19:56:00.999513 (+ 429us) write_op.cc:270] Start()
0503 19:56:00.999537 (+ 24us) write_op.cc:276] Timestamp: P: 1777838134505936 usec, L: 0
0503 19:56:00.999795 (+ 258us) write_op.cc:270] Start()
0503 19:56:00.999822 (+ 27us) write_op.cc:276] Timestamp: P: 1777838134552049 usec, L: 0
0503 19:56:01.001162 (+ 1340us) write_op.cc:270] Start()
0503 19:56:01.001268 (+ 106us) write_op.cc:276] Timestamp: P: 1777838134555203 usec, L: 0
0503 19:56:01.001639 (+ 371us) write_op.cc:270] Start()
0503 19:56:01.001667 (+ 28us) write_op.cc:276] Timestamp: P: 1777838134562058 usec, L: 0
0503 19:56:01.004173 (+ 2506us) write_op.cc:270] Start()
0503 19:56:01.004208 (+ 35us) write_op.cc:276] Timestamp: P: 1777838134597559 usec, L: 0
0503 19:56:01.004470 (+ 262us) write_op.cc:270] Start()
0503 19:56:01.004496 (+ 26us) write_op.cc:276] Timestamp: P: 1777838134637067 usec, L: 0
0503 19:56:01.004703 (+ 207us) write_op.cc:270] Start()
0503 19:56:01.004966 (+ 263us) write_op.cc:276] Timestamp: P: 1777838134645905 usec, L: 0
0503 19:56:01.005264 (+ 298us) write_op.cc:270] Start()
0503 19:56:01.005291 (+ 27us) write_op.cc:276] Timestamp: P: 1777838134670764 usec, L: 0
0503 19:56:01.005495 (+ 204us) write_op.cc:270] Start()
0503 19:56:01.005517 (+ 22us) write_op.cc:276] Timestamp: P: 1777838134698474 usec, L: 0
0503 19:56:01.005768 (+ 251us) write_op.cc:270] Start()
0503 19:56:01.005819 (+ 51us) write_op.cc:276] Timestamp: P: 1777838134726288 usec, L: 0
0503 19:56:01.006358 (+ 539us) write_op.cc:270] Start()
0503 19:56:01.006416 (+ 58us) write_op.cc:276] Timestamp: P: 1777838134740486 usec, L: 0
0503 19:56:01.008799 (+ 2383us) write_op.cc:270] Start()
0503 19:56:01.008831 (+ 32us) write_op.cc:276] Timestamp: P: 1777838134764537 usec, L: 0
0503 19:56:01.009368 (+ 537us) write_op.cc:270] Start()
0503 19:56:01.009394 (+ 26us) write_op.cc:276] Timestamp: P: 1777838134780950 usec, L: 0
0503 19:56:01.009592 (+ 198us) write_op.cc:270] Start()
0503 19:56:01.009612 (+ 20us) write_op.cc:276] Timestamp: P: 1777838134850033 usec, L: 0
0503 19:56:01.009808 (+ 196us) write_op.cc:270] Start()
0503 19:56:01.009829 (+ 21us) write_op.cc:276] Timestamp: P: 1777838134875042 usec, L: 0
0503 19:56:01.010019 (+ 190us) write_op.cc:270] Start()
0503 19:56:01.010041 (+ 22us) write_op.cc:276] Timestamp: P: 1777838134877952 usec, L: 0
0503 19:56:01.010262 (+ 221us) write_op.cc:270] Start()
0503 19:56:01.010282 (+ 20us) write_op.cc:276] Times
I20260503 19:56:03.956197 1594 raft_consensus.cc:493] T d2bf53fe00c2417b872db2ecd4ede593 P 0e52aa88a17542609e84f0c09fb85d87 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a1219433b66444d091420ceeab5092ef)
I20260503 19:56:03.956615 1594 raft_consensus.cc:515] T d2bf53fe00c2417b872db2ecd4ede593 P 0e52aa88a17542609e84f0c09fb85d87 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:56:03.958598 731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2bf53fe00c2417b872db2ecd4ede593" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 3 candidate_status { last_received { term: 2 index: 1289 } } ignore_live_leader: false dest_uuid: "a1219433b66444d091420ceeab5092ef" is_pre_election: true
I20260503 19:56:03.960606 1594 leader_election.cc:290] T d2bf53fe00c2417b872db2ecd4ede593 P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1219433b66444d091420ceeab5092ef (127.0.105.2:38837), 6d99e4f4d5ca48e0bdb54daf8361c5e8 (127.0.105.3:35005)
I20260503 19:56:03.960655 860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2bf53fe00c2417b872db2ecd4ede593" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 3 candidate_status { last_received { term: 2 index: 1289 } } ignore_live_leader: false dest_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" is_pre_election: true
I20260503 19:56:03.961967 1358 leader_election.cc:304] T d2bf53fe00c2417b872db2ecd4ede593 P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e52aa88a17542609e84f0c09fb85d87; no voters: 6d99e4f4d5ca48e0bdb54daf8361c5e8, a1219433b66444d091420ceeab5092ef
I20260503 19:56:03.962978 1594 raft_consensus.cc:2749] T d2bf53fe00c2417b872db2ecd4ede593 P 0e52aa88a17542609e84f0c09fb85d87 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260503 19:56:04.166916 1551 mvcc.cc:204] Tried to move back new op lower bound from 7282025101767729152 to 7282024985337012224. Current Snapshot: MvccSnapshot[applied={T|T < 7282025038932193280 or (T in {7282025039039737856,7282025039173357568,7282025039116623872,7282025039381073920})}]
I20260503 19:56:04.280361 1594 raft_consensus.cc:493] T d2bf53fe00c2417b872db2ecd4ede593 P 0e52aa88a17542609e84f0c09fb85d87 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a1219433b66444d091420ceeab5092ef)
I20260503 19:56:04.280545 1594 raft_consensus.cc:515] T d2bf53fe00c2417b872db2ecd4ede593 P 0e52aa88a17542609e84f0c09fb85d87 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:56:04.281209 1594 leader_election.cc:290] T d2bf53fe00c2417b872db2ecd4ede593 P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1219433b66444d091420ceeab5092ef (127.0.105.2:38837), 6d99e4f4d5ca48e0bdb54daf8361c5e8 (127.0.105.3:35005)
I20260503 19:56:04.282239 860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2bf53fe00c2417b872db2ecd4ede593" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 3 candidate_status { last_received { term: 2 index: 1426 } } ignore_live_leader: false dest_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" is_pre_election: true
I20260503 19:56:04.282795 731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2bf53fe00c2417b872db2ecd4ede593" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 3 candidate_status { last_received { term: 2 index: 1426 } } ignore_live_leader: false dest_uuid: "a1219433b66444d091420ceeab5092ef" is_pre_election: true
I20260503 19:56:04.283879 1356 leader_election.cc:304] T d2bf53fe00c2417b872db2ecd4ede593 P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e52aa88a17542609e84f0c09fb85d87; no voters: 6d99e4f4d5ca48e0bdb54daf8361c5e8, a1219433b66444d091420ceeab5092ef
I20260503 19:56:04.284461 1594 raft_consensus.cc:2749] T d2bf53fe00c2417b872db2ecd4ede593 P 0e52aa88a17542609e84f0c09fb85d87 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260503 19:56:04.926127 1266 ts_manager.cc:284] Unset tserver state for 0e52aa88a17542609e84f0c09fb85d87 from MAINTENANCE_MODE
I20260503 19:56:04.941725 1493 heartbeater.cc:507] Master 127.0.105.62:45771 requested a full tablet report, sending...
I20260503 19:56:04.942817 776 heartbeater.cc:507] Master 127.0.105.62:45771 requested a full tablet report, sending...
I20260503 19:56:04.960559 1167 heartbeater.cc:507] Master 127.0.105.62:45771 requested a full tablet report, sending...
W20260503 19:56:05.170982 666 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.3:35005, user_credentials={real_user=slave}} blocked reactor thread for 57359.7us
I20260503 19:56:05.508176 907 heartbeater.cc:507] Master 127.0.105.62:45771 requested a full tablet report, sending...
W20260503 19:56:08.099136 918 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.105.3:35005, user_credentials={real_user=slave}} blocked reactor thread for 61376.5us
I20260503 19:56:08.349819 1620 raft_consensus.cc:493] T 3983c88812214bc0bfaaa35c08c38875 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d99e4f4d5ca48e0bdb54daf8361c5e8)
I20260503 19:56:08.449071 1620 raft_consensus.cc:515] T 3983c88812214bc0bfaaa35c08c38875 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:56:08.451112 731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3983c88812214bc0bfaaa35c08c38875" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1579 } } ignore_live_leader: false dest_uuid: "a1219433b66444d091420ceeab5092ef" is_pre_election: true
I20260503 19:56:08.451120 858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3983c88812214bc0bfaaa35c08c38875" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1579 } } ignore_live_leader: false dest_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" is_pre_election: true
I20260503 19:56:08.451290 1620 leader_election.cc:290] T 3983c88812214bc0bfaaa35c08c38875 P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1219433b66444d091420ceeab5092ef (127.0.105.2:38837), 6d99e4f4d5ca48e0bdb54daf8361c5e8 (127.0.105.3:35005)
I20260503 19:56:08.460228 1356 leader_election.cc:304] T 3983c88812214bc0bfaaa35c08c38875 P 0e52aa88a17542609e84f0c09fb85d87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e52aa88a17542609e84f0c09fb85d87; no voters: 6d99e4f4d5ca48e0bdb54daf8361c5e8, a1219433b66444d091420ceeab5092ef
I20260503 19:56:08.460628 1620 raft_consensus.cc:2749] T 3983c88812214bc0bfaaa35c08c38875 P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 19:56:08.654909 1266 ts_manager.cc:295] Set tserver state for 0e52aa88a17542609e84f0c09fb85d87 to MAINTENANCE_MODE
I20260503 19:56:08.659077 420 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-task4vf7p3/build/asan/bin/kudu pid 1341
I20260503 19:56:08.660621 1487 generic_service.cc:196] Checking for leaks (request via RPC)
W20260503 19:56:09.519924 1487 rpcz_store.cc:267] Call kudu.server.GenericService.CheckLeaks from 127.0.0.1:58682 (request call id 58) took 859 ms (client timeout 1000 ms). Trace:
W20260503 19:56:09.520321 1487 rpcz_store.cc:269] 0503 19:56:08.660321 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 19:56:08.660401 (+ 80us) service_pool.cc:224] Handling call
0503 19:56:09.519861 (+859460us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 19:56:09.520418 1629 raft_consensus.cc:493] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d99e4f4d5ca48e0bdb54daf8361c5e8)
I20260503 19:56:09.520653 1620 raft_consensus.cc:493] T d2bf53fe00c2417b872db2ecd4ede593 P 0e52aa88a17542609e84f0c09fb85d87 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a1219433b66444d091420ceeab5092ef)
I20260503 19:56:09.520572 1629 raft_consensus.cc:515] T 1c99d75cb2be4439a1610c0de343d73a P 0e52aa88a17542609e84f0c09fb85d87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:56:09.520756 1620 raft_consensus.cc:515] T d2bf53fe00c2417b872db2ecd4ede593 P 0e52aa88a17542609e84f0c09fb85d87 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } }
I20260503 19:56:09.521353 420 external_mini_cluster.cc:1658] Killing /tmp/dist-test-task4vf7p3/build/asan/bin/kudu with pid 1341
I20260503 19:56:09.523751 860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c99d75cb2be4439a1610c0de343d73a" candidate_uuid: "0e52aa88a17542609e84f0c09fb85d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1597 } } ignore_live_leader: false dest_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" is_pre_election: true
W20260503 19:56:09.627724 796 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.0.105.1:37847 (error 108) [suppressed 31 similar messages]
W20260503 19:56:09.628196 798 connection.cc:570] server connection from 127.0.105.1:36811 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260503 19:56:09.628865 665 connection.cc:570] client connection to 127.0.105.1:37847 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260503 19:56:09.629402 665 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107) [suppressed 63 similar messages]
W20260503 19:56:09.650954 796 consensus_peers.cc:597] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260503 19:56:09.651268 796 consensus_peers.cc:597] T 1c99d75cb2be4439a1610c0de343d73a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260503 19:56:09.651907 665 consensus_peers.cc:597] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260503 19:56:09.652143 665 consensus_peers.cc:597] T ecf4b80ba8714f24a49387dc8bbe2da3 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260503 19:56:09.652294 665 consensus_peers.cc:597] T 4d80fc29b7a64074b4a2ce4003054d1a P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260503 19:56:09.652433 665 consensus_peers.cc:597] T a860805e8df84220ae4be7d3279b75f1 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260503 19:56:10.054852 665 consensus_peers.cc:597] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260503 19:56:10.070350 796 consensus_peers.cc:597] T 1c99d75cb2be4439a1610c0de343d73a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260503 19:56:10.176545 665 consensus_peers.cc:597] T 4d80fc29b7a64074b4a2ce4003054d1a P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260503 19:56:10.177878 665 consensus_peers.cc:597] T a860805e8df84220ae4be7d3279b75f1 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260503 19:56:10.211313 796 consensus_peers.cc:597] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260503 19:56:10.247105 665 consensus_peers.cc:597] T ecf4b80ba8714f24a49387dc8bbe2da3 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260503 19:56:10.598783 665 consensus_peers.cc:597] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260503 19:56:10.615391 796 consensus_peers.cc:597] T 1c99d75cb2be4439a1610c0de343d73a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260503 19:56:10.660526 1627 consensus_queue.cc:579] T ecf4b80ba8714f24a49387dc8bbe2da3 P a1219433b66444d091420ceeab5092ef [LEADER]: Leader has been unable to successfully communicate with peer 0e52aa88a17542609e84f0c09fb85d87 for more than 2 seconds (2.014s)
I20260503 19:56:10.663688 1610 consensus_queue.cc:579] T 1c99d75cb2be4439a1610c0de343d73a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [LEADER]: Leader has been unable to successfully communicate with peer 0e52aa88a17542609e84f0c09fb85d87 for more than 2 seconds (2.003s)
I20260503 19:56:10.670454 1593 consensus_queue.cc:579] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef [LEADER]: Leader has been unable to successfully communicate with peer 0e52aa88a17542609e84f0c09fb85d87 for more than 2 seconds (2.024s)
I20260503 19:56:10.678678 1581 consensus_queue.cc:579] T a860805e8df84220ae4be7d3279b75f1 P a1219433b66444d091420ceeab5092ef [LEADER]: Leader has been unable to successfully communicate with peer 0e52aa88a17542609e84f0c09fb85d87 for more than 2 seconds (2.032s)
W20260503 19:56:10.685534 665 consensus_peers.cc:597] T a860805e8df84220ae4be7d3279b75f1 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260503 19:56:10.685721 665 consensus_peers.cc:597] T 4d80fc29b7a64074b4a2ce4003054d1a P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260503 19:56:10.708786 1628 consensus_queue.cc:579] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [LEADER]: Leader has been unable to successfully communicate with peer 0e52aa88a17542609e84f0c09fb85d87 for more than 2 seconds (2.055s)
W20260503 19:56:10.731619 796 consensus_peers.cc:597] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260503 19:56:10.770787 1607 consensus_queue.cc:579] T 4d80fc29b7a64074b4a2ce4003054d1a P a1219433b66444d091420ceeab5092ef [LEADER]: Leader has been unable to successfully communicate with peer 0e52aa88a17542609e84f0c09fb85d87 for more than 2 seconds (2.095s)
W20260503 19:56:10.797735 665 consensus_peers.cc:597] T ecf4b80ba8714f24a49387dc8bbe2da3 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260503 19:56:10.966774 1264 ts_manager.cc:284] Unset tserver state for 0e52aa88a17542609e84f0c09fb85d87 from MAINTENANCE_MODE
I20260503 19:56:10.985174 1167 heartbeater.cc:507] Master 127.0.105.62:45771 requested a full tablet report, sending...
W20260503 19:56:11.076535 665 consensus_peers.cc:597] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260503 19:56:11.178536 665 consensus_peers.cc:597] T 4d80fc29b7a64074b4a2ce4003054d1a P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260503 19:56:11.224104 665 consensus_peers.cc:597] T a860805e8df84220ae4be7d3279b75f1 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260503 19:56:11.222007 796 consensus_peers.cc:597] T 1c99d75cb2be4439a1610c0de343d73a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260503 19:56:11.294478 665 consensus_peers.cc:597] T ecf4b80ba8714f24a49387dc8bbe2da3 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260503 19:56:11.474421 796 consensus_peers.cc:597] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260503 19:56:11.589545 665 consensus_peers.cc:597] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260503 19:56:11.718425 907 heartbeater.cc:507] Master 127.0.105.62:45771 requested a full tablet report, sending...
W20260503 19:56:11.739449 665 consensus_peers.cc:597] T 4d80fc29b7a64074b4a2ce4003054d1a P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260503 19:56:11.788688 665 consensus_peers.cc:597] T a860805e8df84220ae4be7d3279b75f1 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260503 19:56:11.798941 796 consensus_peers.cc:597] T 1c99d75cb2be4439a1610c0de343d73a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260503 19:56:11.823503 776 heartbeater.cc:507] Master 127.0.105.62:45771 requested a full tablet report, sending...
I20260503 19:56:11.829319 859 consensus_queue.cc:237] T 1c99d75cb2be4439a1610c0de343d73a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1724, Committed index: 1724, Last appended: 1.1727, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 1728 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } } peers { permanent_uuid: "6ee23f35facc4d309ca4099163d9ccb2" member_type: NON_VOTER last_known_addr { host: "127.0.105.4" port: 36991 } attrs { promote: true } }
I20260503 19:56:11.832567 858 consensus_queue.cc:237] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1727, Committed index: 1727, Last appended: 1.1727, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 1728 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } } peers { permanent_uuid: "6ee23f35facc4d309ca4099163d9ccb2" member_type: NON_VOTER last_known_addr { host: "127.0.105.4" port: 36991 } attrs { promote: true } }
I20260503 19:56:11.839419 728 raft_consensus.cc:1275] T 1c99d75cb2be4439a1610c0de343d73a P a1219433b66444d091420ceeab5092ef [term 1 FOLLOWER]: Refusing update from remote peer 6d99e4f4d5ca48e0bdb54daf8361c5e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1726. Preceding OpId from leader: term: 1 index: 1728. (index mismatch)
I20260503 19:56:11.841027 728 raft_consensus.cc:1275] T 3983c88812214bc0bfaaa35c08c38875 P a1219433b66444d091420ceeab5092ef [term 1 FOLLOWER]: Refusing update from remote peer 6d99e4f4d5ca48e0bdb54daf8361c5e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1727. Preceding OpId from leader: term: 1 index: 1728. (index mismatch)
I20260503 19:56:11.843674 1643 consensus_queue.cc:1048] T 1c99d75cb2be4439a1610c0de343d73a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1728, Last known committed idx: 1724, Time since last communication: 0.000s
I20260503 19:56:11.844333 1610 consensus_queue.cc:1048] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1728, Last known committed idx: 1725, Time since last communication: 0.000s
W20260503 19:56:11.846871 665 consensus_peers.cc:597] T ecf4b80ba8714f24a49387dc8bbe2da3 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260503 19:56:11.856387 1610 raft_consensus.cc:2955] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 1 LEADER]: Committing config change with OpId 1.1728: config changed from index -1 to 1728, NON_VOTER 6ee23f35facc4d309ca4099163d9ccb2 (127.0.105.4) added. New config: { opid_index: 1728 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } } peers { permanent_uuid: "6ee23f35facc4d309ca4099163d9ccb2" member_type: NON_VOTER last_known_addr { host: "127.0.105.4" port: 36991 } attrs { promote: true } } }
I20260503 19:56:11.859975 730 consensus_queue.cc:237] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1724, Committed index: 1724, Last appended: 2.1728, Last appended by leader: 162, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 1729 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } } peers { permanent_uuid: "6ee23f35facc4d309ca4099163d9ccb2" member_type: NON_VOTER last_known_addr { host: "127.0.105.4" port: 36991 } attrs { promote: true } }
I20260503 19:56:11.860347 728 consensus_queue.cc:237] T a860805e8df84220ae4be7d3279b75f1 P a1219433b66444d091420ceeab5092ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1723, Committed index: 1723, Last appended: 1.1727, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 1728 OBSOLETE_local: false peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "6ee23f35facc4d309ca4099163d9ccb2" member_type: NON_VOTER last_known_addr { host: "127.0.105.4" port: 36991 } attrs { promote: true } }
I20260503 19:56:11.861338 727 consensus_queue.cc:237] T 4d80fc29b7a64074b4a2ce4003054d1a P a1219433b66444d091420ceeab5092ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1723, Committed index: 1723, Last appended: 1.1727, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 1728 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } } peers { permanent_uuid: "6ee23f35facc4d309ca4099163d9ccb2" member_type: NON_VOTER last_known_addr { host: "127.0.105.4" port: 36991 } attrs { promote: true } }
I20260503 19:56:11.862962 729 consensus_queue.cc:237] T ecf4b80ba8714f24a49387dc8bbe2da3 P a1219433b66444d091420ceeab5092ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1723, Committed index: 1723, Last appended: 1.1727, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 1728 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } } peers { permanent_uuid: "6ee23f35facc4d309ca4099163d9ccb2" member_type: NON_VOTER last_known_addr { host: "127.0.105.4" port: 36991 } attrs { promote: true } }
I20260503 19:56:11.872597 1249 catalog_manager.cc:5184] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 3983c88812214bc0bfaaa35c08c38875 with cas_config_opid_index -1: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20260503 19:56:11.879940 862 raft_consensus.cc:1275] T d2bf53fe00c2417b872db2ecd4ede593 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 2 FOLLOWER]: Refusing update from remote peer a1219433b66444d091420ceeab5092ef: Log matching property violated. Preceding OpId in replica: term: 2 index: 1728. Preceding OpId from leader: term: 2 index: 1729. (index mismatch)
I20260503 19:56:11.884554 861 raft_consensus.cc:1275] T 4d80fc29b7a64074b4a2ce4003054d1a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 1 FOLLOWER]: Refusing update from remote peer a1219433b66444d091420ceeab5092ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1727. Preceding OpId from leader: term: 1 index: 1728. (index mismatch)
I20260503 19:56:11.884821 856 raft_consensus.cc:1275] T ecf4b80ba8714f24a49387dc8bbe2da3 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 1 FOLLOWER]: Refusing update from remote peer a1219433b66444d091420ceeab5092ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1727. Preceding OpId from leader: term: 1 index: 1728. (index mismatch)
I20260503 19:56:11.885728 855 raft_consensus.cc:1275] T a860805e8df84220ae4be7d3279b75f1 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 1 FOLLOWER]: Refusing update from remote peer a1219433b66444d091420ceeab5092ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1727. Preceding OpId from leader: term: 1 index: 1728. (index mismatch)
I20260503 19:56:11.886693 1643 raft_consensus.cc:2955] T 1c99d75cb2be4439a1610c0de343d73a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 1 LEADER]: Committing config change with OpId 1.1728: config changed from index -1 to 1728, NON_VOTER 6ee23f35facc4d309ca4099163d9ccb2 (127.0.105.4) added. New config: { opid_index: 1728 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } } peers { permanent_uuid: "6ee23f35facc4d309ca4099163d9ccb2" member_type: NON_VOTER last_known_addr { host: "127.0.105.4" port: 36991 } attrs { promote: true } } }
I20260503 19:56:11.886749 728 raft_consensus.cc:2955] T 3983c88812214bc0bfaaa35c08c38875 P a1219433b66444d091420ceeab5092ef [term 1 FOLLOWER]: Committing config change with OpId 1.1728: config changed from index -1 to 1728, NON_VOTER 6ee23f35facc4d309ca4099163d9ccb2 (127.0.105.4) added. New config: { opid_index: 1728 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } } peers { permanent_uuid: "6ee23f35facc4d309ca4099163d9ccb2" member_type: NON_VOTER last_known_addr { host: "127.0.105.4" port: 36991 } attrs { promote: true } } }
W20260503 19:56:11.894090 797 consensus_peers.cc:597] T 1c99d75cb2be4439a1610c0de343d73a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 6ee23f35facc4d309ca4099163d9ccb2 (127.0.105.4:36991): Couldn't send request to peer 6ee23f35facc4d309ca4099163d9ccb2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c99d75cb2be4439a1610c0de343d73a. This is attempt 1: this message will repeat every 5th retry.
W20260503 19:56:11.894476 797 consensus_peers.cc:597] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 6ee23f35facc4d309ca4099163d9ccb2 (127.0.105.4:36991): Couldn't send request to peer 6ee23f35facc4d309ca4099163d9ccb2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3983c88812214bc0bfaaa35c08c38875. This is attempt 1: this message will repeat every 5th retry.
I20260503 19:56:11.895903 1607 consensus_queue.cc:1048] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1729, Last known committed idx: 1724, Time since last communication: 0.000s
I20260503 19:56:11.896432 1607 consensus_queue.cc:1048] T 4d80fc29b7a64074b4a2ce4003054d1a P a1219433b66444d091420ceeab5092ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1728, Last known committed idx: 1723, Time since last communication: 0.000s
I20260503 19:56:11.896886 1607 consensus_queue.cc:1048] T ecf4b80ba8714f24a49387dc8bbe2da3 P a1219433b66444d091420ceeab5092ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1728, Last known committed idx: 1723, Time since last communication: 0.000s
I20260503 19:56:11.897961 1607 consensus_queue.cc:1048] T a860805e8df84220ae4be7d3279b75f1 P a1219433b66444d091420ceeab5092ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1728, Last known committed idx: 1723, Time since last communication: 0.000s
W20260503 19:56:11.898625 665 consensus_peers.cc:597] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260503 19:56:11.898936 665 consensus_peers.cc:597] T 4d80fc29b7a64074b4a2ce4003054d1a P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260503 19:56:11.899082 665 consensus_peers.cc:597] T a860805e8df84220ae4be7d3279b75f1 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260503 19:56:11.899210 665 consensus_peers.cc:597] T ecf4b80ba8714f24a49387dc8bbe2da3 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260503 19:56:11.900234 666 consensus_peers.cc:597] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef -> Peer 6ee23f35facc4d309ca4099163d9ccb2 (127.0.105.4:36991): Couldn't send request to peer 6ee23f35facc4d309ca4099163d9ccb2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d2bf53fe00c2417b872db2ecd4ede593. This is attempt 1: this message will repeat every 5th retry.
W20260503 19:56:11.900434 666 consensus_peers.cc:597] T 4d80fc29b7a64074b4a2ce4003054d1a P a1219433b66444d091420ceeab5092ef -> Peer 6ee23f35facc4d309ca4099163d9ccb2 (127.0.105.4:36991): Couldn't send request to peer 6ee23f35facc4d309ca4099163d9ccb2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4d80fc29b7a64074b4a2ce4003054d1a. This is attempt 1: this message will repeat every 5th retry.
W20260503 19:56:11.900574 666 consensus_peers.cc:597] T ecf4b80ba8714f24a49387dc8bbe2da3 P a1219433b66444d091420ceeab5092ef -> Peer 6ee23f35facc4d309ca4099163d9ccb2 (127.0.105.4:36991): Couldn't send request to peer 6ee23f35facc4d309ca4099163d9ccb2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ecf4b80ba8714f24a49387dc8bbe2da3. This is attempt 1: this message will repeat every 5th retry.
W20260503 19:56:11.900697 666 consensus_peers.cc:597] T a860805e8df84220ae4be7d3279b75f1 P a1219433b66444d091420ceeab5092ef -> Peer 6ee23f35facc4d309ca4099163d9ccb2 (127.0.105.4:36991): Couldn't send request to peer 6ee23f35facc4d309ca4099163d9ccb2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a860805e8df84220ae4be7d3279b75f1. This is attempt 1: this message will repeat every 5th retry.
W20260503 19:56:11.902207 796 consensus_peers.cc:597] T 1c99d75cb2be4439a1610c0de343d73a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260503 19:56:11.902455 796 consensus_peers.cc:597] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260503 19:56:11.903940 1607 raft_consensus.cc:2955] T 4d80fc29b7a64074b4a2ce4003054d1a P a1219433b66444d091420ceeab5092ef [term 1 LEADER]: Committing config change with OpId 1.1728: config changed from index -1 to 1728, NON_VOTER 6ee23f35facc4d309ca4099163d9ccb2 (127.0.105.4) added. New config: { opid_index: 1728 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } } peers { permanent_uuid: "6ee23f35facc4d309ca4099163d9ccb2" member_type: NON_VOTER last_known_addr { host: "127.0.105.4" port: 36991 } attrs { promote: true } } }
I20260503 19:56:11.908588 1627 raft_consensus.cc:2955] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef [term 2 LEADER]: Committing config change with OpId 2.1729: config changed from index -1 to 1729, NON_VOTER 6ee23f35facc4d309ca4099163d9ccb2 (127.0.105.4) added. New config: { opid_index: 1729 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } } peers { permanent_uuid: "6ee23f35facc4d309ca4099163d9ccb2" member_type: NON_VOTER last_known_addr { host: "127.0.105.4" port: 36991 } attrs { promote: true } } }
I20260503 19:56:11.911887 1573 raft_consensus.cc:2955] T ecf4b80ba8714f24a49387dc8bbe2da3 P a1219433b66444d091420ceeab5092ef [term 1 LEADER]: Committing config change with OpId 1.1728: config changed from index -1 to 1728, NON_VOTER 6ee23f35facc4d309ca4099163d9ccb2 (127.0.105.4) added. New config: { opid_index: 1728 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } } peers { permanent_uuid: "6ee23f35facc4d309ca4099163d9ccb2" member_type: NON_VOTER last_known_addr { host: "127.0.105.4" port: 36991 } attrs { promote: true } } }
I20260503 19:56:11.912928 1247 catalog_manager.cc:5184] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 4d80fc29b7a64074b4a2ce4003054d1a with cas_config_opid_index -1: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20260503 19:56:11.916893 1247 catalog_manager.cc:5184] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet d2bf53fe00c2417b872db2ecd4ede593 with cas_config_opid_index -1: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20260503 19:56:11.917346 1637 raft_consensus.cc:2955] T a860805e8df84220ae4be7d3279b75f1 P a1219433b66444d091420ceeab5092ef [term 1 LEADER]: Committing config change with OpId 1.1728: config changed from index -1 to 1728, NON_VOTER 6ee23f35facc4d309ca4099163d9ccb2 (127.0.105.4) added. New config: { opid_index: 1728 OBSOLETE_local: false peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "6ee23f35facc4d309ca4099163d9ccb2" member_type: NON_VOTER last_known_addr { host: "127.0.105.4" port: 36991 } attrs { promote: true } } }
I20260503 19:56:11.918948 1247 catalog_manager.cc:5184] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet ecf4b80ba8714f24a49387dc8bbe2da3 with cas_config_opid_index -1: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20260503 19:56:11.923048 861 raft_consensus.cc:2955] T ecf4b80ba8714f24a49387dc8bbe2da3 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 1 FOLLOWER]: Committing config change with OpId 1.1728: config changed from index -1 to 1728, NON_VOTER 6ee23f35facc4d309ca4099163d9ccb2 (127.0.105.4) added. New config: { opid_index: 1728 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } } peers { permanent_uuid: "6ee23f35facc4d309ca4099163d9ccb2" member_type: NON_VOTER last_known_addr { host: "127.0.105.4" port: 36991 } attrs { promote: true } } }
I20260503 19:56:11.923497 858 raft_consensus.cc:2955] T d2bf53fe00c2417b872db2ecd4ede593 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 2 FOLLOWER]: Committing config change with OpId 2.1729: config changed from index -1 to 1729, NON_VOTER 6ee23f35facc4d309ca4099163d9ccb2 (127.0.105.4) added. New config: { opid_index: 1729 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } } peers { permanent_uuid: "6ee23f35facc4d309ca4099163d9ccb2" member_type: NON_VOTER last_known_addr { host: "127.0.105.4" port: 36991 } attrs { promote: true } } }
I20260503 19:56:11.928647 856 raft_consensus.cc:2955] T a860805e8df84220ae4be7d3279b75f1 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 1 FOLLOWER]: Committing config change with OpId 1.1728: config changed from index -1 to 1728, NON_VOTER 6ee23f35facc4d309ca4099163d9ccb2 (127.0.105.4) added. New config: { opid_index: 1728 OBSOLETE_local: false peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "6ee23f35facc4d309ca4099163d9ccb2" member_type: NON_VOTER last_known_addr { host: "127.0.105.4" port: 36991 } attrs { promote: true } } }
I20260503 19:56:11.929795 855 raft_consensus.cc:2955] T 4d80fc29b7a64074b4a2ce4003054d1a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 1 FOLLOWER]: Committing config change with OpId 1.1728: config changed from index -1 to 1728, NON_VOTER 6ee23f35facc4d309ca4099163d9ccb2 (127.0.105.4) added. New config: { opid_index: 1728 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } } peers { permanent_uuid: "6ee23f35facc4d309ca4099163d9ccb2" member_type: NON_VOTER last_known_addr { host: "127.0.105.4" port: 36991 } attrs { promote: true } } }
I20260503 19:56:11.882678 1264 catalog_manager.cc:5671] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 reported cstate change: config changed from index -1 to 1728, NON_VOTER 6ee23f35facc4d309ca4099163d9ccb2 (127.0.105.4) added. New cstate: current_term: 1 leader_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" committed_config { opid_index: 1728 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ee23f35facc4d309ca4099163d9ccb2" member_type: NON_VOTER last_known_addr { host: "127.0.105.4" port: 36991 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260503 19:56:11.940768 1249 catalog_manager.cc:5184] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 1c99d75cb2be4439a1610c0de343d73a with cas_config_opid_index -1: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20260503 19:56:11.977056 1247 catalog_manager.cc:5184] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet a860805e8df84220ae4be7d3279b75f1 with cas_config_opid_index -1: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20260503 19:56:11.999047 1656 ts_tablet_manager.cc:933] T 3983c88812214bc0bfaaa35c08c38875 P 6ee23f35facc4d309ca4099163d9ccb2: Initiating tablet copy from peer 6d99e4f4d5ca48e0bdb54daf8361c5e8 (127.0.105.3:35005)
I20260503 19:56:11.998860 728 raft_consensus.cc:2955] T 1c99d75cb2be4439a1610c0de343d73a P a1219433b66444d091420ceeab5092ef [term 1 FOLLOWER]: Committing config change with OpId 1.1728: config changed from index -1 to 1728, NON_VOTER 6ee23f35facc4d309ca4099163d9ccb2 (127.0.105.4) added. New config: { opid_index: 1728 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } } peers { permanent_uuid: "6ee23f35facc4d309ca4099163d9ccb2" member_type: NON_VOTER last_known_addr { host: "127.0.105.4" port: 36991 } attrs { promote: true } } }
I20260503 19:56:12.009460 1657 ts_tablet_manager.cc:933] T 1c99d75cb2be4439a1610c0de343d73a P 6ee23f35facc4d309ca4099163d9ccb2: Initiating tablet copy from peer 6d99e4f4d5ca48e0bdb54daf8361c5e8 (127.0.105.3:35005)
I20260503 19:56:12.009899 1655 ts_tablet_manager.cc:933] T d2bf53fe00c2417b872db2ecd4ede593 P 6ee23f35facc4d309ca4099163d9ccb2: Initiating tablet copy from peer a1219433b66444d091420ceeab5092ef (127.0.105.2:38837)
I20260503 19:56:12.011425 1654 ts_tablet_manager.cc:933] T a860805e8df84220ae4be7d3279b75f1 P 6ee23f35facc4d309ca4099163d9ccb2: Initiating tablet copy from peer a1219433b66444d091420ceeab5092ef (127.0.105.2:38837)
I20260503 19:56:12.012753 1657 tablet_copy_client.cc:323] T 1c99d75cb2be4439a1610c0de343d73a P 6ee23f35facc4d309ca4099163d9ccb2: tablet copy: Beginning tablet copy session from remote peer at address 127.0.105.3:35005
I20260503 19:56:12.012899 1656 tablet_copy_client.cc:323] T 3983c88812214bc0bfaaa35c08c38875 P 6ee23f35facc4d309ca4099163d9ccb2: tablet copy: Beginning tablet copy session from remote peer at address 127.0.105.3:35005
I20260503 19:56:12.013670 1655 tablet_copy_client.cc:323] T d2bf53fe00c2417b872db2ecd4ede593 P 6ee23f35facc4d309ca4099163d9ccb2: tablet copy: Beginning tablet copy session from remote peer at address 127.0.105.2:38837
I20260503 19:56:12.015431 1658 ts_tablet_manager.cc:933] T ecf4b80ba8714f24a49387dc8bbe2da3 P 6ee23f35facc4d309ca4099163d9ccb2: Initiating tablet copy from peer a1219433b66444d091420ceeab5092ef (127.0.105.2:38837)
I20260503 19:56:12.016306 1653 ts_tablet_manager.cc:933] T 4d80fc29b7a64074b4a2ce4003054d1a P 6ee23f35facc4d309ca4099163d9ccb2: Initiating tablet copy from peer a1219433b66444d091420ceeab5092ef (127.0.105.2:38837)
I20260503 19:56:12.070660 1654 tablet_copy_client.cc:323] T a860805e8df84220ae4be7d3279b75f1 P 6ee23f35facc4d309ca4099163d9ccb2: tablet copy: Beginning tablet copy session from remote peer at address 127.0.105.2:38837
I20260503 19:56:12.071557 1653 tablet_copy_client.cc:323] T 4d80fc29b7a64074b4a2ce4003054d1a P 6ee23f35facc4d309ca4099163d9ccb2: tablet copy: Beginning tablet copy session from remote peer at address 127.0.105.2:38837
I20260503 19:56:12.081655 1658 tablet_copy_client.cc:323] T ecf4b80ba8714f24a49387dc8bbe2da3 P 6ee23f35facc4d309ca4099163d9ccb2: tablet copy: Beginning tablet copy session from remote peer at address 127.0.105.2:38837
I20260503 19:56:12.092499 751 tablet_copy_service.cc:140] P a1219433b66444d091420ceeab5092ef: Received BeginTabletCopySession request for tablet d2bf53fe00c2417b872db2ecd4ede593 from peer 6ee23f35facc4d309ca4099163d9ccb2 ({username='slave'} at 127.0.105.4:36285)
I20260503 19:56:12.092839 751 tablet_copy_service.cc:161] P a1219433b66444d091420ceeab5092ef: Beginning new tablet copy session on tablet d2bf53fe00c2417b872db2ecd4ede593 from peer 6ee23f35facc4d309ca4099163d9ccb2 at {username='slave'} at 127.0.105.4:36285: session id = 6ee23f35facc4d309ca4099163d9ccb2-d2bf53fe00c2417b872db2ecd4ede593
I20260503 19:56:12.095393 749 tablet_copy_service.cc:140] P a1219433b66444d091420ceeab5092ef: Received BeginTabletCopySession request for tablet 4d80fc29b7a64074b4a2ce4003054d1a from peer 6ee23f35facc4d309ca4099163d9ccb2 ({username='slave'} at 127.0.105.4:36285)
I20260503 19:56:12.095665 749 tablet_copy_service.cc:161] P a1219433b66444d091420ceeab5092ef: Beginning new tablet copy session on tablet 4d80fc29b7a64074b4a2ce4003054d1a from peer 6ee23f35facc4d309ca4099163d9ccb2 at {username='slave'} at 127.0.105.4:36285: session id = 6ee23f35facc4d309ca4099163d9ccb2-4d80fc29b7a64074b4a2ce4003054d1a
I20260503 19:56:12.092499 750 tablet_copy_service.cc:140] P a1219433b66444d091420ceeab5092ef: Received BeginTabletCopySession request for tablet a860805e8df84220ae4be7d3279b75f1 from peer 6ee23f35facc4d309ca4099163d9ccb2 ({username='slave'} at 127.0.105.4:36285)
I20260503 19:56:12.102224 750 tablet_copy_service.cc:161] P a1219433b66444d091420ceeab5092ef: Beginning new tablet copy session on tablet a860805e8df84220ae4be7d3279b75f1 from peer 6ee23f35facc4d309ca4099163d9ccb2 at {username='slave'} at 127.0.105.4:36285: session id = 6ee23f35facc4d309ca4099163d9ccb2-a860805e8df84220ae4be7d3279b75f1
I20260503 19:56:12.106174 750 tablet_copy_source_session.cc:215] T a860805e8df84220ae4be7d3279b75f1 P a1219433b66444d091420ceeab5092ef: Tablet Copy: opened 0 blocks and 1 log segments
I20260503 19:56:12.110450 751 tablet_copy_source_session.cc:215] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef: Tablet Copy: opened 0 blocks and 1 log segments
I20260503 19:56:12.110433 882 tablet_copy_service.cc:140] P 6d99e4f4d5ca48e0bdb54daf8361c5e8: Received BeginTabletCopySession request for tablet 1c99d75cb2be4439a1610c0de343d73a from peer 6ee23f35facc4d309ca4099163d9ccb2 ({username='slave'} at 127.0.105.4:44239)
I20260503 19:56:12.110721 882 tablet_copy_service.cc:161] P 6d99e4f4d5ca48e0bdb54daf8361c5e8: Beginning new tablet copy session on tablet 1c99d75cb2be4439a1610c0de343d73a from peer 6ee23f35facc4d309ca4099163d9ccb2 at {username='slave'} at 127.0.105.4:44239: session id = 6ee23f35facc4d309ca4099163d9ccb2-1c99d75cb2be4439a1610c0de343d73a
I20260503 19:56:12.110875 749 tablet_copy_source_session.cc:215] T 4d80fc29b7a64074b4a2ce4003054d1a P a1219433b66444d091420ceeab5092ef: Tablet Copy: opened 0 blocks and 1 log segments
I20260503 19:56:12.115128 882 tablet_copy_source_session.cc:215] T 1c99d75cb2be4439a1610c0de343d73a P 6d99e4f4d5ca48e0bdb54daf8361c5e8: Tablet Copy: opened 0 blocks and 1 log segments
I20260503 19:56:12.115829 881 tablet_copy_service.cc:140] P 6d99e4f4d5ca48e0bdb54daf8361c5e8: Received BeginTabletCopySession request for tablet 3983c88812214bc0bfaaa35c08c38875 from peer 6ee23f35facc4d309ca4099163d9ccb2 ({username='slave'} at 127.0.105.4:44239)
I20260503 19:56:12.116102 881 tablet_copy_service.cc:161] P 6d99e4f4d5ca48e0bdb54daf8361c5e8: Beginning new tablet copy session on tablet 3983c88812214bc0bfaaa35c08c38875 from peer 6ee23f35facc4d309ca4099163d9ccb2 at {username='slave'} at 127.0.105.4:44239: session id = 6ee23f35facc4d309ca4099163d9ccb2-3983c88812214bc0bfaaa35c08c38875
I20260503 19:56:12.137842 1266 catalog_manager.cc:5671] T 1c99d75cb2be4439a1610c0de343d73a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 reported cstate change: config changed from index -1 to 1728, NON_VOTER 6ee23f35facc4d309ca4099163d9ccb2 (127.0.105.4) added. New cstate: current_term: 1 leader_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" committed_config { opid_index: 1728 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ee23f35facc4d309ca4099163d9ccb2" member_type: NON_VOTER last_known_addr { host: "127.0.105.4" port: 36991 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260503 19:56:12.138744 1266 catalog_manager.cc:5671] T 4d80fc29b7a64074b4a2ce4003054d1a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 reported cstate change: config changed from index -1 to 1728, NON_VOTER 6ee23f35facc4d309ca4099163d9ccb2 (127.0.105.4) added. New cstate: current_term: 1 leader_uuid: "a1219433b66444d091420ceeab5092ef" committed_config { opid_index: 1728 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } } peers { permanent_uuid: "6ee23f35facc4d309ca4099163d9ccb2" member_type: NON_VOTER last_known_addr { host: "127.0.105.4" port: 36991 } attrs { promote: true } } }
I20260503 19:56:12.139847 1266 catalog_manager.cc:5671] T d2bf53fe00c2417b872db2ecd4ede593 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 reported cstate change: config changed from index -1 to 1729, NON_VOTER 6ee23f35facc4d309ca4099163d9ccb2 (127.0.105.4) added. New cstate: current_term: 2 leader_uuid: "a1219433b66444d091420ceeab5092ef" committed_config { opid_index: 1729 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } } peers { permanent_uuid: "6ee23f35facc4d309ca4099163d9ccb2" member_type: NON_VOTER last_known_addr { host: "127.0.105.4" port: 36991 } attrs { promote: true } } }
I20260503 19:56:12.140959 1266 catalog_manager.cc:5671] T a860805e8df84220ae4be7d3279b75f1 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 reported cstate change: config changed from index -1 to 1728, NON_VOTER 6ee23f35facc4d309ca4099163d9ccb2 (127.0.105.4) added. New cstate: current_term: 1 leader_uuid: "a1219433b66444d091420ceeab5092ef" committed_config { opid_index: 1728 OBSOLETE_local: false peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "6ee23f35facc4d309ca4099163d9ccb2" member_type: NON_VOTER last_known_addr { host: "127.0.105.4" port: 36991 } attrs { promote: true } } }
I20260503 19:56:12.142985 1266 catalog_manager.cc:5671] T ecf4b80ba8714f24a49387dc8bbe2da3 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 reported cstate change: config changed from index -1 to 1728, NON_VOTER 6ee23f35facc4d309ca4099163d9ccb2 (127.0.105.4) added. New cstate: current_term: 1 leader_uuid: "a1219433b66444d091420ceeab5092ef" committed_config { opid_index: 1728 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } } peers { permanent_uuid: "6ee23f35facc4d309ca4099163d9ccb2" member_type: NON_VOTER last_known_addr { host: "127.0.105.4" port: 36991 } attrs { promote: true } } }
I20260503 19:56:12.162127 881 tablet_copy_source_session.cc:215] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8: Tablet Copy: opened 0 blocks and 1 log segments
I20260503 19:56:12.181520 1654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a860805e8df84220ae4be7d3279b75f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 19:56:12.182400 1657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c99d75cb2be4439a1610c0de343d73a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 19:56:12.186547 1655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2bf53fe00c2417b872db2ecd4ede593. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 19:56:12.187005 1653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d80fc29b7a64074b4a2ce4003054d1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 19:56:12.189628 749 tablet_copy_service.cc:140] P a1219433b66444d091420ceeab5092ef: Received BeginTabletCopySession request for tablet ecf4b80ba8714f24a49387dc8bbe2da3 from peer 6ee23f35facc4d309ca4099163d9ccb2 ({username='slave'} at 127.0.105.4:36285)
I20260503 19:56:12.189862 749 tablet_copy_service.cc:161] P a1219433b66444d091420ceeab5092ef: Beginning new tablet copy session on tablet ecf4b80ba8714f24a49387dc8bbe2da3 from peer 6ee23f35facc4d309ca4099163d9ccb2 at {username='slave'} at 127.0.105.4:36285: session id = 6ee23f35facc4d309ca4099163d9ccb2-ecf4b80ba8714f24a49387dc8bbe2da3
I20260503 19:56:12.193411 749 tablet_copy_source_session.cc:215] T ecf4b80ba8714f24a49387dc8bbe2da3 P a1219433b66444d091420ceeab5092ef: Tablet Copy: opened 0 blocks and 1 log segments
I20260503 19:56:12.196324 1656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3983c88812214bc0bfaaa35c08c38875. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 19:56:12.201819 1658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecf4b80ba8714f24a49387dc8bbe2da3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 19:56:12.225579 1658 tablet_copy_client.cc:806] T ecf4b80ba8714f24a49387dc8bbe2da3 P 6ee23f35facc4d309ca4099163d9ccb2: tablet copy: Starting download of 0 data blocks...
I20260503 19:56:12.228888 1657 tablet_copy_client.cc:806] T 1c99d75cb2be4439a1610c0de343d73a P 6ee23f35facc4d309ca4099163d9ccb2: tablet copy: Starting download of 0 data blocks...
I20260503 19:56:12.261157 1657 tablet_copy_client.cc:670] T 1c99d75cb2be4439a1610c0de343d73a P 6ee23f35facc4d309ca4099163d9ccb2: tablet copy: Starting download of 1 WAL segments...
I20260503 19:56:12.261801 1656 tablet_copy_client.cc:806] T 3983c88812214bc0bfaaa35c08c38875 P 6ee23f35facc4d309ca4099163d9ccb2: tablet copy: Starting download of 0 data blocks...
I20260503 19:56:12.262085 1656 tablet_copy_client.cc:670] T 3983c88812214bc0bfaaa35c08c38875 P 6ee23f35facc4d309ca4099163d9ccb2: tablet copy: Starting download of 1 WAL segments...
I20260503 19:56:12.262223 1655 tablet_copy_client.cc:806] T d2bf53fe00c2417b872db2ecd4ede593 P 6ee23f35facc4d309ca4099163d9ccb2: tablet copy: Starting download of 0 data blocks...
I20260503 19:56:12.262418 1655 tablet_copy_client.cc:670] T d2bf53fe00c2417b872db2ecd4ede593 P 6ee23f35facc4d309ca4099163d9ccb2: tablet copy: Starting download of 1 WAL segments...
I20260503 19:56:12.246928 1653 tablet_copy_client.cc:806] T 4d80fc29b7a64074b4a2ce4003054d1a P 6ee23f35facc4d309ca4099163d9ccb2: tablet copy: Starting download of 0 data blocks...
I20260503 19:56:12.262699 1653 tablet_copy_client.cc:670] T 4d80fc29b7a64074b4a2ce4003054d1a P 6ee23f35facc4d309ca4099163d9ccb2: tablet copy: Starting download of 1 WAL segments...
I20260503 19:56:12.251235 1654 tablet_copy_client.cc:806] T a860805e8df84220ae4be7d3279b75f1 P 6ee23f35facc4d309ca4099163d9ccb2: tablet copy: Starting download of 0 data blocks...
I20260503 19:56:12.263010 1654 tablet_copy_client.cc:670] T a860805e8df84220ae4be7d3279b75f1 P 6ee23f35facc4d309ca4099163d9ccb2: tablet copy: Starting download of 1 WAL segments...
I20260503 19:56:12.258948 1658 tablet_copy_client.cc:670] T ecf4b80ba8714f24a49387dc8bbe2da3 P 6ee23f35facc4d309ca4099163d9ccb2: tablet copy: Starting download of 1 WAL segments...
I20260503 19:56:12.278632 1657 tablet_copy_client.cc:538] T 1c99d75cb2be4439a1610c0de343d73a P 6ee23f35facc4d309ca4099163d9ccb2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260503 19:56:12.294878 1657 tablet_bootstrap.cc:492] T 1c99d75cb2be4439a1610c0de343d73a P 6ee23f35facc4d309ca4099163d9ccb2: Bootstrap starting.
I20260503 19:56:12.309291 1654 tablet_copy_client.cc:538] T a860805e8df84220ae4be7d3279b75f1 P 6ee23f35facc4d309ca4099163d9ccb2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260503 19:56:12.314523 1654 tablet_bootstrap.cc:492] T a860805e8df84220ae4be7d3279b75f1 P 6ee23f35facc4d309ca4099163d9ccb2: Bootstrap starting.
W20260503 19:56:12.328022 796 consensus_peers.cc:597] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260503 19:56:12.330736 1656 tablet_copy_client.cc:538] T 3983c88812214bc0bfaaa35c08c38875 P 6ee23f35facc4d309ca4099163d9ccb2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260503 19:56:12.338315 1655 tablet_copy_client.cc:538] T d2bf53fe00c2417b872db2ecd4ede593 P 6ee23f35facc4d309ca4099163d9ccb2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260503 19:56:12.352572 1655 tablet_bootstrap.cc:492] T d2bf53fe00c2417b872db2ecd4ede593 P 6ee23f35facc4d309ca4099163d9ccb2: Bootstrap starting.
I20260503 19:56:12.356716 1656 tablet_bootstrap.cc:492] T 3983c88812214bc0bfaaa35c08c38875 P 6ee23f35facc4d309ca4099163d9ccb2: Bootstrap starting.
I20260503 19:56:12.377912 1658 tablet_copy_client.cc:538] T ecf4b80ba8714f24a49387dc8bbe2da3 P 6ee23f35facc4d309ca4099163d9ccb2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260503 19:56:12.381628 665 consensus_peers.cc:597] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260503 19:56:12.385110 1658 tablet_bootstrap.cc:492] T ecf4b80ba8714f24a49387dc8bbe2da3 P 6ee23f35facc4d309ca4099163d9ccb2: Bootstrap starting.
W20260503 19:56:12.425350 665 consensus_peers.cc:597] T 4d80fc29b7a64074b4a2ce4003054d1a P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260503 19:56:12.429394 665 consensus_peers.cc:597] T a860805e8df84220ae4be7d3279b75f1 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260503 19:56:12.457281 665 consensus_peers.cc:597] T ecf4b80ba8714f24a49387dc8bbe2da3 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260503 19:56:12.463446 796 consensus_peers.cc:597] T 1c99d75cb2be4439a1610c0de343d73a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260503 19:56:12.478895 1653 tablet_copy_client.cc:538] T 4d80fc29b7a64074b4a2ce4003054d1a P 6ee23f35facc4d309ca4099163d9ccb2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260503 19:56:12.489348 1653 tablet_bootstrap.cc:492] T 4d80fc29b7a64074b4a2ce4003054d1a P 6ee23f35facc4d309ca4099163d9ccb2: Bootstrap starting.
I20260503 19:56:12.570235 420 meta_cache.cc:1510] marking tablet server 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847) as failed
W20260503 19:56:12.570461 420 meta_cache.cc:302] tablet ecf4b80ba8714f24a49387dc8bbe2da3: replica 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847) has failed: Network error: TS failed: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111)
W20260503 19:56:12.608901 797 consensus_peers.cc:597] T 1c99d75cb2be4439a1610c0de343d73a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 6ee23f35facc4d309ca4099163d9ccb2 (127.0.105.4:36991): Couldn't send request to peer 6ee23f35facc4d309ca4099163d9ccb2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
W20260503 19:56:12.739552 797 consensus_peers.cc:597] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 6ee23f35facc4d309ca4099163d9ccb2 (127.0.105.4:36991): Couldn't send request to peer 6ee23f35facc4d309ca4099163d9ccb2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
W20260503 19:56:12.782446 666 consensus_peers.cc:597] T 4d80fc29b7a64074b4a2ce4003054d1a P a1219433b66444d091420ceeab5092ef -> Peer 6ee23f35facc4d309ca4099163d9ccb2 (127.0.105.4:36991): Couldn't send request to peer 6ee23f35facc4d309ca4099163d9ccb2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
W20260503 19:56:12.793713 666 consensus_peers.cc:597] T a860805e8df84220ae4be7d3279b75f1 P a1219433b66444d091420ceeab5092ef -> Peer 6ee23f35facc4d309ca4099163d9ccb2 (127.0.105.4:36991): Couldn't send request to peer 6ee23f35facc4d309ca4099163d9ccb2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
W20260503 19:56:12.816521 796 consensus_peers.cc:597] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260503 19:56:12.843395 666 consensus_peers.cc:597] T ecf4b80ba8714f24a49387dc8bbe2da3 P a1219433b66444d091420ceeab5092ef -> Peer 6ee23f35facc4d309ca4099163d9ccb2 (127.0.105.4:36991): Couldn't send request to peer 6ee23f35facc4d309ca4099163d9ccb2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
W20260503 19:56:12.856532 665 consensus_peers.cc:597] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260503 19:56:12.907691 665 consensus_peers.cc:597] T 4d80fc29b7a64074b4a2ce4003054d1a P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260503 19:56:12.916270 665 consensus_peers.cc:597] T a860805e8df84220ae4be7d3279b75f1 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260503 19:56:12.931180 666 consensus_peers.cc:597] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef -> Peer 6ee23f35facc4d309ca4099163d9ccb2 (127.0.105.4:36991): Couldn't send request to peer 6ee23f35facc4d309ca4099163d9ccb2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
W20260503 19:56:12.931237 665 consensus_peers.cc:597] T ecf4b80ba8714f24a49387dc8bbe2da3 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260503 19:56:12.940501 796 consensus_peers.cc:597] T 1c99d75cb2be4439a1610c0de343d73a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260503 19:56:13.130445 797 consensus_peers.cc:597] T 1c99d75cb2be4439a1610c0de343d73a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 6ee23f35facc4d309ca4099163d9ccb2 (127.0.105.4:36991): Couldn't send request to peer 6ee23f35facc4d309ca4099163d9ccb2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
W20260503 19:56:13.241263 797 consensus_peers.cc:597] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 6ee23f35facc4d309ca4099163d9ccb2 (127.0.105.4:36991): Couldn't send request to peer 6ee23f35facc4d309ca4099163d9ccb2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
W20260503 19:56:13.282600 796 consensus_peers.cc:597] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260503 19:56:13.292459 666 consensus_peers.cc:597] T 4d80fc29b7a64074b4a2ce4003054d1a P a1219433b66444d091420ceeab5092ef -> Peer 6ee23f35facc4d309ca4099163d9ccb2 (127.0.105.4:36991): Couldn't send request to peer 6ee23f35facc4d309ca4099163d9ccb2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
W20260503 19:56:13.307541 666 consensus_peers.cc:597] T a860805e8df84220ae4be7d3279b75f1 P a1219433b66444d091420ceeab5092ef -> Peer 6ee23f35facc4d309ca4099163d9ccb2 (127.0.105.4:36991): Couldn't send request to peer 6ee23f35facc4d309ca4099163d9ccb2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
W20260503 19:56:13.339572 665 consensus_peers.cc:597] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260503 19:56:13.370302 666 consensus_peers.cc:597] T ecf4b80ba8714f24a49387dc8bbe2da3 P a1219433b66444d091420ceeab5092ef -> Peer 6ee23f35facc4d309ca4099163d9ccb2 (127.0.105.4:36991): Couldn't send request to peer 6ee23f35facc4d309ca4099163d9ccb2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
W20260503 19:56:13.390475 665 consensus_peers.cc:597] T ecf4b80ba8714f24a49387dc8bbe2da3 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260503 19:56:13.438083 665 consensus_peers.cc:597] T a860805e8df84220ae4be7d3279b75f1 P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260503 19:56:13.445742 665 consensus_peers.cc:597] T 4d80fc29b7a64074b4a2ce4003054d1a P a1219433b66444d091420ceeab5092ef -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260503 19:56:13.456874 666 consensus_peers.cc:597] T d2bf53fe00c2417b872db2ecd4ede593 P a1219433b66444d091420ceeab5092ef -> Peer 6ee23f35facc4d309ca4099163d9ccb2 (127.0.105.4:36991): Couldn't send request to peer 6ee23f35facc4d309ca4099163d9ccb2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
W20260503 19:56:13.486400 796 consensus_peers.cc:597] T 1c99d75cb2be4439a1610c0de343d73a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260503 19:56:13.644796 797 consensus_peers.cc:597] T 1c99d75cb2be4439a1610c0de343d73a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 6ee23f35facc4d309ca4099163d9ccb2 (127.0.105.4:36991): Couldn't send request to peer 6ee23f35facc4d309ca4099163d9ccb2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 16: this message will repeat every 5th retry.
I20260503 19:56:13.647218 420 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-task4vf7p3/build/asan/bin/kudu pid 649
I20260503 19:56:13.648447 771 generic_service.cc:196] Checking for leaks (request via RPC)
W20260503 19:56:13.782507 796 consensus_peers.cc:597] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260503 19:56:13.785164 797 consensus_peers.cc:597] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 6ee23f35facc4d309ca4099163d9ccb2 (127.0.105.4:36991): Couldn't send request to peer 6ee23f35facc4d309ca4099163d9ccb2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 16: this message will repeat every 5th retry.
I20260503 19:56:13.877249 1553 consensus_queue.cc:579] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [LEADER]: Leader has been unable to successfully communicate with peer 0e52aa88a17542609e84f0c09fb85d87 for more than 2 seconds (2.044s)
I20260503 19:56:13.891804 1684 raft_consensus.cc:493] T 4d80fc29b7a64074b4a2ce4003054d1a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a1219433b66444d091420ceeab5092ef)
I20260503 19:56:13.892025 1684 raft_consensus.cc:515] T 4d80fc29b7a64074b4a2ce4003054d1a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 1728 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } } peers { permanent_uuid: "6ee23f35facc4d309ca4099163d9ccb2" member_type: NON_VOTER last_known_addr { host: "127.0.105.4" port: 36991 } attrs { promote: true } }
I20260503 19:56:13.892776 1684 leader_election.cc:290] T 4d80fc29b7a64074b4a2ce4003054d1a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847), a1219433b66444d091420ceeab5092ef (127.0.105.2:38837)
I20260503 19:56:13.894982 1684 consensus_queue.cc:579] T 1c99d75cb2be4439a1610c0de343d73a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [LEADER]: Leader has been unable to successfully communicate with peer 0e52aa88a17542609e84f0c09fb85d87 for more than 2 seconds (2.065s)
W20260503 19:56:13.898607 796 leader_election.cc:336] T 4d80fc29b7a64074b4a2ce4003054d1a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111)
I20260503 19:56:13.903740 1553 raft_consensus.cc:493] T a860805e8df84220ae4be7d3279b75f1 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a1219433b66444d091420ceeab5092ef)
I20260503 19:56:13.903956 1553 raft_consensus.cc:515] T a860805e8df84220ae4be7d3279b75f1 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 1728 OBSOLETE_local: false peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "6ee23f35facc4d309ca4099163d9ccb2" member_type: NON_VOTER last_known_addr { host: "127.0.105.4" port: 36991 } attrs { promote: true } }
I20260503 19:56:13.904910 1553 leader_election.cc:290] T a860805e8df84220ae4be7d3279b75f1 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1219433b66444d091420ceeab5092ef (127.0.105.2:38837), 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847)
W20260503 19:56:13.907009 796 leader_election.cc:336] T a860805e8df84220ae4be7d3279b75f1 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111)
I20260503 19:56:13.936861 1553 raft_consensus.cc:493] T d2bf53fe00c2417b872db2ecd4ede593 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a1219433b66444d091420ceeab5092ef)
I20260503 19:56:13.937094 1553 raft_consensus.cc:515] T d2bf53fe00c2417b872db2ecd4ede593 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 1729 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } } peers { permanent_uuid: "6ee23f35facc4d309ca4099163d9ccb2" member_type: NON_VOTER last_known_addr { host: "127.0.105.4" port: 36991 } attrs { promote: true } }
I20260503 19:56:13.937858 1553 leader_election.cc:290] T d2bf53fe00c2417b872db2ecd4ede593 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847), a1219433b66444d091420ceeab5092ef (127.0.105.2:38837)
W20260503 19:56:13.939821 796 leader_election.cc:336] T d2bf53fe00c2417b872db2ecd4ede593 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111)
I20260503 19:56:13.951323 1655 log.cc:826] T d2bf53fe00c2417b872db2ecd4ede593 P 6ee23f35facc4d309ca4099163d9ccb2: Log is configured to *not* fsync() on all Append() calls
I20260503 19:56:13.952765 1553 raft_consensus.cc:493] T ecf4b80ba8714f24a49387dc8bbe2da3 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a1219433b66444d091420ceeab5092ef)
I20260503 19:56:13.952983 1553 raft_consensus.cc:515] T ecf4b80ba8714f24a49387dc8bbe2da3 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 1728 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } } peers { permanent_uuid: "6ee23f35facc4d309ca4099163d9ccb2" member_type: NON_VOTER last_known_addr { host: "127.0.105.4" port: 36991 } attrs { promote: true } }
I20260503 19:56:13.953728 1553 leader_election.cc:290] T ecf4b80ba8714f24a49387dc8bbe2da3 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847), a1219433b66444d091420ceeab5092ef (127.0.105.2:38837)
W20260503 19:56:13.955551 796 leader_election.cc:336] T ecf4b80ba8714f24a49387dc8bbe2da3 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111)
W20260503 19:56:14.007800 796 consensus_peers.cc:597] T 1c99d75cb2be4439a1610c0de343d73a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260503 19:56:14.146117 797 consensus_peers.cc:597] T 1c99d75cb2be4439a1610c0de343d73a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 6ee23f35facc4d309ca4099163d9ccb2 (127.0.105.4:36991): Couldn't send request to peer 6ee23f35facc4d309ca4099163d9ccb2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 21: this message will repeat every 5th retry.
I20260503 19:56:14.270025 1607 consensus_queue.cc:579] T ecf4b80ba8714f24a49387dc8bbe2da3 P a1219433b66444d091420ceeab5092ef [LEADER]: Leader has been unable to successfully communicate with peer 0e52aa88a17542609e84f0c09fb85d87 for more than 2 seconds (2.396s)
I20260503 19:56:14.271140 1670 consensus_queue.cc:579] T a860805e8df84220ae4be7d3279b75f1 P a1219433b66444d091420ceeab5092ef [LEADER]: Leader has been unable to successfully communicate with peer 0e52aa88a17542609e84f0c09fb85d87 for more than 2 seconds (2.409s)
W20260503 19:56:14.280907 796 consensus_peers.cc:597] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847): Couldn't send request to peer 0e52aa88a17542609e84f0c09fb85d87. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37847: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260503 19:56:14.315120 1701 consensus_queue.cc:579] T 4d80fc29b7a64074b4a2ce4003054d1a P a1219433b66444d091420ceeab5092ef [LEADER]: Leader has been unable to successfully communicate with peer 0e52aa88a17542609e84f0c09fb85d87 for more than 2 seconds (2.453s)
I20260503 19:56:14.316039 1701 raft_consensus.cc:493] T 1c99d75cb2be4439a1610c0de343d73a P a1219433b66444d091420ceeab5092ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d99e4f4d5ca48e0bdb54daf8361c5e8)
I20260503 19:56:14.316357 1701 raft_consensus.cc:515] T 1c99d75cb2be4439a1610c0de343d73a P a1219433b66444d091420ceeab5092ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 1728 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } } peers { permanent_uuid: "6ee23f35facc4d309ca4099163d9ccb2" member_type: NON_VOTER last_known_addr { host: "127.0.105.4" port: 36991 } attrs { promote: true } }
W20260503 19:56:14.324958 797 consensus_peers.cc:597] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer 6ee23f35facc4d309ca4099163d9ccb2 (127.0.105.4:36991): Couldn't send request to peer 6ee23f35facc4d309ca4099163d9ccb2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 21: this message will repeat every 5th retry.
I20260503 19:56:14.318457 728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d80fc29b7a64074b4a2ce4003054d1a" candidate_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1742 } } ignore_live_leader: false dest_uuid: "a1219433b66444d091420ceeab5092ef" is_pre_election: true
I20260503 19:56:14.318869 727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860805e8df84220ae4be7d3279b75f1" candidate_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1742 } } ignore_live_leader: false dest_uuid: "a1219433b66444d091420ceeab5092ef" is_pre_election: true
I20260503 19:56:14.319224 730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2bf53fe00c2417b872db2ecd4ede593" candidate_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 1743 } } ignore_live_leader: false dest_uuid: "a1219433b66444d091420ceeab5092ef" is_pre_election: true
I20260503 19:56:14.319311 731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf4b80ba8714f24a49387dc8bbe2da3" candidate_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1742 } } ignore_live_leader: false dest_uuid: "a1219433b66444d091420ceeab5092ef" is_pre_election: true
I20260503 19:56:14.319820 726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d80fc29b7a64074b4a2ce4003054d1a" candidate_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1742 } } ignore_live_leader: false dest_uuid: "a1219433b66444d091420ceeab5092ef" is_pre_election: true
I20260503 19:56:14.319898 725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf4b80ba8714f24a49387dc8bbe2da3" candidate_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1742 } } ignore_live_leader: false dest_uuid: "a1219433b66444d091420ceeab5092ef" is_pre_election: true
I20260503 19:56:14.320350 724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860805e8df84220ae4be7d3279b75f1" candidate_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1742 } } ignore_live_leader: false dest_uuid: "a1219433b66444d091420ceeab5092ef" is_pre_election: true
I20260503 19:56:14.330736 1701 leader_election.cc:290] T 1c99d75cb2be4439a1610c0de343d73a P a1219433b66444d091420ceeab5092ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847), 6d99e4f4d5ca48e0bdb54daf8361c5e8 (127.0.105.3:35005)
I20260503 19:56:14.331280 420 external_mini_cluster.cc:1658] Killing /tmp/dist-test-task4vf7p3/build/asan/bin/kudu with pid 649
W20260503 19:56:14.470117 796 connection.cc:570] server connection from 127.0.105.2:51035 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260503 19:56:14.470781 795 connection.cc:570] client connection to 127.0.105.2:38837 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260503 19:56:14.471092 795 leader_election.cc:336] T d2bf53fe00c2417b872db2ecd4ede593 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a1219433b66444d091420ceeab5092ef (127.0.105.2:38837): Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260503 19:56:14.471223 795 leader_election.cc:304] T d2bf53fe00c2417b872db2ecd4ede593 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d99e4f4d5ca48e0bdb54daf8361c5e8; no voters: 0e52aa88a17542609e84f0c09fb85d87, a1219433b66444d091420ceeab5092ef
W20260503 19:56:14.471659 795 leader_election.cc:336] T a860805e8df84220ae4be7d3279b75f1 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a1219433b66444d091420ceeab5092ef (127.0.105.2:38837): Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260503 19:56:14.471781 795 leader_election.cc:304] T a860805e8df84220ae4be7d3279b75f1 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d99e4f4d5ca48e0bdb54daf8361c5e8; no voters: 0e52aa88a17542609e84f0c09fb85d87, a1219433b66444d091420ceeab5092ef
I20260503 19:56:14.472452 1553 raft_consensus.cc:2749] T d2bf53fe00c2417b872db2ecd4ede593 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260503 19:56:14.472682 1553 raft_consensus.cc:2749] T a860805e8df84220ae4be7d3279b75f1 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260503 19:56:14.478536 795 leader_election.cc:336] T ecf4b80ba8714f24a49387dc8bbe2da3 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a1219433b66444d091420ceeab5092ef (127.0.105.2:38837): Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260503 19:56:14.478919 795 leader_election.cc:304] T ecf4b80ba8714f24a49387dc8bbe2da3 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d99e4f4d5ca48e0bdb54daf8361c5e8; no voters: 0e52aa88a17542609e84f0c09fb85d87, a1219433b66444d091420ceeab5092ef
I20260503 19:56:14.479327 1704 raft_consensus.cc:2749] T ecf4b80ba8714f24a49387dc8bbe2da3 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260503 19:56:14.479394 795 leader_election.cc:336] T 4d80fc29b7a64074b4a2ce4003054d1a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a1219433b66444d091420ceeab5092ef (127.0.105.2:38837): Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260503 19:56:14.479503 795 leader_election.cc:304] T 4d80fc29b7a64074b4a2ce4003054d1a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d99e4f4d5ca48e0bdb54daf8361c5e8; no voters: 0e52aa88a17542609e84f0c09fb85d87, a1219433b66444d091420ceeab5092ef
I20260503 19:56:14.479740 1704 raft_consensus.cc:2749] T 4d80fc29b7a64074b4a2ce4003054d1a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260503 19:56:14.481686 1249 connection.cc:570] server connection from 127.0.105.2:36915 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260503 19:56:14.483279 1633 negotiation.cc:336] Failed RPC negotiation. Trace:
0503 19:56:14.480659 (+ 0us) reactor.cc:678] Submitting negotiation task for client connection to 127.0.105.2:38837 (local address 127.0.105.3:41731)
0503 19:56:14.480880 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0503 19:56:14.480910 (+ 30us) client_negotiation.cc:175] Beginning negotiation
0503 19:56:14.481090 (+ 180us) client_negotiation.cc:253] Sending NEGOTIATE NegotiatePB request
0503 19:56:14.482156 (+ 1066us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.105.2:38837: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":50}
W20260503 19:56:14.483614 795 consensus_peers.cc:597] T 1c99d75cb2be4439a1610c0de343d73a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer a1219433b66444d091420ceeab5092ef (127.0.105.2:38837): Couldn't send request to peer a1219433b66444d091420ceeab5092ef. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.2:38837: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107). This is attempt 1: this message will repeat every 5th retry.
W20260503 19:56:14.483819 795 consensus_peers.cc:597] T 3983c88812214bc0bfaaa35c08c38875 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 -> Peer a1219433b66444d091420ceeab5092ef (127.0.105.2:38837): Couldn't send request to peer a1219433b66444d091420ceeab5092ef. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.2:38837: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107). This is attempt 1: this message will repeat every 5th retry.
I20260503 19:56:14.484895 420 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-task4vf7p3/build/asan/bin/kudu pid 780
I20260503 19:56:14.488005 902 generic_service.cc:196] Checking for leaks (request via RPC)
I20260503 19:56:15.031137 1553 raft_consensus.cc:493] T a860805e8df84220ae4be7d3279b75f1 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a1219433b66444d091420ceeab5092ef)
I20260503 19:56:15.055922 1553 raft_consensus.cc:515] T a860805e8df84220ae4be7d3279b75f1 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 1728 OBSOLETE_local: false peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "6ee23f35facc4d309ca4099163d9ccb2" member_type: NON_VOTER last_known_addr { host: "127.0.105.4" port: 36991 } attrs { promote: true } }
I20260503 19:56:15.057960 1704 raft_consensus.cc:493] T 4d80fc29b7a64074b4a2ce4003054d1a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a1219433b66444d091420ceeab5092ef)
I20260503 19:56:15.058529 1553 leader_election.cc:290] T a860805e8df84220ae4be7d3279b75f1 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1219433b66444d091420ceeab5092ef (127.0.105.2:38837), 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847)
I20260503 19:56:15.060781 1704 raft_consensus.cc:515] T 4d80fc29b7a64074b4a2ce4003054d1a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 1728 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } } peers { permanent_uuid: "6ee23f35facc4d309ca4099163d9ccb2" member_type: NON_VOTER last_known_addr { host: "127.0.105.4" port: 36991 } attrs { promote: true } }
I20260503 19:56:15.061820 1704 leader_election.cc:290] T 4d80fc29b7a64074b4a2ce4003054d1a P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847), a1219433b66444d091420ceeab5092ef (127.0.105.2:38837)
I20260503 19:56:15.062600 1709 raft_consensus.cc:493] T d2bf53fe00c2417b872db2ecd4ede593 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a1219433b66444d091420ceeab5092ef)
I20260503 19:56:15.062819 1709 raft_consensus.cc:515] T d2bf53fe00c2417b872db2ecd4ede593 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 1729 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } } peers { permanent_uuid: "6ee23f35facc4d309ca4099163d9ccb2" member_type: NON_VOTER last_known_addr { host: "127.0.105.4" port: 36991 } attrs { promote: true } }
I20260503 19:56:15.063781 1709 leader_election.cc:290] T d2bf53fe00c2417b872db2ecd4ede593 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847), a1219433b66444d091420ceeab5092ef (127.0.105.2:38837)
I20260503 19:56:15.063128 1710 raft_consensus.cc:493] T ecf4b80ba8714f24a49387dc8bbe2da3 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a1219433b66444d091420ceeab5092ef)
I20260503 19:56:15.064997 1710 raft_consensus.cc:515] T ecf4b80ba8714f24a49387dc8bbe2da3 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 1728 OBSOLETE_local: false peers { permanent_uuid: "0e52aa88a17542609e84f0c09fb85d87" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37847 } } peers { permanent_uuid: "a1219433b66444d091420ceeab5092ef" member_type: VOTER last_known_addr { host: "127.0.105.2" port: 38837 } } peers { permanent_uuid: "6d99e4f4d5ca48e0bdb54daf8361c5e8" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 35005 } } peers { permanent_uuid: "6ee23f35facc4d309ca4099163d9ccb2" member_type: NON_VOTER last_known_addr { host: "127.0.105.4" port: 36991 } attrs { promote: true } }
I20260503 19:56:15.065800 1710 leader_election.cc:290] T ecf4b80ba8714f24a49387dc8bbe2da3 P 6d99e4f4d5ca48e0bdb54daf8361c5e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0e52aa88a17542609e84f0c09fb85d87 (127.0.105.1:37847), a1219433b66444d091420ceeab5092ef (127.0.105.2:38837)
I20260503 19:56:15.068379 420 external_mini_cluster.cc:1658] Killing /tmp/dist-test-task4vf7p3/build/asan/bin/kudu with pid 780
I20260503 19:56:15.190630 420 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-task4vf7p3/build/asan/bin/kudu pid 1000
I20260503 19:56:15.193434 1162 generic_service.cc:196] Checking for leaks (request via RPC)
I20260503 19:56:15.414225 420 external_mini_cluster.cc:1658] Killing /tmp/dist-test-task4vf7p3/build/asan/bin/kudu with pid 1000
I20260503 19:56:15.450276 420 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-task4vf7p3/build/asan/bin/kudu pid 1228
I20260503 19:56:15.451810 1299 generic_service.cc:196] Checking for leaks (request via RPC)
I20260503 19:56:15.577877 420 external_mini_cluster.cc:1658] Killing /tmp/dist-test-task4vf7p3/build/asan/bin/kudu with pid 1228
2026-05-03T19:56:15Z chronyd exiting
[ OK ] MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate (54463 ms)
[----------] 1 test from MaintenanceModeRF3ITest (54464 ms total)
[----------] 1 test from RollingRestartArgs/RollingRestartITest
[ RUN ] RollingRestartArgs/RollingRestartITest.TestWorkloads/4
2026-05-03T19:56:15Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-05-03T19:56:15Z Disabled control of system clock
I20260503 19:56:15.692852 420 external_mini_cluster.cc:1366] Running /tmp/dist-test-task4vf7p3/build/asan/bin/kudu
/tmp/dist-test-task4vf7p3/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.105.62:37847
--webserver_interface=127.0.105.62
--webserver_port=0
--builtin_ntp_servers=127.0.105.20:45725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.105.62:37847
--location_mapping_cmd=/tmp/dist-test-task4vf7p3/build/asan/bin/testdata/assign-location.py --state_store=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/location-assignment.state --map /L0:4
--master_client_location_assignment_enabled=false with env {}
W20260503 19:56:16.092387 1717 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260503 19:56:16.092728 1717 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260503 19:56:16.092877 1717 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260503 19:56:16.102406 1717 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260503 19:56:16.102526 1717 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260503 19:56:16.102586 1717 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260503 19:56:16.102702 1717 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260503 19:56:16.115700 1717 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.105.20:45725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/master-0/wal
--location_mapping_cmd=/tmp/dist-test-task4vf7p3/build/asan/bin/testdata/assign-location.py --state_store=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/location-assignment.state --map /L0:4
--ipki_ca_key_size=768
--master_addresses=127.0.105.62:37847
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.105.62:37847
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.105.62
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 0ba7f54e15c9f673bf3e350f30b8d5f1a4037b79
build type FASTDEBUG
built by None at 03 May 2026 19:43:25 UTC on bdcb31816ec0
build id 11730
ASAN enabled
I20260503 19:56:16.118140 1717 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260503 19:56:16.120954 1717 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260503 19:56:16.133291 1722 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 19:56:16.133246 1723 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 19:56:16.134248 1725 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260503 19:56:16.135070 1717 server_base.cc:1061] running on GCE node
I20260503 19:56:16.136351 1717 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260503 19:56:16.138104 1717 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260503 19:56:16.139405 1717 hybrid_clock.cc:648] HybridClock initialized: now 1777838176139297 us; error 69 us; skew 500 ppm
I20260503 19:56:16.139884 1717 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260503 19:56:16.143468 1717 webserver.cc:492] Webserver started at http://127.0.105.62:36707/ using document root <none> and password file <none>
I20260503 19:56:16.144733 1717 fs_manager.cc:362] Metadata directory not provided
I20260503 19:56:16.144876 1717 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260503 19:56:16.145438 1717 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260503 19:56:16.148603 1717 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/master-0/data/instance:
uuid: "b8e636bc70fb468d9d4077649932c0b1"
format_stamp: "Formatted at 2026-05-03 19:56:16 on dist-test-slave-nzs1"
I20260503 19:56:16.149606 1717 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/master-0/wal/instance:
uuid: "b8e636bc70fb468d9d4077649932c0b1"
format_stamp: "Formatted at 2026-05-03 19:56:16 on dist-test-slave-nzs1"
I20260503 19:56:16.158520 1717 fs_manager.cc:696] Time spent creating directory manager: real 0.008s user 0.008s sys 0.000s
I20260503 19:56:16.163195 1731 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260503 19:56:16.165302 1717 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260503 19:56:16.165669 1717 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/master-0/data,/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/master-0/wal
uuid: "b8e636bc70fb468d9d4077649932c0b1"
format_stamp: "Formatted at 2026-05-03 19:56:16 on dist-test-slave-nzs1"
I20260503 19:56:16.165951 1717 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260503 19:56:16.191548 1717 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260503 19:56:16.192696 1717 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260503 19:56:16.193040 1717 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260503 19:56:16.218032 1717 rpc_server.cc:307] RPC server started. Bound to: 127.0.105.62:37847
I20260503 19:56:16.218041 1782 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.105.62:37847 every 8 connection(s)
I20260503 19:56:16.220055 1717 server_base.cc:1193] Dumped server information to /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/master-0/data/info.pb
I20260503 19:56:16.224766 1783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 19:56:16.225548 420 external_mini_cluster.cc:1428] Started /tmp/dist-test-task4vf7p3/build/asan/bin/kudu as pid 1717
I20260503 19:56:16.225811 420 external_mini_cluster.cc:1442] Reading /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/master-0/wal/instance
I20260503 19:56:16.237541 1783 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b8e636bc70fb468d9d4077649932c0b1: Bootstrap starting.
I20260503 19:56:16.242028 1783 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b8e636bc70fb468d9d4077649932c0b1: Neither blocks nor log segments found. Creating new log.
I20260503 19:56:16.243340 1783 log.cc:826] T 00000000000000000000000000000000 P b8e636bc70fb468d9d4077649932c0b1: Log is configured to *not* fsync() on all Append() calls
I20260503 19:56:16.246977 1783 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b8e636bc70fb468d9d4077649932c0b1: No bootstrap required, opened a new log
I20260503 19:56:16.252861 1783 raft_consensus.cc:359] T 00000000000000000000000000000000 P b8e636bc70fb468d9d4077649932c0b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8e636bc70fb468d9d4077649932c0b1" member_type: VOTER last_known_addr { host: "127.0.105.62" port: 37847 } }
I20260503 19:56:16.253307 1783 raft_consensus.cc:385] T 00000000000000000000000000000000 P b8e636bc70fb468d9d4077649932c0b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 19:56:16.253424 1783 raft_consensus.cc:740] T 00000000000000000000000000000000 P b8e636bc70fb468d9d4077649932c0b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8e636bc70fb468d9d4077649932c0b1, State: Initialized, Role: FOLLOWER
I20260503 19:56:16.254112 1783 consensus_queue.cc:260] T 00000000000000000000000000000000 P b8e636bc70fb468d9d4077649932c0b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8e636bc70fb468d9d4077649932c0b1" member_type: VOTER last_known_addr { host: "127.0.105.62" port: 37847 } }
I20260503 19:56:16.254345 1783 raft_consensus.cc:399] T 00000000000000000000000000000000 P b8e636bc70fb468d9d4077649932c0b1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260503 19:56:16.254479 1783 raft_consensus.cc:493] T 00000000000000000000000000000000 P b8e636bc70fb468d9d4077649932c0b1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260503 19:56:16.254657 1783 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b8e636bc70fb468d9d4077649932c0b1 [term 0 FOLLOWER]: Advancing to term 1
I20260503 19:56:16.257167 1783 raft_consensus.cc:515] T 00000000000000000000000000000000 P b8e636bc70fb468d9d4077649932c0b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8e636bc70fb468d9d4077649932c0b1" member_type: VOTER last_known_addr { host: "127.0.105.62" port: 37847 } }
I20260503 19:56:16.257767 1783 leader_election.cc:304] T 00000000000000000000000000000000 P b8e636bc70fb468d9d4077649932c0b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b8e636bc70fb468d9d4077649932c0b1; no voters:
I20260503 19:56:16.258492 1783 leader_election.cc:290] T 00000000000000000000000000000000 P b8e636bc70fb468d9d4077649932c0b1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260503 19:56:16.258678 1788 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b8e636bc70fb468d9d4077649932c0b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 19:56:16.259874 1788 raft_consensus.cc:697] T 00000000000000000000000000000000 P b8e636bc70fb468d9d4077649932c0b1 [term 1 LEADER]: Becoming Leader. State: Replica: b8e636bc70fb468d9d4077649932c0b1, State: Running, Role: LEADER
I20260503 19:56:16.260548 1788 consensus_queue.cc:237] T 00000000000000000000000000000000 P b8e636bc70fb468d9d4077649932c0b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8e636bc70fb468d9d4077649932c0b1" member_type: VOTER last_known_addr { host: "127.0.105.62" port: 37847 } }
I20260503 19:56:16.261492 1783 sys_catalog.cc:565] T 00000000000000000000000000000000 P b8e636bc70fb468d9d4077649932c0b1 [sys.catalog]: configured and running, proceeding with master startup.
I20260503 19:56:16.264015 1790 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8e636bc70fb468d9d4077649932c0b1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b8e636bc70fb468d9d4077649932c0b1. Latest consensus state: current_term: 1 leader_uuid: "b8e636bc70fb468d9d4077649932c0b1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8e636bc70fb468d9d4077649932c0b1" member_type: VOTER last_known_addr { host: "127.0.105.62" port: 37847 } } }
I20260503 19:56:16.265466 1790 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8e636bc70fb468d9d4077649932c0b1 [sys.catalog]: This master's current role is: LEADER
I20260503 19:56:16.264037 1789 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8e636bc70fb468d9d4077649932c0b1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b8e636bc70fb468d9d4077649932c0b1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8e636bc70fb468d9d4077649932c0b1" member_type: VOTER last_known_addr { host: "127.0.105.62" port: 37847 } } }
I20260503 19:56:16.267499 1789 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8e636bc70fb468d9d4077649932c0b1 [sys.catalog]: This master's current role is: LEADER
I20260503 19:56:16.268285 1794 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260503 19:56:16.274888 1794 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260503 19:56:16.285817 1794 catalog_manager.cc:1357] Generated new cluster ID: c1287867503a403fb2ad2e628ae2d24c
I20260503 19:56:16.285990 1794 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260503 19:56:16.301203 1794 catalog_manager.cc:1380] Generated new certificate authority record
I20260503 19:56:16.302819 1794 catalog_manager.cc:1514] Loading token signing keys...
I20260503 19:56:16.314590 1794 catalog_manager.cc:6044] T 00000000000000000000000000000000 P b8e636bc70fb468d9d4077649932c0b1: Generated new TSK 0
I20260503 19:56:16.316006 1794 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260503 19:56:16.330427 420 external_mini_cluster.cc:1366] Running /tmp/dist-test-task4vf7p3/build/asan/bin/kudu
/tmp/dist-test-task4vf7p3/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.105.1:0
--local_ip_for_outbound_sockets=127.0.105.1
--webserver_interface=127.0.105.1
--webserver_port=0
--tserver_master_addrs=127.0.105.62:37847
--builtin_ntp_servers=127.0.105.20:45725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
W20260503 19:56:16.748611 1807 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260503 19:56:16.748953 1807 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260503 19:56:16.749033 1807 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260503 19:56:16.760214 1807 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260503 19:56:16.760427 1807 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.105.1
I20260503 19:56:16.773322 1807 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.105.20:45725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.105.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.105.1
--webserver_port=0
--tserver_master_addrs=127.0.105.62:37847
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.105.1
--log_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 0ba7f54e15c9f673bf3e350f30b8d5f1a4037b79
build type FASTDEBUG
built by None at 03 May 2026 19:43:25 UTC on bdcb31816ec0
build id 11730
ASAN enabled
I20260503 19:56:16.775120 1807 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260503 19:56:16.777352 1807 file_cache.cc:492] Constructed file cache file cache with capacity 419430
E20260503 19:56:16.781704 1807 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260503 19:56:16.789528 1812 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 19:56:16.789562 1813 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 19:56:16.790390 1815 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260503 19:56:16.791181 1807 server_base.cc:1061] running on GCE node
I20260503 19:56:16.791957 1807 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260503 19:56:16.793015 1807 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260503 19:56:16.794333 1807 hybrid_clock.cc:648] HybridClock initialized: now 1777838176794241 us; error 58 us; skew 500 ppm
I20260503 19:56:16.794710 1807 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260503 19:56:16.797348 1807 webserver.cc:492] Webserver started at http://127.0.105.1:39515/ using document root <none> and password file <none>
I20260503 19:56:16.798204 1807 fs_manager.cc:362] Metadata directory not provided
I20260503 19:56:16.798378 1807 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260503 19:56:16.798749 1807 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260503 19:56:16.801487 1807 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-0/data/instance:
uuid: "a417bd6c4b7d4bab8e96e65908ec2385"
format_stamp: "Formatted at 2026-05-03 19:56:16 on dist-test-slave-nzs1"
I20260503 19:56:16.802414 1807 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-0/wal/instance:
uuid: "a417bd6c4b7d4bab8e96e65908ec2385"
format_stamp: "Formatted at 2026-05-03 19:56:16 on dist-test-slave-nzs1"
I20260503 19:56:16.809372 1807 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.006s sys 0.002s
I20260503 19:56:16.814347 1821 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260503 19:56:16.816679 1807 fs_manager.cc:730] Time spent opening block manager: real 0.005s user 0.002s sys 0.000s
I20260503 19:56:16.816944 1807 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-0/data,/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-0/wal
uuid: "a417bd6c4b7d4bab8e96e65908ec2385"
format_stamp: "Formatted at 2026-05-03 19:56:16 on dist-test-slave-nzs1"
I20260503 19:56:16.817159 1807 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260503 19:56:16.846266 1807 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260503 19:56:16.848308 1807 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260503 19:56:16.848719 1807 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260503 19:56:16.850678 1807 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260503 19:56:16.853039 1807 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260503 19:56:16.853181 1807 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260503 19:56:16.853370 1807 ts_tablet_manager.cc:616] Registered 0 tablets
I20260503 19:56:16.853457 1807 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260503 19:56:16.895339 1807 rpc_server.cc:307] RPC server started. Bound to: 127.0.105.1:37957
I20260503 19:56:16.895388 1933 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.105.1:37957 every 8 connection(s)
I20260503 19:56:16.896963 1807 server_base.cc:1193] Dumped server information to /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-0/data/info.pb
I20260503 19:56:16.899307 420 external_mini_cluster.cc:1428] Started /tmp/dist-test-task4vf7p3/build/asan/bin/kudu as pid 1807
I20260503 19:56:16.899541 420 external_mini_cluster.cc:1442] Reading /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-0/wal/instance
I20260503 19:56:16.903337 420 external_mini_cluster.cc:1366] Running /tmp/dist-test-task4vf7p3/build/asan/bin/kudu
/tmp/dist-test-task4vf7p3/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.105.2:0
--local_ip_for_outbound_sockets=127.0.105.2
--webserver_interface=127.0.105.2
--webserver_port=0
--tserver_master_addrs=127.0.105.62:37847
--builtin_ntp_servers=127.0.105.20:45725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
I20260503 19:56:16.912583 1934 heartbeater.cc:344] Connected to a master server at 127.0.105.62:37847
I20260503 19:56:16.913030 1934 heartbeater.cc:461] Registering TS with master...
I20260503 19:56:16.914029 1934 heartbeater.cc:507] Master 127.0.105.62:37847 requested a full tablet report, sending...
I20260503 19:56:16.976257 1748 ts_manager.cc:194] Registered new tserver with Master: a417bd6c4b7d4bab8e96e65908ec2385 (127.0.105.1:37957)
I20260503 19:56:16.978905 1748 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.105.1:39351
W20260503 19:56:17.308374 1938 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260503 19:56:17.308705 1938 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260503 19:56:17.308785 1938 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260503 19:56:17.317909 1938 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260503 19:56:17.318107 1938 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.105.2
I20260503 19:56:17.329043 1938 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.105.20:45725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.105.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.105.2
--webserver_port=0
--tserver_master_addrs=127.0.105.62:37847
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.105.2
--log_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 0ba7f54e15c9f673bf3e350f30b8d5f1a4037b79
build type FASTDEBUG
built by None at 03 May 2026 19:43:25 UTC on bdcb31816ec0
build id 11730
ASAN enabled
I20260503 19:56:17.330740 1938 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260503 19:56:17.332731 1938 file_cache.cc:492] Constructed file cache file cache with capacity 419430
E20260503 19:56:17.336764 1938 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260503 19:56:17.343164 1945 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 19:56:17.343250 1944 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 19:56:17.343811 1947 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260503 19:56:17.344430 1938 server_base.cc:1061] running on GCE node
I20260503 19:56:17.345221 1938 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260503 19:56:17.346608 1938 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260503 19:56:17.347908 1938 hybrid_clock.cc:648] HybridClock initialized: now 1777838177347788 us; error 65 us; skew 500 ppm
I20260503 19:56:17.348416 1938 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260503 19:56:17.351111 1938 webserver.cc:492] Webserver started at http://127.0.105.2:46229/ using document root <none> and password file <none>
I20260503 19:56:17.352051 1938 fs_manager.cc:362] Metadata directory not provided
I20260503 19:56:17.352200 1938 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260503 19:56:17.352581 1938 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260503 19:56:17.355414 1938 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-1/data/instance:
uuid: "d337855bccbf4d0c84a8c5d26db11d85"
format_stamp: "Formatted at 2026-05-03 19:56:17 on dist-test-slave-nzs1"
I20260503 19:56:17.356410 1938 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-1/wal/instance:
uuid: "d337855bccbf4d0c84a8c5d26db11d85"
format_stamp: "Formatted at 2026-05-03 19:56:17 on dist-test-slave-nzs1"
I20260503 19:56:17.362954 1938 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260503 19:56:17.366986 1953 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260503 19:56:17.369099 1938 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260503 19:56:17.369414 1938 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-1/data,/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-1/wal
uuid: "d337855bccbf4d0c84a8c5d26db11d85"
format_stamp: "Formatted at 2026-05-03 19:56:17 on dist-test-slave-nzs1"
I20260503 19:56:17.369619 1938 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260503 19:56:17.406579 1938 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260503 19:56:17.407682 1938 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260503 19:56:17.408053 1938 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260503 19:56:17.409124 1938 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260503 19:56:17.411341 1938 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260503 19:56:17.411480 1938 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260503 19:56:17.411798 1938 ts_tablet_manager.cc:616] Registered 0 tablets
I20260503 19:56:17.411901 1938 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260503 19:56:17.453665 1938 rpc_server.cc:307] RPC server started. Bound to: 127.0.105.2:32969
I20260503 19:56:17.453768 2065 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.105.2:32969 every 8 connection(s)
I20260503 19:56:17.455228 1938 server_base.cc:1193] Dumped server information to /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-1/data/info.pb
I20260503 19:56:17.459576 420 external_mini_cluster.cc:1428] Started /tmp/dist-test-task4vf7p3/build/asan/bin/kudu as pid 1938
I20260503 19:56:17.459820 420 external_mini_cluster.cc:1442] Reading /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-1/wal/instance
I20260503 19:56:17.464118 420 external_mini_cluster.cc:1366] Running /tmp/dist-test-task4vf7p3/build/asan/bin/kudu
/tmp/dist-test-task4vf7p3/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.105.3:0
--local_ip_for_outbound_sockets=127.0.105.3
--webserver_interface=127.0.105.3
--webserver_port=0
--tserver_master_addrs=127.0.105.62:37847
--builtin_ntp_servers=127.0.105.20:45725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
I20260503 19:56:17.474009 2066 heartbeater.cc:344] Connected to a master server at 127.0.105.62:37847
I20260503 19:56:17.474450 2066 heartbeater.cc:461] Registering TS with master...
I20260503 19:56:17.475627 2066 heartbeater.cc:507] Master 127.0.105.62:37847 requested a full tablet report, sending...
I20260503 19:56:17.529803 1748 ts_manager.cc:194] Registered new tserver with Master: d337855bccbf4d0c84a8c5d26db11d85 (127.0.105.2:32969)
I20260503 19:56:17.531802 1748 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.105.2:57239
W20260503 19:56:17.841468 2070 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260503 19:56:17.841830 2070 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260503 19:56:17.841909 2070 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260503 19:56:17.851549 2070 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260503 19:56:17.851807 2070 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.105.3
I20260503 19:56:17.862869 2070 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.105.20:45725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.105.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.105.3
--webserver_port=0
--tserver_master_addrs=127.0.105.62:37847
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.105.3
--log_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 0ba7f54e15c9f673bf3e350f30b8d5f1a4037b79
build type FASTDEBUG
built by None at 03 May 2026 19:43:25 UTC on bdcb31816ec0
build id 11730
ASAN enabled
I20260503 19:56:17.864686 2070 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260503 19:56:17.866715 2070 file_cache.cc:492] Constructed file cache file cache with capacity 419430
E20260503 19:56:17.871794 2070 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260503 19:56:17.879050 2077 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 19:56:17.879113 2076 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 19:56:17.880123 2079 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260503 19:56:17.880597 2070 server_base.cc:1061] running on GCE node
I20260503 19:56:17.881263 2070 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260503 19:56:17.882325 2070 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260503 19:56:17.883584 2070 hybrid_clock.cc:648] HybridClock initialized: now 1777838177883493 us; error 61 us; skew 500 ppm
I20260503 19:56:17.884009 2070 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260503 19:56:17.891321 2070 webserver.cc:492] Webserver started at http://127.0.105.3:33159/ using document root <none> and password file <none>
I20260503 19:56:17.892333 2070 fs_manager.cc:362] Metadata directory not provided
I20260503 19:56:17.892477 2070 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260503 19:56:17.892851 2070 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260503 19:56:17.896840 2070 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-2/data/instance:
uuid: "6d32022b7ea94ea48926c65f7a62d687"
format_stamp: "Formatted at 2026-05-03 19:56:17 on dist-test-slave-nzs1"
I20260503 19:56:17.898105 2070 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-2/wal/instance:
uuid: "6d32022b7ea94ea48926c65f7a62d687"
format_stamp: "Formatted at 2026-05-03 19:56:17 on dist-test-slave-nzs1"
I20260503 19:56:17.906170 2070 fs_manager.cc:696] Time spent creating directory manager: real 0.007s user 0.005s sys 0.004s
I20260503 19:56:17.910656 2085 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260503 19:56:17.912593 2070 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260503 19:56:17.912832 2070 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-2/data,/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-2/wal
uuid: "6d32022b7ea94ea48926c65f7a62d687"
format_stamp: "Formatted at 2026-05-03 19:56:17 on dist-test-slave-nzs1"
I20260503 19:56:17.913082 2070 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260503 19:56:17.935230 2070 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260503 19:56:17.936260 2070 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260503 19:56:17.936625 2070 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260503 19:56:17.937698 2070 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260503 19:56:17.939497 2070 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260503 19:56:17.939617 2070 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260503 19:56:17.939795 2070 ts_tablet_manager.cc:616] Registered 0 tablets
I20260503 19:56:17.939873 2070 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260503 19:56:17.982918 1934 heartbeater.cc:499] Master 127.0.105.62:37847 was elected leader, sending a full tablet report...
I20260503 19:56:17.985424 2070 rpc_server.cc:307] RPC server started. Bound to: 127.0.105.3:33995
I20260503 19:56:17.985477 2197 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.105.3:33995 every 8 connection(s)
I20260503 19:56:17.987039 2070 server_base.cc:1193] Dumped server information to /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-2/data/info.pb
I20260503 19:56:17.991793 420 external_mini_cluster.cc:1428] Started /tmp/dist-test-task4vf7p3/build/asan/bin/kudu as pid 2070
I20260503 19:56:17.992403 420 external_mini_cluster.cc:1442] Reading /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-2/wal/instance
I20260503 19:56:17.996299 420 external_mini_cluster.cc:1366] Running /tmp/dist-test-task4vf7p3/build/asan/bin/kudu
/tmp/dist-test-task4vf7p3/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-3/wal
--fs_data_dirs=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-3/logs
--server_dump_info_path=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.105.4:0
--local_ip_for_outbound_sockets=127.0.105.4
--webserver_interface=127.0.105.4
--webserver_port=0
--tserver_master_addrs=127.0.105.62:37847
--builtin_ntp_servers=127.0.105.20:45725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
I20260503 19:56:18.010617 2198 heartbeater.cc:344] Connected to a master server at 127.0.105.62:37847
I20260503 19:56:18.011055 2198 heartbeater.cc:461] Registering TS with master...
I20260503 19:56:18.012084 2198 heartbeater.cc:507] Master 127.0.105.62:37847 requested a full tablet report, sending...
I20260503 19:56:18.065831 1748 ts_manager.cc:194] Registered new tserver with Master: 6d32022b7ea94ea48926c65f7a62d687 (127.0.105.3:33995)
I20260503 19:56:18.067056 1748 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.105.3:47117
W20260503 19:56:18.427784 2202 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260503 19:56:18.428185 2202 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260503 19:56:18.428335 2202 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260503 19:56:18.437330 2202 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260503 19:56:18.437614 2202 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.105.4
I20260503 19:56:18.448649 2202 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.105.20:45725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-3/data
--fs_wal_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.105.4:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-3/data/info.pb
--webserver_interface=127.0.105.4
--webserver_port=0
--tserver_master_addrs=127.0.105.62:37847
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.105.4
--log_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-3/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 0ba7f54e15c9f673bf3e350f30b8d5f1a4037b79
build type FASTDEBUG
built by None at 03 May 2026 19:43:25 UTC on bdcb31816ec0
build id 11730
ASAN enabled
I20260503 19:56:18.450397 2202 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260503 19:56:18.452414 2202 file_cache.cc:492] Constructed file cache file cache with capacity 419430
E20260503 19:56:18.456545 2202 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260503 19:56:18.462917 2209 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 19:56:18.463124 2208 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 19:56:18.463748 2211 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260503 19:56:18.464195 2202 server_base.cc:1061] running on GCE node
I20260503 19:56:18.464826 2202 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260503 19:56:18.465862 2202 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260503 19:56:18.467152 2202 hybrid_clock.cc:648] HybridClock initialized: now 1777838178467056 us; error 65 us; skew 500 ppm
I20260503 19:56:18.467547 2202 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260503 19:56:18.470392 2202 webserver.cc:492] Webserver started at http://127.0.105.4:42465/ using document root <none> and password file <none>
I20260503 19:56:18.471282 2202 fs_manager.cc:362] Metadata directory not provided
I20260503 19:56:18.471609 2202 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260503 19:56:18.472180 2202 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260503 19:56:18.474860 2202 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-3/data/instance:
uuid: "24488daee7104583a6f986a6ae3f8fe0"
format_stamp: "Formatted at 2026-05-03 19:56:18 on dist-test-slave-nzs1"
I20260503 19:56:18.475852 2202 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-3/wal/instance:
uuid: "24488daee7104583a6f986a6ae3f8fe0"
format_stamp: "Formatted at 2026-05-03 19:56:18 on dist-test-slave-nzs1"
I20260503 19:56:18.481976 2202 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.000s sys 0.004s
I20260503 19:56:18.485809 2217 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260503 19:56:18.487764 2202 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260503 19:56:18.487972 2202 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-3/data,/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-3/wal
uuid: "24488daee7104583a6f986a6ae3f8fe0"
format_stamp: "Formatted at 2026-05-03 19:56:18 on dist-test-slave-nzs1"
I20260503 19:56:18.488164 2202 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-3/wal
metadata directory: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-3/wal
1 data directories: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260503 19:56:18.530323 2202 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260503 19:56:18.531270 2202 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260503 19:56:18.531592 2202 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260503 19:56:18.532684 2202 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260503 19:56:18.534525 2202 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260503 19:56:18.534646 2202 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260503 19:56:18.534804 2202 ts_tablet_manager.cc:616] Registered 0 tablets
I20260503 19:56:18.534878 2202 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260503 19:56:18.535164 2066 heartbeater.cc:499] Master 127.0.105.62:37847 was elected leader, sending a full tablet report...
I20260503 19:56:18.572346 2202 rpc_server.cc:307] RPC server started. Bound to: 127.0.105.4:34213
I20260503 19:56:18.572444 2329 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.105.4:34213 every 8 connection(s)
I20260503 19:56:18.573837 2202 server_base.cc:1193] Dumped server information to /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-3/data/info.pb
I20260503 19:56:18.583545 420 external_mini_cluster.cc:1428] Started /tmp/dist-test-task4vf7p3/build/asan/bin/kudu as pid 2202
I20260503 19:56:18.583791 420 external_mini_cluster.cc:1442] Reading /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-3/wal/instance
I20260503 19:56:18.588658 2330 heartbeater.cc:344] Connected to a master server at 127.0.105.62:37847
I20260503 19:56:18.589030 2330 heartbeater.cc:461] Registering TS with master...
I20260503 19:56:18.589892 2330 heartbeater.cc:507] Master 127.0.105.62:37847 requested a full tablet report, sending...
I20260503 19:56:18.639884 1748 ts_manager.cc:194] Registered new tserver with Master: 24488daee7104583a6f986a6ae3f8fe0 (127.0.105.4:34213)
I20260503 19:56:18.640988 1748 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.105.4:51881
I20260503 19:56:18.642203 420 external_mini_cluster.cc:949] 4 TS(s) registered with all masters
I20260503 19:56:18.684494 1747 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48666:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260503 19:56:18.728209 1869 tablet_service.cc:1511] Processing CreateTablet for tablet 305dbeef23b540c69080a3b2d03c9c35 (DEFAULT_TABLE table=test-workload [id=c4a30a56f0434a7ca3e04d137698f6e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 19:56:18.729969 1869 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 305dbeef23b540c69080a3b2d03c9c35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 19:56:18.731973 2133 tablet_service.cc:1511] Processing CreateTablet for tablet 305dbeef23b540c69080a3b2d03c9c35 (DEFAULT_TABLE table=test-workload [id=c4a30a56f0434a7ca3e04d137698f6e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 19:56:18.733486 2133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 305dbeef23b540c69080a3b2d03c9c35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 19:56:18.742306 2265 tablet_service.cc:1511] Processing CreateTablet for tablet 305dbeef23b540c69080a3b2d03c9c35 (DEFAULT_TABLE table=test-workload [id=c4a30a56f0434a7ca3e04d137698f6e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260503 19:56:18.743957 2355 tablet_bootstrap.cc:492] T 305dbeef23b540c69080a3b2d03c9c35 P a417bd6c4b7d4bab8e96e65908ec2385: Bootstrap starting.
I20260503 19:56:18.744335 2265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 305dbeef23b540c69080a3b2d03c9c35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 19:56:18.746918 2356 tablet_bootstrap.cc:492] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687: Bootstrap starting.
I20260503 19:56:18.749821 2355 tablet_bootstrap.cc:654] T 305dbeef23b540c69080a3b2d03c9c35 P a417bd6c4b7d4bab8e96e65908ec2385: Neither blocks nor log segments found. Creating new log.
I20260503 19:56:18.751431 2355 log.cc:826] T 305dbeef23b540c69080a3b2d03c9c35 P a417bd6c4b7d4bab8e96e65908ec2385: Log is configured to *not* fsync() on all Append() calls
I20260503 19:56:18.752002 2356 tablet_bootstrap.cc:654] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687: Neither blocks nor log segments found. Creating new log.
I20260503 19:56:18.754606 2356 log.cc:826] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687: Log is configured to *not* fsync() on all Append() calls
I20260503 19:56:18.756799 2355 tablet_bootstrap.cc:492] T 305dbeef23b540c69080a3b2d03c9c35 P a417bd6c4b7d4bab8e96e65908ec2385: No bootstrap required, opened a new log
I20260503 19:56:18.757593 2355 ts_tablet_manager.cc:1403] T 305dbeef23b540c69080a3b2d03c9c35 P a417bd6c4b7d4bab8e96e65908ec2385: Time spent bootstrapping tablet: real 0.014s user 0.011s sys 0.000s
I20260503 19:56:18.758214 2359 tablet_bootstrap.cc:492] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0: Bootstrap starting.
I20260503 19:56:18.759256 2356 tablet_bootstrap.cc:492] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687: No bootstrap required, opened a new log
I20260503 19:56:18.759744 2356 ts_tablet_manager.cc:1403] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687: Time spent bootstrapping tablet: real 0.013s user 0.008s sys 0.004s
I20260503 19:56:18.762015 2359 tablet_bootstrap.cc:654] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0: Neither blocks nor log segments found. Creating new log.
I20260503 19:56:18.763630 2359 log.cc:826] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0: Log is configured to *not* fsync() on all Append() calls
I20260503 19:56:18.766288 2355 raft_consensus.cc:359] T 305dbeef23b540c69080a3b2d03c9c35 P a417bd6c4b7d4bab8e96e65908ec2385 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d32022b7ea94ea48926c65f7a62d687" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 33995 } } peers { permanent_uuid: "a417bd6c4b7d4bab8e96e65908ec2385" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37957 } } peers { permanent_uuid: "24488daee7104583a6f986a6ae3f8fe0" member_type: VOTER last_known_addr { host: "127.0.105.4" port: 34213 } }
I20260503 19:56:18.766726 2355 raft_consensus.cc:385] T 305dbeef23b540c69080a3b2d03c9c35 P a417bd6c4b7d4bab8e96e65908ec2385 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 19:56:18.766875 2359 tablet_bootstrap.cc:492] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0: No bootstrap required, opened a new log
I20260503 19:56:18.766877 2355 raft_consensus.cc:740] T 305dbeef23b540c69080a3b2d03c9c35 P a417bd6c4b7d4bab8e96e65908ec2385 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a417bd6c4b7d4bab8e96e65908ec2385, State: Initialized, Role: FOLLOWER
I20260503 19:56:18.767247 2359 ts_tablet_manager.cc:1403] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260503 19:56:18.767402 2356 raft_consensus.cc:359] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d32022b7ea94ea48926c65f7a62d687" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 33995 } } peers { permanent_uuid: "a417bd6c4b7d4bab8e96e65908ec2385" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37957 } } peers { permanent_uuid: "24488daee7104583a6f986a6ae3f8fe0" member_type: VOTER last_known_addr { host: "127.0.105.4" port: 34213 } }
I20260503 19:56:18.767678 2355 consensus_queue.cc:260] T 305dbeef23b540c69080a3b2d03c9c35 P a417bd6c4b7d4bab8e96e65908ec2385 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d32022b7ea94ea48926c65f7a62d687" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 33995 } } peers { permanent_uuid: "a417bd6c4b7d4bab8e96e65908ec2385" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37957 } } peers { permanent_uuid: "24488daee7104583a6f986a6ae3f8fe0" member_type: VOTER last_known_addr { host: "127.0.105.4" port: 34213 } }
I20260503 19:56:18.767849 2356 raft_consensus.cc:385] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 19:56:18.767946 2356 raft_consensus.cc:740] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d32022b7ea94ea48926c65f7a62d687, State: Initialized, Role: FOLLOWER
I20260503 19:56:18.769402 2356 consensus_queue.cc:260] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d32022b7ea94ea48926c65f7a62d687" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 33995 } } peers { permanent_uuid: "a417bd6c4b7d4bab8e96e65908ec2385" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37957 } } peers { permanent_uuid: "24488daee7104583a6f986a6ae3f8fe0" member_type: VOTER last_known_addr { host: "127.0.105.4" port: 34213 } }
I20260503 19:56:18.770653 2198 heartbeater.cc:499] Master 127.0.105.62:37847 was elected leader, sending a full tablet report...
I20260503 19:56:18.771353 2356 ts_tablet_manager.cc:1434] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687: Time spent starting tablet: real 0.011s user 0.010s sys 0.000s
I20260503 19:56:18.774153 2355 ts_tablet_manager.cc:1434] T 305dbeef23b540c69080a3b2d03c9c35 P a417bd6c4b7d4bab8e96e65908ec2385: Time spent starting tablet: real 0.016s user 0.007s sys 0.003s
I20260503 19:56:18.775844 2359 raft_consensus.cc:359] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d32022b7ea94ea48926c65f7a62d687" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 33995 } } peers { permanent_uuid: "a417bd6c4b7d4bab8e96e65908ec2385" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37957 } } peers { permanent_uuid: "24488daee7104583a6f986a6ae3f8fe0" member_type: VOTER last_known_addr { host: "127.0.105.4" port: 34213 } }
I20260503 19:56:18.776335 2359 raft_consensus.cc:385] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 19:56:18.776501 2359 raft_consensus.cc:740] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24488daee7104583a6f986a6ae3f8fe0, State: Initialized, Role: FOLLOWER
I20260503 19:56:18.777527 2359 consensus_queue.cc:260] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d32022b7ea94ea48926c65f7a62d687" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 33995 } } peers { permanent_uuid: "a417bd6c4b7d4bab8e96e65908ec2385" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37957 } } peers { permanent_uuid: "24488daee7104583a6f986a6ae3f8fe0" member_type: VOTER last_known_addr { host: "127.0.105.4" port: 34213 } }
I20260503 19:56:18.779551 2330 heartbeater.cc:499] Master 127.0.105.62:37847 was elected leader, sending a full tablet report...
I20260503 19:56:18.780201 2359 ts_tablet_manager.cc:1434] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0: Time spent starting tablet: real 0.013s user 0.014s sys 0.000s
I20260503 19:56:18.797828 2363 raft_consensus.cc:493] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 19:56:18.798101 2363 raft_consensus.cc:515] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d32022b7ea94ea48926c65f7a62d687" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 33995 } } peers { permanent_uuid: "a417bd6c4b7d4bab8e96e65908ec2385" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37957 } } peers { permanent_uuid: "24488daee7104583a6f986a6ae3f8fe0" member_type: VOTER last_known_addr { host: "127.0.105.4" port: 34213 } }
I20260503 19:56:18.801326 2363 leader_election.cc:290] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d32022b7ea94ea48926c65f7a62d687 (127.0.105.3:33995), a417bd6c4b7d4bab8e96e65908ec2385 (127.0.105.1:37957)
I20260503 19:56:18.810395 1889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305dbeef23b540c69080a3b2d03c9c35" candidate_uuid: "24488daee7104583a6f986a6ae3f8fe0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a417bd6c4b7d4bab8e96e65908ec2385" is_pre_election: true
I20260503 19:56:18.810395 2153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305dbeef23b540c69080a3b2d03c9c35" candidate_uuid: "24488daee7104583a6f986a6ae3f8fe0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d32022b7ea94ea48926c65f7a62d687" is_pre_election: true
I20260503 19:56:18.811000 1889 raft_consensus.cc:2468] T 305dbeef23b540c69080a3b2d03c9c35 P a417bd6c4b7d4bab8e96e65908ec2385 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24488daee7104583a6f986a6ae3f8fe0 in term 0.
I20260503 19:56:18.810995 2153 raft_consensus.cc:2468] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24488daee7104583a6f986a6ae3f8fe0 in term 0.
I20260503 19:56:18.811975 2221 leader_election.cc:304] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24488daee7104583a6f986a6ae3f8fe0, a417bd6c4b7d4bab8e96e65908ec2385; no voters:
I20260503 19:56:18.812698 2363 raft_consensus.cc:2804] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 19:56:18.812975 2363 raft_consensus.cc:493] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 19:56:18.813395 2363 raft_consensus.cc:3060] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [term 0 FOLLOWER]: Advancing to term 1
I20260503 19:56:18.815905 2363 raft_consensus.cc:515] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d32022b7ea94ea48926c65f7a62d687" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 33995 } } peers { permanent_uuid: "a417bd6c4b7d4bab8e96e65908ec2385" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37957 } } peers { permanent_uuid: "24488daee7104583a6f986a6ae3f8fe0" member_type: VOTER last_known_addr { host: "127.0.105.4" port: 34213 } }
I20260503 19:56:18.816625 2363 leader_election.cc:290] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [CANDIDATE]: Term 1 election: Requested vote from peers 6d32022b7ea94ea48926c65f7a62d687 (127.0.105.3:33995), a417bd6c4b7d4bab8e96e65908ec2385 (127.0.105.1:37957)
I20260503 19:56:18.817463 1889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305dbeef23b540c69080a3b2d03c9c35" candidate_uuid: "24488daee7104583a6f986a6ae3f8fe0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a417bd6c4b7d4bab8e96e65908ec2385"
I20260503 19:56:18.817463 2153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305dbeef23b540c69080a3b2d03c9c35" candidate_uuid: "24488daee7104583a6f986a6ae3f8fe0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d32022b7ea94ea48926c65f7a62d687"
I20260503 19:56:18.817703 2153 raft_consensus.cc:3060] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687 [term 0 FOLLOWER]: Advancing to term 1
I20260503 19:56:18.817711 1889 raft_consensus.cc:3060] T 305dbeef23b540c69080a3b2d03c9c35 P a417bd6c4b7d4bab8e96e65908ec2385 [term 0 FOLLOWER]: Advancing to term 1
I20260503 19:56:18.821272 1889 raft_consensus.cc:2468] T 305dbeef23b540c69080a3b2d03c9c35 P a417bd6c4b7d4bab8e96e65908ec2385 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24488daee7104583a6f986a6ae3f8fe0 in term 1.
I20260503 19:56:18.821272 2153 raft_consensus.cc:2468] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24488daee7104583a6f986a6ae3f8fe0 in term 1.
I20260503 19:56:18.821867 2218 leader_election.cc:304] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24488daee7104583a6f986a6ae3f8fe0, 6d32022b7ea94ea48926c65f7a62d687; no voters:
I20260503 19:56:18.822291 2363 raft_consensus.cc:2804] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 19:56:18.823448 2363 raft_consensus.cc:697] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [term 1 LEADER]: Becoming Leader. State: Replica: 24488daee7104583a6f986a6ae3f8fe0, State: Running, Role: LEADER
I20260503 19:56:18.824375 2363 consensus_queue.cc:237] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d32022b7ea94ea48926c65f7a62d687" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 33995 } } peers { permanent_uuid: "a417bd6c4b7d4bab8e96e65908ec2385" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37957 } } peers { permanent_uuid: "24488daee7104583a6f986a6ae3f8fe0" member_type: VOTER last_known_addr { host: "127.0.105.4" port: 34213 } }
W20260503 19:56:18.825632 2331 tablet.cc:2404] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260503 19:56:18.830768 1748 catalog_manager.cc:5671] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 24488daee7104583a6f986a6ae3f8fe0 (127.0.105.4). New cstate: current_term: 1 leader_uuid: "24488daee7104583a6f986a6ae3f8fe0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d32022b7ea94ea48926c65f7a62d687" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 33995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a417bd6c4b7d4bab8e96e65908ec2385" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24488daee7104583a6f986a6ae3f8fe0" member_type: VOTER last_known_addr { host: "127.0.105.4" port: 34213 } health_report { overall_health: HEALTHY } } }
I20260503 19:56:18.869621 420 maintenance_mode-itest.cc:745] Restarting batch of 4 tservers: d337855bccbf4d0c84a8c5d26db11d85,24488daee7104583a6f986a6ae3f8fe0,6d32022b7ea94ea48926c65f7a62d687,a417bd6c4b7d4bab8e96e65908ec2385
W20260503 19:56:18.900743 1935 tablet.cc:2404] T 305dbeef23b540c69080a3b2d03c9c35 P a417bd6c4b7d4bab8e96e65908ec2385: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260503 19:56:18.915890 2363 consensus_queue.cc:1048] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d32022b7ea94ea48926c65f7a62d687" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 33995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 19:56:18.940485 2363 consensus_queue.cc:1048] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a417bd6c4b7d4bab8e96e65908ec2385" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260503 19:56:19.468331 2367 meta_cache.cc:1261] Time spent looking up entry by key: real 0.125s user 0.004s sys 0.000s
W20260503 19:56:19.608593 2369 meta_cache.cc:1261] Time spent looking up entry by key: real 0.074s user 0.003s sys 0.000s
I20260503 19:56:20.104897 1741 ts_manager.cc:295] Set tserver state for 24488daee7104583a6f986a6ae3f8fe0 to MAINTENANCE_MODE
I20260503 19:56:20.257035 1746 ts_manager.cc:295] Set tserver state for a417bd6c4b7d4bab8e96e65908ec2385 to MAINTENANCE_MODE
I20260503 19:56:20.303187 1746 ts_manager.cc:295] Set tserver state for d337855bccbf4d0c84a8c5d26db11d85 to MAINTENANCE_MODE
I20260503 19:56:20.458388 1746 ts_manager.cc:295] Set tserver state for 6d32022b7ea94ea48926c65f7a62d687 to MAINTENANCE_MODE
I20260503 19:56:21.970587 1869 tablet_service.cc:1460] Tablet server a417bd6c4b7d4bab8e96e65908ec2385 set to quiescing
I20260503 19:56:21.971388 1869 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260503 19:56:21.982170 2265 tablet_service.cc:1460] Tablet server 24488daee7104583a6f986a6ae3f8fe0 set to quiescing
I20260503 19:56:21.982498 2265 tablet_service.cc:1467] Tablet server has 1 leaders and 3 scanners
I20260503 19:56:22.007973 2001 tablet_service.cc:1460] Tablet server d337855bccbf4d0c84a8c5d26db11d85 set to quiescing
I20260503 19:56:22.008304 2001 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260503 19:56:22.008977 2395 raft_consensus.cc:993] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0: : Instructing follower 6d32022b7ea94ea48926c65f7a62d687 to start an election
I20260503 19:56:22.009122 2395 raft_consensus.cc:1081] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [term 1 LEADER]: Signalling peer 6d32022b7ea94ea48926c65f7a62d687 to start an election
I20260503 19:56:22.011955 2153 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "305dbeef23b540c69080a3b2d03c9c35"
dest_uuid: "6d32022b7ea94ea48926c65f7a62d687"
from {username='slave'} at 127.0.105.4:44971
I20260503 19:56:22.012864 2153 raft_consensus.cc:493] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 19:56:22.013080 2153 raft_consensus.cc:3060] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687 [term 1 FOLLOWER]: Advancing to term 2
I20260503 19:56:22.035003 2153 raft_consensus.cc:515] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d32022b7ea94ea48926c65f7a62d687" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 33995 } } peers { permanent_uuid: "a417bd6c4b7d4bab8e96e65908ec2385" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37957 } } peers { permanent_uuid: "24488daee7104583a6f986a6ae3f8fe0" member_type: VOTER last_known_addr { host: "127.0.105.4" port: 34213 } }
I20260503 19:56:22.036091 2152 raft_consensus.cc:1240] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687 [term 2 FOLLOWER]: Rejecting Update request from peer 24488daee7104583a6f986a6ae3f8fe0 for earlier term 1. Current term is 2. Ops: []
I20260503 19:56:22.046530 2365 consensus_queue.cc:1059] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d32022b7ea94ea48926c65f7a62d687" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 33995 }, Status: INVALID_TERM, Last received: 1.99, Next index: 100, Last known committed idx: 98, Time since last communication: 0.000s
I20260503 19:56:22.047046 2365 raft_consensus.cc:3055] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [term 1 LEADER]: Stepping down as leader of term 1
I20260503 19:56:22.047824 2365 raft_consensus.cc:740] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 24488daee7104583a6f986a6ae3f8fe0, State: Running, Role: LEADER
I20260503 19:56:22.049535 2365 consensus_queue.cc:260] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 99, Committed index: 99, Last appended: 1.100, Last appended by leader: 100, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d32022b7ea94ea48926c65f7a62d687" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 33995 } } peers { permanent_uuid: "a417bd6c4b7d4bab8e96e65908ec2385" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37957 } } peers { permanent_uuid: "24488daee7104583a6f986a6ae3f8fe0" member_type: VOTER last_known_addr { host: "127.0.105.4" port: 34213 } }
I20260503 19:56:22.050158 2365 raft_consensus.cc:3060] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [term 1 FOLLOWER]: Advancing to term 2
I20260503 19:56:22.051366 2153 leader_election.cc:290] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687 [CANDIDATE]: Term 2 election: Requested vote from peers a417bd6c4b7d4bab8e96e65908ec2385 (127.0.105.1:37957), 24488daee7104583a6f986a6ae3f8fe0 (127.0.105.4:34213)
W20260503 19:56:22.059696 2380 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59302: Illegal state: Replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d32022b7ea94ea48926c65f7a62d687" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 33995 } } peers { permanent_uuid: "a417bd6c4b7d4bab8e96e65908ec2385" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37957 } } peers { permanent_uuid: "24488daee7104583a6f986a6ae3f8fe0" member_type: VOTER last_known_addr { host: "127.0.105.4" port: 34213 } } }
W20260503 19:56:22.070859 2242 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59302: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
I20260503 19:56:22.096200 2133 tablet_service.cc:1460] Tablet server 6d32022b7ea94ea48926c65f7a62d687 set to quiescing
I20260503 19:56:22.096511 2133 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260503 19:56:22.096459 2285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305dbeef23b540c69080a3b2d03c9c35" candidate_uuid: "6d32022b7ea94ea48926c65f7a62d687" candidate_term: 2 candidate_status { last_received { term: 1 index: 99 } } ignore_live_leader: true dest_uuid: "24488daee7104583a6f986a6ae3f8fe0"
I20260503 19:56:22.097258 2285 raft_consensus.cc:2410] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d32022b7ea94ea48926c65f7a62d687 for term 2 because replica has last-logged OpId of term: 1 index: 100, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 99.
I20260503 19:56:22.099813 1889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305dbeef23b540c69080a3b2d03c9c35" candidate_uuid: "6d32022b7ea94ea48926c65f7a62d687" candidate_term: 2 candidate_status { last_received { term: 1 index: 99 } } ignore_live_leader: true dest_uuid: "a417bd6c4b7d4bab8e96e65908ec2385"
I20260503 19:56:22.100131 1889 raft_consensus.cc:3060] T 305dbeef23b540c69080a3b2d03c9c35 P a417bd6c4b7d4bab8e96e65908ec2385 [term 1 FOLLOWER]: Advancing to term 2
I20260503 19:56:22.104883 1889 raft_consensus.cc:2410] T 305dbeef23b540c69080a3b2d03c9c35 P a417bd6c4b7d4bab8e96e65908ec2385 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d32022b7ea94ea48926c65f7a62d687 for term 2 because replica has last-logged OpId of term: 1 index: 100, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 99.
I20260503 19:56:22.107460 2089 leader_election.cc:304] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d32022b7ea94ea48926c65f7a62d687; no voters: 24488daee7104583a6f986a6ae3f8fe0, a417bd6c4b7d4bab8e96e65908ec2385
I20260503 19:56:22.150213 2500 raft_consensus.cc:2749] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260503 19:56:22.156241 2113 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35444: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:22.158013 2112 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35444: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:22.163816 2089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.1:37957, user_credentials={real_user=slave}} blocked reactor thread for 56969us
W20260503 19:56:22.190544 1849 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46222: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:22.190886 1848 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46222: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:22.206303 2245 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59302: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:56:22.212023 2245 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59302: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:56:22.213761 2113 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35444: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:22.220876 2113 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35444: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:22.223356 1849 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46222: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:22.231985 1849 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46222: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:22.236579 2245 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59302: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:56:22.247686 2244 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59302: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:56:22.250968 2113 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35444: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:22.261051 2113 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35444: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:22.264873 1849 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46222: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:22.275542 1849 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46222: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:22.282976 2244 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59302: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:56:22.294193 2244 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59302: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:56:22.296484 2113 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35444: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:22.297187 2365 raft_consensus.cc:670] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0: failed to trigger leader election: Illegal state: leader elections are disabled
W20260503 19:56:22.311200 2113 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35444: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:22.311769 1849 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46222: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:22.330133 1849 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46222: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:22.334010 2244 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59302: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:56:22.341949 2503 raft_consensus.cc:670] T 305dbeef23b540c69080a3b2d03c9c35 P a417bd6c4b7d4bab8e96e65908ec2385: failed to trigger leader election: Illegal state: leader elections are disabled
W20260503 19:56:22.350696 2113 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35444: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:22.353190 2244 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59302: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:56:22.370144 1849 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46222: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:22.373217 1849 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46222: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:22.391916 2113 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35444: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:22.392635 2244 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59302: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:56:22.416155 2113 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35444: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:22.418318 2244 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59302: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:56:22.437961 1849 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46222: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:22.439606 1849 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46222: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:22.461416 2113 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35444: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:22.465041 2244 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59302: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:56:22.487540 2244 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59302: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:56:22.491595 2113 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35444: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:22.512856 2113 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35444: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:22.516815 1849 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46222: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:22.537319 1849 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46222: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:22.548799 2244 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59302: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:56:22.554965 2500 raft_consensus.cc:670] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687: failed to trigger leader election: Illegal state: leader elections are disabled
W20260503 19:56:22.566691 2244 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59302: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:56:22.579331 2113 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35444: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:22.593708 2113 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35444: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:22.608271 1849 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46222: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:22.620952 1849 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46222: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:22.641450 2244 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59302: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:56:22.653925 2244 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59302: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:56:22.673055 2113 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35444: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:22.685825 2113 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35444: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:22.702857 1849 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46222: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:22.719770 1849 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46222: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:22.738336 2244 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59302: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:56:22.757314 2244 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59302: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:56:22.773770 2113 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35444: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:22.792284 2113 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35444: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:22.805876 1849 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46222: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:22.825846 1849 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46222: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:22.841763 2244 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59302: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:56:22.863526 2244 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59302: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:56:22.878011 2113 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35444: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:22.897758 2113 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35444: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:22.917796 1849 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46222: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:22.937566 1849 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46222: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:22.959429 2244 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59302: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:56:22.977344 2244 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59302: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:56:23.000355 2113 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35444: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:23.016701 2113 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35444: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:23.039882 1849 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46222: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:23.058358 1849 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46222: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:23.081426 2244 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59302: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:56:23.102531 2244 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59302: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:56:23.124691 2113 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35444: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:23.147019 2113 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35444: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:23.165482 1849 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46222: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:23.191987 1849 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46222: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:23.211143 2244 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59302: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:56:23.240146 2244 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59302: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:56:23.255854 2113 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35444: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:23.286767 2113 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35444: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:23.304232 1849 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46222: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:23.334489 1849 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46222: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:23.353453 2244 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59302: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:56:23.383585 2244 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59302: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:56:23.401095 2113 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35444: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:23.432235 2113 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35444: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:23.449343 1849 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46222: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:23.482231 1849 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46222: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:23.503278 2244 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59302: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:56:23.534034 2244 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59302: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:56:23.554518 2113 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35444: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:23.582998 2113 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35444: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:23.607926 1849 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46222: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:23.634150 1849 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46222: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:23.662113 2244 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59302: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:56:23.690201 2244 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59302: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:56:23.717809 2113 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35444: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:23.743000 2113 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35444: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
I20260503 19:56:23.747996 2265 tablet_service.cc:1460] Tablet server 24488daee7104583a6f986a6ae3f8fe0 set to quiescing
I20260503 19:56:23.748250 2265 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
W20260503 19:56:23.773265 1849 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46222: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:23.797127 1849 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46222: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:23.829161 2244 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59302: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
I20260503 19:56:23.847954 420 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-task4vf7p3/build/asan/bin/kudu pid 1938
W20260503 19:56:23.855962 2244 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59302: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
I20260503 19:56:23.856484 2061 generic_service.cc:196] Checking for leaks (request via RPC)
W20260503 19:56:23.884590 2113 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35444: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:23.913198 2113 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35444: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:23.945425 1849 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46222: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
I20260503 19:56:23.954377 420 external_mini_cluster.cc:1658] Killing /tmp/dist-test-task4vf7p3/build/asan/bin/kudu with pid 1938
W20260503 19:56:23.969352 1849 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46222: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
I20260503 19:56:23.976465 420 external_mini_cluster.cc:1366] Running /tmp/dist-test-task4vf7p3/build/asan/bin/kudu
/tmp/dist-test-task4vf7p3/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.105.2:32969
--local_ip_for_outbound_sockets=127.0.105.2
--tserver_master_addrs=127.0.105.62:37847
--webserver_port=46229
--webserver_interface=127.0.105.2
--builtin_ntp_servers=127.0.105.20:45725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
W20260503 19:56:24.008208 2244 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59302: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:56:24.029449 2244 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59302: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:56:24.067966 2113 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35444: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:24.087505 2113 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35444: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:24.129516 1849 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46222: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:24.147008 1849 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46222: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:24.192914 2244 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59302: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:56:24.213258 2244 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59302: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:56:24.256996 2113 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35444: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:24.277084 2113 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35444: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:24.321882 1849 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46222: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:24.340430 1849 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46222: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:24.391163 2244 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59302: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:56:24.411516 2244 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59302: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:56:24.427490 2519 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260503 19:56:24.428273 2519 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260503 19:56:24.428586 2519 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260503 19:56:24.440313 2519 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260503 19:56:24.440613 2519 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.105.2
W20260503 19:56:24.456701 2113 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35444: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
I20260503 19:56:24.460317 2519 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.105.20:45725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.105.2:32969
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.105.2
--webserver_port=46229
--tserver_master_addrs=127.0.105.62:37847
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.105.2
--log_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 0ba7f54e15c9f673bf3e350f30b8d5f1a4037b79
build type FASTDEBUG
built by None at 03 May 2026 19:43:25 UTC on bdcb31816ec0
build id 11730
ASAN enabled
I20260503 19:56:24.464093 2519 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260503 19:56:24.468127 2519 file_cache.cc:492] Constructed file cache file cache with capacity 419430
E20260503 19:56:24.473905 2519 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260503 19:56:24.481086 2113 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35444: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:24.493263 2524 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 19:56:24.493310 2525 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 19:56:24.497781 2527 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260503 19:56:24.499781 2519 server_base.cc:1061] running on GCE node
I20260503 19:56:24.501081 2519 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260503 19:56:24.502627 2519 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260503 19:56:24.506146 2519 hybrid_clock.cc:648] HybridClock initialized: now 1777838184506152 us; error 232 us; skew 500 ppm
I20260503 19:56:24.506953 2519 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260503 19:56:24.511121 2519 webserver.cc:492] Webserver started at http://127.0.105.2:46229/ using document root <none> and password file <none>
I20260503 19:56:24.512485 2519 fs_manager.cc:362] Metadata directory not provided
I20260503 19:56:24.512687 2519 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260503 19:56:24.522136 2519 fs_manager.cc:714] Time spent opening directory manager: real 0.007s user 0.007s sys 0.000s
W20260503 19:56:24.527762 1849 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46222: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
I20260503 19:56:24.528890 2533 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260503 19:56:24.530985 2519 fs_manager.cc:730] Time spent opening block manager: real 0.005s user 0.001s sys 0.003s
I20260503 19:56:24.531183 2519 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-1/data,/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-1/wal
uuid: "d337855bccbf4d0c84a8c5d26db11d85"
format_stamp: "Formatted at 2026-05-03 19:56:17 on dist-test-slave-nzs1"
I20260503 19:56:24.532106 2519 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260503 19:56:24.547274 1849 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46222: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
I20260503 19:56:24.557758 2519 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260503 19:56:24.558899 2519 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260503 19:56:24.559245 2519 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260503 19:56:24.561390 2519 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260503 19:56:24.564219 2519 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260503 19:56:24.564353 2519 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260503 19:56:24.564515 2519 ts_tablet_manager.cc:616] Registered 0 tablets
I20260503 19:56:24.564574 2519 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
W20260503 19:56:24.599011 2244 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59302: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
I20260503 19:56:24.613543 2519 rpc_server.cc:307] RPC server started. Bound to: 127.0.105.2:32969
I20260503 19:56:24.613669 2645 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.105.2:32969 every 8 connection(s)
I20260503 19:56:24.615696 2519 server_base.cc:1193] Dumped server information to /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-1/data/info.pb
W20260503 19:56:24.616616 2244 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59302: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
I20260503 19:56:24.623754 420 external_mini_cluster.cc:1428] Started /tmp/dist-test-task4vf7p3/build/asan/bin/kudu as pid 2519
I20260503 19:56:24.624011 420 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-task4vf7p3/build/asan/bin/kudu pid 2202
I20260503 19:56:24.633415 2325 generic_service.cc:196] Checking for leaks (request via RPC)
I20260503 19:56:24.634737 2646 heartbeater.cc:344] Connected to a master server at 127.0.105.62:37847
I20260503 19:56:24.635437 2646 heartbeater.cc:461] Registering TS with master...
I20260503 19:56:24.637454 2646 heartbeater.cc:507] Master 127.0.105.62:37847 requested a full tablet report, sending...
I20260503 19:56:24.640978 1746 ts_manager.cc:194] Re-registered known tserver with Master: d337855bccbf4d0c84a8c5d26db11d85 (127.0.105.2:32969)
I20260503 19:56:24.642926 1746 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.105.2:47763
W20260503 19:56:24.666420 2113 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35444: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:24.687148 2113 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35444: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:24.737532 1849 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46222: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:24.756299 1849 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46222: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
I20260503 19:56:24.784529 420 external_mini_cluster.cc:1658] Killing /tmp/dist-test-task4vf7p3/build/asan/bin/kudu with pid 2202
W20260503 19:56:24.814527 2340 connection.cc:570] client connection to 127.0.105.4:34213 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260503 19:56:24.814829 2340 meta_cache.cc:302] tablet 305dbeef23b540c69080a3b2d03c9c35: replica 24488daee7104583a6f986a6ae3f8fe0 (127.0.105.4:34213) has failed: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260503 19:56:24.814893 2371 meta_cache.cc:1510] marking tablet server 24488daee7104583a6f986a6ae3f8fe0 (127.0.105.4:34213) as failed
I20260503 19:56:24.815810 420 external_mini_cluster.cc:1366] Running /tmp/dist-test-task4vf7p3/build/asan/bin/kudu
/tmp/dist-test-task4vf7p3/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-3/wal
--fs_data_dirs=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-3/logs
--server_dump_info_path=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.105.4:34213
--local_ip_for_outbound_sockets=127.0.105.4
--tserver_master_addrs=127.0.105.62:37847
--webserver_port=42465
--webserver_interface=127.0.105.4
--builtin_ntp_servers=127.0.105.20:45725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
W20260503 19:56:24.829746 2112 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35444: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:24.888950 1848 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46222: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:24.907586 1848 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46222: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:24.961197 2112 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35444: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:24.980283 2112 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35444: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:25.111369 2112 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35444: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:25.132424 2112 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35444: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:25.190976 1848 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46222: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:25.209460 1848 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46222: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:25.272048 2653 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260503 19:56:25.272485 2653 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260503 19:56:25.272746 2653 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260503 19:56:25.282541 2653 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260503 19:56:25.282743 2653 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.105.4
I20260503 19:56:25.295723 2653 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.105.20:45725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-3/data
--fs_wal_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.105.4:34213
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-3/data/info.pb
--webserver_interface=127.0.105.4
--webserver_port=42465
--tserver_master_addrs=127.0.105.62:37847
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.105.4
--log_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-3/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 0ba7f54e15c9f673bf3e350f30b8d5f1a4037b79
build type FASTDEBUG
built by None at 03 May 2026 19:43:25 UTC on bdcb31816ec0
build id 11730
ASAN enabled
I20260503 19:56:25.297546 2653 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260503 19:56:25.299553 2653 file_cache.cc:492] Constructed file cache file cache with capacity 419430
E20260503 19:56:25.304080 2653 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260503 19:56:25.311758 2659 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 19:56:25.311587 2660 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 19:56:25.313418 2662 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260503 19:56:25.314330 2653 server_base.cc:1061] running on GCE node
I20260503 19:56:25.315117 2653 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260503 19:56:25.316561 2653 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260503 19:56:25.318230 2653 hybrid_clock.cc:648] HybridClock initialized: now 1777838185318084 us; error 103 us; skew 500 ppm
I20260503 19:56:25.318727 2653 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260503 19:56:25.322505 2653 webserver.cc:492] Webserver started at http://127.0.105.4:42465/ using document root <none> and password file <none>
I20260503 19:56:25.323477 2653 fs_manager.cc:362] Metadata directory not provided
I20260503 19:56:25.323733 2653 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260503 19:56:25.332423 2653 fs_manager.cc:714] Time spent opening directory manager: real 0.005s user 0.006s sys 0.001s
I20260503 19:56:25.336498 2668 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260503 19:56:25.338353 2653 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260503 19:56:25.338608 2653 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-3/data,/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-3/wal
uuid: "24488daee7104583a6f986a6ae3f8fe0"
format_stamp: "Formatted at 2026-05-03 19:56:18 on dist-test-slave-nzs1"
I20260503 19:56:25.339489 2653 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-3/wal
metadata directory: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-3/wal
1 data directories: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260503 19:56:25.345546 2112 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35444: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
I20260503 19:56:25.356793 2653 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260503 19:56:25.357933 2653 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260503 19:56:25.358228 2653 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260503 19:56:25.359409 2653 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260503 19:56:25.362288 2675 ts_tablet_manager.cc:548] Loading tablet metadata (0/1 complete)
W20260503 19:56:25.368207 2112 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35444: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
I20260503 19:56:25.369603 2653 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260503 19:56:25.369745 2653 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.008s user 0.001s sys 0.000s
I20260503 19:56:25.369846 2653 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260503 19:56:25.373327 2653 ts_tablet_manager.cc:616] Registered 1 tablets
I20260503 19:56:25.373551 2653 ts_tablet_manager.cc:595] Time spent register tablets: real 0.004s user 0.000s sys 0.002s
I20260503 19:56:25.374233 2675 tablet_bootstrap.cc:492] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0: Bootstrap starting.
W20260503 19:56:25.423494 1848 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46222: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
I20260503 19:56:25.434782 2653 rpc_server.cc:307] RPC server started. Bound to: 127.0.105.4:34213
I20260503 19:56:25.434821 2781 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.105.4:34213 every 8 connection(s)
I20260503 19:56:25.436720 2653 server_base.cc:1193] Dumped server information to /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-3/data/info.pb
I20260503 19:56:25.443372 420 external_mini_cluster.cc:1428] Started /tmp/dist-test-task4vf7p3/build/asan/bin/kudu as pid 2653
I20260503 19:56:25.443626 420 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-task4vf7p3/build/asan/bin/kudu pid 2070
W20260503 19:56:25.446161 1848 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46222: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
I20260503 19:56:25.450601 2675 log.cc:826] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0: Log is configured to *not* fsync() on all Append() calls
I20260503 19:56:25.466589 2782 heartbeater.cc:344] Connected to a master server at 127.0.105.62:37847
I20260503 19:56:25.467530 2782 heartbeater.cc:461] Registering TS with master...
I20260503 19:56:25.468653 2193 generic_service.cc:196] Checking for leaks (request via RPC)
I20260503 19:56:25.469609 2782 heartbeater.cc:507] Master 127.0.105.62:37847 requested a full tablet report, sending...
I20260503 19:56:25.474552 1746 ts_manager.cc:194] Re-registered known tserver with Master: 24488daee7104583a6f986a6ae3f8fe0 (127.0.105.4:34213)
I20260503 19:56:25.476320 1746 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.105.4:42563
I20260503 19:56:25.596918 420 external_mini_cluster.cc:1658] Killing /tmp/dist-test-task4vf7p3/build/asan/bin/kudu with pid 2070
W20260503 19:56:25.623924 2340 connection.cc:570] client connection to 127.0.105.3:33995 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260503 19:56:25.624635 420 external_mini_cluster.cc:1366] Running /tmp/dist-test-task4vf7p3/build/asan/bin/kudu
/tmp/dist-test-task4vf7p3/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.105.3:33995
--local_ip_for_outbound_sockets=127.0.105.3
--tserver_master_addrs=127.0.105.62:37847
--webserver_port=33159
--webserver_interface=127.0.105.3
--builtin_ntp_servers=127.0.105.20:45725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
I20260503 19:56:25.648561 2646 heartbeater.cc:499] Master 127.0.105.62:37847 was elected leader, sending a full tablet report...
W20260503 19:56:25.694952 1848 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46222: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:25.710294 1848 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46222: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
I20260503 19:56:25.806744 2675 tablet_bootstrap.cc:492] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0: Bootstrap replayed 1/1 log segments. Stats: ops{read=100 overwritten=0 applied=99 ignored=0} inserts{seen=4900 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260503 19:56:25.807935 2675 tablet_bootstrap.cc:492] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0: Bootstrap complete.
I20260503 19:56:25.809551 2675 ts_tablet_manager.cc:1403] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0: Time spent bootstrapping tablet: real 0.436s user 0.394s sys 0.036s
I20260503 19:56:25.815026 2675 raft_consensus.cc:359] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [term 2 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d32022b7ea94ea48926c65f7a62d687" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 33995 } } peers { permanent_uuid: "a417bd6c4b7d4bab8e96e65908ec2385" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37957 } } peers { permanent_uuid: "24488daee7104583a6f986a6ae3f8fe0" member_type: VOTER last_known_addr { host: "127.0.105.4" port: 34213 } }
I20260503 19:56:25.818293 2675 raft_consensus.cc:740] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24488daee7104583a6f986a6ae3f8fe0, State: Initialized, Role: FOLLOWER
I20260503 19:56:25.819132 2675 consensus_queue.cc:260] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 99, Last appended: 1.100, Last appended by leader: 100, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d32022b7ea94ea48926c65f7a62d687" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 33995 } } peers { permanent_uuid: "a417bd6c4b7d4bab8e96e65908ec2385" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37957 } } peers { permanent_uuid: "24488daee7104583a6f986a6ae3f8fe0" member_type: VOTER last_known_addr { host: "127.0.105.4" port: 34213 } }
I20260503 19:56:25.820433 2782 heartbeater.cc:499] Master 127.0.105.62:37847 was elected leader, sending a full tablet report...
I20260503 19:56:25.821094 2675 ts_tablet_manager.cc:1434] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0: Time spent starting tablet: real 0.011s user 0.010s sys 0.002s
W20260503 19:56:25.867609 1848 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46222: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:25.881898 2697 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:52614: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:56:25.951957 2340 meta_cache.cc:302] tablet 305dbeef23b540c69080a3b2d03c9c35: replica 6d32022b7ea94ea48926c65f7a62d687 (127.0.105.3:33995) has failed: Network error: Client connection negotiation failed: client connection to 127.0.105.3:33995: connect: Connection refused (error 111)
W20260503 19:56:25.968746 1848 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46222: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:26.041399 2697 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:52614: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:56:26.101014 2791 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260503 19:56:26.101383 2791 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260503 19:56:26.101473 2791 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20260503 19:56:26.108035 2793 raft_consensus.cc:493] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 19:56:26.108367 2793 raft_consensus.cc:515] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d32022b7ea94ea48926c65f7a62d687" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 33995 } } peers { permanent_uuid: "a417bd6c4b7d4bab8e96e65908ec2385" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37957 } } peers { permanent_uuid: "24488daee7104583a6f986a6ae3f8fe0" member_type: VOTER last_known_addr { host: "127.0.105.4" port: 34213 } }
I20260503 19:56:26.110096 2793 leader_election.cc:290] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d32022b7ea94ea48926c65f7a62d687 (127.0.105.3:33995), a417bd6c4b7d4bab8e96e65908ec2385 (127.0.105.1:37957)
W20260503 19:56:26.111980 2791 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260503 19:56:26.112483 2791 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.105.3
W20260503 19:56:26.122762 2669 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.105.3:33995: connect: Connection refused (error 111)
W20260503 19:56:26.125406 2669 leader_election.cc:336] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6d32022b7ea94ea48926c65f7a62d687 (127.0.105.3:33995): Network error: Client connection negotiation failed: client connection to 127.0.105.3:33995: connect: Connection refused (error 111)
I20260503 19:56:26.132397 2791 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.105.20:45725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.105.3:33995
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.105.3
--webserver_port=33159
--tserver_master_addrs=127.0.105.62:37847
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.105.3
--log_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 0ba7f54e15c9f673bf3e350f30b8d5f1a4037b79
build type FASTDEBUG
built by None at 03 May 2026 19:43:25 UTC on bdcb31816ec0
build id 11730
ASAN enabled
W20260503 19:56:26.133802 1848 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46222: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
I20260503 19:56:26.135205 1889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305dbeef23b540c69080a3b2d03c9c35" candidate_uuid: "24488daee7104583a6f986a6ae3f8fe0" candidate_term: 3 candidate_status { last_received { term: 1 index: 100 } } ignore_live_leader: false dest_uuid: "a417bd6c4b7d4bab8e96e65908ec2385" is_pre_election: true
I20260503 19:56:26.135291 2791 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260503 19:56:26.135499 1889 raft_consensus.cc:2468] T 305dbeef23b540c69080a3b2d03c9c35 P a417bd6c4b7d4bab8e96e65908ec2385 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24488daee7104583a6f986a6ae3f8fe0 in term 2.
I20260503 19:56:26.136356 2672 leader_election.cc:304] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24488daee7104583a6f986a6ae3f8fe0, a417bd6c4b7d4bab8e96e65908ec2385; no voters: 6d32022b7ea94ea48926c65f7a62d687
I20260503 19:56:26.136960 2793 raft_consensus.cc:2804] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260503 19:56:26.137148 2793 raft_consensus.cc:493] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 19:56:26.137333 2793 raft_consensus.cc:3060] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [term 2 FOLLOWER]: Advancing to term 3
I20260503 19:56:26.138032 2791 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260503 19:56:26.141750 2793 raft_consensus.cc:515] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d32022b7ea94ea48926c65f7a62d687" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 33995 } } peers { permanent_uuid: "a417bd6c4b7d4bab8e96e65908ec2385" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37957 } } peers { permanent_uuid: "24488daee7104583a6f986a6ae3f8fe0" member_type: VOTER last_known_addr { host: "127.0.105.4" port: 34213 } }
W20260503 19:56:26.142953 2697 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:52614: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
I20260503 19:56:26.143059 2793 leader_election.cc:290] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [CANDIDATE]: Term 3 election: Requested vote from peers 6d32022b7ea94ea48926c65f7a62d687 (127.0.105.3:33995), a417bd6c4b7d4bab8e96e65908ec2385 (127.0.105.1:37957)
I20260503 19:56:26.143172 1889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305dbeef23b540c69080a3b2d03c9c35" candidate_uuid: "24488daee7104583a6f986a6ae3f8fe0" candidate_term: 3 candidate_status { last_received { term: 1 index: 100 } } ignore_live_leader: false dest_uuid: "a417bd6c4b7d4bab8e96e65908ec2385"
I20260503 19:56:26.143453 1889 raft_consensus.cc:3060] T 305dbeef23b540c69080a3b2d03c9c35 P a417bd6c4b7d4bab8e96e65908ec2385 [term 2 FOLLOWER]: Advancing to term 3
E20260503 19:56:26.143847 2791 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260503 19:56:26.145166 2669 leader_election.cc:336] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 6d32022b7ea94ea48926c65f7a62d687 (127.0.105.3:33995): Network error: Client connection negotiation failed: client connection to 127.0.105.3:33995: connect: Connection refused (error 111)
I20260503 19:56:26.146072 1889 raft_consensus.cc:2468] T 305dbeef23b540c69080a3b2d03c9c35 P a417bd6c4b7d4bab8e96e65908ec2385 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24488daee7104583a6f986a6ae3f8fe0 in term 3.
I20260503 19:56:26.146597 2672 leader_election.cc:304] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24488daee7104583a6f986a6ae3f8fe0, a417bd6c4b7d4bab8e96e65908ec2385; no voters: 6d32022b7ea94ea48926c65f7a62d687
I20260503 19:56:26.147068 2793 raft_consensus.cc:2804] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [term 3 FOLLOWER]: Leader election won for term 3
I20260503 19:56:26.147677 2793 raft_consensus.cc:697] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [term 3 LEADER]: Becoming Leader. State: Replica: 24488daee7104583a6f986a6ae3f8fe0, State: Running, Role: LEADER
I20260503 19:56:26.148998 2793 consensus_queue.cc:237] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 99, Committed index: 99, Last appended: 1.100, Last appended by leader: 100, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d32022b7ea94ea48926c65f7a62d687" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 33995 } } peers { permanent_uuid: "a417bd6c4b7d4bab8e96e65908ec2385" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37957 } } peers { permanent_uuid: "24488daee7104583a6f986a6ae3f8fe0" member_type: VOTER last_known_addr { host: "127.0.105.4" port: 34213 } }
W20260503 19:56:26.150933 2803 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 19:56:26.154608 2804 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 19:56:26.155527 2807 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260503 19:56:26.156032 1746 catalog_manager.cc:5671] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "24488daee7104583a6f986a6ae3f8fe0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d32022b7ea94ea48926c65f7a62d687" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 33995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a417bd6c4b7d4bab8e96e65908ec2385" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24488daee7104583a6f986a6ae3f8fe0" member_type: VOTER last_known_addr { host: "127.0.105.4" port: 34213 } health_report { overall_health: HEALTHY } } }
I20260503 19:56:26.156766 2791 server_base.cc:1061] running on GCE node
I20260503 19:56:26.157624 2791 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260503 19:56:26.159847 2791 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260503 19:56:26.161407 2791 hybrid_clock.cc:648] HybridClock initialized: now 1777838186161234 us; error 149 us; skew 500 ppm
I20260503 19:56:26.161841 2791 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260503 19:56:26.165308 2791 webserver.cc:492] Webserver started at http://127.0.105.3:33159/ using document root <none> and password file <none>
I20260503 19:56:26.166296 2791 fs_manager.cc:362] Metadata directory not provided
I20260503 19:56:26.166512 2791 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260503 19:56:26.173765 2791 fs_manager.cc:714] Time spent opening directory manager: real 0.005s user 0.000s sys 0.004s
I20260503 19:56:26.178056 2817 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260503 19:56:26.180416 2791 fs_manager.cc:730] Time spent opening block manager: real 0.005s user 0.005s sys 0.000s
I20260503 19:56:26.180722 2791 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-2/data,/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-2/wal
uuid: "6d32022b7ea94ea48926c65f7a62d687"
format_stamp: "Formatted at 2026-05-03 19:56:17 on dist-test-slave-nzs1"
I20260503 19:56:26.181631 2791 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260503 19:56:26.198194 2791 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260503 19:56:26.199271 2791 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260503 19:56:26.199707 2791 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260503 19:56:26.200915 2791 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260503 19:56:26.203522 2824 ts_tablet_manager.cc:548] Loading tablet metadata (0/1 complete)
I20260503 19:56:26.210549 2791 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260503 19:56:26.210777 2791 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.008s user 0.001s sys 0.000s
I20260503 19:56:26.210952 2791 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260503 19:56:26.214841 2791 ts_tablet_manager.cc:616] Registered 1 tablets
I20260503 19:56:26.215029 2791 ts_tablet_manager.cc:595] Time spent register tablets: real 0.004s user 0.001s sys 0.000s
I20260503 19:56:26.215705 2824 tablet_bootstrap.cc:492] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687: Bootstrap starting.
W20260503 19:56:26.228631 1848 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46222: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:26.230866 2669 consensus_peers.cc:597] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 -> Peer 6d32022b7ea94ea48926c65f7a62d687 (127.0.105.3:33995): Couldn't send request to peer 6d32022b7ea94ea48926c65f7a62d687. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.3:33995: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260503 19:56:26.275434 1889 raft_consensus.cc:1275] T 305dbeef23b540c69080a3b2d03c9c35 P a417bd6c4b7d4bab8e96e65908ec2385 [term 3 FOLLOWER]: Refusing update from remote peer 24488daee7104583a6f986a6ae3f8fe0: Log matching property violated. Preceding OpId in replica: term: 1 index: 100. Preceding OpId from leader: term: 3 index: 101. (index mismatch)
I20260503 19:56:26.277197 2793 consensus_queue.cc:1048] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a417bd6c4b7d4bab8e96e65908ec2385" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 101, Last known committed idx: 99, Time since last communication: 0.000s
I20260503 19:56:26.305044 2907 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:46222 (ReqId={client: 2baef47169a94d76b532b9350f8ffd6a, seq_no=98, attempt_no=4}) took 1455 ms. Trace:
I20260503 19:56:26.305406 2907 rpcz_store.cc:276] 0503 19:56:24.849636 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 19:56:24.849726 (+ 90us) service_pool.cc:224] Handling call
0503 19:56:26.304979 (+1455253us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 19:56:26.322932 2824 log.cc:826] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687: Log is configured to *not* fsync() on all Append() calls
I20260503 19:56:26.343222 2791 rpc_server.cc:307] RPC server started. Bound to: 127.0.105.3:33995
I20260503 19:56:26.343327 2935 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.105.3:33995 every 8 connection(s)
I20260503 19:56:26.345435 2791 server_base.cc:1193] Dumped server information to /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-2/data/info.pb
I20260503 19:56:26.353576 420 external_mini_cluster.cc:1428] Started /tmp/dist-test-task4vf7p3/build/asan/bin/kudu as pid 2791
I20260503 19:56:26.353847 420 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-task4vf7p3/build/asan/bin/kudu pid 1807
W20260503 19:56:26.407893 2370 scanner-internal.cc:458] Time spent opening tablet: real 4.095s user 0.011s sys 0.000s
W20260503 19:56:26.443027 2372 scanner-internal.cc:458] Time spent opening tablet: real 4.081s user 0.009s sys 0.001s
W20260503 19:56:26.449568 2371 scanner-internal.cc:458] Time spent opening tablet: real 4.064s user 0.007s sys 0.004s
I20260503 19:56:26.479158 1929 generic_service.cc:196] Checking for leaks (request via RPC)
I20260503 19:56:26.495698 2936 heartbeater.cc:344] Connected to a master server at 127.0.105.62:37847
I20260503 19:56:26.496129 2936 heartbeater.cc:461] Registering TS with master...
I20260503 19:56:26.497925 2936 heartbeater.cc:507] Master 127.0.105.62:37847 requested a full tablet report, sending...
I20260503 19:56:26.502204 1746 ts_manager.cc:194] Re-registered known tserver with Master: 6d32022b7ea94ea48926c65f7a62d687 (127.0.105.3:33995)
I20260503 19:56:26.504369 1746 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.105.3:33197
W20260503 19:56:26.536836 1848 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46222: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:26.730862 1848 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46222: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
I20260503 19:56:26.731768 420 external_mini_cluster.cc:1658] Killing /tmp/dist-test-task4vf7p3/build/asan/bin/kudu with pid 1807
W20260503 19:56:26.746827 2669 consensus_peers.cc:597] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 -> Peer 6d32022b7ea94ea48926c65f7a62d687 (127.0.105.3:33995): Couldn't send request to peer 6d32022b7ea94ea48926c65f7a62d687. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
I20260503 19:56:26.778141 420 external_mini_cluster.cc:1366] Running /tmp/dist-test-task4vf7p3/build/asan/bin/kudu
/tmp/dist-test-task4vf7p3/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.105.1:37957
--local_ip_for_outbound_sockets=127.0.105.1
--tserver_master_addrs=127.0.105.62:37847
--webserver_port=39515
--webserver_interface=127.0.105.1
--builtin_ntp_servers=127.0.105.20:45725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
W20260503 19:56:26.778384 2797 negotiation.cc:336] Failed RPC negotiation. Trace:
0503 19:56:26.776940 (+ 0us) reactor.cc:678] Submitting negotiation task for client connection to 127.0.105.1:37957 (local address 127.0.105.4:51301)
0503 19:56:26.777218 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0503 19:56:26.777327 (+ 109us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37957: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":141}
W20260503 19:56:26.778692 2672 consensus_peers.cc:597] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 -> Peer a417bd6c4b7d4bab8e96e65908ec2385 (127.0.105.1:37957): Couldn't send request to peer a417bd6c4b7d4bab8e96e65908ec2385. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37957: connect: Connection reset by peer (error 104). This is attempt 1: this message will repeat every 5th retry.
I20260503 19:56:26.874887 2824 tablet_bootstrap.cc:492] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687: Bootstrap replayed 1/1 log segments. Stats: ops{read=99 overwritten=0 applied=98 ignored=0} inserts{seen=4850 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260503 19:56:26.875772 2824 tablet_bootstrap.cc:492] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687: Bootstrap complete.
I20260503 19:56:26.877424 2824 ts_tablet_manager.cc:1403] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687: Time spent bootstrapping tablet: real 0.662s user 0.553s sys 0.055s
I20260503 19:56:26.881948 2824 raft_consensus.cc:359] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687 [term 2 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d32022b7ea94ea48926c65f7a62d687" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 33995 } } peers { permanent_uuid: "a417bd6c4b7d4bab8e96e65908ec2385" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37957 } } peers { permanent_uuid: "24488daee7104583a6f986a6ae3f8fe0" member_type: VOTER last_known_addr { host: "127.0.105.4" port: 34213 } }
I20260503 19:56:26.885409 2824 raft_consensus.cc:740] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d32022b7ea94ea48926c65f7a62d687, State: Initialized, Role: FOLLOWER
I20260503 19:56:26.886993 2824 consensus_queue.cc:260] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 98, Last appended: 1.99, Last appended by leader: 99, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d32022b7ea94ea48926c65f7a62d687" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 33995 } } peers { permanent_uuid: "a417bd6c4b7d4bab8e96e65908ec2385" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37957 } } peers { permanent_uuid: "24488daee7104583a6f986a6ae3f8fe0" member_type: VOTER last_known_addr { host: "127.0.105.4" port: 34213 } }
I20260503 19:56:26.888254 2936 heartbeater.cc:499] Master 127.0.105.62:37847 was elected leader, sending a full tablet report...
I20260503 19:56:26.888942 2824 ts_tablet_manager.cc:1434] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687: Time spent starting tablet: real 0.011s user 0.012s sys 0.000s
I20260503 19:56:26.946569 2886 raft_consensus.cc:3060] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687 [term 2 FOLLOWER]: Advancing to term 3
I20260503 19:56:26.950961 2886 raft_consensus.cc:1275] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687 [term 3 FOLLOWER]: Refusing update from remote peer 24488daee7104583a6f986a6ae3f8fe0: Log matching property violated. Preceding OpId in replica: term: 1 index: 99. Preceding OpId from leader: term: 1 index: 100. (index mismatch)
I20260503 19:56:26.952292 2801 consensus_queue.cc:1050] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [LEADER]: Got LMP mismatch error from peer: Peer: permanent_uuid: "6d32022b7ea94ea48926c65f7a62d687" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 33995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 101, Last known committed idx: 98, Time since last communication: 0.000s
W20260503 19:56:27.274327 2672 consensus_peers.cc:597] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 -> Peer a417bd6c4b7d4bab8e96e65908ec2385 (127.0.105.1:37957): Couldn't send request to peer a417bd6c4b7d4bab8e96e65908ec2385. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37957: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260503 19:56:27.511219 2947 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260503 19:56:27.511813 2947 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260503 19:56:27.511997 2947 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260503 19:56:27.527101 2947 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260503 19:56:27.527509 2947 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.105.1
I20260503 19:56:27.545241 2947 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.105.20:45725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.105.1:37957
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.105.1
--webserver_port=39515
--tserver_master_addrs=127.0.105.62:37847
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.105.1
--log_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 0ba7f54e15c9f673bf3e350f30b8d5f1a4037b79
build type FASTDEBUG
built by None at 03 May 2026 19:43:25 UTC on bdcb31816ec0
build id 11730
ASAN enabled
I20260503 19:56:27.547873 2947 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260503 19:56:27.550850 2947 file_cache.cc:492] Constructed file cache file cache with capacity 419430
E20260503 19:56:27.556922 2947 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260503 19:56:27.569954 2961 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 19:56:27.572247 2962 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 19:56:27.580257 2965 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260503 19:56:27.604780 2947 server_base.cc:1061] running on GCE node
I20260503 19:56:27.605916 2947 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260503 19:56:27.621232 2947 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260503 19:56:27.626861 2947 hybrid_clock.cc:648] HybridClock initialized: now 1777838187626698 us; error 114 us; skew 500 ppm
I20260503 19:56:27.627817 2947 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260503 19:56:27.635401 2947 webserver.cc:492] Webserver started at http://127.0.105.1:39515/ using document root <none> and password file <none>
I20260503 19:56:27.636724 2947 fs_manager.cc:362] Metadata directory not provided
I20260503 19:56:27.637017 2947 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260503 19:56:27.660881 2947 fs_manager.cc:714] Time spent opening directory manager: real 0.021s user 0.003s sys 0.001s
I20260503 19:56:27.685015 2971 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260503 19:56:27.694581 2947 fs_manager.cc:730] Time spent opening block manager: real 0.031s user 0.011s sys 0.008s
I20260503 19:56:27.694921 2947 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-0/data,/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-0/wal
uuid: "a417bd6c4b7d4bab8e96e65908ec2385"
format_stamp: "Formatted at 2026-05-03 19:56:16 on dist-test-slave-nzs1"
I20260503 19:56:27.696403 2947 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260503 19:56:27.738924 2947 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260503 19:56:27.740443 2947 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260503 19:56:27.740898 2947 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260503 19:56:27.746152 2947 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260503 19:56:27.757197 2978 ts_tablet_manager.cc:548] Loading tablet metadata (0/1 complete)
I20260503 19:56:27.767580 2947 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260503 19:56:27.767764 2947 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.018s user 0.000s sys 0.008s
I20260503 19:56:27.767904 2947 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260503 19:56:27.773849 2947 ts_tablet_manager.cc:616] Registered 1 tablets
I20260503 19:56:27.774049 2947 ts_tablet_manager.cc:595] Time spent register tablets: real 0.006s user 0.003s sys 0.003s
I20260503 19:56:27.775110 2978 tablet_bootstrap.cc:492] T 305dbeef23b540c69080a3b2d03c9c35 P a417bd6c4b7d4bab8e96e65908ec2385: Bootstrap starting.
W20260503 19:56:27.790088 2672 consensus_peers.cc:597] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 -> Peer a417bd6c4b7d4bab8e96e65908ec2385 (127.0.105.1:37957): Couldn't send request to peer a417bd6c4b7d4bab8e96e65908ec2385. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37957: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260503 19:56:27.928556 2978 log.cc:826] T 305dbeef23b540c69080a3b2d03c9c35 P a417bd6c4b7d4bab8e96e65908ec2385: Log is configured to *not* fsync() on all Append() calls
W20260503 19:56:28.289436 2672 consensus_peers.cc:597] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 -> Peer a417bd6c4b7d4bab8e96e65908ec2385 (127.0.105.1:37957): Couldn't send request to peer a417bd6c4b7d4bab8e96e65908ec2385. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37957: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260503 19:56:28.752256 2978 tablet_bootstrap.cc:492] T 305dbeef23b540c69080a3b2d03c9c35 P a417bd6c4b7d4bab8e96e65908ec2385: Bootstrap replayed 1/1 log segments. Stats: ops{read=106 overwritten=0 applied=106 ignored=0} inserts{seen=5200 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260503 19:56:28.753227 2978 tablet_bootstrap.cc:492] T 305dbeef23b540c69080a3b2d03c9c35 P a417bd6c4b7d4bab8e96e65908ec2385: Bootstrap complete.
I20260503 19:56:28.755052 2978 ts_tablet_manager.cc:1403] T 305dbeef23b540c69080a3b2d03c9c35 P a417bd6c4b7d4bab8e96e65908ec2385: Time spent bootstrapping tablet: real 0.980s user 0.641s sys 0.073s
I20260503 19:56:28.763129 2978 raft_consensus.cc:359] T 305dbeef23b540c69080a3b2d03c9c35 P a417bd6c4b7d4bab8e96e65908ec2385 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d32022b7ea94ea48926c65f7a62d687" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 33995 } } peers { permanent_uuid: "a417bd6c4b7d4bab8e96e65908ec2385" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37957 } } peers { permanent_uuid: "24488daee7104583a6f986a6ae3f8fe0" member_type: VOTER last_known_addr { host: "127.0.105.4" port: 34213 } }
I20260503 19:56:28.764432 2978 raft_consensus.cc:740] T 305dbeef23b540c69080a3b2d03c9c35 P a417bd6c4b7d4bab8e96e65908ec2385 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: a417bd6c4b7d4bab8e96e65908ec2385, State: Initialized, Role: FOLLOWER
I20260503 19:56:28.765570 2978 consensus_queue.cc:260] T 305dbeef23b540c69080a3b2d03c9c35 P a417bd6c4b7d4bab8e96e65908ec2385 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 106, Last appended: 3.106, Last appended by leader: 106, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d32022b7ea94ea48926c65f7a62d687" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 33995 } } peers { permanent_uuid: "a417bd6c4b7d4bab8e96e65908ec2385" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37957 } } peers { permanent_uuid: "24488daee7104583a6f986a6ae3f8fe0" member_type: VOTER last_known_addr { host: "127.0.105.4" port: 34213 } }
I20260503 19:56:28.780059 2978 ts_tablet_manager.cc:1434] T 305dbeef23b540c69080a3b2d03c9c35 P a417bd6c4b7d4bab8e96e65908ec2385: Time spent starting tablet: real 0.025s user 0.010s sys 0.008s
W20260503 19:56:28.780598 2672 consensus_peers.cc:597] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 -> Peer a417bd6c4b7d4bab8e96e65908ec2385 (127.0.105.1:37957): Couldn't send request to peer a417bd6c4b7d4bab8e96e65908ec2385. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37957: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260503 19:56:28.907264 2947 rpc_server.cc:307] RPC server started. Bound to: 127.0.105.1:37957
I20260503 19:56:28.907320 3089 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.105.1:37957 every 8 connection(s)
I20260503 19:56:28.910944 2947 server_base.cc:1193] Dumped server information to /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-0/data/info.pb
I20260503 19:56:28.920130 420 external_mini_cluster.cc:1428] Started /tmp/dist-test-task4vf7p3/build/asan/bin/kudu as pid 2947
I20260503 19:56:29.014494 3090 heartbeater.cc:344] Connected to a master server at 127.0.105.62:37847
I20260503 19:56:29.014986 3090 heartbeater.cc:461] Registering TS with master...
I20260503 19:56:29.016892 3090 heartbeater.cc:507] Master 127.0.105.62:37847 requested a full tablet report, sending...
I20260503 19:56:29.047098 1746 ts_manager.cc:194] Re-registered known tserver with Master: a417bd6c4b7d4bab8e96e65908ec2385 (127.0.105.1:37957)
I20260503 19:56:29.049113 1746 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.105.1:53259
I20260503 19:56:29.094452 3090 heartbeater.cc:499] Master 127.0.105.62:37847 was elected leader, sending a full tablet report...
I20260503 19:56:30.844590 3023 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260503 19:56:30.866554 2717 tablet_service.cc:1467] Tablet server has 1 leaders and 3 scanners
I20260503 19:56:30.868465 2581 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260503 19:56:30.877034 2866 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260503 19:56:33.327409 1746 ts_manager.cc:284] Unset tserver state for 24488daee7104583a6f986a6ae3f8fe0 from MAINTENANCE_MODE
I20260503 19:56:33.328899 3090 heartbeater.cc:507] Master 127.0.105.62:37847 requested a full tablet report, sending...
I20260503 19:56:33.335199 2782 heartbeater.cc:507] Master 127.0.105.62:37847 requested a full tablet report, sending...
I20260503 19:56:33.394821 1747 ts_manager.cc:284] Unset tserver state for d337855bccbf4d0c84a8c5d26db11d85 from MAINTENANCE_MODE
I20260503 19:56:33.463717 1747 ts_manager.cc:284] Unset tserver state for a417bd6c4b7d4bab8e96e65908ec2385 from MAINTENANCE_MODE
I20260503 19:56:33.672014 2646 heartbeater.cc:507] Master 127.0.105.62:37847 requested a full tablet report, sending...
I20260503 19:56:34.077780 2936 heartbeater.cc:507] Master 127.0.105.62:37847 requested a full tablet report, sending...
I20260503 19:56:34.168236 1747 ts_manager.cc:284] Unset tserver state for 6d32022b7ea94ea48926c65f7a62d687 from MAINTENANCE_MODE
I20260503 19:56:34.340803 3090 heartbeater.cc:507] Master 127.0.105.62:37847 requested a full tablet report, sending...
I20260503 19:56:34.341699 2782 heartbeater.cc:507] Master 127.0.105.62:37847 requested a full tablet report, sending...
I20260503 19:56:34.679606 2646 heartbeater.cc:507] Master 127.0.105.62:37847 requested a full tablet report, sending...
I20260503 19:56:35.083273 2936 heartbeater.cc:507] Master 127.0.105.62:37847 requested a full tablet report, sending...
I20260503 19:56:35.947436 1739 ts_manager.cc:295] Set tserver state for 24488daee7104583a6f986a6ae3f8fe0 to MAINTENANCE_MODE
I20260503 19:56:36.777817 1739 ts_manager.cc:295] Set tserver state for 6d32022b7ea94ea48926c65f7a62d687 to MAINTENANCE_MODE
I20260503 19:56:36.833293 1739 ts_manager.cc:295] Set tserver state for d337855bccbf4d0c84a8c5d26db11d85 to MAINTENANCE_MODE
I20260503 19:56:37.116166 1739 ts_manager.cc:295] Set tserver state for a417bd6c4b7d4bab8e96e65908ec2385 to MAINTENANCE_MODE
I20260503 19:56:38.144855 2866 tablet_service.cc:1460] Tablet server 6d32022b7ea94ea48926c65f7a62d687 set to quiescing
I20260503 19:56:38.145217 2866 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260503 19:56:38.743095 2717 tablet_service.cc:1460] Tablet server 24488daee7104583a6f986a6ae3f8fe0 set to quiescing
I20260503 19:56:38.743367 2717 tablet_service.cc:1467] Tablet server has 1 leaders and 3 scanners
I20260503 19:56:38.754271 3239 raft_consensus.cc:993] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0: : Instructing follower a417bd6c4b7d4bab8e96e65908ec2385 to start an election
I20260503 19:56:38.758751 3239 raft_consensus.cc:1081] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [term 3 LEADER]: Signalling peer a417bd6c4b7d4bab8e96e65908ec2385 to start an election
I20260503 19:56:38.763298 3042 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "305dbeef23b540c69080a3b2d03c9c35"
dest_uuid: "a417bd6c4b7d4bab8e96e65908ec2385"
from {username='slave'} at 127.0.105.4:36641
I20260503 19:56:38.765076 3042 raft_consensus.cc:493] T 305dbeef23b540c69080a3b2d03c9c35 P a417bd6c4b7d4bab8e96e65908ec2385 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 19:56:38.765333 3042 raft_consensus.cc:3060] T 305dbeef23b540c69080a3b2d03c9c35 P a417bd6c4b7d4bab8e96e65908ec2385 [term 3 FOLLOWER]: Advancing to term 4
I20260503 19:56:38.780627 3042 raft_consensus.cc:515] T 305dbeef23b540c69080a3b2d03c9c35 P a417bd6c4b7d4bab8e96e65908ec2385 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d32022b7ea94ea48926c65f7a62d687" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 33995 } } peers { permanent_uuid: "a417bd6c4b7d4bab8e96e65908ec2385" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37957 } } peers { permanent_uuid: "24488daee7104583a6f986a6ae3f8fe0" member_type: VOTER last_known_addr { host: "127.0.105.4" port: 34213 } }
I20260503 19:56:38.785481 3043 raft_consensus.cc:1240] T 305dbeef23b540c69080a3b2d03c9c35 P a417bd6c4b7d4bab8e96e65908ec2385 [term 4 FOLLOWER]: Rejecting Update request from peer 24488daee7104583a6f986a6ae3f8fe0 for earlier term 3. Current term is 4. Ops: [3.815-3.815]
I20260503 19:56:38.787297 3239 consensus_queue.cc:1059] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a417bd6c4b7d4bab8e96e65908ec2385" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37957 }, Status: INVALID_TERM, Last received: 3.814, Next index: 815, Last known committed idx: 813, Time since last communication: 0.000s
I20260503 19:56:38.829226 3042 leader_election.cc:290] T 305dbeef23b540c69080a3b2d03c9c35 P a417bd6c4b7d4bab8e96e65908ec2385 [CANDIDATE]: Term 4 election: Requested vote from peers 6d32022b7ea94ea48926c65f7a62d687 (127.0.105.3:33995), 24488daee7104583a6f986a6ae3f8fe0 (127.0.105.4:34213)
I20260503 19:56:38.833262 3042 raft_consensus.cc:1240] T 305dbeef23b540c69080a3b2d03c9c35 P a417bd6c4b7d4bab8e96e65908ec2385 [term 4 FOLLOWER]: Rejecting Update request from peer 24488daee7104583a6f986a6ae3f8fe0 for earlier term 3. Current term is 4. Ops: [3.815-3.815]
I20260503 19:56:38.834195 3190 consensus_queue.cc:1059] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a417bd6c4b7d4bab8e96e65908ec2385" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37957 }, Status: INVALID_TERM, Last received: 3.814, Next index: 815, Last known committed idx: 813, Time since last communication: 0.000s
I20260503 19:56:38.836923 3104 raft_consensus.cc:3055] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [term 3 LEADER]: Stepping down as leader of term 3
I20260503 19:56:38.837035 3104 raft_consensus.cc:740] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 24488daee7104583a6f986a6ae3f8fe0, State: Running, Role: LEADER
I20260503 19:56:38.837332 3104 consensus_queue.cc:260] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 815, Committed index: 815, Last appended: 3.817, Last appended by leader: 817, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d32022b7ea94ea48926c65f7a62d687" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 33995 } } peers { permanent_uuid: "a417bd6c4b7d4bab8e96e65908ec2385" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37957 } } peers { permanent_uuid: "24488daee7104583a6f986a6ae3f8fe0" member_type: VOTER last_known_addr { host: "127.0.105.4" port: 34213 } }
I20260503 19:56:38.837891 3104 raft_consensus.cc:3060] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [term 3 FOLLOWER]: Advancing to term 4
W20260503 19:56:38.840966 2792 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:52614: Illegal state: Cannot assign timestamp to op. Tablet is not in leader mode. Last heard from a leader: 0.006s ago.
W20260503 19:56:38.850219 2845 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35514: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
I20260503 19:56:38.858816 2737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305dbeef23b540c69080a3b2d03c9c35" candidate_uuid: "a417bd6c4b7d4bab8e96e65908ec2385" candidate_term: 4 candidate_status { last_received { term: 3 index: 814 } } ignore_live_leader: true dest_uuid: "24488daee7104583a6f986a6ae3f8fe0"
I20260503 19:56:38.859253 2737 raft_consensus.cc:2410] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a417bd6c4b7d4bab8e96e65908ec2385 for term 4 because replica has last-logged OpId of term: 3 index: 817, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 814.
I20260503 19:56:38.875501 2885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305dbeef23b540c69080a3b2d03c9c35" candidate_uuid: "a417bd6c4b7d4bab8e96e65908ec2385" candidate_term: 4 candidate_status { last_received { term: 3 index: 814 } } ignore_live_leader: true dest_uuid: "6d32022b7ea94ea48926c65f7a62d687"
I20260503 19:56:38.875952 2885 raft_consensus.cc:3060] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687 [term 3 FOLLOWER]: Advancing to term 4
I20260503 19:56:38.879918 2885 raft_consensus.cc:2410] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a417bd6c4b7d4bab8e96e65908ec2385 for term 4 because replica has last-logged OpId of term: 3 index: 816, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 814.
I20260503 19:56:38.880784 2972 leader_election.cc:304] T 305dbeef23b540c69080a3b2d03c9c35 P a417bd6c4b7d4bab8e96e65908ec2385 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a417bd6c4b7d4bab8e96e65908ec2385; no voters: 24488daee7104583a6f986a6ae3f8fe0, 6d32022b7ea94ea48926c65f7a62d687
I20260503 19:56:38.889335 3307 raft_consensus.cc:2749] T 305dbeef23b540c69080a3b2d03c9c35 P a417bd6c4b7d4bab8e96e65908ec2385 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260503 19:56:38.901537 3000 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43146: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:38.913599 2695 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:52614: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:56:38.921033 2845 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35514: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:38.929533 3000 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43146: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:38.944029 2695 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:52614: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:56:38.959487 2845 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35514: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:38.972719 3000 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43146: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:38.989184 2696 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:52614: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:56:39.005764 2845 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35514: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:39.020452 3000 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43146: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:39.038837 2696 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:52614: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:56:39.054188 2845 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35514: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:39.072666 3000 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43146: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
I20260503 19:56:39.089833 3023 tablet_service.cc:1460] Tablet server a417bd6c4b7d4bab8e96e65908ec2385 set to quiescing
W20260503 19:56:39.089845 3104 raft_consensus.cc:670] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0: failed to trigger leader election: Illegal state: leader elections are disabled
I20260503 19:56:39.090109 3023 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
W20260503 19:56:39.093547 2696 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:52614: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:56:39.115399 2845 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35514: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:39.136705 3000 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43146: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:39.138114 3317 raft_consensus.cc:670] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687: failed to trigger leader election: Illegal state: leader elections are disabled
W20260503 19:56:39.163575 2697 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:52614: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:56:39.188807 2845 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35514: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:39.214633 3000 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43146: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:39.241021 2696 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:52614: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:56:39.243894 3307 raft_consensus.cc:670] T 305dbeef23b540c69080a3b2d03c9c35 P a417bd6c4b7d4bab8e96e65908ec2385: failed to trigger leader election: Illegal state: leader elections are disabled
W20260503 19:56:39.268533 2845 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35514: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:39.295318 3000 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43146: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
I20260503 19:56:39.299358 2581 tablet_service.cc:1460] Tablet server d337855bccbf4d0c84a8c5d26db11d85 set to quiescing
I20260503 19:56:39.299692 2581 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
W20260503 19:56:39.325066 2696 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:52614: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:56:39.352901 2845 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35514: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:39.383052 3000 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43146: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:39.418650 2696 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:52614: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:56:39.453830 2845 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35514: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:39.489015 3000 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43146: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:39.524199 2695 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:52614: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:56:39.562224 2845 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35514: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:39.600277 3000 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43146: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:39.637290 2696 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:52614: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:56:39.676709 2845 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35514: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:39.716169 3000 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43146: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:39.760571 2696 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:52614: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:56:39.804453 2845 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35514: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:39.845602 3000 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43146: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:39.890576 2696 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:52614: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:56:39.937006 2845 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35514: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:39.984500 3000 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43146: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:40.035146 2696 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:52614: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:56:40.084178 2845 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35514: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:40.132756 3000 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43146: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:40.185253 2696 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:52614: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:56:40.238029 2845 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35514: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:40.289793 3000 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43146: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:40.343400 2696 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:52614: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:56:40.397289 2845 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35514: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:40.450052 3000 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43146: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:40.507886 2696 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:52614: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
I20260503 19:56:40.553771 2717 tablet_service.cc:1460] Tablet server 24488daee7104583a6f986a6ae3f8fe0 set to quiescing
I20260503 19:56:40.554024 2717 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
W20260503 19:56:40.564199 2845 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35514: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:40.622648 3000 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43146: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:40.683440 2696 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:52614: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
I20260503 19:56:40.705793 420 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-task4vf7p3/build/asan/bin/kudu pid 2519
I20260503 19:56:40.718273 2640 generic_service.cc:196] Checking for leaks (request via RPC)
W20260503 19:56:40.741232 2845 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35514: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:40.800217 3000 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43146: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
I20260503 19:56:40.820633 420 external_mini_cluster.cc:1658] Killing /tmp/dist-test-task4vf7p3/build/asan/bin/kudu with pid 2519
I20260503 19:56:40.841400 420 external_mini_cluster.cc:1366] Running /tmp/dist-test-task4vf7p3/build/asan/bin/kudu
/tmp/dist-test-task4vf7p3/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.105.2:32969
--local_ip_for_outbound_sockets=127.0.105.2
--tserver_master_addrs=127.0.105.62:37847
--webserver_port=46229
--webserver_interface=127.0.105.2
--builtin_ntp_servers=127.0.105.20:45725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
W20260503 19:56:40.864218 2696 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:52614: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:56:40.926985 2845 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35514: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:40.993094 3000 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43146: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:41.060544 2696 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:52614: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:56:41.126243 2845 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35514: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:41.191151 3000 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43146: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:41.260290 2696 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:52614: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:56:41.290657 3345 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260503 19:56:41.291160 3345 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260503 19:56:41.291338 3345 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260503 19:56:41.302652 3345 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260503 19:56:41.302996 3345 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.105.2
I20260503 19:56:41.315277 3345 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.105.20:45725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.105.2:32969
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.105.2
--webserver_port=46229
--tserver_master_addrs=127.0.105.62:37847
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.105.2
--log_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 0ba7f54e15c9f673bf3e350f30b8d5f1a4037b79
build type FASTDEBUG
built by None at 03 May 2026 19:43:25 UTC on bdcb31816ec0
build id 11730
ASAN enabled
I20260503 19:56:41.317164 3345 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260503 19:56:41.319268 3345 file_cache.cc:492] Constructed file cache file cache with capacity 419430
E20260503 19:56:41.323770 3345 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260503 19:56:41.333094 2845 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35514: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:41.334144 3351 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 19:56:41.334180 3350 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 19:56:41.337107 3353 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260503 19:56:41.337857 3345 server_base.cc:1061] running on GCE node
I20260503 19:56:41.339154 3345 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260503 19:56:41.340610 3345 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260503 19:56:41.344143 3345 hybrid_clock.cc:648] HybridClock initialized: now 1777838201343937 us; error 97 us; skew 500 ppm
I20260503 19:56:41.345144 3345 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260503 19:56:41.350359 3345 webserver.cc:492] Webserver started at http://127.0.105.2:46229/ using document root <none> and password file <none>
I20260503 19:56:41.351328 3345 fs_manager.cc:362] Metadata directory not provided
I20260503 19:56:41.351505 3345 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260503 19:56:41.361904 3345 fs_manager.cc:714] Time spent opening directory manager: real 0.006s user 0.005s sys 0.004s
I20260503 19:56:41.366865 3359 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260503 19:56:41.369213 3345 fs_manager.cc:730] Time spent opening block manager: real 0.005s user 0.002s sys 0.000s
I20260503 19:56:41.369493 3345 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-1/data,/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-1/wal
uuid: "d337855bccbf4d0c84a8c5d26db11d85"
format_stamp: "Formatted at 2026-05-03 19:56:17 on dist-test-slave-nzs1"
I20260503 19:56:41.370539 3345 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260503 19:56:41.403390 3000 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43146: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
I20260503 19:56:41.438934 3345 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260503 19:56:41.439957 3345 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260503 19:56:41.440249 3345 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260503 19:56:41.442126 3345 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260503 19:56:41.444456 3345 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260503 19:56:41.444586 3345 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260503 19:56:41.444749 3345 ts_tablet_manager.cc:616] Registered 0 tablets
I20260503 19:56:41.444861 3345 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
W20260503 19:56:41.477994 2696 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:52614: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
I20260503 19:56:41.502257 3345 rpc_server.cc:307] RPC server started. Bound to: 127.0.105.2:32969
I20260503 19:56:41.502311 3471 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.105.2:32969 every 8 connection(s)
I20260503 19:56:41.504361 3345 server_base.cc:1193] Dumped server information to /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-1/data/info.pb
I20260503 19:56:41.508069 420 external_mini_cluster.cc:1428] Started /tmp/dist-test-task4vf7p3/build/asan/bin/kudu as pid 3345
I20260503 19:56:41.508644 420 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-task4vf7p3/build/asan/bin/kudu pid 2653
I20260503 19:56:41.529776 2777 generic_service.cc:196] Checking for leaks (request via RPC)
I20260503 19:56:41.533782 3472 heartbeater.cc:344] Connected to a master server at 127.0.105.62:37847
I20260503 19:56:41.534780 3472 heartbeater.cc:461] Registering TS with master...
I20260503 19:56:41.537818 3472 heartbeater.cc:507] Master 127.0.105.62:37847 requested a full tablet report, sending...
I20260503 19:56:41.540990 1739 ts_manager.cc:194] Re-registered known tserver with Master: d337855bccbf4d0c84a8c5d26db11d85 (127.0.105.2:32969)
I20260503 19:56:41.543047 1739 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.105.2:56029
W20260503 19:56:41.554347 2845 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35514: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:41.629980 3000 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43146: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:41.780644 2695 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:52614: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
I20260503 19:56:41.781186 420 external_mini_cluster.cc:1658] Killing /tmp/dist-test-task4vf7p3/build/asan/bin/kudu with pid 2653
W20260503 19:56:41.834580 2340 connection.cc:570] client connection to 127.0.105.4:34213 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260503 19:56:41.835004 2340 meta_cache.cc:302] tablet 305dbeef23b540c69080a3b2d03c9c35: replica 24488daee7104583a6f986a6ae3f8fe0 (127.0.105.4:34213) has failed: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260503 19:56:41.835103 2372 meta_cache.cc:1510] marking tablet server 24488daee7104583a6f986a6ae3f8fe0 (127.0.105.4:34213) as failed
I20260503 19:56:41.835589 420 external_mini_cluster.cc:1366] Running /tmp/dist-test-task4vf7p3/build/asan/bin/kudu
/tmp/dist-test-task4vf7p3/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-3/wal
--fs_data_dirs=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-3/logs
--server_dump_info_path=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.105.4:34213
--local_ip_for_outbound_sockets=127.0.105.4
--tserver_master_addrs=127.0.105.62:37847
--webserver_port=42465
--webserver_interface=127.0.105.4
--builtin_ntp_servers=127.0.105.20:45725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
W20260503 19:56:41.854552 2845 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35514: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:41.859994 2845 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35514: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:41.863551 3000 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43146: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:41.864933 2999 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43146: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:41.886219 2845 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35514: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:41.898707 2999 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43146: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:41.922737 2845 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35514: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:41.937955 2999 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43146: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:41.937968 3000 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43146: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:41.970813 2845 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35514: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:41.985229 3000 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43146: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:42.024690 2845 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35514: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:42.045645 3000 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43146: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:42.087224 2845 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35514: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:42.097640 2845 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35514: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:42.111194 3000 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43146: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:42.164368 2845 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35514: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:42.175351 3000 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43146: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:42.191329 3000 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43146: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:42.246827 2845 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35514: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:42.274132 3000 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43146: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:42.333562 2845 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35514: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:42.340232 2845 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35514: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:42.340200 3479 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260503 19:56:42.340655 3479 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260503 19:56:42.340847 3479 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260503 19:56:42.350046 3479 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260503 19:56:42.350318 3479 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.105.4
I20260503 19:56:42.361299 3479 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.105.20:45725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-3/data
--fs_wal_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.105.4:34213
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-3/data/info.pb
--webserver_interface=127.0.105.4
--webserver_port=42465
--tserver_master_addrs=127.0.105.62:37847
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.105.4
--log_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-3/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 0ba7f54e15c9f673bf3e350f30b8d5f1a4037b79
build type FASTDEBUG
built by None at 03 May 2026 19:43:25 UTC on bdcb31816ec0
build id 11730
ASAN enabled
I20260503 19:56:42.363222 3479 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260503 19:56:42.365144 3479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260503 19:56:42.366768 3000 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43146: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
E20260503 19:56:42.370132 3479 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260503 19:56:42.378383 3485 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 19:56:42.378480 3486 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 19:56:42.378472 3488 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260503 19:56:42.379699 3479 server_base.cc:1061] running on GCE node
I20260503 19:56:42.380463 3479 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260503 19:56:42.381654 3479 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260503 19:56:42.382920 3479 hybrid_clock.cc:648] HybridClock initialized: now 1777838202382848 us; error 51 us; skew 500 ppm
I20260503 19:56:42.383302 3479 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260503 19:56:42.385972 3479 webserver.cc:492] Webserver started at http://127.0.105.4:42465/ using document root <none> and password file <none>
I20260503 19:56:42.386842 3479 fs_manager.cc:362] Metadata directory not provided
I20260503 19:56:42.386961 3479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260503 19:56:42.393538 3479 fs_manager.cc:714] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260503 19:56:42.398293 3494 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260503 19:56:42.400413 3479 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260503 19:56:42.400615 3479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-3/data,/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-3/wal
uuid: "24488daee7104583a6f986a6ae3f8fe0"
format_stamp: "Formatted at 2026-05-03 19:56:18 on dist-test-slave-nzs1"
I20260503 19:56:42.401530 3479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-3/wal
metadata directory: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-3/wal
1 data directories: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260503 19:56:42.421379 3000 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43146: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
I20260503 19:56:42.427120 3479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260503 19:56:42.428298 3479 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260503 19:56:42.428637 3479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260503 19:56:42.429872 3479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260503 19:56:42.432732 3501 ts_tablet_manager.cc:548] Loading tablet metadata (0/1 complete)
W20260503 19:56:42.433491 3000 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43146: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
I20260503 19:56:42.439914 3479 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260503 19:56:42.440069 3479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.008s user 0.001s sys 0.000s
I20260503 19:56:42.440268 3479 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260503 19:56:42.443966 3479 ts_tablet_manager.cc:616] Registered 1 tablets
I20260503 19:56:42.444068 3479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.004s user 0.004s sys 0.000s
I20260503 19:56:42.444698 3501 tablet_bootstrap.cc:492] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0: Bootstrap starting.
W20260503 19:56:42.465090 2845 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35514: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
I20260503 19:56:42.514745 3479 rpc_server.cc:307] RPC server started. Bound to: 127.0.105.4:34213
I20260503 19:56:42.514777 3607 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.105.4:34213 every 8 connection(s)
I20260503 19:56:42.516835 3479 server_base.cc:1193] Dumped server information to /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-3/data/info.pb
I20260503 19:56:42.518110 420 external_mini_cluster.cc:1428] Started /tmp/dist-test-task4vf7p3/build/asan/bin/kudu as pid 3479
I20260503 19:56:42.518426 420 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-task4vf7p3/build/asan/bin/kudu pid 2791
I20260503 19:56:42.529409 2931 generic_service.cc:196] Checking for leaks (request via RPC)
I20260503 19:56:42.541010 3608 heartbeater.cc:344] Connected to a master server at 127.0.105.62:37847
I20260503 19:56:42.541524 3608 heartbeater.cc:461] Registering TS with master...
I20260503 19:56:42.542891 3608 heartbeater.cc:507] Master 127.0.105.62:37847 requested a full tablet report, sending...
I20260503 19:56:42.546897 1739 ts_manager.cc:194] Re-registered known tserver with Master: 24488daee7104583a6f986a6ae3f8fe0 (127.0.105.4:34213)
I20260503 19:56:42.546981 3472 heartbeater.cc:499] Master 127.0.105.62:37847 was elected leader, sending a full tablet report...
I20260503 19:56:42.548949 1739 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.105.4:60139
W20260503 19:56:42.684634 2845 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35514: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:42.684870 2844 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35514: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
I20260503 19:56:42.685259 420 external_mini_cluster.cc:1658] Killing /tmp/dist-test-task4vf7p3/build/asan/bin/kudu with pid 2791
I20260503 19:56:42.716172 420 external_mini_cluster.cc:1366] Running /tmp/dist-test-task4vf7p3/build/asan/bin/kudu
/tmp/dist-test-task4vf7p3/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.105.3:33995
--local_ip_for_outbound_sockets=127.0.105.3
--tserver_master_addrs=127.0.105.62:37847
--webserver_port=33159
--webserver_interface=127.0.105.3
--builtin_ntp_servers=127.0.105.20:45725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
W20260503 19:56:42.732204 3000 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43146: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
I20260503 19:56:42.763801 3501 log.cc:826] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0: Log is configured to *not* fsync() on all Append() calls
W20260503 19:56:42.778625 3000 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43146: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:42.832115 3000 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43146: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:42.850455 3000 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43146: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:42.852927 3000 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43146: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:42.866871 3000 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43146: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:42.886310 2340 meta_cache.cc:302] tablet 305dbeef23b540c69080a3b2d03c9c35: replica 6d32022b7ea94ea48926c65f7a62d687 (127.0.105.3:33995) has failed: Network error: Client connection negotiation failed: client connection to 127.0.105.3:33995: connect: Connection refused (error 111)
W20260503 19:56:42.945117 3000 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43146: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:42.994009 3000 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43146: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:43.024827 3000 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43146: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:43.047500 3000 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43146: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:43.063580 3000 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43146: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:43.151412 3000 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43146: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:43.159036 3000 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43146: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:43.241008 3000 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43146: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:43.252068 3615 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260503 19:56:43.252470 3615 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260503 19:56:43.252625 3615 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260503 19:56:43.256789 3000 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43146: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:43.263159 3615 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260503 19:56:43.263808 3615 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.105.3
I20260503 19:56:43.278429 3615 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.105.20:45725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.105.3:33995
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.105.3
--webserver_port=33159
--tserver_master_addrs=127.0.105.62:37847
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.105.3
--log_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 0ba7f54e15c9f673bf3e350f30b8d5f1a4037b79
build type FASTDEBUG
built by None at 03 May 2026 19:43:25 UTC on bdcb31816ec0
build id 11730
ASAN enabled
I20260503 19:56:43.280341 3615 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260503 19:56:43.282388 3615 file_cache.cc:492] Constructed file cache file cache with capacity 419430
E20260503 19:56:43.287359 3615 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260503 19:56:43.298144 3623 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 19:56:43.300539 3625 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 19:56:43.300601 3622 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260503 19:56:43.306828 3615 server_base.cc:1061] running on GCE node
I20260503 19:56:43.308126 3615 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260503 19:56:43.309813 3615 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260503 19:56:43.311219 3615 hybrid_clock.cc:648] HybridClock initialized: now 1777838203311111 us; error 63 us; skew 500 ppm
I20260503 19:56:43.311625 3615 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260503 19:56:43.315274 3615 webserver.cc:492] Webserver started at http://127.0.105.3:33159/ using document root <none> and password file <none>
I20260503 19:56:43.316344 3615 fs_manager.cc:362] Metadata directory not provided
I20260503 19:56:43.316540 3615 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260503 19:56:43.323000 3615 fs_manager.cc:714] Time spent opening directory manager: real 0.004s user 0.005s sys 0.001s
I20260503 19:56:43.327018 3631 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260503 19:56:43.328879 3615 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260503 19:56:43.329107 3615 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-2/data,/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-2/wal
uuid: "6d32022b7ea94ea48926c65f7a62d687"
format_stamp: "Formatted at 2026-05-03 19:56:17 on dist-test-slave-nzs1"
I20260503 19:56:43.329944 3615 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260503 19:56:43.341737 3000 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43146: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:43.358479 3000 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43146: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
I20260503 19:56:43.378094 3615 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260503 19:56:43.379138 3615 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260503 19:56:43.379892 3615 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260503 19:56:43.382368 3615 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260503 19:56:43.387488 3638 ts_tablet_manager.cc:548] Loading tablet metadata (0/1 complete)
I20260503 19:56:43.395064 2370 meta_cache.cc:1510] marking tablet server 6d32022b7ea94ea48926c65f7a62d687 (127.0.105.3:33995) as failed
I20260503 19:56:43.396584 3615 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260503 19:56:43.396776 3615 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.011s user 0.001s sys 0.002s
I20260503 19:56:43.396919 3615 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260503 19:56:43.402218 3615 ts_tablet_manager.cc:616] Registered 1 tablets
I20260503 19:56:43.402518 3615 ts_tablet_manager.cc:595] Time spent register tablets: real 0.006s user 0.003s sys 0.000s
I20260503 19:56:43.403036 3638 tablet_bootstrap.cc:492] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687: Bootstrap starting.
W20260503 19:56:43.452849 3000 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43146: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:56:43.462548 3000 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43146: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
I20260503 19:56:43.540932 3615 rpc_server.cc:307] RPC server started. Bound to: 127.0.105.3:33995
I20260503 19:56:43.541013 3744 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.105.3:33995 every 8 connection(s)
I20260503 19:56:43.543193 3615 server_base.cc:1193] Dumped server information to /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-2/data/info.pb
I20260503 19:56:43.545598 420 external_mini_cluster.cc:1428] Started /tmp/dist-test-task4vf7p3/build/asan/bin/kudu as pid 3615
I20260503 19:56:43.545841 420 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-task4vf7p3/build/asan/bin/kudu pid 2947
I20260503 19:56:43.553138 3608 heartbeater.cc:499] Master 127.0.105.62:37847 was elected leader, sending a full tablet report...
I20260503 19:56:43.571810 3085 generic_service.cc:196] Checking for leaks (request via RPC)
W20260503 19:56:43.572072 3000 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43146: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
I20260503 19:56:43.584807 3745 heartbeater.cc:344] Connected to a master server at 127.0.105.62:37847
I20260503 19:56:43.585285 3745 heartbeater.cc:461] Registering TS with master...
I20260503 19:56:43.586603 3745 heartbeater.cc:507] Master 127.0.105.62:37847 requested a full tablet report, sending...
I20260503 19:56:43.590603 1739 ts_manager.cc:194] Re-registered known tserver with Master: 6d32022b7ea94ea48926c65f7a62d687 (127.0.105.3:33995)
I20260503 19:56:43.592424 1739 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.105.3:44709
I20260503 19:56:43.754841 3638 log.cc:826] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687: Log is configured to *not* fsync() on all Append() calls
I20260503 19:56:43.832829 420 external_mini_cluster.cc:1658] Killing /tmp/dist-test-task4vf7p3/build/asan/bin/kudu with pid 2947
I20260503 19:56:43.874230 420 external_mini_cluster.cc:1366] Running /tmp/dist-test-task4vf7p3/build/asan/bin/kudu
/tmp/dist-test-task4vf7p3/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.105.1:37957
--local_ip_for_outbound_sockets=127.0.105.1
--tserver_master_addrs=127.0.105.62:37847
--webserver_port=39515
--webserver_interface=127.0.105.1
--builtin_ntp_servers=127.0.105.20:45725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
W20260503 19:56:43.928689 2343 meta_cache.cc:302] tablet 305dbeef23b540c69080a3b2d03c9c35: replica a417bd6c4b7d4bab8e96e65908ec2385 (127.0.105.1:37957) has failed: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37957: connect: Connection refused (error 111)
W20260503 19:56:44.435709 3754 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260503 19:56:44.436256 3754 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260503 19:56:44.436432 3754 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260503 19:56:44.450903 3754 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260503 19:56:44.451187 3754 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.105.1
I20260503 19:56:44.469674 3754 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.105.20:45725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.105.1:37957
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.105.1
--webserver_port=39515
--tserver_master_addrs=127.0.105.62:37847
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.105.1
--log_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 0ba7f54e15c9f673bf3e350f30b8d5f1a4037b79
build type FASTDEBUG
built by None at 03 May 2026 19:43:25 UTC on bdcb31816ec0
build id 11730
ASAN enabled
I20260503 19:56:44.472079 3754 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260503 19:56:44.474975 3754 file_cache.cc:492] Constructed file cache file cache with capacity 419430
E20260503 19:56:44.481626 3754 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260503 19:56:44.492538 3760 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 19:56:44.492831 3759 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 19:56:44.500943 3762 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260503 19:56:44.502161 3754 server_base.cc:1061] running on GCE node
I20260503 19:56:44.503244 3754 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260503 19:56:44.505978 3754 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260503 19:56:44.507495 3754 hybrid_clock.cc:648] HybridClock initialized: now 1777838204507362 us; error 88 us; skew 500 ppm
I20260503 19:56:44.508199 3754 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260503 19:56:44.512161 3754 webserver.cc:492] Webserver started at http://127.0.105.1:39515/ using document root <none> and password file <none>
I20260503 19:56:44.513525 3754 fs_manager.cc:362] Metadata directory not provided
I20260503 19:56:44.513729 3754 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260503 19:56:44.534279 3754 fs_manager.cc:714] Time spent opening directory manager: real 0.017s user 0.004s sys 0.010s
I20260503 19:56:44.553910 3768 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260503 19:56:44.556105 3754 fs_manager.cc:730] Time spent opening block manager: real 0.020s user 0.012s sys 0.005s
I20260503 19:56:44.556372 3754 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-0/data,/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-0/wal
uuid: "a417bd6c4b7d4bab8e96e65908ec2385"
format_stamp: "Formatted at 2026-05-03 19:56:16 on dist-test-slave-nzs1"
I20260503 19:56:44.557652 3754 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260503 19:56:44.586719 3754 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260503 19:56:44.588043 3754 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260503 19:56:44.588423 3754 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260503 19:56:44.589756 3754 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260503 19:56:44.592881 3775 ts_tablet_manager.cc:548] Loading tablet metadata (0/1 complete)
I20260503 19:56:44.596379 3745 heartbeater.cc:499] Master 127.0.105.62:37847 was elected leader, sending a full tablet report...
I20260503 19:56:44.603595 3754 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260503 19:56:44.603813 3754 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.011s user 0.001s sys 0.000s
I20260503 19:56:44.603958 3754 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260503 19:56:44.609009 3754 ts_tablet_manager.cc:616] Registered 1 tablets
I20260503 19:56:44.609146 3754 ts_tablet_manager.cc:595] Time spent register tablets: real 0.005s user 0.002s sys 0.002s
I20260503 19:56:44.610090 3775 tablet_bootstrap.cc:492] T 305dbeef23b540c69080a3b2d03c9c35 P a417bd6c4b7d4bab8e96e65908ec2385: Bootstrap starting.
W20260503 19:56:44.942939 2343 meta_cache.cc:302] tablet 305dbeef23b540c69080a3b2d03c9c35: replica a417bd6c4b7d4bab8e96e65908ec2385 (127.0.105.1:37957) has failed: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37957: connect: Connection refused (error 111)
I20260503 19:56:45.119159 3775 log.cc:826] T 305dbeef23b540c69080a3b2d03c9c35 P a417bd6c4b7d4bab8e96e65908ec2385: Log is configured to *not* fsync() on all Append() calls
I20260503 19:56:45.370738 2372 meta_cache.cc:1510] marking tablet server a417bd6c4b7d4bab8e96e65908ec2385 (127.0.105.1:37957) as failed
I20260503 19:56:45.385178 3754 rpc_server.cc:307] RPC server started. Bound to: 127.0.105.1:37957
I20260503 19:56:45.385202 3882 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.105.1:37957 every 8 connection(s)
I20260503 19:56:45.387907 3754 server_base.cc:1193] Dumped server information to /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-0/data/info.pb
I20260503 19:56:45.396696 420 external_mini_cluster.cc:1428] Started /tmp/dist-test-task4vf7p3/build/asan/bin/kudu as pid 3754
I20260503 19:56:45.473485 3883 heartbeater.cc:344] Connected to a master server at 127.0.105.62:37847
I20260503 19:56:45.473953 3883 heartbeater.cc:461] Registering TS with master...
I20260503 19:56:45.476415 3883 heartbeater.cc:507] Master 127.0.105.62:37847 requested a full tablet report, sending...
I20260503 19:56:45.480003 1739 ts_manager.cc:194] Re-registered known tserver with Master: a417bd6c4b7d4bab8e96e65908ec2385 (127.0.105.1:37957)
I20260503 19:56:45.481573 1739 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.105.1:36163
I20260503 19:56:46.290897 3501 tablet_bootstrap.cc:492] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0: Bootstrap replayed 1/1 log segments. Stats: ops{read=817 overwritten=0 applied=815 ignored=0} inserts{seen=40650 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 2 replicates
I20260503 19:56:46.291893 3501 tablet_bootstrap.cc:492] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0: Bootstrap complete.
I20260503 19:56:46.294040 3501 ts_tablet_manager.cc:1403] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0: Time spent bootstrapping tablet: real 3.850s user 3.427s sys 0.263s
I20260503 19:56:46.302079 3501 raft_consensus.cc:359] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [term 4 FOLLOWER]: Replica starting. Triggering 2 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d32022b7ea94ea48926c65f7a62d687" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 33995 } } peers { permanent_uuid: "a417bd6c4b7d4bab8e96e65908ec2385" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37957 } } peers { permanent_uuid: "24488daee7104583a6f986a6ae3f8fe0" member_type: VOTER last_known_addr { host: "127.0.105.4" port: 34213 } }
I20260503 19:56:46.324755 3501 raft_consensus.cc:740] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [term 4 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24488daee7104583a6f986a6ae3f8fe0, State: Initialized, Role: FOLLOWER
I20260503 19:56:46.325819 3501 consensus_queue.cc:260] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 815, Last appended: 3.817, Last appended by leader: 817, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d32022b7ea94ea48926c65f7a62d687" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 33995 } } peers { permanent_uuid: "a417bd6c4b7d4bab8e96e65908ec2385" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37957 } } peers { permanent_uuid: "24488daee7104583a6f986a6ae3f8fe0" member_type: VOTER last_known_addr { host: "127.0.105.4" port: 34213 } }
I20260503 19:56:46.341460 3501 ts_tablet_manager.cc:1434] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0: Time spent starting tablet: real 0.047s user 0.022s sys 0.024s
I20260503 19:56:46.485932 3883 heartbeater.cc:499] Master 127.0.105.62:37847 was elected leader, sending a full tablet report...
I20260503 19:56:46.520172 3817 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260503 19:56:46.521371 3543 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260503 19:56:46.556305 3407 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260503 19:56:46.556651 3680 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
W20260503 19:56:46.675805 3522 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:51200: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
I20260503 19:56:46.677088 3901 raft_consensus.cc:493] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 19:56:46.677368 3901 raft_consensus.cc:515] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d32022b7ea94ea48926c65f7a62d687" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 33995 } } peers { permanent_uuid: "a417bd6c4b7d4bab8e96e65908ec2385" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37957 } } peers { permanent_uuid: "24488daee7104583a6f986a6ae3f8fe0" member_type: VOTER last_known_addr { host: "127.0.105.4" port: 34213 } }
I20260503 19:56:46.679771 3901 leader_election.cc:290] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d32022b7ea94ea48926c65f7a62d687 (127.0.105.3:33995), a417bd6c4b7d4bab8e96e65908ec2385 (127.0.105.1:37957)
I20260503 19:56:46.706053 3700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305dbeef23b540c69080a3b2d03c9c35" candidate_uuid: "24488daee7104583a6f986a6ae3f8fe0" candidate_term: 5 candidate_status { last_received { term: 3 index: 817 } } ignore_live_leader: false dest_uuid: "6d32022b7ea94ea48926c65f7a62d687" is_pre_election: true
W20260503 19:56:46.710893 3495 leader_election.cc:343] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [CANDIDATE]: Term 5 pre-election: Tablet error from VoteRequest() call to peer 6d32022b7ea94ea48926c65f7a62d687 (127.0.105.3:33995): Illegal state: must be running to vote when last-logged opid is not known
I20260503 19:56:46.714524 3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305dbeef23b540c69080a3b2d03c9c35" candidate_uuid: "24488daee7104583a6f986a6ae3f8fe0" candidate_term: 5 candidate_status { last_received { term: 3 index: 817 } } ignore_live_leader: false dest_uuid: "a417bd6c4b7d4bab8e96e65908ec2385" is_pre_election: true
W20260503 19:56:46.718667 3498 leader_election.cc:343] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [CANDIDATE]: Term 5 pre-election: Tablet error from VoteRequest() call to peer a417bd6c4b7d4bab8e96e65908ec2385 (127.0.105.1:37957): Illegal state: must be running to vote when last-logged opid is not known
I20260503 19:56:46.718874 3498 leader_election.cc:304] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24488daee7104583a6f986a6ae3f8fe0; no voters: 6d32022b7ea94ea48926c65f7a62d687, a417bd6c4b7d4bab8e96e65908ec2385
I20260503 19:56:46.719374 3901 raft_consensus.cc:2749] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260503 19:56:47.054252 3522 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:51200: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
I20260503 19:56:47.133404 3901 raft_consensus.cc:493] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 19:56:47.133630 3901 raft_consensus.cc:515] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d32022b7ea94ea48926c65f7a62d687" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 33995 } } peers { permanent_uuid: "a417bd6c4b7d4bab8e96e65908ec2385" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37957 } } peers { permanent_uuid: "24488daee7104583a6f986a6ae3f8fe0" member_type: VOTER last_known_addr { host: "127.0.105.4" port: 34213 } }
I20260503 19:56:47.135084 3901 leader_election.cc:290] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d32022b7ea94ea48926c65f7a62d687 (127.0.105.3:33995), a417bd6c4b7d4bab8e96e65908ec2385 (127.0.105.1:37957)
I20260503 19:56:47.136276 3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305dbeef23b540c69080a3b2d03c9c35" candidate_uuid: "24488daee7104583a6f986a6ae3f8fe0" candidate_term: 5 candidate_status { last_received { term: 3 index: 817 } } ignore_live_leader: false dest_uuid: "a417bd6c4b7d4bab8e96e65908ec2385" is_pre_election: true
W20260503 19:56:47.137120 3498 leader_election.cc:343] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [CANDIDATE]: Term 5 pre-election: Tablet error from VoteRequest() call to peer a417bd6c4b7d4bab8e96e65908ec2385 (127.0.105.1:37957): Illegal state: must be running to vote when last-logged opid is not known
I20260503 19:56:47.138058 3700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305dbeef23b540c69080a3b2d03c9c35" candidate_uuid: "24488daee7104583a6f986a6ae3f8fe0" candidate_term: 5 candidate_status { last_received { term: 3 index: 817 } } ignore_live_leader: false dest_uuid: "6d32022b7ea94ea48926c65f7a62d687" is_pre_election: true
W20260503 19:56:47.138742 3495 leader_election.cc:343] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [CANDIDATE]: Term 5 pre-election: Tablet error from VoteRequest() call to peer 6d32022b7ea94ea48926c65f7a62d687 (127.0.105.3:33995): Illegal state: must be running to vote when last-logged opid is not known
I20260503 19:56:47.138976 3495 leader_election.cc:304] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24488daee7104583a6f986a6ae3f8fe0; no voters: 6d32022b7ea94ea48926c65f7a62d687, a417bd6c4b7d4bab8e96e65908ec2385
I20260503 19:56:47.139515 3901 raft_consensus.cc:2749] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260503 19:56:47.359690 3638 tablet_bootstrap.cc:492] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687: Bootstrap replayed 1/1 log segments. Stats: ops{read=816 overwritten=0 applied=815 ignored=0} inserts{seen=40650 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260503 19:56:47.360409 3638 tablet_bootstrap.cc:492] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687: Bootstrap complete.
I20260503 19:56:47.361931 3638 ts_tablet_manager.cc:1403] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687: Time spent bootstrapping tablet: real 3.960s user 3.590s sys 0.246s
I20260503 19:56:47.366173 3638 raft_consensus.cc:359] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687 [term 4 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d32022b7ea94ea48926c65f7a62d687" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 33995 } } peers { permanent_uuid: "a417bd6c4b7d4bab8e96e65908ec2385" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37957 } } peers { permanent_uuid: "24488daee7104583a6f986a6ae3f8fe0" member_type: VOTER last_known_addr { host: "127.0.105.4" port: 34213 } }
I20260503 19:56:47.370175 3638 raft_consensus.cc:740] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687 [term 4 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d32022b7ea94ea48926c65f7a62d687, State: Initialized, Role: FOLLOWER
I20260503 19:56:47.371321 3638 consensus_queue.cc:260] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 815, Last appended: 3.816, Last appended by leader: 816, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d32022b7ea94ea48926c65f7a62d687" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 33995 } } peers { permanent_uuid: "a417bd6c4b7d4bab8e96e65908ec2385" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37957 } } peers { permanent_uuid: "24488daee7104583a6f986a6ae3f8fe0" member_type: VOTER last_known_addr { host: "127.0.105.4" port: 34213 } }
I20260503 19:56:47.373564 3638 ts_tablet_manager.cc:1434] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687: Time spent starting tablet: real 0.011s user 0.012s sys 0.000s
W20260503 19:56:47.438824 3522 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:51200: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:56:47.567803 3660 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54074: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
I20260503 19:56:47.576081 3901 raft_consensus.cc:493] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 19:56:47.576402 3901 raft_consensus.cc:515] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d32022b7ea94ea48926c65f7a62d687" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 33995 } } peers { permanent_uuid: "a417bd6c4b7d4bab8e96e65908ec2385" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37957 } } peers { permanent_uuid: "24488daee7104583a6f986a6ae3f8fe0" member_type: VOTER last_known_addr { host: "127.0.105.4" port: 34213 } }
I20260503 19:56:47.577262 3901 leader_election.cc:290] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d32022b7ea94ea48926c65f7a62d687 (127.0.105.3:33995), a417bd6c4b7d4bab8e96e65908ec2385 (127.0.105.1:37957)
I20260503 19:56:47.577842 3700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305dbeef23b540c69080a3b2d03c9c35" candidate_uuid: "24488daee7104583a6f986a6ae3f8fe0" candidate_term: 5 candidate_status { last_received { term: 3 index: 817 } } ignore_live_leader: false dest_uuid: "6d32022b7ea94ea48926c65f7a62d687" is_pre_election: true
I20260503 19:56:47.577852 3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305dbeef23b540c69080a3b2d03c9c35" candidate_uuid: "24488daee7104583a6f986a6ae3f8fe0" candidate_term: 5 candidate_status { last_received { term: 3 index: 817 } } ignore_live_leader: false dest_uuid: "a417bd6c4b7d4bab8e96e65908ec2385" is_pre_election: true
I20260503 19:56:47.578238 3700 raft_consensus.cc:2468] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24488daee7104583a6f986a6ae3f8fe0 in term 4.
W20260503 19:56:47.578459 3498 leader_election.cc:343] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [CANDIDATE]: Term 5 pre-election: Tablet error from VoteRequest() call to peer a417bd6c4b7d4bab8e96e65908ec2385 (127.0.105.1:37957): Illegal state: must be running to vote when last-logged opid is not known
I20260503 19:56:47.578747 3495 leader_election.cc:304] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24488daee7104583a6f986a6ae3f8fe0, 6d32022b7ea94ea48926c65f7a62d687; no voters: a417bd6c4b7d4bab8e96e65908ec2385
I20260503 19:56:47.579070 3901 raft_consensus.cc:2804] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260503 19:56:47.579213 3901 raft_consensus.cc:493] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 19:56:47.579319 3901 raft_consensus.cc:3060] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [term 4 FOLLOWER]: Advancing to term 5
I20260503 19:56:47.584424 3901 raft_consensus.cc:515] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d32022b7ea94ea48926c65f7a62d687" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 33995 } } peers { permanent_uuid: "a417bd6c4b7d4bab8e96e65908ec2385" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37957 } } peers { permanent_uuid: "24488daee7104583a6f986a6ae3f8fe0" member_type: VOTER last_known_addr { host: "127.0.105.4" port: 34213 } }
I20260503 19:56:47.585341 3901 leader_election.cc:290] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [CANDIDATE]: Term 5 election: Requested vote from peers 6d32022b7ea94ea48926c65f7a62d687 (127.0.105.3:33995), a417bd6c4b7d4bab8e96e65908ec2385 (127.0.105.1:37957)
I20260503 19:56:47.585891 3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305dbeef23b540c69080a3b2d03c9c35" candidate_uuid: "24488daee7104583a6f986a6ae3f8fe0" candidate_term: 5 candidate_status { last_received { term: 3 index: 817 } } ignore_live_leader: false dest_uuid: "a417bd6c4b7d4bab8e96e65908ec2385"
I20260503 19:56:47.585912 3700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305dbeef23b540c69080a3b2d03c9c35" candidate_uuid: "24488daee7104583a6f986a6ae3f8fe0" candidate_term: 5 candidate_status { last_received { term: 3 index: 817 } } ignore_live_leader: false dest_uuid: "6d32022b7ea94ea48926c65f7a62d687"
I20260503 19:56:47.586129 3700 raft_consensus.cc:3060] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687 [term 4 FOLLOWER]: Advancing to term 5
W20260503 19:56:47.586642 3498 leader_election.cc:343] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [CANDIDATE]: Term 5 election: Tablet error from VoteRequest() call to peer a417bd6c4b7d4bab8e96e65908ec2385 (127.0.105.1:37957): Illegal state: must be running to vote when last-logged opid is not known
I20260503 19:56:47.590628 3700 raft_consensus.cc:2468] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24488daee7104583a6f986a6ae3f8fe0 in term 5.
I20260503 19:56:47.591315 3495 leader_election.cc:304] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24488daee7104583a6f986a6ae3f8fe0, 6d32022b7ea94ea48926c65f7a62d687; no voters: a417bd6c4b7d4bab8e96e65908ec2385
I20260503 19:56:47.591776 3901 raft_consensus.cc:2804] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [term 5 FOLLOWER]: Leader election won for term 5
I20260503 19:56:47.592224 3901 raft_consensus.cc:697] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [term 5 LEADER]: Becoming Leader. State: Replica: 24488daee7104583a6f986a6ae3f8fe0, State: Running, Role: LEADER
I20260503 19:56:47.592821 3901 consensus_queue.cc:237] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 815, Committed index: 815, Last appended: 3.817, Last appended by leader: 817, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d32022b7ea94ea48926c65f7a62d687" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 33995 } } peers { permanent_uuid: "a417bd6c4b7d4bab8e96e65908ec2385" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37957 } } peers { permanent_uuid: "24488daee7104583a6f986a6ae3f8fe0" member_type: VOTER last_known_addr { host: "127.0.105.4" port: 34213 } }
I20260503 19:56:47.598143 1739 catalog_manager.cc:5671] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "24488daee7104583a6f986a6ae3f8fe0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d32022b7ea94ea48926c65f7a62d687" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 33995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a417bd6c4b7d4bab8e96e65908ec2385" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24488daee7104583a6f986a6ae3f8fe0" member_type: VOTER last_known_addr { host: "127.0.105.4" port: 34213 } health_report { overall_health: HEALTHY } } }
W20260503 19:56:47.681460 2372 scanner-internal.cc:458] Time spent opening tablet: real 8.279s user 0.014s sys 0.002s
I20260503 19:56:47.685802 3700 raft_consensus.cc:1275] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687 [term 5 FOLLOWER]: Refusing update from remote peer 24488daee7104583a6f986a6ae3f8fe0: Log matching property violated. Preceding OpId in replica: term: 3 index: 816. Preceding OpId from leader: term: 5 index: 818. (index mismatch)
I20260503 19:56:47.687106 3901 consensus_queue.cc:1048] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d32022b7ea94ea48926c65f7a62d687" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 33995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 818, Last known committed idx: 815, Time since last communication: 0.000s
W20260503 19:56:47.717388 3498 consensus_peers.cc:597] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 -> Peer a417bd6c4b7d4bab8e96e65908ec2385 (127.0.105.1:37957): Couldn't send request to peer a417bd6c4b7d4bab8e96e65908ec2385. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260503 19:56:47.723112 2370 scanner-internal.cc:458] Time spent opening tablet: real 8.600s user 0.014s sys 0.005s
I20260503 19:56:47.729295 3937 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:51200 (ReqId={client: 2baef47169a94d76b532b9350f8ffd6a, seq_no=813, attempt_no=79}) took 1217 ms. Trace:
I20260503 19:56:47.730041 3937 rpcz_store.cc:276] 0503 19:56:46.512279 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 19:56:46.512351 (+ 72us) service_pool.cc:224] Handling call
0503 19:56:47.729205 (+1216854us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 19:56:47.734642 3937 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:51200 (ReqId={client: 2baef47169a94d76b532b9350f8ffd6a, seq_no=815, attempt_no=86}) took 1271 ms. Trace:
I20260503 19:56:47.734939 3937 rpcz_store.cc:276] 0503 19:56:46.463262 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 19:56:46.463335 (+ 73us) service_pool.cc:224] Handling call
0503 19:56:47.734572 (+1271237us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260503 19:56:47.746212 3660 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54074: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:47.746946 3659 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54074: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:56:48.050825 2371 scanner-internal.cc:458] Time spent opening tablet: real 8.368s user 0.004s sys 0.008s
W20260503 19:56:48.167790 3498 consensus_peers.cc:597] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 -> Peer a417bd6c4b7d4bab8e96e65908ec2385 (127.0.105.1:37957): Couldn't send request to peer a417bd6c4b7d4bab8e96e65908ec2385. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
W20260503 19:56:48.652910 3498 consensus_peers.cc:597] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 -> Peer a417bd6c4b7d4bab8e96e65908ec2385 (127.0.105.1:37957): Couldn't send request to peer a417bd6c4b7d4bab8e96e65908ec2385. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
I20260503 19:56:49.135731 3775 tablet_bootstrap.cc:492] T 305dbeef23b540c69080a3b2d03c9c35 P a417bd6c4b7d4bab8e96e65908ec2385: Bootstrap replayed 1/1 log segments. Stats: ops{read=814 overwritten=0 applied=813 ignored=0} inserts{seen=40550 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260503 19:56:49.136786 3775 tablet_bootstrap.cc:492] T 305dbeef23b540c69080a3b2d03c9c35 P a417bd6c4b7d4bab8e96e65908ec2385: Bootstrap complete.
W20260503 19:56:49.137503 3498 consensus_peers.cc:597] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 -> Peer a417bd6c4b7d4bab8e96e65908ec2385 (127.0.105.1:37957): Couldn't send request to peer a417bd6c4b7d4bab8e96e65908ec2385. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 16: this message will repeat every 5th retry.
I20260503 19:56:49.138646 3775 ts_tablet_manager.cc:1403] T 305dbeef23b540c69080a3b2d03c9c35 P a417bd6c4b7d4bab8e96e65908ec2385: Time spent bootstrapping tablet: real 4.529s user 3.863s sys 0.309s
I20260503 19:56:49.142203 3775 raft_consensus.cc:359] T 305dbeef23b540c69080a3b2d03c9c35 P a417bd6c4b7d4bab8e96e65908ec2385 [term 4 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d32022b7ea94ea48926c65f7a62d687" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 33995 } } peers { permanent_uuid: "a417bd6c4b7d4bab8e96e65908ec2385" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37957 } } peers { permanent_uuid: "24488daee7104583a6f986a6ae3f8fe0" member_type: VOTER last_known_addr { host: "127.0.105.4" port: 34213 } }
I20260503 19:56:49.158542 3775 raft_consensus.cc:740] T 305dbeef23b540c69080a3b2d03c9c35 P a417bd6c4b7d4bab8e96e65908ec2385 [term 4 FOLLOWER]: Becoming Follower/Learner. State: Replica: a417bd6c4b7d4bab8e96e65908ec2385, State: Initialized, Role: FOLLOWER
I20260503 19:56:49.159546 3775 consensus_queue.cc:260] T 305dbeef23b540c69080a3b2d03c9c35 P a417bd6c4b7d4bab8e96e65908ec2385 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 813, Last appended: 3.814, Last appended by leader: 814, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d32022b7ea94ea48926c65f7a62d687" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 33995 } } peers { permanent_uuid: "a417bd6c4b7d4bab8e96e65908ec2385" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37957 } } peers { permanent_uuid: "24488daee7104583a6f986a6ae3f8fe0" member_type: VOTER last_known_addr { host: "127.0.105.4" port: 34213 } }
I20260503 19:56:49.167900 3775 ts_tablet_manager.cc:1434] T 305dbeef23b540c69080a3b2d03c9c35 P a417bd6c4b7d4bab8e96e65908ec2385: Time spent starting tablet: real 0.029s user 0.017s sys 0.007s
I20260503 19:56:49.240665 3837 raft_consensus.cc:3060] T 305dbeef23b540c69080a3b2d03c9c35 P a417bd6c4b7d4bab8e96e65908ec2385 [term 4 FOLLOWER]: Advancing to term 5
I20260503 19:56:49.256116 3837 raft_consensus.cc:1275] T 305dbeef23b540c69080a3b2d03c9c35 P a417bd6c4b7d4bab8e96e65908ec2385 [term 5 FOLLOWER]: Refusing update from remote peer 24488daee7104583a6f986a6ae3f8fe0: Log matching property violated. Preceding OpId in replica: term: 3 index: 814. Preceding OpId from leader: term: 3 index: 817. (index mismatch)
I20260503 19:56:49.259611 3901 consensus_queue.cc:1050] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [LEADER]: Got LMP mismatch error from peer: Peer: permanent_uuid: "a417bd6c4b7d4bab8e96e65908ec2385" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 818, Last known committed idx: 813, Time since last communication: 0.000s
I20260503 19:56:49.763108 3947 mvcc.cc:204] Tried to move back new op lower bound from 7282025305036058624 to 7282025298304245760. Current Snapshot: MvccSnapshot[applied={T|T < 7282025303493206016 or (T in {7282025303513456640,7282025303614279680,7282025303538089984})}]
I20260503 19:56:53.530444 3543 tablet_service.cc:1467] Tablet server has 1 leaders and 3 scanners
I20260503 19:56:53.608752 3680 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260503 19:56:53.627271 3817 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260503 19:56:53.631762 3407 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260503 19:56:55.293677 1747 ts_manager.cc:284] Unset tserver state for 24488daee7104583a6f986a6ae3f8fe0 from MAINTENANCE_MODE
I20260503 19:56:55.517724 3883 heartbeater.cc:507] Master 127.0.105.62:37847 requested a full tablet report, sending...
I20260503 19:56:55.532217 3608 heartbeater.cc:507] Master 127.0.105.62:37847 requested a full tablet report, sending...
I20260503 19:56:55.587865 3472 heartbeater.cc:507] Master 127.0.105.62:37847 requested a full tablet report, sending...
I20260503 19:56:55.665297 1747 ts_manager.cc:284] Unset tserver state for 6d32022b7ea94ea48926c65f7a62d687 from MAINTENANCE_MODE
I20260503 19:56:55.691057 1747 ts_manager.cc:284] Unset tserver state for a417bd6c4b7d4bab8e96e65908ec2385 from MAINTENANCE_MODE
I20260503 19:56:55.745745 3745 heartbeater.cc:507] Master 127.0.105.62:37847 requested a full tablet report, sending...
I20260503 19:56:56.167126 1747 ts_manager.cc:284] Unset tserver state for d337855bccbf4d0c84a8c5d26db11d85 from MAINTENANCE_MODE
I20260503 19:56:56.522675 3883 heartbeater.cc:507] Master 127.0.105.62:37847 requested a full tablet report, sending...
W20260503 19:56:56.538934 2340 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.105.4:34213, user_credentials={real_user=slave}} blocked reactor thread for 46666.3us
I20260503 19:56:56.552656 3608 heartbeater.cc:507] Master 127.0.105.62:37847 requested a full tablet report, sending...
I20260503 19:56:56.595094 3472 heartbeater.cc:507] Master 127.0.105.62:37847 requested a full tablet report, sending...
I20260503 19:56:56.758167 3745 heartbeater.cc:507] Master 127.0.105.62:37847 requested a full tablet report, sending...
I20260503 19:56:57.650169 1747 ts_manager.cc:295] Set tserver state for a417bd6c4b7d4bab8e96e65908ec2385 to MAINTENANCE_MODE
I20260503 19:56:58.052927 1747 ts_manager.cc:295] Set tserver state for d337855bccbf4d0c84a8c5d26db11d85 to MAINTENANCE_MODE
I20260503 19:56:59.107290 1747 ts_manager.cc:295] Set tserver state for 6d32022b7ea94ea48926c65f7a62d687 to MAINTENANCE_MODE
I20260503 19:56:59.174229 1747 ts_manager.cc:295] Set tserver state for 24488daee7104583a6f986a6ae3f8fe0 to MAINTENANCE_MODE
I20260503 19:57:00.065485 3817 tablet_service.cc:1460] Tablet server a417bd6c4b7d4bab8e96e65908ec2385 set to quiescing
I20260503 19:57:00.065758 3817 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260503 19:57:00.586328 3407 tablet_service.cc:1460] Tablet server d337855bccbf4d0c84a8c5d26db11d85 set to quiescing
I20260503 19:57:00.586596 3407 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260503 19:57:01.051520 3543 tablet_service.cc:1460] Tablet server 24488daee7104583a6f986a6ae3f8fe0 set to quiescing
I20260503 19:57:01.051820 3543 tablet_service.cc:1467] Tablet server has 1 leaders and 3 scanners
I20260503 19:57:01.064895 4105 raft_consensus.cc:993] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0: : Instructing follower 6d32022b7ea94ea48926c65f7a62d687 to start an election
I20260503 19:57:01.065094 4105 raft_consensus.cc:1081] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [term 5 LEADER]: Signalling peer 6d32022b7ea94ea48926c65f7a62d687 to start an election
I20260503 19:57:01.076453 3700 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "305dbeef23b540c69080a3b2d03c9c35"
dest_uuid: "6d32022b7ea94ea48926c65f7a62d687"
from {username='slave'} at 127.0.105.4:40603
I20260503 19:57:01.076876 3700 raft_consensus.cc:493] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 19:57:01.077066 3700 raft_consensus.cc:3060] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687 [term 5 FOLLOWER]: Advancing to term 6
I20260503 19:57:01.081401 3700 raft_consensus.cc:515] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d32022b7ea94ea48926c65f7a62d687" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 33995 } } peers { permanent_uuid: "a417bd6c4b7d4bab8e96e65908ec2385" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37957 } } peers { permanent_uuid: "24488daee7104583a6f986a6ae3f8fe0" member_type: VOTER last_known_addr { host: "127.0.105.4" port: 34213 } }
I20260503 19:57:01.091212 3700 leader_election.cc:290] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687 [CANDIDATE]: Term 6 election: Requested vote from peers a417bd6c4b7d4bab8e96e65908ec2385 (127.0.105.1:37957), 24488daee7104583a6f986a6ae3f8fe0 (127.0.105.4:34213)
I20260503 19:57:01.099813 3700 raft_consensus.cc:1240] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687 [term 6 FOLLOWER]: Rejecting Update request from peer 24488daee7104583a6f986a6ae3f8fe0 for earlier term 5. Current term is 6. Ops: [5.1736-5.1736]
I20260503 19:57:01.101876 4152 consensus_queue.cc:1059] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d32022b7ea94ea48926c65f7a62d687" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 33995 }, Status: INVALID_TERM, Last received: 5.1735, Next index: 1736, Last known committed idx: 1735, Time since last communication: 0.000s
I20260503 19:57:01.102308 4152 raft_consensus.cc:3055] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [term 5 LEADER]: Stepping down as leader of term 5
I20260503 19:57:01.102420 4152 raft_consensus.cc:740] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 24488daee7104583a6f986a6ae3f8fe0, State: Running, Role: LEADER
W20260503 19:57:01.102720 3519 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:51200: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
I20260503 19:57:01.102746 4152 consensus_queue.cc:260] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1736, Committed index: 1736, Last appended: 5.1737, Last appended by leader: 1737, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d32022b7ea94ea48926c65f7a62d687" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 33995 } } peers { permanent_uuid: "a417bd6c4b7d4bab8e96e65908ec2385" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37957 } } peers { permanent_uuid: "24488daee7104583a6f986a6ae3f8fe0" member_type: VOTER last_known_addr { host: "127.0.105.4" port: 34213 } }
I20260503 19:57:01.103569 4152 raft_consensus.cc:3060] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [term 5 FOLLOWER]: Advancing to term 6
W20260503 19:57:01.109306 3659 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54074: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
I20260503 19:57:01.110776 3563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305dbeef23b540c69080a3b2d03c9c35" candidate_uuid: "6d32022b7ea94ea48926c65f7a62d687" candidate_term: 6 candidate_status { last_received { term: 5 index: 1735 } } ignore_live_leader: true dest_uuid: "24488daee7104583a6f986a6ae3f8fe0"
I20260503 19:57:01.111243 3563 raft_consensus.cc:2410] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d32022b7ea94ea48926c65f7a62d687 for term 6 because replica has last-logged OpId of term: 5 index: 1737, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 1735.
W20260503 19:57:01.115712 3941 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:51200: Illegal state: Cannot assign timestamp to op. Tablet is not in leader mode. Last heard from a leader: 0.015s ago.
W20260503 19:57:01.117439 3797 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44830: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
I20260503 19:57:01.119086 3837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305dbeef23b540c69080a3b2d03c9c35" candidate_uuid: "6d32022b7ea94ea48926c65f7a62d687" candidate_term: 6 candidate_status { last_received { term: 5 index: 1735 } } ignore_live_leader: true dest_uuid: "a417bd6c4b7d4bab8e96e65908ec2385"
I20260503 19:57:01.119395 3837 raft_consensus.cc:3060] T 305dbeef23b540c69080a3b2d03c9c35 P a417bd6c4b7d4bab8e96e65908ec2385 [term 5 FOLLOWER]: Advancing to term 6
W20260503 19:57:01.120088 3797 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44830: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
I20260503 19:57:01.126051 3837 raft_consensus.cc:2410] T 305dbeef23b540c69080a3b2d03c9c35 P a417bd6c4b7d4bab8e96e65908ec2385 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d32022b7ea94ea48926c65f7a62d687 for term 6 because replica has last-logged OpId of term: 5 index: 1737, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 1735.
I20260503 19:57:01.127038 3635 leader_election.cc:304] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d32022b7ea94ea48926c65f7a62d687; no voters: 24488daee7104583a6f986a6ae3f8fe0, a417bd6c4b7d4bab8e96e65908ec2385
W20260503 19:57:01.127964 3520 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:51200: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:57:01.128499 3659 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54074: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
I20260503 19:57:01.130357 4165 raft_consensus.cc:2749] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260503 19:57:01.137316 3659 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54074: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:57:01.138347 3519 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:51200: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:57:01.147527 3797 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44830: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:57:01.148929 3797 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44830: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:57:01.156036 3659 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54074: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:57:01.162493 3517 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:51200: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:57:01.167164 3518 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:51200: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:57:01.173354 3659 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54074: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:57:01.179318 3659 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54074: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:57:01.186697 3797 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44830: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:57:01.192909 3797 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44830: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:57:01.203047 3518 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:51200: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:57:01.209878 3518 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:51200: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:57:01.216070 3659 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54074: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:57:01.226905 3659 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54074: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:57:01.234483 3797 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44830: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:57:01.243597 3797 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44830: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:57:01.251961 3519 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:51200: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:57:01.266252 3518 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:51200: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:57:01.273424 3659 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54074: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
I20260503 19:57:01.283627 3680 tablet_service.cc:1460] Tablet server 6d32022b7ea94ea48926c65f7a62d687 set to quiescing
I20260503 19:57:01.283969 3680 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
W20260503 19:57:01.289458 3659 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54074: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:57:01.296047 3797 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44830: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:57:01.311997 3797 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44830: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:57:01.318749 3518 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:51200: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:57:01.335258 3520 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:51200: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:57:01.339496 3659 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54074: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:57:01.357285 3659 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54074: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:57:01.358820 3797 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44830: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:57:01.380672 3520 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:51200: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:57:01.383663 3797 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44830: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:57:01.405320 3797 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44830: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:57:01.411248 3519 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:51200: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:57:01.422576 4178 raft_consensus.cc:670] T 305dbeef23b540c69080a3b2d03c9c35 P a417bd6c4b7d4bab8e96e65908ec2385: failed to trigger leader election: Illegal state: leader elections are disabled
W20260503 19:57:01.429284 3659 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54074: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:57:01.431157 4152 raft_consensus.cc:670] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0: failed to trigger leader election: Illegal state: leader elections are disabled
W20260503 19:57:01.437543 3659 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54074: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:57:01.456413 3518 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:51200: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:57:01.461110 3797 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44830: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:57:01.462704 4165 raft_consensus.cc:670] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687: failed to trigger leader election: Illegal state: leader elections are disabled
W20260503 19:57:01.485894 3797 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44830: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:57:01.490800 3520 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:51200: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:57:01.514189 3659 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54074: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:57:01.521572 3659 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54074: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:57:01.542606 3520 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:51200: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:57:01.550127 3797 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44830: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:57:01.572258 3797 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44830: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:57:01.580078 3518 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:51200: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:57:01.604456 3659 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54074: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:57:01.609467 3659 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54074: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:57:01.639981 3518 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:51200: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:57:01.641009 3797 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44830: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:57:01.670596 3797 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44830: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:57:01.675679 3518 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:51200: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:57:01.704064 3659 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54074: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:57:01.706941 3659 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54074: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:57:01.738224 3797 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44830: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:57:01.741233 3520 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:51200: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:57:01.775357 3517 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:51200: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:57:01.776458 3659 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54074: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:57:01.811924 3659 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54074: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:57:01.813122 3797 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44830: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:57:01.849676 3797 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44830: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:57:01.853996 3520 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:51200: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:57:01.887010 3520 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:51200: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:57:01.893241 3659 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54074: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:57:01.924423 3659 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54074: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:57:01.934168 3797 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44830: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:57:01.964251 3797 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44830: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:57:01.975821 3520 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:51200: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:57:02.008143 3520 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:51200: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:57:02.019829 3659 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54074: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:57:02.055709 3659 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54074: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:57:02.062384 3797 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44830: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:57:02.100159 3797 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44830: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:57:02.110805 3517 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:51200: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:57:02.147178 3517 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:51200: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:57:02.155036 3659 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54074: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:57:02.193936 3659 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54074: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:57:02.202405 3797 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44830: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:57:02.237953 3797 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44830: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:57:02.252172 3517 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:51200: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:57:02.284909 3517 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:51200: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:57:02.299293 3659 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54074: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:57:02.333992 3659 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54074: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:57:02.349658 3797 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44830: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:57:02.385996 3797 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44830: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:57:02.403321 3517 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:51200: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:57:02.436488 3517 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:51200: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:57:02.454200 3659 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54074: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:57:02.487017 3659 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54074: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:57:02.508579 3797 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44830: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:57:02.540004 3797 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44830: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:57:02.566937 3517 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:51200: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:57:02.598712 3517 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:51200: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:57:02.620218 3659 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54074: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:57:02.650964 3659 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54074: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:57:02.676095 3797 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44830: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:57:02.705404 3797 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44830: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:57:02.737031 3517 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:51200: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:57:02.764972 3517 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:51200: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:57:02.794157 3659 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54074: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
I20260503 19:57:02.803153 3543 tablet_service.cc:1460] Tablet server 24488daee7104583a6f986a6ae3f8fe0 set to quiescing
I20260503 19:57:02.803357 3543 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
W20260503 19:57:02.819501 3659 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54074: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:57:02.854930 3797 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44830: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:57:02.879851 3797 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44830: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
I20260503 19:57:02.908111 420 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-task4vf7p3/build/asan/bin/kudu pid 3345
I20260503 19:57:02.917191 3467 generic_service.cc:196] Checking for leaks (request via RPC)
W20260503 19:57:02.917716 3517 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:51200: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:57:02.939448 3517 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:51200: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:57:02.978535 3659 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54074: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:57:02.999217 3659 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54074: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
I20260503 19:57:03.023993 420 external_mini_cluster.cc:1658] Killing /tmp/dist-test-task4vf7p3/build/asan/bin/kudu with pid 3345
W20260503 19:57:03.039016 3797 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44830: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
I20260503 19:57:03.046319 420 external_mini_cluster.cc:1366] Running /tmp/dist-test-task4vf7p3/build/asan/bin/kudu
/tmp/dist-test-task4vf7p3/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.105.2:32969
--local_ip_for_outbound_sockets=127.0.105.2
--tserver_master_addrs=127.0.105.62:37847
--webserver_port=46229
--webserver_interface=127.0.105.2
--builtin_ntp_servers=127.0.105.20:45725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
W20260503 19:57:03.061062 3797 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44830: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:57:03.103552 3517 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:51200: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:57:03.127380 3517 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:51200: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:57:03.168710 3659 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54074: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:57:03.188746 3659 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54074: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:57:03.235030 3797 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44830: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:57:03.255251 3797 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44830: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:57:03.304824 3517 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:51200: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:57:03.321580 3517 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:51200: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:57:03.368680 3659 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54074: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:57:03.387410 3659 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54074: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:57:03.436488 3797 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44830: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:57:03.452879 3797 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44830: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:57:03.502087 4194 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260503 19:57:03.502444 4194 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260503 19:57:03.502537 4194 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260503 19:57:03.504897 3517 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:51200: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:57:03.513758 4194 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260503 19:57:03.513971 4194 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.105.2
W20260503 19:57:03.524299 3517 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:51200: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
I20260503 19:57:03.526356 4194 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.105.20:45725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.105.2:32969
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.105.2
--webserver_port=46229
--tserver_master_addrs=127.0.105.62:37847
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.105.2
--log_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 0ba7f54e15c9f673bf3e350f30b8d5f1a4037b79
build type FASTDEBUG
built by None at 03 May 2026 19:43:25 UTC on bdcb31816ec0
build id 11730
ASAN enabled
I20260503 19:57:03.528256 4194 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260503 19:57:03.530155 4194 file_cache.cc:492] Constructed file cache file cache with capacity 419430
E20260503 19:57:03.534375 4194 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260503 19:57:03.541791 4199 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 19:57:03.542097 4202 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 19:57:03.542097 4200 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260503 19:57:03.544055 4194 server_base.cc:1061] running on GCE node
I20260503 19:57:03.545025 4194 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260503 19:57:03.546226 4194 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260503 19:57:03.547868 4194 hybrid_clock.cc:648] HybridClock initialized: now 1777838223547782 us; error 59 us; skew 500 ppm
I20260503 19:57:03.548276 4194 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260503 19:57:03.550962 4194 webserver.cc:492] Webserver started at http://127.0.105.2:46229/ using document root <none> and password file <none>
I20260503 19:57:03.551909 4194 fs_manager.cc:362] Metadata directory not provided
I20260503 19:57:03.552104 4194 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260503 19:57:03.559051 4194 fs_manager.cc:714] Time spent opening directory manager: real 0.005s user 0.004s sys 0.002s
I20260503 19:57:03.562789 4208 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260503 19:57:03.564524 4194 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.000s sys 0.002s
I20260503 19:57:03.564720 4194 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-1/data,/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-1/wal
uuid: "d337855bccbf4d0c84a8c5d26db11d85"
format_stamp: "Formatted at 2026-05-03 19:56:17 on dist-test-slave-nzs1"
I20260503 19:57:03.565474 4194 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260503 19:57:03.575800 3659 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54074: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:57:03.594354 3659 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54074: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
I20260503 19:57:03.596021 4194 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260503 19:57:03.596886 4194 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260503 19:57:03.597147 4194 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260503 19:57:03.598148 4194 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260503 19:57:03.599911 4194 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260503 19:57:03.600008 4194 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260503 19:57:03.600086 4194 ts_tablet_manager.cc:616] Registered 0 tablets
I20260503 19:57:03.600142 4194 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260503 19:57:03.637966 4194 rpc_server.cc:307] RPC server started. Bound to: 127.0.105.2:32969
I20260503 19:57:03.638074 4320 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.105.2:32969 every 8 connection(s)
I20260503 19:57:03.639590 4194 server_base.cc:1193] Dumped server information to /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-1/data/info.pb
I20260503 19:57:03.640202 420 external_mini_cluster.cc:1428] Started /tmp/dist-test-task4vf7p3/build/asan/bin/kudu as pid 4194
I20260503 19:57:03.640496 420 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-task4vf7p3/build/asan/bin/kudu pid 3479
W20260503 19:57:03.646692 3797 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44830: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
I20260503 19:57:03.653195 3602 generic_service.cc:196] Checking for leaks (request via RPC)
I20260503 19:57:03.659961 4321 heartbeater.cc:344] Connected to a master server at 127.0.105.62:37847
I20260503 19:57:03.660465 4321 heartbeater.cc:461] Registering TS with master...
I20260503 19:57:03.661470 4321 heartbeater.cc:507] Master 127.0.105.62:37847 requested a full tablet report, sending...
I20260503 19:57:03.663676 1739 ts_manager.cc:194] Re-registered known tserver with Master: d337855bccbf4d0c84a8c5d26db11d85 (127.0.105.2:32969)
W20260503 19:57:03.664069 3797 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44830: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
I20260503 19:57:03.664913 1739 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.105.2:43615
W20260503 19:57:03.880285 3517 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:51200: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:57:03.880285 3520 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:51200: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
I20260503 19:57:03.880882 420 external_mini_cluster.cc:1658] Killing /tmp/dist-test-task4vf7p3/build/asan/bin/kudu with pid 3479
W20260503 19:57:03.929360 2340 meta_cache.cc:302] tablet 305dbeef23b540c69080a3b2d03c9c35: replica 24488daee7104583a6f986a6ae3f8fe0 (127.0.105.4:34213) has failed: Network error: recv got EOF from 127.0.105.4:34213 (error 108)
I20260503 19:57:03.930233 420 external_mini_cluster.cc:1366] Running /tmp/dist-test-task4vf7p3/build/asan/bin/kudu
/tmp/dist-test-task4vf7p3/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-3/wal
--fs_data_dirs=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-3/logs
--server_dump_info_path=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.105.4:34213
--local_ip_for_outbound_sockets=127.0.105.4
--tserver_master_addrs=127.0.105.62:37847
--webserver_port=42465
--webserver_interface=127.0.105.4
--builtin_ntp_servers=127.0.105.20:45725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
W20260503 19:57:03.943208 3659 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54074: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:57:03.951326 3797 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44830: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:57:03.953749 3797 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44830: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:57:04.025602 3659 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54074: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:57:04.028738 3659 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54074: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:57:04.174254 3659 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54074: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:57:04.177589 3659 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54074: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:57:04.249293 3797 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44830: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:57:04.256049 3797 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44830: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
I20260503 19:57:04.333081 2370 meta_cache.cc:1510] marking tablet server 24488daee7104583a6f986a6ae3f8fe0 (127.0.105.4:34213) as failed
W20260503 19:57:04.358392 4328 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260503 19:57:04.358857 4328 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260503 19:57:04.358968 4328 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260503 19:57:04.370275 4328 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260503 19:57:04.370565 4328 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.105.4
I20260503 19:57:04.382346 4328 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.105.20:45725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-3/data
--fs_wal_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.105.4:34213
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-3/data/info.pb
--webserver_interface=127.0.105.4
--webserver_port=42465
--tserver_master_addrs=127.0.105.62:37847
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.105.4
--log_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-3/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 0ba7f54e15c9f673bf3e350f30b8d5f1a4037b79
build type FASTDEBUG
built by None at 03 May 2026 19:43:25 UTC on bdcb31816ec0
build id 11730
ASAN enabled
I20260503 19:57:04.384282 4328 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260503 19:57:04.386437 4328 file_cache.cc:492] Constructed file cache file cache with capacity 419430
E20260503 19:57:04.391101 4328 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260503 19:57:04.400197 4334 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 19:57:04.400759 4335 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 19:57:04.400192 4337 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260503 19:57:04.401126 4328 server_base.cc:1061] running on GCE node
I20260503 19:57:04.403420 4328 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260503 19:57:04.404997 4328 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260503 19:57:04.406452 4328 hybrid_clock.cc:648] HybridClock initialized: now 1777838224406329 us; error 87 us; skew 500 ppm
I20260503 19:57:04.406988 4328 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260503 19:57:04.409958 4328 webserver.cc:492] Webserver started at http://127.0.105.4:42465/ using document root <none> and password file <none>
I20260503 19:57:04.410912 4328 fs_manager.cc:362] Metadata directory not provided
I20260503 19:57:04.411145 4328 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
W20260503 19:57:04.414945 3659 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54074: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
I20260503 19:57:04.422415 4328 fs_manager.cc:714] Time spent opening directory manager: real 0.008s user 0.004s sys 0.003s
I20260503 19:57:04.428992 4343 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260503 19:57:04.431288 4328 fs_manager.cc:730] Time spent opening block manager: real 0.005s user 0.004s sys 0.000s
I20260503 19:57:04.431577 4328 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-3/data,/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-3/wal
uuid: "24488daee7104583a6f986a6ae3f8fe0"
format_stamp: "Formatted at 2026-05-03 19:56:18 on dist-test-slave-nzs1"
I20260503 19:57:04.432524 4328 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-3/wal
metadata directory: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-3/wal
1 data directories: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260503 19:57:04.464454 4328 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260503 19:57:04.466521 4328 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260503 19:57:04.467024 4328 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260503 19:57:04.468571 4328 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260503 19:57:04.472303 4350 ts_tablet_manager.cc:548] Loading tablet metadata (0/1 complete)
I20260503 19:57:04.481165 4328 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260503 19:57:04.481348 4328 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.010s user 0.000s sys 0.002s
W20260503 19:57:04.481444 3659 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54074: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
I20260503 19:57:04.481491 4328 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260503 19:57:04.485836 4328 ts_tablet_manager.cc:616] Registered 1 tablets
I20260503 19:57:04.485997 4328 ts_tablet_manager.cc:595] Time spent register tablets: real 0.005s user 0.001s sys 0.001s
I20260503 19:57:04.486537 4350 tablet_bootstrap.cc:492] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0: Bootstrap starting.
W20260503 19:57:04.496135 3797 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44830: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
I20260503 19:57:04.545047 4328 rpc_server.cc:307] RPC server started. Bound to: 127.0.105.4:34213
I20260503 19:57:04.545095 4456 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.105.4:34213 every 8 connection(s)
I20260503 19:57:04.547082 4328 server_base.cc:1193] Dumped server information to /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-3/data/info.pb
I20260503 19:57:04.554701 420 external_mini_cluster.cc:1428] Started /tmp/dist-test-task4vf7p3/build/asan/bin/kudu as pid 4328
I20260503 19:57:04.555099 420 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-task4vf7p3/build/asan/bin/kudu pid 3615
W20260503 19:57:04.561878 3797 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44830: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
I20260503 19:57:04.581202 3740 generic_service.cc:196] Checking for leaks (request via RPC)
I20260503 19:57:04.582439 4457 heartbeater.cc:344] Connected to a master server at 127.0.105.62:37847
I20260503 19:57:04.582901 4457 heartbeater.cc:461] Registering TS with master...
I20260503 19:57:04.584308 4457 heartbeater.cc:507] Master 127.0.105.62:37847 requested a full tablet report, sending...
I20260503 19:57:04.588183 1739 ts_manager.cc:194] Re-registered known tserver with Master: 24488daee7104583a6f986a6ae3f8fe0 (127.0.105.4:34213)
I20260503 19:57:04.589918 1739 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.105.4:45005
I20260503 19:57:04.668373 4321 heartbeater.cc:499] Master 127.0.105.62:37847 was elected leader, sending a full tablet report...
I20260503 19:57:04.848472 420 external_mini_cluster.cc:1658] Killing /tmp/dist-test-task4vf7p3/build/asan/bin/kudu with pid 3615
W20260503 19:57:04.890671 1735 connection.cc:570] server connection from 127.0.105.3:44709 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260503 19:57:04.891297 2371 meta_cache.cc:1510] marking tablet server 6d32022b7ea94ea48926c65f7a62d687 (127.0.105.3:33995) as failed
I20260503 19:57:04.891481 420 external_mini_cluster.cc:1366] Running /tmp/dist-test-task4vf7p3/build/asan/bin/kudu
/tmp/dist-test-task4vf7p3/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.105.3:33995
--local_ip_for_outbound_sockets=127.0.105.3
--tserver_master_addrs=127.0.105.62:37847
--webserver_port=33159
--webserver_interface=127.0.105.3
--builtin_ntp_servers=127.0.105.20:45725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
W20260503 19:57:04.974200 2340 meta_cache.cc:302] tablet 305dbeef23b540c69080a3b2d03c9c35: replica 6d32022b7ea94ea48926c65f7a62d687 (127.0.105.3:33995) has failed: Network error: Client connection negotiation failed: client connection to 127.0.105.3:33995: connect: Connection refused (error 111)
W20260503 19:57:05.055559 3797 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44830: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:57:05.057013 3797 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44830: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
I20260503 19:57:05.069100 4350 log.cc:826] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0: Log is configured to *not* fsync() on all Append() calls
W20260503 19:57:05.230413 3797 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44830: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:57:05.313654 3797 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44830: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:57:05.318712 4465 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260503 19:57:05.319092 4465 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260503 19:57:05.319237 4465 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260503 19:57:05.328759 4465 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260503 19:57:05.329026 4465 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.105.3
I20260503 19:57:05.341848 4465 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.105.20:45725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.105.3:33995
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.105.3
--webserver_port=33159
--tserver_master_addrs=127.0.105.62:37847
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.105.3
--log_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 0ba7f54e15c9f673bf3e350f30b8d5f1a4037b79
build type FASTDEBUG
built by None at 03 May 2026 19:43:25 UTC on bdcb31816ec0
build id 11730
ASAN enabled
I20260503 19:57:05.343739 4465 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260503 19:57:05.345854 4465 file_cache.cc:492] Constructed file cache file cache with capacity 419430
E20260503 19:57:05.352074 4465 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260503 19:57:05.359103 4472 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 19:57:05.360064 4471 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 19:57:05.361236 4474 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260503 19:57:05.361815 4465 server_base.cc:1061] running on GCE node
I20260503 19:57:05.362551 4465 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260503 19:57:05.363953 4465 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260503 19:57:05.365286 4465 hybrid_clock.cc:648] HybridClock initialized: now 1777838225365198 us; error 64 us; skew 500 ppm
I20260503 19:57:05.365747 4465 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260503 19:57:05.368826 4465 webserver.cc:492] Webserver started at http://127.0.105.3:33159/ using document root <none> and password file <none>
I20260503 19:57:05.369850 4465 fs_manager.cc:362] Metadata directory not provided
I20260503 19:57:05.370059 4465 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260503 19:57:05.379130 4465 fs_manager.cc:714] Time spent opening directory manager: real 0.005s user 0.005s sys 0.000s
I20260503 19:57:05.383116 4480 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260503 19:57:05.384953 4465 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.000s sys 0.003s
I20260503 19:57:05.385203 4465 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-2/data,/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-2/wal
uuid: "6d32022b7ea94ea48926c65f7a62d687"
format_stamp: "Formatted at 2026-05-03 19:56:17 on dist-test-slave-nzs1"
I20260503 19:57:05.386082 4465 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260503 19:57:05.421219 4465 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260503 19:57:05.422286 4465 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260503 19:57:05.422622 4465 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260503 19:57:05.423826 4465 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260503 19:57:05.426560 4487 ts_tablet_manager.cc:548] Loading tablet metadata (0/1 complete)
I20260503 19:57:05.433136 4465 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260503 19:57:05.433305 4465 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.007s user 0.000s sys 0.001s
I20260503 19:57:05.433495 4465 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260503 19:57:05.436950 4465 ts_tablet_manager.cc:616] Registered 1 tablets
I20260503 19:57:05.437076 4465 ts_tablet_manager.cc:595] Time spent register tablets: real 0.004s user 0.000s sys 0.003s
I20260503 19:57:05.437594 4487 tablet_bootstrap.cc:492] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687: Bootstrap starting.
W20260503 19:57:05.490733 3797 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44830: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
I20260503 19:57:05.536653 4465 rpc_server.cc:307] RPC server started. Bound to: 127.0.105.3:33995
I20260503 19:57:05.536695 4593 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.105.3:33995 every 8 connection(s)
I20260503 19:57:05.538481 4465 server_base.cc:1193] Dumped server information to /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-2/data/info.pb
I20260503 19:57:05.546317 420 external_mini_cluster.cc:1428] Started /tmp/dist-test-task4vf7p3/build/asan/bin/kudu as pid 4465
I20260503 19:57:05.546607 420 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-task4vf7p3/build/asan/bin/kudu pid 3754
I20260503 19:57:05.593353 3877 generic_service.cc:196] Checking for leaks (request via RPC)
I20260503 19:57:05.594528 4457 heartbeater.cc:499] Master 127.0.105.62:37847 was elected leader, sending a full tablet report...
I20260503 19:57:05.614615 4594 heartbeater.cc:344] Connected to a master server at 127.0.105.62:37847
I20260503 19:57:05.615142 4594 heartbeater.cc:461] Registering TS with master...
I20260503 19:57:05.616454 4594 heartbeater.cc:507] Master 127.0.105.62:37847 requested a full tablet report, sending...
I20260503 19:57:05.620185 1747 ts_manager.cc:194] Re-registered known tserver with Master: 6d32022b7ea94ea48926c65f7a62d687 (127.0.105.3:33995)
I20260503 19:57:05.621965 1747 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.105.3:55019
W20260503 19:57:05.833673 3797 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44830: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
I20260503 19:57:05.834017 420 external_mini_cluster.cc:1658] Killing /tmp/dist-test-task4vf7p3/build/asan/bin/kudu with pid 3754
I20260503 19:57:05.875356 420 external_mini_cluster.cc:1366] Running /tmp/dist-test-task4vf7p3/build/asan/bin/kudu
/tmp/dist-test-task4vf7p3/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.105.1:37957
--local_ip_for_outbound_sockets=127.0.105.1
--tserver_master_addrs=127.0.105.62:37847
--webserver_port=39515
--webserver_interface=127.0.105.1
--builtin_ntp_servers=127.0.105.20:45725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
I20260503 19:57:05.942871 2370 meta_cache.cc:1510] marking tablet server a417bd6c4b7d4bab8e96e65908ec2385 (127.0.105.1:37957) as failed
W20260503 19:57:05.982061 2343 meta_cache.cc:302] tablet 305dbeef23b540c69080a3b2d03c9c35: replica a417bd6c4b7d4bab8e96e65908ec2385 (127.0.105.1:37957) has failed: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37957: connect: Connection refused (error 111)
I20260503 19:57:06.298579 4487 log.cc:826] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687: Log is configured to *not* fsync() on all Append() calls
W20260503 19:57:06.330272 4602 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260503 19:57:06.330654 4602 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260503 19:57:06.330808 4602 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260503 19:57:06.340430 4602 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260503 19:57:06.340759 4602 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.105.1
I20260503 19:57:06.352958 4602 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.105.20:45725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.105.1:37957
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.105.1
--webserver_port=39515
--tserver_master_addrs=127.0.105.62:37847
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.105.1
--log_dir=/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 0ba7f54e15c9f673bf3e350f30b8d5f1a4037b79
build type FASTDEBUG
built by None at 03 May 2026 19:43:25 UTC on bdcb31816ec0
build id 11730
ASAN enabled
I20260503 19:57:06.354812 4602 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260503 19:57:06.356886 4602 file_cache.cc:492] Constructed file cache file cache with capacity 419430
E20260503 19:57:06.361300 4602 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260503 19:57:06.370441 4608 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 19:57:06.378327 4609 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 19:57:06.380090 4611 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260503 19:57:06.380246 4602 server_base.cc:1061] running on GCE node
I20260503 19:57:06.381145 4602 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260503 19:57:06.382465 4602 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260503 19:57:06.383780 4602 hybrid_clock.cc:648] HybridClock initialized: now 1777838226383685 us; error 68 us; skew 500 ppm
I20260503 19:57:06.384187 4602 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260503 19:57:06.387216 4602 webserver.cc:492] Webserver started at http://127.0.105.1:39515/ using document root <none> and password file <none>
I20260503 19:57:06.388306 4602 fs_manager.cc:362] Metadata directory not provided
I20260503 19:57:06.388468 4602 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260503 19:57:06.396636 4602 fs_manager.cc:714] Time spent opening directory manager: real 0.005s user 0.005s sys 0.002s
I20260503 19:57:06.401008 4617 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260503 19:57:06.403105 4602 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260503 19:57:06.403321 4602 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-0/data,/tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-0/wal
uuid: "a417bd6c4b7d4bab8e96e65908ec2385"
format_stamp: "Formatted at 2026-05-03 19:56:16 on dist-test-slave-nzs1"
I20260503 19:57:06.404394 4602 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260503 19:57:06.444564 4602 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260503 19:57:06.445794 4602 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260503 19:57:06.446187 4602 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260503 19:57:06.447520 4602 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260503 19:57:06.450589 4624 ts_tablet_manager.cc:548] Loading tablet metadata (0/1 complete)
I20260503 19:57:06.459353 4602 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260503 19:57:06.459518 4602 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.009s user 0.000s sys 0.001s
I20260503 19:57:06.459759 4602 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260503 19:57:06.464500 4602 ts_tablet_manager.cc:616] Registered 1 tablets
I20260503 19:57:06.464715 4602 ts_tablet_manager.cc:595] Time spent register tablets: real 0.005s user 0.005s sys 0.000s
I20260503 19:57:06.465161 4624 tablet_bootstrap.cc:492] T 305dbeef23b540c69080a3b2d03c9c35 P a417bd6c4b7d4bab8e96e65908ec2385: Bootstrap starting.
I20260503 19:57:06.626479 4594 heartbeater.cc:499] Master 127.0.105.62:37847 was elected leader, sending a full tablet report...
W20260503 19:57:07.029146 2343 meta_cache.cc:302] tablet 305dbeef23b540c69080a3b2d03c9c35: replica a417bd6c4b7d4bab8e96e65908ec2385 (127.0.105.1:37957) has failed: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37957: connect: Connection refused (error 111)
I20260503 19:57:07.373420 4730 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.105.1:37957 every 8 connection(s)
I20260503 19:57:07.373833 4602 rpc_server.cc:307] RPC server started. Bound to: 127.0.105.1:37957
I20260503 19:57:07.376459 4602 server_base.cc:1193] Dumped server information to /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0/minicluster-data/ts-0/data/info.pb
I20260503 19:57:07.377499 420 external_mini_cluster.cc:1428] Started /tmp/dist-test-task4vf7p3/build/asan/bin/kudu as pid 4602
I20260503 19:57:07.466413 4731 heartbeater.cc:344] Connected to a master server at 127.0.105.62:37847
I20260503 19:57:07.466881 4731 heartbeater.cc:461] Registering TS with master...
I20260503 19:57:07.469019 4731 heartbeater.cc:507] Master 127.0.105.62:37847 requested a full tablet report, sending...
I20260503 19:57:07.473023 1739 ts_manager.cc:194] Re-registered known tserver with Master: a417bd6c4b7d4bab8e96e65908ec2385 (127.0.105.1:37957)
I20260503 19:57:07.474862 1739 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.105.1:60465
I20260503 19:57:07.497342 4624 log.cc:826] T 305dbeef23b540c69080a3b2d03c9c35 P a417bd6c4b7d4bab8e96e65908ec2385: Log is configured to *not* fsync() on all Append() calls
I20260503 19:57:08.479296 4731 heartbeater.cc:499] Master 127.0.105.62:37847 was elected leader, sending a full tablet report...
I20260503 19:57:08.610380 4666 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260503 19:57:08.612957 4529 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260503 19:57:08.620182 4392 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260503 19:57:08.621742 4256 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260503 19:57:10.076069 4350 tablet_bootstrap.cc:492] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0: Bootstrap replaying log segment 1/1 (1.82M/3.00M this segment, stats: ops{read=1055 overwritten=0 applied=1055 ignored=0} inserts{seen=52600 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0)
I20260503 19:57:11.303208 4487 tablet_bootstrap.cc:492] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687: Bootstrap replaying log segment 1/1 (1.79M/2.95M this segment, stats: ops{read=1045 overwritten=0 applied=1043 ignored=0} inserts{seen=52000 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0)
I20260503 19:57:12.512104 4624 tablet_bootstrap.cc:492] T 305dbeef23b540c69080a3b2d03c9c35 P a417bd6c4b7d4bab8e96e65908ec2385: Bootstrap replaying log segment 1/1 (1.95M/2.94M this segment, stats: ops{read=1155 overwritten=0 applied=1155 ignored=0} inserts{seen=57600 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0)
I20260503 19:57:12.746677 2372 scanner-internal.cc:172] Scan of tablet 305dbeef23b540c69080a3b2d03c9c35 at 24488daee7104583a6f986a6ae3f8fe0 (127.0.105.4:34213) deadline exceeded after 10.000s
W20260503 19:57:12.747072 2372 scanner-internal.cc:458] Time spent opening tablet: real 10.872s user 0.013s sys 0.001s
I20260503 19:57:13.005447 4350 tablet_bootstrap.cc:492] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1737 overwritten=0 applied=1736 ignored=0} inserts{seen=86650 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260503 19:57:13.006357 4350 tablet_bootstrap.cc:492] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0: Bootstrap complete.
I20260503 19:57:13.013695 4350 ts_tablet_manager.cc:1403] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0: Time spent bootstrapping tablet: real 8.528s user 7.679s sys 0.488s
I20260503 19:57:13.024466 4350 raft_consensus.cc:359] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [term 6 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d32022b7ea94ea48926c65f7a62d687" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 33995 } } peers { permanent_uuid: "a417bd6c4b7d4bab8e96e65908ec2385" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37957 } } peers { permanent_uuid: "24488daee7104583a6f986a6ae3f8fe0" member_type: VOTER last_known_addr { host: "127.0.105.4" port: 34213 } }
I20260503 19:57:13.029944 4350 raft_consensus.cc:740] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [term 6 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24488daee7104583a6f986a6ae3f8fe0, State: Initialized, Role: FOLLOWER
I20260503 19:57:13.031304 4350 consensus_queue.cc:260] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1736, Last appended: 5.1737, Last appended by leader: 1737, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d32022b7ea94ea48926c65f7a62d687" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 33995 } } peers { permanent_uuid: "a417bd6c4b7d4bab8e96e65908ec2385" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37957 } } peers { permanent_uuid: "24488daee7104583a6f986a6ae3f8fe0" member_type: VOTER last_known_addr { host: "127.0.105.4" port: 34213 } }
I20260503 19:57:13.040091 4350 ts_tablet_manager.cc:1434] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0: Time spent starting tablet: real 0.026s user 0.022s sys 0.004s
W20260503 19:57:13.120591 4371 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:38814: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
I20260503 19:57:13.159111 2370 scanner-internal.cc:172] Scan of tablet 305dbeef23b540c69080a3b2d03c9c35 at 24488daee7104583a6f986a6ae3f8fe0 (127.0.105.4:34213) deadline exceeded after 10.000s
W20260503 19:57:13.159379 2370 scanner-internal.cc:458] Time spent opening tablet: real 11.250s user 0.015s sys 0.001s
I20260503 19:57:13.271562 4773 raft_consensus.cc:493] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 19:57:13.272490 4773 raft_consensus.cc:515] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d32022b7ea94ea48926c65f7a62d687" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 33995 } } peers { permanent_uuid: "a417bd6c4b7d4bab8e96e65908ec2385" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37957 } } peers { permanent_uuid: "24488daee7104583a6f986a6ae3f8fe0" member_type: VOTER last_known_addr { host: "127.0.105.4" port: 34213 } }
I20260503 19:57:13.288427 4773 leader_election.cc:290] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d32022b7ea94ea48926c65f7a62d687 (127.0.105.3:33995), a417bd6c4b7d4bab8e96e65908ec2385 (127.0.105.1:37957)
I20260503 19:57:13.321601 4549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305dbeef23b540c69080a3b2d03c9c35" candidate_uuid: "24488daee7104583a6f986a6ae3f8fe0" candidate_term: 7 candidate_status { last_received { term: 5 index: 1737 } } ignore_live_leader: false dest_uuid: "6d32022b7ea94ea48926c65f7a62d687" is_pre_election: true
W20260503 19:57:13.325994 4344 leader_election.cc:343] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [CANDIDATE]: Term 7 pre-election: Tablet error from VoteRequest() call to peer 6d32022b7ea94ea48926c65f7a62d687 (127.0.105.3:33995): Illegal state: must be running to vote when last-logged opid is not known
I20260503 19:57:13.362995 4686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305dbeef23b540c69080a3b2d03c9c35" candidate_uuid: "24488daee7104583a6f986a6ae3f8fe0" candidate_term: 7 candidate_status { last_received { term: 5 index: 1737 } } ignore_live_leader: false dest_uuid: "a417bd6c4b7d4bab8e96e65908ec2385" is_pre_election: true
W20260503 19:57:13.372154 4347 leader_election.cc:343] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [CANDIDATE]: Term 7 pre-election: Tablet error from VoteRequest() call to peer a417bd6c4b7d4bab8e96e65908ec2385 (127.0.105.1:37957): Illegal state: must be running to vote when last-logged opid is not known
I20260503 19:57:13.372659 4347 leader_election.cc:304] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24488daee7104583a6f986a6ae3f8fe0; no voters: 6d32022b7ea94ea48926c65f7a62d687, a417bd6c4b7d4bab8e96e65908ec2385
I20260503 19:57:13.373761 4773 raft_consensus.cc:2749] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260503 19:57:13.418191 4371 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:38814: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
I20260503 19:57:13.423629 2371 scanner-internal.cc:172] Scan of tablet 305dbeef23b540c69080a3b2d03c9c35 at 24488daee7104583a6f986a6ae3f8fe0 (127.0.105.4:34213) deadline exceeded after 10.000s
W20260503 19:57:13.423877 2371 scanner-internal.cc:458] Time spent opening tablet: real 11.177s user 0.013s sys 0.008s
W20260503 19:57:13.597112 4371 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:38814: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
I20260503 19:57:13.691851 4773 raft_consensus.cc:493] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 19:57:13.692121 4773 raft_consensus.cc:515] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d32022b7ea94ea48926c65f7a62d687" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 33995 } } peers { permanent_uuid: "a417bd6c4b7d4bab8e96e65908ec2385" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37957 } } peers { permanent_uuid: "24488daee7104583a6f986a6ae3f8fe0" member_type: VOTER last_known_addr { host: "127.0.105.4" port: 34213 } }
I20260503 19:57:13.692899 4773 leader_election.cc:290] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d32022b7ea94ea48926c65f7a62d687 (127.0.105.3:33995), a417bd6c4b7d4bab8e96e65908ec2385 (127.0.105.1:37957)
I20260503 19:57:13.693974 4549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305dbeef23b540c69080a3b2d03c9c35" candidate_uuid: "24488daee7104583a6f986a6ae3f8fe0" candidate_term: 7 candidate_status { last_received { term: 5 index: 1737 } } ignore_live_leader: false dest_uuid: "6d32022b7ea94ea48926c65f7a62d687" is_pre_election: true
W20260503 19:57:13.694780 4344 leader_election.cc:343] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [CANDIDATE]: Term 7 pre-election: Tablet error from VoteRequest() call to peer 6d32022b7ea94ea48926c65f7a62d687 (127.0.105.3:33995): Illegal state: must be running to vote when last-logged opid is not known
I20260503 19:57:13.695685 4686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305dbeef23b540c69080a3b2d03c9c35" candidate_uuid: "24488daee7104583a6f986a6ae3f8fe0" candidate_term: 7 candidate_status { last_received { term: 5 index: 1737 } } ignore_live_leader: false dest_uuid: "a417bd6c4b7d4bab8e96e65908ec2385" is_pre_election: true
W20260503 19:57:13.696421 4347 leader_election.cc:343] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [CANDIDATE]: Term 7 pre-election: Tablet error from VoteRequest() call to peer a417bd6c4b7d4bab8e96e65908ec2385 (127.0.105.1:37957): Illegal state: must be running to vote when last-logged opid is not known
I20260503 19:57:13.696587 4347 leader_election.cc:304] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24488daee7104583a6f986a6ae3f8fe0; no voters: 6d32022b7ea94ea48926c65f7a62d687, a417bd6c4b7d4bab8e96e65908ec2385
I20260503 19:57:13.697157 4773 raft_consensus.cc:2749] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260503 19:57:13.888376 4371 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:38814: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
W20260503 19:57:14.078670 4371 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:38814: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
I20260503 19:57:14.123037 4773 raft_consensus.cc:493] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 19:57:14.123301 4773 raft_consensus.cc:515] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d32022b7ea94ea48926c65f7a62d687" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 33995 } } peers { permanent_uuid: "a417bd6c4b7d4bab8e96e65908ec2385" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37957 } } peers { permanent_uuid: "24488daee7104583a6f986a6ae3f8fe0" member_type: VOTER last_known_addr { host: "127.0.105.4" port: 34213 } }
I20260503 19:57:14.124334 4773 leader_election.cc:290] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d32022b7ea94ea48926c65f7a62d687 (127.0.105.3:33995), a417bd6c4b7d4bab8e96e65908ec2385 (127.0.105.1:37957)
I20260503 19:57:14.125576 4549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305dbeef23b540c69080a3b2d03c9c35" candidate_uuid: "24488daee7104583a6f986a6ae3f8fe0" candidate_term: 7 candidate_status { last_received { term: 5 index: 1737 } } ignore_live_leader: false dest_uuid: "6d32022b7ea94ea48926c65f7a62d687" is_pre_election: true
I20260503 19:57:14.126178 4686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305dbeef23b540c69080a3b2d03c9c35" candidate_uuid: "24488daee7104583a6f986a6ae3f8fe0" candidate_term: 7 candidate_status { last_received { term: 5 index: 1737 } } ignore_live_leader: false dest_uuid: "a417bd6c4b7d4bab8e96e65908ec2385" is_pre_election: true
W20260503 19:57:14.127004 4347 leader_election.cc:343] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [CANDIDATE]: Term 7 pre-election: Tablet error from VoteRequest() call to peer a417bd6c4b7d4bab8e96e65908ec2385 (127.0.105.1:37957): Illegal state: must be running to vote when last-logged opid is not known
W20260503 19:57:14.127569 4344 leader_election.cc:343] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [CANDIDATE]: Term 7 pre-election: Tablet error from VoteRequest() call to peer 6d32022b7ea94ea48926c65f7a62d687 (127.0.105.3:33995): Illegal state: must be running to vote when last-logged opid is not known
I20260503 19:57:14.127835 4344 leader_election.cc:304] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24488daee7104583a6f986a6ae3f8fe0; no voters: 6d32022b7ea94ea48926c65f7a62d687, a417bd6c4b7d4bab8e96e65908ec2385
I20260503 19:57:14.128443 4773 raft_consensus.cc:2749] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260503 19:57:14.366212 4371 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:38814: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
I20260503 19:57:14.479118 4773 raft_consensus.cc:493] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 19:57:14.479355 4773 raft_consensus.cc:515] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d32022b7ea94ea48926c65f7a62d687" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 33995 } } peers { permanent_uuid: "a417bd6c4b7d4bab8e96e65908ec2385" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37957 } } peers { permanent_uuid: "24488daee7104583a6f986a6ae3f8fe0" member_type: VOTER last_known_addr { host: "127.0.105.4" port: 34213 } }
I20260503 19:57:14.480190 4773 leader_election.cc:290] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d32022b7ea94ea48926c65f7a62d687 (127.0.105.3:33995), a417bd6c4b7d4bab8e96e65908ec2385 (127.0.105.1:37957)
I20260503 19:57:14.481184 4549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305dbeef23b540c69080a3b2d03c9c35" candidate_uuid: "24488daee7104583a6f986a6ae3f8fe0" candidate_term: 7 candidate_status { last_received { term: 5 index: 1737 } } ignore_live_leader: false dest_uuid: "6d32022b7ea94ea48926c65f7a62d687" is_pre_election: true
I20260503 19:57:14.482318 4686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305dbeef23b540c69080a3b2d03c9c35" candidate_uuid: "24488daee7104583a6f986a6ae3f8fe0" candidate_term: 7 candidate_status { last_received { term: 5 index: 1737 } } ignore_live_leader: false dest_uuid: "a417bd6c4b7d4bab8e96e65908ec2385" is_pre_election: true
W20260503 19:57:14.483110 4344 leader_election.cc:343] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [CANDIDATE]: Term 7 pre-election: Tablet error from VoteRequest() call to peer 6d32022b7ea94ea48926c65f7a62d687 (127.0.105.3:33995): Illegal state: must be running to vote when last-logged opid is not known
W20260503 19:57:14.483659 4347 leader_election.cc:343] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [CANDIDATE]: Term 7 pre-election: Tablet error from VoteRequest() call to peer a417bd6c4b7d4bab8e96e65908ec2385 (127.0.105.1:37957): Illegal state: must be running to vote when last-logged opid is not known
I20260503 19:57:14.483814 4347 leader_election.cc:304] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24488daee7104583a6f986a6ae3f8fe0; no voters: 6d32022b7ea94ea48926c65f7a62d687, a417bd6c4b7d4bab8e96e65908ec2385
I20260503 19:57:14.484364 4773 raft_consensus.cc:2749] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260503 19:57:14.560246 4371 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:38814: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
I20260503 19:57:14.824160 4487 tablet_bootstrap.cc:492] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687: Bootstrap replayed 1/1 log segments. Stats: ops{read=1735 overwritten=0 applied=1735 ignored=0} inserts{seen=86600 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260503 19:57:14.824959 4487 tablet_bootstrap.cc:492] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687: Bootstrap complete.
I20260503 19:57:14.827203 4487 ts_tablet_manager.cc:1403] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687: Time spent bootstrapping tablet: real 9.390s user 8.505s sys 0.637s
I20260503 19:57:14.833385 4487 raft_consensus.cc:359] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687 [term 6 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d32022b7ea94ea48926c65f7a62d687" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 33995 } } peers { permanent_uuid: "a417bd6c4b7d4bab8e96e65908ec2385" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37957 } } peers { permanent_uuid: "24488daee7104583a6f986a6ae3f8fe0" member_type: VOTER last_known_addr { host: "127.0.105.4" port: 34213 } }
I20260503 19:57:14.834540 4487 raft_consensus.cc:740] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687 [term 6 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d32022b7ea94ea48926c65f7a62d687, State: Initialized, Role: FOLLOWER
I20260503 19:57:14.835510 4487 consensus_queue.cc:260] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1735, Last appended: 5.1735, Last appended by leader: 1735, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d32022b7ea94ea48926c65f7a62d687" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 33995 } } peers { permanent_uuid: "a417bd6c4b7d4bab8e96e65908ec2385" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37957 } } peers { permanent_uuid: "24488daee7104583a6f986a6ae3f8fe0" member_type: VOTER last_known_addr { host: "127.0.105.4" port: 34213 } }
I20260503 19:57:14.838546 4487 ts_tablet_manager.cc:1434] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687: Time spent starting tablet: real 0.011s user 0.009s sys 0.004s
W20260503 19:57:14.847566 4371 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:38814: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
I20260503 19:57:14.953950 4392 tablet_service.cc:1467] Tablet server has 0 leaders and 2 scanners
I20260503 19:57:14.964604 4256 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260503 19:57:14.965051 4529 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260503 19:57:14.980279 4666 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
W20260503 19:57:15.048503 4371 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:38814: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
I20260503 19:57:15.063897 4791 raft_consensus.cc:493] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 19:57:15.064281 4791 raft_consensus.cc:515] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d32022b7ea94ea48926c65f7a62d687" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 33995 } } peers { permanent_uuid: "a417bd6c4b7d4bab8e96e65908ec2385" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37957 } } peers { permanent_uuid: "24488daee7104583a6f986a6ae3f8fe0" member_type: VOTER last_known_addr { host: "127.0.105.4" port: 34213 } }
I20260503 19:57:15.066085 4791 leader_election.cc:290] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a417bd6c4b7d4bab8e96e65908ec2385 (127.0.105.1:37957), 24488daee7104583a6f986a6ae3f8fe0 (127.0.105.4:34213)
I20260503 19:57:15.085021 4686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305dbeef23b540c69080a3b2d03c9c35" candidate_uuid: "6d32022b7ea94ea48926c65f7a62d687" candidate_term: 7 candidate_status { last_received { term: 5 index: 1735 } } ignore_live_leader: false dest_uuid: "a417bd6c4b7d4bab8e96e65908ec2385" is_pre_election: true
W20260503 19:57:15.086004 4484 leader_election.cc:343] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687 [CANDIDATE]: Term 7 pre-election: Tablet error from VoteRequest() call to peer a417bd6c4b7d4bab8e96e65908ec2385 (127.0.105.1:37957): Illegal state: must be running to vote when last-logged opid is not known
I20260503 19:57:15.088361 4412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305dbeef23b540c69080a3b2d03c9c35" candidate_uuid: "6d32022b7ea94ea48926c65f7a62d687" candidate_term: 7 candidate_status { last_received { term: 5 index: 1735 } } ignore_live_leader: false dest_uuid: "24488daee7104583a6f986a6ae3f8fe0" is_pre_election: true
I20260503 19:57:15.088929 4412 raft_consensus.cc:2410] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d32022b7ea94ea48926c65f7a62d687 for term 7 because replica has last-logged OpId of term: 5 index: 1737, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 1735.
I20260503 19:57:15.089792 4481 leader_election.cc:304] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d32022b7ea94ea48926c65f7a62d687; no voters: 24488daee7104583a6f986a6ae3f8fe0, a417bd6c4b7d4bab8e96e65908ec2385
I20260503 19:57:15.090296 4791 raft_consensus.cc:2749] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260503 19:57:15.175050 4508 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:58534: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:57:15.213759 4508 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:58534: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:57:15.342823 4371 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:38814: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
I20260503 19:57:15.431738 4624 tablet_bootstrap.cc:492] T 305dbeef23b540c69080a3b2d03c9c35 P a417bd6c4b7d4bab8e96e65908ec2385: Bootstrap replayed 1/1 log segments. Stats: ops{read=1737 overwritten=0 applied=1736 ignored=0} inserts{seen=86650 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260503 19:57:15.432399 4624 tablet_bootstrap.cc:492] T 305dbeef23b540c69080a3b2d03c9c35 P a417bd6c4b7d4bab8e96e65908ec2385: Bootstrap complete.
I20260503 19:57:15.433988 4624 ts_tablet_manager.cc:1403] T 305dbeef23b540c69080a3b2d03c9c35 P a417bd6c4b7d4bab8e96e65908ec2385: Time spent bootstrapping tablet: real 8.969s user 7.881s sys 0.573s
I20260503 19:57:15.438074 4624 raft_consensus.cc:359] T 305dbeef23b540c69080a3b2d03c9c35 P a417bd6c4b7d4bab8e96e65908ec2385 [term 6 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d32022b7ea94ea48926c65f7a62d687" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 33995 } } peers { permanent_uuid: "a417bd6c4b7d4bab8e96e65908ec2385" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37957 } } peers { permanent_uuid: "24488daee7104583a6f986a6ae3f8fe0" member_type: VOTER last_known_addr { host: "127.0.105.4" port: 34213 } }
I20260503 19:57:15.441072 4624 raft_consensus.cc:740] T 305dbeef23b540c69080a3b2d03c9c35 P a417bd6c4b7d4bab8e96e65908ec2385 [term 6 FOLLOWER]: Becoming Follower/Learner. State: Replica: a417bd6c4b7d4bab8e96e65908ec2385, State: Initialized, Role: FOLLOWER
I20260503 19:57:15.441886 4624 consensus_queue.cc:260] T 305dbeef23b540c69080a3b2d03c9c35 P a417bd6c4b7d4bab8e96e65908ec2385 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1736, Last appended: 5.1737, Last appended by leader: 1737, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d32022b7ea94ea48926c65f7a62d687" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 33995 } } peers { permanent_uuid: "a417bd6c4b7d4bab8e96e65908ec2385" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37957 } } peers { permanent_uuid: "24488daee7104583a6f986a6ae3f8fe0" member_type: VOTER last_known_addr { host: "127.0.105.4" port: 34213 } }
I20260503 19:57:15.443575 4624 ts_tablet_manager.cc:1434] T 305dbeef23b540c69080a3b2d03c9c35 P a417bd6c4b7d4bab8e96e65908ec2385: Time spent starting tablet: real 0.009s user 0.011s sys 0.000s
W20260503 19:57:15.509819 4646 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:41832: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
I20260503 19:57:15.515288 4791 raft_consensus.cc:493] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 19:57:15.515498 4791 raft_consensus.cc:515] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d32022b7ea94ea48926c65f7a62d687" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 33995 } } peers { permanent_uuid: "a417bd6c4b7d4bab8e96e65908ec2385" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37957 } } peers { permanent_uuid: "24488daee7104583a6f986a6ae3f8fe0" member_type: VOTER last_known_addr { host: "127.0.105.4" port: 34213 } }
I20260503 19:57:15.516395 4791 leader_election.cc:290] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a417bd6c4b7d4bab8e96e65908ec2385 (127.0.105.1:37957), 24488daee7104583a6f986a6ae3f8fe0 (127.0.105.4:34213)
I20260503 19:57:15.517119 4412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305dbeef23b540c69080a3b2d03c9c35" candidate_uuid: "6d32022b7ea94ea48926c65f7a62d687" candidate_term: 7 candidate_status { last_received { term: 5 index: 1735 } } ignore_live_leader: false dest_uuid: "24488daee7104583a6f986a6ae3f8fe0" is_pre_election: true
I20260503 19:57:15.517295 4686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305dbeef23b540c69080a3b2d03c9c35" candidate_uuid: "6d32022b7ea94ea48926c65f7a62d687" candidate_term: 7 candidate_status { last_received { term: 5 index: 1735 } } ignore_live_leader: false dest_uuid: "a417bd6c4b7d4bab8e96e65908ec2385" is_pre_election: true
I20260503 19:57:15.517414 4412 raft_consensus.cc:2410] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d32022b7ea94ea48926c65f7a62d687 for term 7 because replica has last-logged OpId of term: 5 index: 1737, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 1735.
I20260503 19:57:15.517750 4686 raft_consensus.cc:2410] T 305dbeef23b540c69080a3b2d03c9c35 P a417bd6c4b7d4bab8e96e65908ec2385 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d32022b7ea94ea48926c65f7a62d687 for term 7 because replica has last-logged OpId of term: 5 index: 1737, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 1735.
I20260503 19:57:15.518353 4484 leader_election.cc:304] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d32022b7ea94ea48926c65f7a62d687; no voters: 24488daee7104583a6f986a6ae3f8fe0, a417bd6c4b7d4bab8e96e65908ec2385
I20260503 19:57:15.518776 4791 raft_consensus.cc:2749] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260503 19:57:15.550679 4371 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:38814: Illegal state: replica 24488daee7104583a6f986a6ae3f8fe0 is not leader of this config: current role FOLLOWER
I20260503 19:57:15.643355 4819 raft_consensus.cc:493] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 19:57:15.643604 4819 raft_consensus.cc:515] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d32022b7ea94ea48926c65f7a62d687" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 33995 } } peers { permanent_uuid: "a417bd6c4b7d4bab8e96e65908ec2385" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37957 } } peers { permanent_uuid: "24488daee7104583a6f986a6ae3f8fe0" member_type: VOTER last_known_addr { host: "127.0.105.4" port: 34213 } }
I20260503 19:57:15.644622 4819 leader_election.cc:290] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d32022b7ea94ea48926c65f7a62d687 (127.0.105.3:33995), a417bd6c4b7d4bab8e96e65908ec2385 (127.0.105.1:37957)
I20260503 19:57:15.645426 4686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305dbeef23b540c69080a3b2d03c9c35" candidate_uuid: "24488daee7104583a6f986a6ae3f8fe0" candidate_term: 7 candidate_status { last_received { term: 5 index: 1737 } } ignore_live_leader: false dest_uuid: "a417bd6c4b7d4bab8e96e65908ec2385" is_pre_election: true
I20260503 19:57:15.645618 4549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305dbeef23b540c69080a3b2d03c9c35" candidate_uuid: "24488daee7104583a6f986a6ae3f8fe0" candidate_term: 7 candidate_status { last_received { term: 5 index: 1737 } } ignore_live_leader: false dest_uuid: "6d32022b7ea94ea48926c65f7a62d687" is_pre_election: true
I20260503 19:57:15.645913 4549 raft_consensus.cc:2468] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24488daee7104583a6f986a6ae3f8fe0 in term 6.
I20260503 19:57:15.645951 4686 raft_consensus.cc:2468] T 305dbeef23b540c69080a3b2d03c9c35 P a417bd6c4b7d4bab8e96e65908ec2385 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24488daee7104583a6f986a6ae3f8fe0 in term 6.
I20260503 19:57:15.646543 4344 leader_election.cc:304] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 24488daee7104583a6f986a6ae3f8fe0, 6d32022b7ea94ea48926c65f7a62d687, a417bd6c4b7d4bab8e96e65908ec2385; no voters:
I20260503 19:57:15.646946 4819 raft_consensus.cc:2804] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260503 19:57:15.647153 4819 raft_consensus.cc:493] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 19:57:15.647285 4819 raft_consensus.cc:3060] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [term 6 FOLLOWER]: Advancing to term 7
I20260503 19:57:15.650996 4819 raft_consensus.cc:515] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d32022b7ea94ea48926c65f7a62d687" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 33995 } } peers { permanent_uuid: "a417bd6c4b7d4bab8e96e65908ec2385" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37957 } } peers { permanent_uuid: "24488daee7104583a6f986a6ae3f8fe0" member_type: VOTER last_known_addr { host: "127.0.105.4" port: 34213 } }
I20260503 19:57:15.651916 4819 leader_election.cc:290] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [CANDIDATE]: Term 7 election: Requested vote from peers 6d32022b7ea94ea48926c65f7a62d687 (127.0.105.3:33995), a417bd6c4b7d4bab8e96e65908ec2385 (127.0.105.1:37957)
I20260503 19:57:15.652551 4686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305dbeef23b540c69080a3b2d03c9c35" candidate_uuid: "24488daee7104583a6f986a6ae3f8fe0" candidate_term: 7 candidate_status { last_received { term: 5 index: 1737 } } ignore_live_leader: false dest_uuid: "a417bd6c4b7d4bab8e96e65908ec2385"
I20260503 19:57:15.652601 4549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305dbeef23b540c69080a3b2d03c9c35" candidate_uuid: "24488daee7104583a6f986a6ae3f8fe0" candidate_term: 7 candidate_status { last_received { term: 5 index: 1737 } } ignore_live_leader: false dest_uuid: "6d32022b7ea94ea48926c65f7a62d687"
I20260503 19:57:15.652809 4686 raft_consensus.cc:3060] T 305dbeef23b540c69080a3b2d03c9c35 P a417bd6c4b7d4bab8e96e65908ec2385 [term 6 FOLLOWER]: Advancing to term 7
I20260503 19:57:15.653002 4549 raft_consensus.cc:3060] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687 [term 6 FOLLOWER]: Advancing to term 7
I20260503 19:57:15.656733 4686 raft_consensus.cc:2468] T 305dbeef23b540c69080a3b2d03c9c35 P a417bd6c4b7d4bab8e96e65908ec2385 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24488daee7104583a6f986a6ae3f8fe0 in term 7.
I20260503 19:57:15.656762 4549 raft_consensus.cc:2468] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24488daee7104583a6f986a6ae3f8fe0 in term 7.
I20260503 19:57:15.657514 4344 leader_election.cc:304] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 24488daee7104583a6f986a6ae3f8fe0, 6d32022b7ea94ea48926c65f7a62d687, a417bd6c4b7d4bab8e96e65908ec2385; no voters:
I20260503 19:57:15.657979 4819 raft_consensus.cc:2804] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [term 7 FOLLOWER]: Leader election won for term 7
I20260503 19:57:15.658497 4819 raft_consensus.cc:697] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [term 7 LEADER]: Becoming Leader. State: Replica: 24488daee7104583a6f986a6ae3f8fe0, State: Running, Role: LEADER
I20260503 19:57:15.659435 4819 consensus_queue.cc:237] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1736, Committed index: 1736, Last appended: 5.1737, Last appended by leader: 1737, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d32022b7ea94ea48926c65f7a62d687" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 33995 } } peers { permanent_uuid: "a417bd6c4b7d4bab8e96e65908ec2385" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37957 } } peers { permanent_uuid: "24488daee7104583a6f986a6ae3f8fe0" member_type: VOTER last_known_addr { host: "127.0.105.4" port: 34213 } }
I20260503 19:57:15.664510 1739 catalog_manager.cc:5671] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "24488daee7104583a6f986a6ae3f8fe0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d32022b7ea94ea48926c65f7a62d687" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 33995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a417bd6c4b7d4bab8e96e65908ec2385" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24488daee7104583a6f986a6ae3f8fe0" member_type: VOTER last_known_addr { host: "127.0.105.4" port: 34213 } health_report { overall_health: HEALTHY } } }
W20260503 19:57:15.677021 4508 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:58534: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:57:15.718526 4508 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:58534: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
I20260503 19:57:15.759395 4686 raft_consensus.cc:1275] T 305dbeef23b540c69080a3b2d03c9c35 P a417bd6c4b7d4bab8e96e65908ec2385 [term 7 FOLLOWER]: Refusing update from remote peer 24488daee7104583a6f986a6ae3f8fe0: Log matching property violated. Preceding OpId in replica: term: 5 index: 1737. Preceding OpId from leader: term: 7 index: 1738. (index mismatch)
I20260503 19:57:15.760439 4819 consensus_queue.cc:1048] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a417bd6c4b7d4bab8e96e65908ec2385" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1738, Last known committed idx: 1736, Time since last communication: 0.000s
I20260503 19:57:15.771247 4827 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:38814 (ReqId={client: 2baef47169a94d76b532b9350f8ffd6a, seq_no=1733, attempt_no=115}) took 2511 ms. Trace:
I20260503 19:57:15.772132 4549 raft_consensus.cc:1275] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687 [term 7 FOLLOWER]: Refusing update from remote peer 24488daee7104583a6f986a6ae3f8fe0: Log matching property violated. Preceding OpId in replica: term: 5 index: 1735. Preceding OpId from leader: term: 7 index: 1738. (index mismatch)
I20260503 19:57:15.771515 4827 rpcz_store.cc:276] 0503 19:57:13.260089 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 19:57:13.260168 (+ 79us) service_pool.cc:224] Handling call
0503 19:57:15.771172 (+2511004us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 19:57:15.773326 4819 consensus_queue.cc:1048] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d32022b7ea94ea48926c65f7a62d687" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 33995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1738, Last known committed idx: 1735, Time since last communication: 0.000s
W20260503 19:57:15.781545 4508 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:58534: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:57:15.786196 4646 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:41832: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:57:15.887182 4646 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:41832: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:57:15.893469 4646 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:41832: Illegal state: replica a417bd6c4b7d4bab8e96e65908ec2385 is not leader of this config: current role FOLLOWER
W20260503 19:57:15.897982 4508 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:58534: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:57:15.898700 4509 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:58534: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
W20260503 19:57:16.062127 4509 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:58534: Illegal state: replica 6d32022b7ea94ea48926c65f7a62d687 is not leader of this config: current role FOLLOWER
I20260503 19:57:21.340543 4392 tablet_service.cc:1467] Tablet server has 1 leaders and 2 scanners
I20260503 19:57:21.363680 4529 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260503 19:57:21.388646 4666 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260503 19:57:21.434926 4256 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260503 19:57:23.209457 1740 ts_manager.cc:284] Unset tserver state for d337855bccbf4d0c84a8c5d26db11d85 from MAINTENANCE_MODE
I20260503 19:57:23.346380 1740 ts_manager.cc:284] Unset tserver state for 24488daee7104583a6f986a6ae3f8fe0 from MAINTENANCE_MODE
I20260503 19:57:23.533723 1740 ts_manager.cc:284] Unset tserver state for 6d32022b7ea94ea48926c65f7a62d687 from MAINTENANCE_MODE
I20260503 19:57:23.734043 4321 heartbeater.cc:507] Master 127.0.105.62:37847 requested a full tablet report, sending...
I20260503 19:57:23.776417 1740 ts_manager.cc:284] Unset tserver state for a417bd6c4b7d4bab8e96e65908ec2385 from MAINTENANCE_MODE
I20260503 19:57:23.790248 4731 heartbeater.cc:507] Master 127.0.105.62:37847 requested a full tablet report, sending...
I20260503 19:57:23.810009 4594 heartbeater.cc:507] Master 127.0.105.62:37847 requested a full tablet report, sending...
I20260503 19:57:23.825786 4457 heartbeater.cc:507] Master 127.0.105.62:37847 requested a full tablet report, sending...
/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/integration-tests/maintenance_mode-itest.cc:750: Failure
Value of: s.ok()
Actual: true
Expected: false
/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/test_util.cc:402: Failure
Failed
Timed out waiting for assertion to pass.
I20260503 19:57:24.068987 420 external_mini_cluster-itest-base.cc:80] Found fatal failure
I20260503 19:57:24.069661 420 external_mini_cluster-itest-base.cc:86] Attempting to dump stacks of TS 0 with UUID a417bd6c4b7d4bab8e96e65908ec2385 and pid 4602
************************ BEGIN STACKS **************************
I20260503 19:57:24.738732 4321 heartbeater.cc:507] Master 127.0.105.62:37847 requested a full tablet report, sending...
[New LWP 4604]
[New LWP 4605]
[New LWP 4606]
[New LWP 4607]
[New LWP 4613]
[New LWP 4614]
[New LWP 4615]
[New LWP 4618]
[New LWP 4619]
[New LWP 4620]
[New LWP 4621]
[New LWP 4622]
[New LWP 4623]
[New LWP 4625]
[New LWP 4626]
[New LWP 4627]
[New LWP 4628]
[New LWP 4629]
[New LWP 4630]
[New LWP 4631]
[New LWP 4632]
[New LWP 4633]
[New LWP 4634]
[New LWP 4635]
[New LWP 4636]
[New LWP 4637]
[New LWP 4638]
[New LWP 4639]
[New LWP 4640]
[New LWP 4641]
[New LWP 4642]
[New LWP 4643]
[New LWP 4644]
[New LWP 4645]
[New LWP 4646]
[New LWP 4647]
[New LWP 4648]
[New LWP 4649]
[New LWP 4650]
[New LWP 4651]
[New LWP 4652]
[New LWP 4653]
[New LWP 4654]
[New LWP 4655]
[New LWP 4656]
[New LWP 4657]
[New LWP 4658]
[New LWP 4659]
[New LWP 4660]
[New LWP 4661]
[New LWP 4662]
[New LWP 4663]
[New LWP 4664]
[New LWP 4665]
[New LWP 4666]
[New LWP 4667]
[New LWP 4668]
[New LWP 4669]
[New LWP 4670]
[New LWP 4671]
[New LWP 4672]
[New LWP 4673]
[New LWP 4674]
[New LWP 4675]
[New LWP 4676]
[New LWP 4677]
[New LWP 4678]
[New LWP 4679]
[New LWP 4680]
[New LWP 4681]
[New LWP 4682]
[New LWP 4683]
[New LWP 4684]
[New LWP 4685]
[New LWP 4686]
[New LWP 4687]
[New LWP 4688]
[New LWP 4689]
[New LWP 4690]
[New LWP 4691]
[New LWP 4692]
[New LWP 4693]
[New LWP 4694]
[New LWP 4695]
[New LWP 4696]
[New LWP 4697]
[New LWP 4698]
[New LWP 4699]
[New LWP 4700]
[New LWP 4701]
[New LWP 4702]
[New LWP 4703]
[New LWP 4704]
[New LWP 4705]
[New LWP 4706]
[New LWP 4707]
[New LWP 4708]
[New LWP 4709]
[New LWP 4710]
[New LWP 4711]
[New LWP 4712]
[New LWP 4713]
[New LWP 4714]
[New LWP 4715]
[New LWP 4716]
[New LWP 4717]
[New LWP 4718]
[New LWP 4719]
[New LWP 4720]
[New LWP 4721]
[New LWP 4722]
[New LWP 4723]
[New LWP 4724]
[New LWP 4725]
[New LWP 4726]
[New LWP 4727]
[New LWP 4728]
[New LWP 4729]
[New LWP 4730]
[New LWP 4731]
[New LWP 4732]
[New LWP 4826]
Cannot access memory at address 0x20666f2074756f28
Cannot access memory at address 0x20666f2074756f20
Cannot access memory at address 0x20666f2074756f28
Cannot access memory at address 0x20666f2074756f28
Cannot access memory at address 0x20666f2074756f20
0x00007fba483a3d50 in ?? ()
Id Target Id Frame
* 1 LWP 4602 "kudu" 0x00007fba483a3d50 in ?? ()
2 LWP 4604 "kudu" 0x00007fba4839ffb9 in ?? ()
3 LWP 4605 "kudu" 0x00007fba4839ffb9 in ?? ()
4 LWP 4606 "kudu" 0x00007fba4839ffb9 in ?? ()
5 LWP 4607 "kernel-watcher-" 0x00007fba4839ffb9 in ?? ()
6 LWP 4613 "ntp client-4613" 0x00007fba483a39e2 in ?? ()
7 LWP 4614 "file cache-evic" 0x00007fba4839ffb9 in ?? ()
8 LWP 4615 "sq_acceptor" 0x00007fba40eb6bb9 in ?? ()
9 LWP 4618 "rpc reactor-461" 0x00007fba40ec3947 in ?? ()
10 LWP 4619 "rpc reactor-461" 0x00007fba40ec3947 in ?? ()
11 LWP 4620 "rpc reactor-462" 0x00007fba40ec3947 in ?? ()
12 LWP 4621 "rpc reactor-462" 0x00007fba40ec3947 in ?? ()
13 LWP 4622 "MaintenanceMgr " 0x00007fba4839fad3 in ?? ()
14 LWP 4623 "txn-status-mana" 0x00007fba4839ffb9 in ?? ()
15 LWP 4625 "collect_and_rem" 0x00007fba4839ffb9 in ?? ()
16 LWP 4626 "tc-session-exp-" 0x00007fba4839ffb9 in ?? ()
17 LWP 4627 "rpc worker-4627" 0x00007fba4839fad3 in ?? ()
18 LWP 4628 "rpc worker-4628" 0x00007fba4839fad3 in ?? ()
19 LWP 4629 "rpc worker-4629" 0x00007fba4839fad3 in ?? ()
20 LWP 4630 "rpc worker-4630" 0x00007fba4839fad3 in ?? ()
21 LWP 4631 "rpc worker-4631" 0x00007fba4839fad3 in ?? ()
22 LWP 4632 "rpc worker-4632" 0x00007fba4839fad3 in ?? ()
23 LWP 4633 "rpc worker-4633" 0x00007fba4839fad3 in ?? ()
24 LWP 4634 "rpc worker-4634" 0x00007fba4839fad3 in ?? ()
25 LWP 4635 "rpc worker-4635" 0x00007fba4839fad3 in ?? ()
26 LWP 4636 "rpc worker-4636" 0x00007fba4839fad3 in ?? ()
27 LWP 4637 "rpc worker-4637" 0x00007fba4839fad3 in ?? ()
28 LWP 4638 "rpc worker-4638" 0x00007fba4839fad3 in ?? ()
29 LWP 4639 "rpc worker-4639" 0x00007fba4839fad3 in ?? ()
30 LWP 4640 "rpc worker-4640" 0x00007fba4839fad3 in ?? ()
31 LWP 4641 "rpc worker-4641" 0x00007fba4839fad3 in ?? ()
32 LWP 4642 "rpc worker-4642" 0x00007fba4839fad3 in ?? ()
33 LWP 4643 "rpc worker-4643" 0x00007fba4839fad3 in ?? ()
34 LWP 4644 "rpc worker-4644" 0x00007fba4839fad3 in ?? ()
35 LWP 4645 "rpc worker-4645" 0x00007fba4839fad3 in ?? ()
36 LWP 4646 "rpc worker-4646" 0x00007fba4839fad3 in ?? ()
37 LWP 4647 "rpc worker-4647" 0x00007fba4839fad3 in ?? ()
38 LWP 4648 "rpc worker-4648" 0x00007fba4839fad3 in ?? ()
39 LWP 4649 "rpc worker-4649" 0x00007fba4839fad3 in ?? ()
40 LWP 4650 "rpc worker-4650" 0x00007fba4839fad3 in ?? ()
41 LWP 4651 "rpc worker-4651" 0x00007fba4839fad3 in ?? ()
42 LWP 4652 "rpc worker-4652" 0x00007fba4839fad3 in ?? ()
43 LWP 4653 "rpc worker-4653" 0x00007fba4839fad3 in ?? ()
44 LWP 4654 "rpc worker-4654" 0x00007fba4839fad3 in ?? ()
45 LWP 4655 "rpc worker-4655" 0x00007fba4839fad3 in ?? ()
46 LWP 4656 "rpc worker-4656" 0x00007fba4839fad3 in ?? ()
47 LWP 4657 "rpc worker-4657" 0x00007fba4839fad3 in ?? ()
48 LWP 4658 "rpc worker-4658" 0x00007fba4839fad3 in ?? ()
49 LWP 4659 "rpc worker-4659" 0x00007fba4839fad3 in ?? ()
50 LWP 4660 "rpc worker-4660" 0x00007fba4839fad3 in ?? ()
51 LWP 4661 "rpc worker-4661" 0x00007fba4839fad3 in ?? ()
52 LWP 4662 "rpc worker-4662" 0x00007fba4839fad3 in ?? ()
53 LWP 4663 "rpc worker-4663" 0x00007fba4839fad3 in ?? ()
54 LWP 4664 "rpc worker-4664" 0x00007fba4839fad3 in ?? ()
55 LWP 4665 "rpc worker-4665" 0x00007fba4839fad3 in ?? ()
56 LWP 4666 "rpc worker-4666" 0x00007fba4839fad3 in ?? ()
57 LWP 4667 "rpc worker-4667" 0x00007fba4839fad3 in ?? ()
58 LWP 4668 "rpc worker-4668" 0x00007fba4839fad3 in ?? ()
59 LWP 4669 "rpc worker-4669" 0x00007fba4839fad3 in ?? ()
60 LWP 4670 "rpc worker-4670" 0x00007fba4839fad3 in ?? ()
61 LWP 4671 "rpc worker-4671" 0x00007fba4839fad3 in ?? ()
62 LWP 4672 "rpc worker-4672" 0x00007fba4839fad3 in ?? ()
63 LWP 4673 "rpc worker-4673" 0x00007fba4839fad3 in ?? ()
64 LWP 4674 "rpc worker-4674" 0x00007fba4839fad3 in ?? ()
65 LWP 4675 "rpc worker-4675" 0x00007fba4839fad3 in ?? ()
66 LWP 4676 "rpc worker-4676" 0x00007fba4839fad3 in ?? ()
67 LWP 4677 "rpc worker-4677" 0x00007fba4839fad3 in ?? ()
68 LWP 4678 "rpc worker-4678" 0x00007fba4839fad3 in ?? ()
69 LWP 4679 "rpc worker-4679" 0x00007fba4839fad3 in ?? ()
70 LWP 4680 "rpc worker-4680" 0x00007fba4839fad3 in ?? ()
71 LWP 4681 "rpc worker-4681" 0x00007fba4839fad3 in ?? ()
72 LWP 4682 "rpc worker-4682" 0x00007fba4839fad3 in ?? ()
73 LWP 4683 "rpc worker-4683" 0x00007fba4839fad3 in ?? ()
74 LWP 4684 "rpc worker-4684" 0x00007fba4839fad3 in ?? ()
75 LWP 4685 "rpc worker-4685" 0x00007fba4839fad3 in ?? ()
76 LWP 4686 "rpc worker-4686" 0x00007fba4839fad3 in ?? ()
77 LWP 4687 "rpc worker-4687" 0x00007fba4839fad3 in ?? ()
78 LWP 4688 "rpc worker-4688" 0x00007fba4839fad3 in ?? ()
79 LWP 4689 "rpc worker-4689" 0x00007fba4839fad3 in ?? ()
80 LWP 4690 "rpc worker-4690" 0x00007fba4839fad3 in ?? ()
81 LWP 4691 "rpc worker-4691" 0x00007fba4839fad3 in ?? ()
82 LWP 4692 "rpc worker-4692" 0x00007fba4839fad3 in ?? ()
83 LWP 4693 "rpc worker-4693" 0x00007fba4839fad3 in ?? ()
84 LWP 4694 "rpc worker-4694" 0x00007fba4839fad3 in ?? ()
85 LWP 4695 "rpc worker-4695" 0x00007fba4839fad3 in ?? ()
86 LWP 4696 "rpc worker-4696" 0x00007fba4839fad3 in ?? ()
87 LWP 4697 "rpc worker-4697" 0x00007fba4839fad3 in ?? ()
88 LWP 4698 "rpc worker-4698" 0x00007fba4839fad3 in ?? ()
89 LWP 4699 "rpc worker-4699" 0x00007fba4839fad3 in ?? ()
90 LWP 4700 "rpc worker-4700" 0x00007fba4839fad3 in ?? ()
91 LWP 4701 "rpc worker-4701" 0x00007fba4839fad3 in ?? ()
92 LWP 4702 "rpc worker-4702" 0x00007fba4839fad3 in ?? ()
93 LWP 4703 "rpc worker-4703" 0x00007fba4839fad3 in ?? ()
94 LWP 4704 "rpc worker-4704" 0x00007fba4839fad3 in ?? ()
95 LWP 4705 "rpc worker-4705" 0x00007fba4839fad3 in ?? ()
96 LWP 4706 "rpc worker-4706" 0x00007fba4839fad3 in ?? ()
97 LWP 4707 "rpc worker-4707" 0x00007fba4839fad3 in ?? ()
98 LWP 4708 "rpc worker-4708" 0x00007fba4839fad3 in ?? ()
99 LWP 4709 "rpc worker-4709" 0x00007fba4839fad3 in ?? ()
100 LWP 4710 "rpc worker-4710" 0x00007fba4839fad3 in ?? ()
101 LWP 4711 "rpc worker-4711" 0x00007fba4839fad3 in ?? ()
102 LWP 4712 "rpc worker-4712" 0x00007fba4839fad3 in ?? ()
103 LWP 4713 "rpc worker-4713" 0x00007fba4839fad3 in ?? ()
104 LWP 4714 "rpc worker-4714" 0x00007fba4839fad3 in ?? ()
105 LWP 4715 "rpc worker-4715" 0x00007fba4839fad3 in ?? ()
106 LWP 4716 "rpc worker-4716" 0x00007fba4839fad3 in ?? ()
107 LWP 4717 "rpc worker-4717" 0x00007fba4839fad3 in ?? ()
108 LWP 4718 "rpc worker-4718" 0x00007fba4839fad3 in ?? ()
109 LWP 4719 "rpc worker-4719" 0x00007fba4839fad3 in ?? ()
110 LWP 4720 "rpc worker-4720" 0x00007fba4839fad3 in ?? ()
111 LWP 4721 "rpc worker-4721" 0x00007fba4839fad3 in ?? ()
112 LWP 4722 "rpc worker-4722" 0x00007fba4839fad3 in ?? ()
113 LWP 4723 "rpc worker-4723" 0x00007fba4839fad3 in ?? ()
114 LWP 4724 "rpc worker-4724" 0x00007fba4839fad3 in ?? ()
115 LWP 4725 "rpc worker-4725" 0x00007fba4839fad3 in ?? ()
116 LWP 4726 "rpc worker-4726" 0x00007fba4839fad3 in ?? ()
117 LWP 4727 "diag-logger-472" 0x00007fba4839ffb9 in ?? ()
118 LWP 4728 "result-tracker-" 0x00007fba4839ffb9 in ?? ()
119 LWP 4729 "excess-log-dele" 0x00007fba4839ffb9 in ?? ()
120 LWP 4730 "acceptor-4730" 0x00007fba40ec4fc7 in ?? ()
121 LWP 4731 "heartbeat-4731" 0x00007fba4839ffb9 in ?? ()
122 LWP 4732 "maintenance_sch" 0x00007fba4839ffb9 in ?? ()
123 LWP 4826 "wal-append [wor" 0x00007fba4839ffb9 in ?? ()
Thread 123 (LWP 4826):
#0 0x00007fba4839ffb9 in ?? ()
#1 0x0000602000a55f78 in ?? ()
#2 0x00000000000005a9 in ?? ()
#3 0x0000000100000081 in ?? ()
#4 0x000061a0002c47b4 in ?? ()
#5 0x00007fb9fc0b8130 in ?? ()
#6 0x0000000000000b53 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x00007fb9fc0b8150 in ?? ()
#9 0x0000000200000000 in ?? ()
#10 0x0000008000000189 in ?? ()
#11 0x0000000000000000 in ?? ()
Thread 122 (LWP 4732):
#0 0x00007fba4839ffb9 in ?? ()
#1 0x00007fb9fd0f8700 in ?? ()
#2 0x0000000000000045 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x0000616000016ca0 in ?? ()
#5 0x00007fb9fd0f8750 in ?? ()
#6 0x000000000000008a in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 121 (LWP 4731):
#0 0x00007fba4839ffb9 in ?? ()
#1 0xe2b340df1b29b749 in ?? ()
#2 0x0000000000000013 in ?? ()
#3 0x0000000100000081 in ?? ()
#4 0x000061300001bc44 in ?? ()
#5 0x00007fb9fd910610 in ?? ()
#6 0x0000000000000027 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x00007fb9fd910630 in ?? ()
#9 0x0000000200000000 in ?? ()
#10 0x0000008000000189 in ?? ()
#11 0x00007fb9fd9106b0 in ?? ()
#12 0x00000ff73fb220d8 in ?? ()
#13 0x0000000000000000 in ?? ()
Thread 120 (LWP 4730):
#0 0x00007fba40ec4fc7 in ?? ()
#1 0x00006140000222a8 in ?? ()
#2 0x00007fb9fe137d70 in ?? ()
#3 0x00007fb9fe137da0 in ?? ()
#4 0x00007fb9fe137ea0 in ?? ()
#5 0x00007fb9fe137d90 in ?? ()
#6 0x00007fb9fe137e00 in ?? ()
#7 0x0000000000000080 in ?? ()
#8 0x00000000008d957b in __sanitizer::theDepot ()
#9 0x0000000500000014 in ?? ()
#10 0x00007fb9fe137f20 in ?? ()
#11 0x00007fb9fe13765c in ?? ()
#12 0x00000032fe1375d0 in ?? ()
#13 0x00007fb9fd93b000 in ?? ()
#14 0x0000000000000000 in ?? ()
Thread 119 (LWP 4729):
#0 0x00007fba4839ffb9 in ?? ()
#1 0x00007fb9fe950f60 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 118 (LWP 4728):
#0 0x00007fba4839ffb9 in ?? ()
#1 0x00007fb9ff16a120 in ?? ()
#2 0x0000000000000011 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061100008caf0 in ?? ()
#5 0x00007fb9ff16a110 in ?? ()
#6 0x0000000000000022 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 117 (LWP 4727):
#0 0x00007fba4839ffb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 116 (LWP 4726):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000003 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d0002b684c in ?? ()
#4 0x00007fba00199ef0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fba00199f10 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0002b6800 in ?? ()
#9 0x00007fba4839f770 in ?? ()
#10 0x00007fba00199f10 in ?? ()
#11 0x00007fba00199ed0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 115 (LWP 4725):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000009 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d0002b004c in ?? ()
#4 0x00007fba009b1ef0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fba009b1f10 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0002b0000 in ?? ()
#9 0x00007fba4839f770 in ?? ()
#10 0x00007fba009b1f10 in ?? ()
#11 0x00007fba009b1ed0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 114 (LWP 4724):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 113 (LWP 4723):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 112 (LWP 4722):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 111 (LWP 4721):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 110 (LWP 4720):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 109 (LWP 4719):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 108 (LWP 4718):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 107 (LWP 4717):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 106 (LWP 4716):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 105 (LWP 4715):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 104 (LWP 4714):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 103 (LWP 4713):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 102 (LWP 4712):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 101 (LWP 4711):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 100 (LWP 4710):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 99 (LWP 4709):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 98 (LWP 4708):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 97 (LWP 4707):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 96 (LWP 4706):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 95 (LWP 4705):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 94 (LWP 4704):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 93 (LWP 4703):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 92 (LWP 4702):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 91 (LWP 4701):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 90 (LWP 4700):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 89 (LWP 4699):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 88 (LWP 4698):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 87 (LWP 4697):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 86 (LWP 4696):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 85 (LWP 4695):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 84 (LWP 4694):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 83 (LWP 4693):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 82 (LWP 4692):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 81 (LWP 4691):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 80 (LWP 4690):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 79 (LWP 4689):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 78 (LWP 4688):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 77 (LWP 4687):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 76 (LWP 4686):
#0 0x00007fba4839fad3 in ?? ()
#1 0x00000000000000e6 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d0001ad088 in ?? ()
#4 0x00007fba1456aef0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fba1456af10 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 75 (LWP 4685):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000290 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d0001a6888 in ?? ()
#4 0x00007fba14d83ef0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fba14d83f10 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 74 (LWP 4684):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000135 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d0001a008c in ?? ()
#4 0x00007fba1559aef0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fba1559af10 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0001a0040 in ?? ()
#9 0x00007fba4839f770 in ?? ()
#10 0x00007fba1559af10 in ?? ()
#11 0x00007fba1559aed0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 73 (LWP 4683):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 72 (LWP 4682):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 71 (LWP 4681):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 70 (LWP 4680):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 69 (LWP 4679):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 68 (LWP 4678):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 67 (LWP 4677):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 66 (LWP 4676):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 65 (LWP 4675):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 64 (LWP 4674):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 63 (LWP 4673):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 62 (LWP 4672):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 61 (LWP 4671):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 60 (LWP 4670):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 59 (LWP 4669):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 58 (LWP 4668):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 57 (LWP 4667):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 56 (LWP 4666):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000003 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00012683c in ?? ()
#4 0x00007fba1dfaeef0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fba1dfaef10 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0001267f0 in ?? ()
#9 0x00007fba4839f770 in ?? ()
#10 0x00007fba1dfaef10 in ?? ()
#11 0x00007fba1dfaeed0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 55 (LWP 4665):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 54 (LWP 4664):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 53 (LWP 4663):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 52 (LWP 4662):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 51 (LWP 4661):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 50 (LWP 4660):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 49 (LWP 4659):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 48 (LWP 4658):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 47 (LWP 4657):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 46 (LWP 4656):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 45 (LWP 4655):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 44 (LWP 4654):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 43 (LWP 4653):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 42 (LWP 4652):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 41 (LWP 4651):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 40 (LWP 4650):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 39 (LWP 4649):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 38 (LWP 4648):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 37 (LWP 4647):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 36 (LWP 4646):
#0 0x00007fba4839fad3 in ?? ()
#1 0x000000000000004a in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d0000a67e8 in ?? ()
#4 0x00007fba2818fef0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fba2818ff10 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 35 (LWP 4645):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 34 (LWP 4644):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 33 (LWP 4643):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 32 (LWP 4642):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 31 (LWP 4641):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 30 (LWP 4640):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 29 (LWP 4639):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 28 (LWP 4638):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 27 (LWP 4637):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 26 (LWP 4636):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 25 (LWP 4635):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 24 (LWP 4634):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 23 (LWP 4633):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 22 (LWP 4632):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 21 (LWP 4631):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 20 (LWP 4630):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 19 (LWP 4629):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 18 (LWP 4628):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 17 (LWP 4627):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 16 (LWP 4626):
#0 0x00007fba4839ffb9 in ?? ()
#1 0x00007fba32394ce0 in ?? ()
#2 0x0000000000000001 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061300001cbe0 in ?? ()
#5 0x00007fba32394cd0 in ?? ()
#6 0x0000000000000002 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 15 (LWP 4625):
#0 0x00007fba4839ffb9 in ?? ()
#1 0x4008000000000000 in ?? ()
#2 0x0000000000000003 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061200001fe98 in ?? ()
#5 0x00007fba32bdc270 in ?? ()
#6 0x0000000000000006 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 14 (LWP 4623):
#0 0x00007fba4839ffb9 in ?? ()
#1 0x00007fba33c29260 in ?? ()
#2 0x0000000000000001 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061800000c9a8 in ?? ()
#5 0x00007fba33c29250 in ?? ()
#6 0x0000000000000002 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 13 (LWP 4622):
#0 0x00007fba4839fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 12 (LWP 4621):
#0 0x00007fba40ec3947 in ?? ()
#1 0x00007fba34c78340 in ?? ()
#2 0x000061a00000c680 in ?? ()
#3 0x00007fba34c78330 in ?? ()
#4 0x00007fba34c78540 in ?? ()
#5 0x00007fba34c78380 in ?? ()
#6 0x0000614000022298 in ?? ()
#7 0x00007fba34c78400 in ?? ()
#8 0x00007fba4353825d in ?? ()
#9 0x3fb97875879b3000 in ?? ()
#10 0x000061a00000c680 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000c680 in ?? ()
#13 0x000000004bcede80 in ?? ()
#14 0x00007fba00000000 in ?? ()
#15 0x41da7de9d0230c86 in ?? ()
#16 0x00000ff7c6987080 in ?? ()
#17 0x00007fba34c783e0 in ?? ()
#18 0x00007fba4353cba3 in ?? ()
#19 0x00007fba34c783b0 in ?? ()
#20 0x3fb97875879b3000 in ?? ()
#21 0x0000000034c78400 in ?? ()
#22 0x000061a00000c680 in ?? ()
#23 0x0000614000022298 in ?? ()
#24 0x3fb97875879b3000 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 11 (LWP 4620):
#0 0x00007fba40ec3947 in ?? ()
#1 0x00007fba3548f340 in ?? ()
#2 0x000061a00000c080 in ?? ()
#3 0x00007fba3548f330 in ?? ()
#4 0x00007fba3548f540 in ?? ()
#5 0x00007fba3548f380 in ?? ()
#6 0x0000614000022098 in ?? ()
#7 0x00007fba3548f400 in ?? ()
#8 0x00007fba4353825d in ?? ()
#9 0x3fb95e7cab2e9000 in ?? ()
#10 0x000061a00000c080 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000c080 in ?? ()
#13 0x000000004bcede80 in ?? ()
#14 0x00007fba00000000 in ?? ()
#15 0x41da7de9d0230c85 in ?? ()
#16 0x00000ff7c6a89e80 in ?? ()
#17 0x00007fba3548f3e0 in ?? ()
#18 0x00007fba4353cba3 in ?? ()
#19 0x00007fba3548f3b0 in ?? ()
#20 0x3fb95e7cab2e9000 in ?? ()
#21 0x000000003548f400 in ?? ()
#22 0x000061a00000c080 in ?? ()
#23 0x0000614000022098 in ?? ()
#24 0x3fb95e7cab2e9000 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 10 (LWP 4619):
#0 0x00007fba40ec3947 in ?? ()
#1 0x00007fba35ca6340 in ?? ()
#2 0x000061a00000ba80 in ?? ()
#3 0x00007fba35ca6330 in ?? ()
#4 0x00007fba35ca6540 in ?? ()
#5 0x00007fba35ca6380 in ?? ()
#6 0x0000614000021e98 in ?? ()
#7 0x00007fba35ca6400 in ?? ()
#8 0x00007fba4353825d in ?? ()
#9 0x3fb6d26016922000 in ?? ()
#10 0x000061a00000ba80 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000ba80 in ?? ()
#13 0x000000004bcede80 in ?? ()
#14 0x00007fba00000000 in ?? ()
#15 0x41da7de9d0230c85 in ?? ()
#16 0x00000ff7c6b8cc80 in ?? ()
#17 0x00007fba35ca63e0 in ?? ()
#18 0x00007fba4353cba3 in ?? ()
#19 0x00007fba35ca63b0 in ?? ()
#20 0x3fb6d26016922000 in ?? ()
#21 0x0000000035ca6400 in ?? ()
#22 0x000061a00000ba80 in ?? ()
#23 0x0000614000021e98 in ?? ()
#24 0x3fb6d26016922000 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 9 (LWP 4618):
#0 0x00007fba40ec3947 in ?? ()
#1 0x00007fba37cad340 in ?? ()
#2 0x000061a00000b480 in ?? ()
#3 0x00007fba37cad330 in ?? ()
#4 0x00007fba37cad540 in ?? ()
#5 0x00007fba37cad380 in ?? ()
#6 0x0000614000021c98 in ?? ()
#7 0x00007fba37cad400 in ?? ()
#8 0x00007fba4353825d in ?? ()
#9 0x3fb989eed6bc8000 in ?? ()
#10 0x000061a00000b480 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000b480 in ?? ()
#13 0x000000004bcede80 in ?? ()
#14 0x00007fba00000000 in ?? ()
#15 0x41da7de9d0230c83 in ?? ()
#16 0x00000ff7c6f8da80 in ?? ()
#17 0x00007fba37cad3e0 in ?? ()
#18 0x00007fba4353cba3 in ?? ()
#19 0x0000000000000000 in ?? ()
Thread 8 (LWP 4615):
#0 0x00007fba40eb6bb9 in ?? ()
#1 0x00000000000000c8 in ?? ()
#2 0x00007fba396b77b8 in ?? ()
#3 0x000060200001ea50 in ?? ()
#4 0x0000000000000002 in ?? ()
#5 0x00000000000000c8 in ?? ()
#6 0x00000000008d11c1 in __sanitizer::theDepot ()
#7 0x0000000000000000 in ?? ()
Thread 7 (LWP 4614):
#0 0x00007fba4839ffb9 in ?? ()
#1 0x00007fba38eb60e0 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 6 (LWP 4613):
#0 0x00007fba483a39e2 in ?? ()
#1 0x00007fba386b3bc0 in ?? ()
#2 0x00007fba386b3c60 in ?? ()
#3 0x000000000000001e in ?? ()
#4 0x0000000000000030 in ?? ()
#5 0x00007fba386b3c10 in ?? ()
#6 0x00000000017d0860 in ?? ()
#7 0x00007fba386b3c70 in ?? ()
#8 0x000061100008d450 in ?? ()
#9 0x00007fba386b3c60 in ?? ()
#10 0x00000000008cb6b7 in __sanitizer::theDepot ()
#11 0x00007fba4dd50bfc in ?? ()
#12 0x00007fba4dd40209 in ?? ()
#13 0x00007fba4dd447f6 in ?? ()
#14 0x00007fba4dd49230 in ?? ()
#15 0x00007fba4dd49059 in ?? ()
#16 0x0000000000aa4cad in __sanitizer::theDepot ()
#17 0x00007fba44dab529 in ?? ()
#18 0x00007fba483996db in ?? ()
#19 0x00000ff7c70ce688 in ?? ()
#20 0x00007fba386b3460 in ?? ()
#21 0x0000000000000000 in ?? ()
Thread 5 (LWP 4607):
#0 0x00007fba4839ffb9 in ?? ()
#1 0x00007fba3a6b8ca0 in ?? ()
#2 0x000000000000005c in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061200000c728 in ?? ()
#5 0x00007fba3a6b8c90 in ?? ()
#6 0x00000000000000b8 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 4 (LWP 4606):
#0 0x00007fba4839ffb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 3 (LWP 4605):
#0 0x00007fba4839ffb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 2 (LWP 4604):
#0 0x00007fba4839ffb9 in ?? ()
#1 0x5f5347414c46000a in ?? ()
#2 0x0000000000000002 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x0000612000012b38 in ?? ()
#5 0x00007fba3bebc450 in ?? ()
#6 0x0000000000000004 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 1 (LWP 4602):
#0 0x00007fba483a3d50 in ?? ()
#1 0x0000000000000000 in ?? ()
************************* END STACKS ***************************
I20260503 19:57:24.948081 420 external_mini_cluster-itest-base.cc:86] Attempting to dump stacks of TS 1 with UUID d337855bccbf4d0c84a8c5d26db11d85 and pid 4194
************************ BEGIN STACKS **************************
[New LWP 4195]
[New LWP 4196]
[New LWP 4197]
[New LWP 4198]
[New LWP 4204]
[New LWP 4205]
[New LWP 4206]
[New LWP 4209]
[New LWP 4210]
[New LWP 4211]
[New LWP 4212]
[New LWP 4213]
[New LWP 4214]
[New LWP 4215]
[New LWP 4216]
[New LWP 4217]
[New LWP 4218]
[New LWP 4219]
[New LWP 4220]
[New LWP 4221]
[New LWP 4222]
[New LWP 4223]
[New LWP 4224]
[New LWP 4225]
[New LWP 4226]
[New LWP 4227]
[New LWP 4228]
[New LWP 4229]
[New LWP 4230]
[New LWP 4231]
[New LWP 4232]
[New LWP 4233]
[New LWP 4234]
[New LWP 4235]
[New LWP 4236]
[New LWP 4237]
[New LWP 4238]
[New LWP 4239]
[New LWP 4240]
[New LWP 4241]
[New LWP 4242]
[New LWP 4243]
[New LWP 4244]
[New LWP 4245]
[New LWP 4246]
[New LWP 4247]
[New LWP 4248]
[New LWP 4249]
[New LWP 4250]
[New LWP 4251]
[New LWP 4252]
[New LWP 4253]
[New LWP 4254]
[New LWP 4255]
[New LWP 4256]
[New LWP 4257]
[New LWP 4258]
[New LWP 4259]
[New LWP 4260]
[New LWP 4261]
[New LWP 4262]
[New LWP 4263]
[New LWP 4264]
[New LWP 4265]
[New LWP 4266]
[New LWP 4267]
[New LWP 4268]
[New LWP 4269]
[New LWP 4270]
[New LWP 4271]
[New LWP 4272]
[New LWP 4273]
[New LWP 4274]
[New LWP 4275]
[New LWP 4276]
[New LWP 4277]
[New LWP 4278]
[New LWP 4279]
[New LWP 4280]
[New LWP 4281]
[New LWP 4282]
[New LWP 4283]
[New LWP 4284]
[New LWP 4285]
[New LWP 4286]
[New LWP 4287]
[New LWP 4288]
[New LWP 4289]
[New LWP 4290]
[New LWP 4291]
[New LWP 4292]
[New LWP 4293]
[New LWP 4294]
[New LWP 4295]
[New LWP 4296]
[New LWP 4297]
[New LWP 4298]
[New LWP 4299]
[New LWP 4300]
[New LWP 4301]
[New LWP 4302]
[New LWP 4303]
[New LWP 4304]
[New LWP 4305]
[New LWP 4306]
[New LWP 4307]
[New LWP 4308]
[New LWP 4309]
[New LWP 4310]
[New LWP 4311]
[New LWP 4312]
[New LWP 4313]
[New LWP 4314]
[New LWP 4315]
[New LWP 4316]
[New LWP 4317]
[New LWP 4318]
[New LWP 4319]
[New LWP 4320]
[New LWP 4321]
[New LWP 4322]
Cannot access memory at address 0x20666f2074756f28
Cannot access memory at address 0x20666f2074756f20
Cannot access memory at address 0x20666f2074756f28
Cannot access memory at address 0x20666f2074756f28
Cannot access memory at address 0x20666f2074756f20
0x00007f2a2d163d50 in ?? ()
Id Target Id Frame
* 1 LWP 4194 "kudu" 0x00007f2a2d163d50 in ?? ()
2 LWP 4195 "kudu" 0x00007f2a2d15ffb9 in ?? ()
3 LWP 4196 "kudu" 0x00007f2a2d15ffb9 in ?? ()
4 LWP 4197 "kudu" 0x00007f2a2d15ffb9 in ?? ()
5 LWP 4198 "kernel-watcher-" 0x00007f2a2d15ffb9 in ?? ()
6 LWP 4204 "ntp client-4204" 0x00007f2a2d1639e2 in ?? ()
7 LWP 4205 "file cache-evic" 0x00007f2a2d15ffb9 in ?? ()
8 LWP 4206 "sq_acceptor" 0x00007f2a25c76bb9 in ?? ()
9 LWP 4209 "rpc reactor-420" 0x00007f2a25c83947 in ?? ()
10 LWP 4210 "rpc reactor-421" 0x00007f2a25c83947 in ?? ()
11 LWP 4211 "rpc reactor-421" 0x00007f2a25c83947 in ?? ()
12 LWP 4212 "rpc reactor-421" 0x00007f2a25c83947 in ?? ()
13 LWP 4213 "MaintenanceMgr " 0x00007f2a2d15fad3 in ?? ()
14 LWP 4214 "txn-status-mana" 0x00007f2a2d15ffb9 in ?? ()
15 LWP 4215 "collect_and_rem" 0x00007f2a2d15ffb9 in ?? ()
16 LWP 4216 "tc-session-exp-" 0x00007f2a2d15ffb9 in ?? ()
17 LWP 4217 "rpc worker-4217" 0x00007f2a2d15fad3 in ?? ()
18 LWP 4218 "rpc worker-4218" 0x00007f2a2d15fad3 in ?? ()
19 LWP 4219 "rpc worker-4219" 0x00007f2a2d15fad3 in ?? ()
20 LWP 4220 "rpc worker-4220" 0x00007f2a2d15fad3 in ?? ()
21 LWP 4221 "rpc worker-4221" 0x00007f2a2d15fad3 in ?? ()
22 LWP 4222 "rpc worker-4222" 0x00007f2a2d15fad3 in ?? ()
23 LWP 4223 "rpc worker-4223" 0x00007f2a2d15fad3 in ?? ()
24 LWP 4224 "rpc worker-4224" 0x00007f2a2d15fad3 in ?? ()
25 LWP 4225 "rpc worker-4225" 0x00007f2a2d15fad3 in ?? ()
26 LWP 4226 "rpc worker-4226" 0x00007f2a2d15fad3 in ?? ()
27 LWP 4227 "rpc worker-4227" 0x00007f2a2d15fad3 in ?? ()
28 LWP 4228 "rpc worker-4228" 0x00007f2a2d15fad3 in ?? ()
29 LWP 4229 "rpc worker-4229" 0x00007f2a2d15fad3 in ?? ()
30 LWP 4230 "rpc worker-4230" 0x00007f2a2d15fad3 in ?? ()
31 LWP 4231 "rpc worker-4231" 0x00007f2a2d15fad3 in ?? ()
32 LWP 4232 "rpc worker-4232" 0x00007f2a2d15fad3 in ?? ()
33 LWP 4233 "rpc worker-4233" 0x00007f2a2d15fad3 in ?? ()
34 LWP 4234 "rpc worker-4234" 0x00007f2a2d15fad3 in ?? ()
35 LWP 4235 "rpc worker-4235" 0x00007f2a2d15fad3 in ?? ()
36 LWP 4236 "rpc worker-4236" 0x00007f2a2d15fad3 in ?? ()
37 LWP 4237 "rpc worker-4237" 0x00007f2a2d15fad3 in ?? ()
38 LWP 4238 "rpc worker-4238" 0x00007f2a2d15fad3 in ?? ()
39 LWP 4239 "rpc worker-4239" 0x00007f2a2d15fad3 in ?? ()
40 LWP 4240 "rpc worker-4240" 0x00007f2a2d15fad3 in ?? ()
41 LWP 4241 "rpc worker-4241" 0x00007f2a2d15fad3 in ?? ()
42 LWP 4242 "rpc worker-4242" 0x00007f2a2d15fad3 in ?? ()
43 LWP 4243 "rpc worker-4243" 0x00007f2a2d15fad3 in ?? ()
44 LWP 4244 "rpc worker-4244" 0x00007f2a2d15fad3 in ?? ()
45 LWP 4245 "rpc worker-4245" 0x00007f2a2d15fad3 in ?? ()
46 LWP 4246 "rpc worker-4246" 0x00007f2a2d15fad3 in ?? ()
47 LWP 4247 "rpc worker-4247" 0x00007f2a2d15fad3 in ?? ()
48 LWP 4248 "rpc worker-4248" 0x00007f2a2d15fad3 in ?? ()
49 LWP 4249 "rpc worker-4249" 0x00007f2a2d15fad3 in ?? ()
50 LWP 4250 "rpc worker-4250" 0x00007f2a2d15fad3 in ?? ()
51 LWP 4251 "rpc worker-4251" 0x00007f2a2d15fad3 in ?? ()
52 LWP 4252 "rpc worker-4252" 0x00007f2a2d15fad3 in ?? ()
53 LWP 4253 "rpc worker-4253" 0x00007f2a2d15fad3 in ?? ()
54 LWP 4254 "rpc worker-4254" 0x00007f2a2d15fad3 in ?? ()
55 LWP 4255 "rpc worker-4255" 0x00007f2a2d15fad3 in ?? ()
56 LWP 4256 "rpc worker-4256" 0x00007f2a2d15fad3 in ?? ()
57 LWP 4257 "rpc worker-4257" 0x00007f2a2d15fad3 in ?? ()
58 LWP 4258 "rpc worker-4258" 0x00007f2a2d15fad3 in ?? ()
59 LWP 4259 "rpc worker-4259" 0x00007f2a2d15fad3 in ?? ()
60 LWP 4260 "rpc worker-4260" 0x00007f2a2d15fad3 in ?? ()
61 LWP 4261 "rpc worker-4261" 0x00007f2a2d15fad3 in ?? ()
62 LWP 4262 "rpc worker-4262" 0x00007f2a2d15fad3 in ?? ()
63 LWP 4263 "rpc worker-4263" 0x00007f2a2d15fad3 in ?? ()
64 LWP 4264 "rpc worker-4264" 0x00007f2a2d15fad3 in ?? ()
65 LWP 4265 "rpc worker-4265" 0x00007f2a2d15fad3 in ?? ()
66 LWP 4266 "rpc worker-4266" 0x00007f2a2d15fad3 in ?? ()
67 LWP 4267 "rpc worker-4267" 0x00007f2a2d15fad3 in ?? ()
68 LWP 4268 "rpc worker-4268" 0x00007f2a2d15fad3 in ?? ()
69 LWP 4269 "rpc worker-4269" 0x00007f2a2d15fad3 in ?? ()
70 LWP 4270 "rpc worker-4270" 0x00007f2a2d15fad3 in ?? ()
71 LWP 4271 "rpc worker-4271" 0x00007f2a2d15fad3 in ?? ()
72 LWP 4272 "rpc worker-4272" 0x00007f2a2d15fad3 in ?? ()
73 LWP 4273 "rpc worker-4273" 0x00007f2a2d15fad3 in ?? ()
74 LWP 4274 "rpc worker-4274" 0x00007f2a2d15fad3 in ?? ()
75 LWP 4275 "rpc worker-4275" 0x00007f2a2d15fad3 in ?? ()
76 LWP 4276 "rpc worker-4276" 0x00007f2a2d15fad3 in ?? ()
77 LWP 4277 "rpc worker-4277" 0x00007f2a2d15fad3 in ?? ()
78 LWP 4278 "rpc worker-4278" 0x00007f2a2d15fad3 in ?? ()
79 LWP 4279 "rpc worker-4279" 0x00007f2a2d15fad3 in ?? ()
80 LWP 4280 "rpc worker-4280" 0x00007f2a2d15fad3 in ?? ()
81 LWP 4281 "rpc worker-4281" 0x00007f2a2d15fad3 in ?? ()
82 LWP 4282 "rpc worker-4282" 0x00007f2a2d15fad3 in ?? ()
83 LWP 4283 "rpc worker-4283" 0x00007f2a2d15fad3 in ?? ()
84 LWP 4284 "rpc worker-4284" 0x00007f2a2d15fad3 in ?? ()
85 LWP 4285 "rpc worker-4285" 0x00007f2a2d15fad3 in ?? ()
86 LWP 4286 "rpc worker-4286" 0x00007f2a2d15fad3 in ?? ()
87 LWP 4287 "rpc worker-4287" 0x00007f2a2d15fad3 in ?? ()
88 LWP 4288 "rpc worker-4288" 0x00007f2a2d15fad3 in ?? ()
89 LWP 4289 "rpc worker-4289" 0x00007f2a2d15fad3 in ?? ()
90 LWP 4290 "rpc worker-4290" 0x00007f2a2d15fad3 in ?? ()
91 LWP 4291 "rpc worker-4291" 0x00007f2a2d15fad3 in ?? ()
92 LWP 4292 "rpc worker-4292" 0x00007f2a2d15fad3 in ?? ()
93 LWP 4293 "rpc worker-4293" 0x00007f2a2d15fad3 in ?? ()
94 LWP 4294 "rpc worker-4294" 0x00007f2a2d15fad3 in ?? ()
95 LWP 4295 "rpc worker-4295" 0x00007f2a2d15fad3 in ?? ()
96 LWP 4296 "rpc worker-4296" 0x00007f2a2d15fad3 in ?? ()
97 LWP 4297 "rpc worker-4297" 0x00007f2a2d15fad3 in ?? ()
98 LWP 4298 "rpc worker-4298" 0x00007f2a2d15fad3 in ?? ()
99 LWP 4299 "rpc worker-4299" 0x00007f2a2d15fad3 in ?? ()
100 LWP 4300 "rpc worker-4300" 0x00007f2a2d15fad3 in ?? ()
101 LWP 4301 "rpc worker-4301" 0x00007f2a2d15fad3 in ?? ()
102 LWP 4302 "rpc worker-4302" 0x00007f2a2d15fad3 in ?? ()
103 LWP 4303 "rpc worker-4303" 0x00007f2a2d15fad3 in ?? ()
104 LWP 4304 "rpc worker-4304" 0x00007f2a2d15fad3 in ?? ()
105 LWP 4305 "rpc worker-4305" 0x00007f2a2d15fad3 in ?? ()
106 LWP 4306 "rpc worker-4306" 0x00007f2a2d15fad3 in ?? ()
107 LWP 4307 "rpc worker-4307" 0x00007f2a2d15fad3 in ?? ()
108 LWP 4308 "rpc worker-4308" 0x00007f2a2d15fad3 in ?? ()
109 LWP 4309 "rpc worker-4309" 0x00007f2a2d15fad3 in ?? ()
110 LWP 4310 "rpc worker-4310" 0x00007f2a2d15fad3 in ?? ()
111 LWP 4311 "rpc worker-4311" 0x00007f2a2d15fad3 in ?? ()
112 LWP 4312 "rpc worker-4312" 0x00007f2a2d15fad3 in ?? ()
113 LWP 4313 "rpc worker-4313" 0x00007f2a2d15fad3 in ?? ()
114 LWP 4314 "rpc worker-4314" 0x00007f2a2d15fad3 in ?? ()
115 LWP 4315 "rpc worker-4315" 0x00007f2a2d15fad3 in ?? ()
116 LWP 4316 "rpc worker-4316" 0x00007f2a2d15fad3 in ?? ()
117 LWP 4317 "diag-logger-431" 0x00007f2a2d15ffb9 in ?? ()
118 LWP 4318 "result-tracker-" 0x00007f2a2d15ffb9 in ?? ()
119 LWP 4319 "excess-log-dele" 0x00007f2a2d15ffb9 in ?? ()
120 LWP 4320 "acceptor-4320" 0x00007f2a25c84fc7 in ?? ()
121 LWP 4321 "heartbeat-4321" 0x00007f2a2d15ffb9 in ?? ()
122 LWP 4322 "maintenance_sch" 0x00007f2a2d15ffb9 in ?? ()
Thread 122 (LWP 4322):
#0 0x00007f2a2d15ffb9 in ?? ()
#1 0x00007f29e1f73700 in ?? ()
#2 0x0000000000000058 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x0000616000016ca0 in ?? ()
#5 0x00007f29e1f73750 in ?? ()
#6 0x00000000000000b0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 121 (LWP 4321):
#0 0x00007f2a2d15ffb9 in ?? ()
#1 0xe2b340df1b29b749 in ?? ()
#2 0x0000000000000015 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061300001bc40 in ?? ()
#5 0x00007f29e278b610 in ?? ()
#6 0x000000000000002a in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 120 (LWP 4320):
#0 0x00007f2a25c84fc7 in ?? ()
#1 0x0000614000021ea8 in ?? ()
#2 0x00007f29e2fb2d70 in ?? ()
#3 0x00007f29e2fb2da0 in ?? ()
#4 0x00007f29e2fb2ea0 in ?? ()
#5 0x00007f29e2fb2d90 in ?? ()
#6 0x00007f29e2fb2e00 in ?? ()
#7 0x0000000000000080 in ?? ()
#8 0x00000000008d957b in __sanitizer::theDepot ()
#9 0x0000000500000014 in ?? ()
#10 0x00007f29e2fb2f20 in ?? ()
#11 0x00007f29e2fb265c in ?? ()
#12 0x00000032e2fb25d0 in ?? ()
#13 0x00007f29e27b6000 in ?? ()
#14 0x0000000000000000 in ?? ()
Thread 119 (LWP 4319):
#0 0x00007f2a2d15ffb9 in ?? ()
#1 0x00007f29e37ccf60 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 118 (LWP 4318):
#0 0x00007f2a2d15ffb9 in ?? ()
#1 0x00007f29e3fe5120 in ?? ()
#2 0x0000000000000016 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061100008caf0 in ?? ()
#5 0x00007f29e3fe5110 in ?? ()
#6 0x000000000000002c in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 117 (LWP 4317):
#0 0x00007f2a2d15ffb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 116 (LWP 4316):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000007 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d0002b004c in ?? ()
#4 0x00007f29e5014ef0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f29e5014f10 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0002b0000 in ?? ()
#9 0x00007f2a2d15f770 in ?? ()
#10 0x00007f29e5014f10 in ?? ()
#11 0x00007f29e5014ed0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 115 (LWP 4315):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000005 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d0002a685c in ?? ()
#4 0x00007f29e582cef0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f29e582cf10 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0002a6810 in ?? ()
#9 0x00007f2a2d15f770 in ?? ()
#10 0x00007f29e582cf10 in ?? ()
#11 0x00007f29e582ced0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 114 (LWP 4314):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 113 (LWP 4313):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 112 (LWP 4312):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 111 (LWP 4311):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 110 (LWP 4310):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 109 (LWP 4309):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 108 (LWP 4308):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 107 (LWP 4307):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 106 (LWP 4306):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 105 (LWP 4305):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 104 (LWP 4304):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 103 (LWP 4303):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 102 (LWP 4302):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 101 (LWP 4301):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 100 (LWP 4300):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 99 (LWP 4299):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 98 (LWP 4298):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 97 (LWP 4297):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 96 (LWP 4296):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 95 (LWP 4295):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 94 (LWP 4294):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 93 (LWP 4293):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 92 (LWP 4292):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 91 (LWP 4291):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 90 (LWP 4290):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 89 (LWP 4289):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 88 (LWP 4288):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 87 (LWP 4287):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 86 (LWP 4286):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 85 (LWP 4285):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 84 (LWP 4284):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 83 (LWP 4283):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 82 (LWP 4282):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 81 (LWP 4281):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 80 (LWP 4280):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 79 (LWP 4279):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 78 (LWP 4278):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 77 (LWP 4277):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 76 (LWP 4276):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000003 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d0001a688c in ?? ()
#4 0x00007f29f93e5ef0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f29f93e5f10 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0001a6840 in ?? ()
#9 0x00007f2a2d15f770 in ?? ()
#10 0x00007f29f93e5f10 in ?? ()
#11 0x00007f29f93e5ed0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 75 (LWP 4275):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 74 (LWP 4274):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 73 (LWP 4273):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 72 (LWP 4272):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 71 (LWP 4271):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 70 (LWP 4270):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 69 (LWP 4269):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 68 (LWP 4268):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 67 (LWP 4267):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 66 (LWP 4266):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 65 (LWP 4265):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 64 (LWP 4264):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 63 (LWP 4263):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 62 (LWP 4262):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 61 (LWP 4261):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 60 (LWP 4260):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 59 (LWP 4259):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 58 (LWP 4258):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 57 (LWP 4257):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 56 (LWP 4256):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000003 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00012003c in ?? ()
#4 0x00007f2a035c6ef0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f2a035c6f10 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d00011fff0 in ?? ()
#9 0x00007f2a2d15f770 in ?? ()
#10 0x00007f2a035c6f10 in ?? ()
#11 0x00007f2a035c6ed0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 55 (LWP 4255):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 54 (LWP 4254):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 53 (LWP 4253):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 52 (LWP 4252):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 51 (LWP 4251):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 50 (LWP 4250):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 49 (LWP 4249):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 48 (LWP 4248):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 47 (LWP 4247):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 46 (LWP 4246):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 45 (LWP 4245):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 44 (LWP 4244):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 43 (LWP 4243):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 42 (LWP 4242):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 41 (LWP 4241):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 40 (LWP 4240):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 39 (LWP 4239):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 38 (LWP 4238):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 37 (LWP 4237):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 36 (LWP 4236):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000003 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00009ffec in ?? ()
#4 0x00007f2a0d7a7ef0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f2a0d7a7f10 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d00009ffa0 in ?? ()
#9 0x00007f2a2d15f770 in ?? ()
#10 0x00007f2a0d7a7f10 in ?? ()
#11 0x00007f2a0d7a7ed0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 35 (LWP 4235):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 34 (LWP 4234):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 33 (LWP 4233):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 32 (LWP 4232):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 31 (LWP 4231):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 30 (LWP 4230):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 29 (LWP 4229):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 28 (LWP 4228):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 27 (LWP 4227):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 26 (LWP 4226):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 25 (LWP 4225):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 24 (LWP 4224):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 23 (LWP 4223):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 22 (LWP 4222):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 21 (LWP 4221):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 20 (LWP 4220):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 19 (LWP 4219):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 18 (LWP 4218):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 17 (LWP 4217):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 16 (LWP 4216):
#0 0x00007f2a2d15ffb9 in ?? ()
#1 0x00007f2a179a6ce0 in ?? ()
#2 0x0000000000000002 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061300001c4e0 in ?? ()
#5 0x00007f2a179a6cd0 in ?? ()
#6 0x0000000000000004 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 15 (LWP 4215):
#0 0x00007f2a2d15ffb9 in ?? ()
#1 0x4008000000000000 in ?? ()
#2 0x0000000000000004 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061200001fe98 in ?? ()
#5 0x00007f2a181ce270 in ?? ()
#6 0x0000000000000008 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 14 (LWP 4214):
#0 0x00007f2a2d15ffb9 in ?? ()
#1 0x00007f2a189e4260 in ?? ()
#2 0x0000000000000002 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061800000c9a8 in ?? ()
#5 0x00007f2a189e4250 in ?? ()
#6 0x0000000000000004 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 13 (LWP 4213):
#0 0x00007f2a2d15fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 12 (LWP 4212):
#0 0x00007f2a25c83947 in ?? ()
#1 0x00007f2a19a33340 in ?? ()
#2 0x000061a00000c680 in ?? ()
#3 0x00007f2a19a33330 in ?? ()
#4 0x00007f2a19a33540 in ?? ()
#5 0x00007f2a19a33380 in ?? ()
#6 0x0000614000022298 in ?? ()
#7 0x00007f2a19a33400 in ?? ()
#8 0x00007f2a282f825d in ?? ()
#9 0x3fb97d8c83f32000 in ?? ()
#10 0x000061a00000c680 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000c680 in ?? ()
#13 0x0000000030aade80 in ?? ()
#14 0x00007f2a00000000 in ?? ()
#15 0x41da7de9d0230c84 in ?? ()
#16 0x00000fe5c333e680 in ?? ()
#17 0x00007f2a19a333e0 in ?? ()
#18 0x00007f2a282fcba3 in ?? ()
#19 0x00007f2a19a333b0 in ?? ()
#20 0x3fb97d8c83f32000 in ?? ()
#21 0x0000000019a33400 in ?? ()
#22 0x000061a00000c680 in ?? ()
#23 0x0000614000022298 in ?? ()
#24 0x3fb97d8c83f32000 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 11 (LWP 4211):
#0 0x00007f2a25c83947 in ?? ()
#1 0x00007f2a1a24a340 in ?? ()
#2 0x000061a00000c080 in ?? ()
#3 0x00007f2a1a24a330 in ?? ()
#4 0x00007f2a1a24a540 in ?? ()
#5 0x00007f2a1a24a380 in ?? ()
#6 0x0000614000022098 in ?? ()
#7 0x00007f2a1a24a400 in ?? ()
#8 0x00007f2a282f825d in ?? ()
#9 0x3fb97f1d305bd000 in ?? ()
#10 0x000061a00000c080 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000c080 in ?? ()
#13 0x0000000030aade80 in ?? ()
#14 0x00007f2a00000000 in ?? ()
#15 0x41da7de9d0230c87 in ?? ()
#16 0x00000fe5c3441480 in ?? ()
#17 0x00007f2a1a24a3e0 in ?? ()
#18 0x00007f2a282fcba3 in ?? ()
#19 0x00007f2a1a24a3b0 in ?? ()
#20 0x3fb97f1d305bd000 in ?? ()
#21 0x000000001a24a400 in ?? ()
#22 0x000061a00000c080 in ?? ()
#23 0x0000614000022098 in ?? ()
#24 0x3fb97f1d305bd000 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 10 (LWP 4210):
#0 0x00007f2a25c83947 in ?? ()
#1 0x00007f2a1aa61340 in ?? ()
#2 0x000061a00000ba80 in ?? ()
#3 0x00007f2a1aa61330 in ?? ()
#4 0x00007f2a1aa61540 in ?? ()
#5 0x00007f2a1aa61380 in ?? ()
#6 0x0000614000021e98 in ?? ()
#7 0x00007f2a1aa61400 in ?? ()
#8 0x00007f2a282f825d in ?? ()
#9 0x3fb965fb877ae000 in ?? ()
#10 0x000061a00000ba80 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000ba80 in ?? ()
#13 0x0000000030aade80 in ?? ()
#14 0x00007f2a00000000 in ?? ()
#15 0x41da7de9d0230c84 in ?? ()
#16 0x00000fe5c3544280 in ?? ()
#17 0x00007f2a1aa613e0 in ?? ()
#18 0x00007f2a282fcba3 in ?? ()
#19 0x00007f2a1aa613b0 in ?? ()
#20 0x3fb965fb877ae000 in ?? ()
#21 0x000000001aa61400 in ?? ()
#22 0x000061a00000ba80 in ?? ()
#23 0x0000614000021e98 in ?? ()
#24 0x3fb965fb877ae000 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 9 (LWP 4209):
#0 0x00007f2a25c83947 in ?? ()
#1 0x00007f2a1ca87340 in ?? ()
#2 0x000061a00000b480 in ?? ()
#3 0x00007f2a1ca87330 in ?? ()
#4 0x00007f2a1ca87540 in ?? ()
#5 0x00007f2a1ca87380 in ?? ()
#6 0x0000614000021c98 in ?? ()
#7 0x00007f2a1ca87400 in ?? ()
#8 0x00007f2a282f825d in ?? ()
#9 0x3fb95fbf652d2000 in ?? ()
#10 0x000061a00000b480 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000b480 in ?? ()
#13 0x0000000030aade80 in ?? ()
#14 0x00007f2a00000000 in ?? ()
#15 0x41da7de9d0230c86 in ?? ()
#16 0x00000fe5c3948e80 in ?? ()
#17 0x00007f2a1ca873e0 in ?? ()
#18 0x00007f2a282fcba3 in ?? ()
#19 0x0000000000000000 in ?? ()
Thread 8 (LWP 4206):
#0 0x00007f2a25c76bb9 in ?? ()
#1 0x00000000000000c8 in ?? ()
#2 0x00007f2a1e4b77b8 in ?? ()
#3 0x000060200001c550 in ?? ()
#4 0x0000000000000002 in ?? ()
#5 0x00000000000000c8 in ?? ()
#6 0x00000000008d11c1 in __sanitizer::theDepot ()
#7 0x0000000000000000 in ?? ()
Thread 7 (LWP 4205):
#0 0x00007f2a2d15ffb9 in ?? ()
#1 0x00007f2a1dcb60e0 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 6 (LWP 4204):
#0 0x00007f2a2d1639e2 in ?? ()
#1 0x00007f2a1d4b3bc0 in ?? ()
#2 0x00007f2a1d4b3c60 in ?? ()
#3 0x000000000000001e in ?? ()
#4 0x0000000000000030 in ?? ()
#5 0x00007f2a1d4b3c10 in ?? ()
#6 0x00000000017d0860 in ?? ()
#7 0x00007f2a1d4b3c70 in ?? ()
#8 0x000061100008d450 in ?? ()
#9 0x00007f2a1d4b3c60 in ?? ()
#10 0x00000000008cb6b7 in __sanitizer::theDepot ()
#11 0x00007f2a32b10bfc in ?? ()
#12 0x00007f2a32b00209 in ?? ()
#13 0x00007f2a32b047f6 in ?? ()
#14 0x00007f2a32b09230 in ?? ()
#15 0x00007f2a32b09059 in ?? ()
#16 0x0000000000aa4cad in __sanitizer::theDepot ()
#17 0x00007f2a29b6b529 in ?? ()
#18 0x00007f2a2d1596db in ?? ()
#19 0x00000fe5c3a8e688 in ?? ()
#20 0x00007f2a1d4b3460 in ?? ()
#21 0x0000000000000000 in ?? ()
Thread 5 (LWP 4198):
#0 0x00007f2a2d15ffb9 in ?? ()
#1 0x00007f2a1f4b8ca0 in ?? ()
#2 0x000000000000006e in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061200000c728 in ?? ()
#5 0x00007f2a1f4b8c90 in ?? ()
#6 0x00000000000000dc in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 4 (LWP 4197):
#0 0x00007f2a2d15ffb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 3 (LWP 4196):
#0 0x00007f2a2d15ffb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 2 (LWP 4195):
#0 0x00007f2a2d15ffb9 in ?? ()
#1 0x5f5347414c46000a in ?? ()
#2 0x0000000000000002 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x0000612000012b38 in ?? ()
#5 0x00007f2a20cbc450 in ?? ()
#6 0x0000000000000004 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 1 (LWP 4194):
#0 0x00007f2a2d163d50 in ?? ()
#1 0x0000000000000000 in ?? ()
************************* END STACKS ***************************
I20260503 19:57:25.828305 420 external_mini_cluster-itest-base.cc:86] Attempting to dump stacks of TS 2 with UUID 6d32022b7ea94ea48926c65f7a62d687 and pid 4465
************************ BEGIN STACKS **************************
[New LWP 4467]
[New LWP 4468]
[New LWP 4469]
[New LWP 4470]
[New LWP 4476]
[New LWP 4477]
[New LWP 4478]
[New LWP 4481]
[New LWP 4482]
[New LWP 4483]
[New LWP 4484]
[New LWP 4485]
[New LWP 4486]
[New LWP 4488]
[New LWP 4489]
[New LWP 4490]
[New LWP 4491]
[New LWP 4492]
[New LWP 4493]
[New LWP 4494]
[New LWP 4495]
[New LWP 4496]
[New LWP 4497]
[New LWP 4498]
[New LWP 4499]
[New LWP 4500]
[New LWP 4501]
[New LWP 4502]
[New LWP 4503]
[New LWP 4504]
[New LWP 4505]
[New LWP 4506]
[New LWP 4507]
[New LWP 4508]
[New LWP 4509]
[New LWP 4510]
[New LWP 4511]
[New LWP 4512]
[New LWP 4513]
[New LWP 4514]
[New LWP 4515]
[New LWP 4516]
[New LWP 4517]
[New LWP 4518]
[New LWP 4519]
[New LWP 4520]
[New LWP 4521]
[New LWP 4522]
[New LWP 4523]
[New LWP 4524]
[New LWP 4525]
[New LWP 4526]
[New LWP 4527]
[New LWP 4528]
[New LWP 4529]
[New LWP 4530]
[New LWP 4531]
[New LWP 4532]
[New LWP 4533]
[New LWP 4534]
[New LWP 4535]
[New LWP 4536]
[New LWP 4537]
[New LWP 4538]
[New LWP 4539]
[New LWP 4540]
[New LWP 4541]
[New LWP 4542]
[New LWP 4543]
[New LWP 4544]
[New LWP 4545]
[New LWP 4546]
[New LWP 4547]
[New LWP 4548]
[New LWP 4549]
[New LWP 4550]
[New LWP 4551]
[New LWP 4552]
[New LWP 4553]
[New LWP 4554]
[New LWP 4555]
[New LWP 4556]
[New LWP 4557]
[New LWP 4558]
[New LWP 4559]
[New LWP 4560]
[New LWP 4561]
[New LWP 4562]
[New LWP 4563]
[New LWP 4564]
[New LWP 4565]
[New LWP 4566]
[New LWP 4567]
[New LWP 4568]
[New LWP 4569]
[New LWP 4570]
[New LWP 4571]
[New LWP 4572]
[New LWP 4573]
[New LWP 4574]
[New LWP 4575]
[New LWP 4576]
[New LWP 4577]
[New LWP 4578]
[New LWP 4579]
[New LWP 4580]
[New LWP 4581]
[New LWP 4582]
[New LWP 4583]
[New LWP 4584]
[New LWP 4585]
[New LWP 4586]
[New LWP 4587]
[New LWP 4588]
[New LWP 4589]
[New LWP 4590]
[New LWP 4591]
[New LWP 4592]
[New LWP 4593]
[New LWP 4594]
[New LWP 4595]
Cannot access memory at address 0x20666f2074756f28
Cannot access memory at address 0x20666f2074756f20
Cannot access memory at address 0x20666f2074756f28
Cannot access memory at address 0x20666f2074756f28
Cannot access memory at address 0x20666f2074756f20
0x00007fc46eddcd50 in ?? ()
Id Target Id Frame
* 1 LWP 4465 "kudu" 0x00007fc46eddcd50 in ?? ()
2 LWP 4467 "kudu" 0x00007fc46edd8fb9 in ?? ()
3 LWP 4468 "kudu" 0x00007fc46edd8fb9 in ?? ()
4 LWP 4469 "kudu" 0x00007fc46edd8fb9 in ?? ()
5 LWP 4470 "kernel-watcher-" 0x00007fc46edd8fb9 in ?? ()
6 LWP 4476 "ntp client-4476" 0x00007fc46eddc9e2 in ?? ()
7 LWP 4477 "file cache-evic" 0x00007fc46edd8fb9 in ?? ()
8 LWP 4478 "sq_acceptor" 0x00007fc4678efbb9 in ?? ()
9 LWP 4481 "rpc reactor-448" 0x00007fc4678fc947 in ?? ()
10 LWP 4482 "rpc reactor-448" 0x00007fc4678fc947 in ?? ()
11 LWP 4483 "rpc reactor-448" 0x00007fc4678fc947 in ?? ()
12 LWP 4484 "rpc reactor-448" 0x00007fc4678fc947 in ?? ()
13 LWP 4485 "MaintenanceMgr " 0x00007fc46edd8ad3 in ?? ()
14 LWP 4486 "txn-status-mana" 0x00007fc46edd8fb9 in ?? ()
15 LWP 4488 "collect_and_rem" 0x00007fc46edd8fb9 in ?? ()
16 LWP 4489 "tc-session-exp-" 0x00007fc46edd8fb9 in ?? ()
17 LWP 4490 "rpc worker-4490" 0x00007fc46edd8ad3 in ?? ()
18 LWP 4491 "rpc worker-4491" 0x00007fc46edd8ad3 in ?? ()
19 LWP 4492 "rpc worker-4492" 0x00007fc46edd8ad3 in ?? ()
20 LWP 4493 "rpc worker-4493" 0x00007fc46edd8ad3 in ?? ()
21 LWP 4494 "rpc worker-4494" 0x00007fc46edd8ad3 in ?? ()
22 LWP 4495 "rpc worker-4495" 0x00007fc46edd8ad3 in ?? ()
23 LWP 4496 "rpc worker-4496" 0x00007fc46edd8ad3 in ?? ()
24 LWP 4497 "rpc worker-4497" 0x00007fc46edd8ad3 in ?? ()
25 LWP 4498 "rpc worker-4498" 0x00007fc46edd8ad3 in ?? ()
26 LWP 4499 "rpc worker-4499" 0x00007fc46edd8ad3 in ?? ()
27 LWP 4500 "rpc worker-4500" 0x00007fc46edd8ad3 in ?? ()
28 LWP 4501 "rpc worker-4501" 0x00007fc46edd8ad3 in ?? ()
29 LWP 4502 "rpc worker-4502" 0x00007fc46edd8ad3 in ?? ()
30 LWP 4503 "rpc worker-4503" 0x00007fc46edd8ad3 in ?? ()
31 LWP 4504 "rpc worker-4504" 0x00007fc46edd8ad3 in ?? ()
32 LWP 4505 "rpc worker-4505" 0x00007fc46edd8ad3 in ?? ()
33 LWP 4506 "rpc worker-4506" 0x00007fc46edd8ad3 in ?? ()
34 LWP 4507 "rpc worker-4507" 0x00007fc46edd8ad3 in ?? ()
35 LWP 4508 "rpc worker-4508" 0x00007fc46edd8ad3 in ?? ()
36 LWP 4509 "rpc worker-4509" 0x00007fc46edd8ad3 in ?? ()
37 LWP 4510 "rpc worker-4510" 0x00007fc46edd8ad3 in ?? ()
38 LWP 4511 "rpc worker-4511" 0x00007fc46edd8ad3 in ?? ()
39 LWP 4512 "rpc worker-4512" 0x00007fc46edd8ad3 in ?? ()
40 LWP 4513 "rpc worker-4513" 0x00007fc46edd8ad3 in ?? ()
41 LWP 4514 "rpc worker-4514" 0x00007fc46edd8ad3 in ?? ()
42 LWP 4515 "rpc worker-4515" 0x00007fc46edd8ad3 in ?? ()
43 LWP 4516 "rpc worker-4516" 0x00007fc46edd8ad3 in ?? ()
44 LWP 4517 "rpc worker-4517" 0x00007fc46edd8ad3 in ?? ()
45 LWP 4518 "rpc worker-4518" 0x00007fc46edd8ad3 in ?? ()
46 LWP 4519 "rpc worker-4519" 0x00007fc46edd8ad3 in ?? ()
47 LWP 4520 "rpc worker-4520" 0x00007fc46edd8ad3 in ?? ()
48 LWP 4521 "rpc worker-4521" 0x00007fc46edd8ad3 in ?? ()
49 LWP 4522 "rpc worker-4522" 0x00007fc46edd8ad3 in ?? ()
50 LWP 4523 "rpc worker-4523" 0x00007fc46edd8ad3 in ?? ()
51 LWP 4524 "rpc worker-4524" 0x00007fc46edd8ad3 in ?? ()
52 LWP 4525 "rpc worker-4525" 0x00007fc46edd8ad3 in ?? ()
53 LWP 4526 "rpc worker-4526" 0x00007fc46edd8ad3 in ?? ()
54 LWP 4527 "rpc worker-4527" 0x00007fc46edd8ad3 in ?? ()
55 LWP 4528 "rpc worker-4528" 0x00007fc46edd8ad3 in ?? ()
56 LWP 4529 "rpc worker-4529" 0x00007fc46edd8ad3 in ?? ()
57 LWP 4530 "rpc worker-4530" 0x00007fc46edd8ad3 in ?? ()
58 LWP 4531 "rpc worker-4531" 0x00007fc46edd8ad3 in ?? ()
59 LWP 4532 "rpc worker-4532" 0x00007fc46edd8ad3 in ?? ()
60 LWP 4533 "rpc worker-4533" 0x00007fc46edd8ad3 in ?? ()
61 LWP 4534 "rpc worker-4534" 0x00007fc46edd8ad3 in ?? ()
62 LWP 4535 "rpc worker-4535" 0x00007fc46edd8ad3 in ?? ()
63 LWP 4536 "rpc worker-4536" 0x00007fc46edd8ad3 in ?? ()
64 LWP 4537 "rpc worker-4537" 0x00007fc46edd8ad3 in ?? ()
65 LWP 4538 "rpc worker-4538" 0x00007fc46edd8ad3 in ?? ()
66 LWP 4539 "rpc worker-4539" 0x00007fc46edd8ad3 in ?? ()
67 LWP 4540 "rpc worker-4540" 0x00007fc46edd8ad3 in ?? ()
68 LWP 4541 "rpc worker-4541" 0x00007fc46edd8ad3 in ?? ()
69 LWP 4542 "rpc worker-4542" 0x00007fc46edd8ad3 in ?? ()
70 LWP 4543 "rpc worker-4543" 0x00007fc46edd8ad3 in ?? ()
71 LWP 4544 "rpc worker-4544" 0x00007fc46edd8ad3 in ?? ()
72 LWP 4545 "rpc worker-4545" 0x00007fc46edd8ad3 in ?? ()
73 LWP 4546 "rpc worker-4546" 0x00007fc46edd8ad3 in ?? ()
74 LWP 4547 "rpc worker-4547" 0x00007fc46edd8ad3 in ?? ()
75 LWP 4548 "rpc worker-4548" 0x00007fc46edd8ad3 in ?? ()
76 LWP 4549 "rpc worker-4549" 0x00007fc46edd8ad3 in ?? ()
77 LWP 4550 "rpc worker-4550" 0x00007fc46edd8ad3 in ?? ()
78 LWP 4551 "rpc worker-4551" 0x00007fc46edd8ad3 in ?? ()
79 LWP 4552 "rpc worker-4552" 0x00007fc46edd8ad3 in ?? ()
80 LWP 4553 "rpc worker-4553" 0x00007fc46edd8ad3 in ?? ()
81 LWP 4554 "rpc worker-4554" 0x00007fc46edd8ad3 in ?? ()
82 LWP 4555 "rpc worker-4555" 0x00007fc46edd8ad3 in ?? ()
83 LWP 4556 "rpc worker-4556" 0x00007fc46edd8ad3 in ?? ()
84 LWP 4557 "rpc worker-4557" 0x00007fc46edd8ad3 in ?? ()
85 LWP 4558 "rpc worker-4558" 0x00007fc46edd8ad3 in ?? ()
86 LWP 4559 "rpc worker-4559" 0x00007fc46edd8ad3 in ?? ()
87 LWP 4560 "rpc worker-4560" 0x00007fc46edd8ad3 in ?? ()
88 LWP 4561 "rpc worker-4561" 0x00007fc46edd8ad3 in ?? ()
89 LWP 4562 "rpc worker-4562" 0x00007fc46edd8ad3 in ?? ()
90 LWP 4563 "rpc worker-4563" 0x00007fc46edd8ad3 in ?? ()
91 LWP 4564 "rpc worker-4564" 0x00007fc46edd8ad3 in ?? ()
92 LWP 4565 "rpc worker-4565" 0x00007fc46edd8ad3 in ?? ()
93 LWP 4566 "rpc worker-4566" 0x00007fc46edd8ad3 in ?? ()
94 LWP 4567 "rpc worker-4567" 0x00007fc46edd8ad3 in ?? ()
95 LWP 4568 "rpc worker-4568" 0x00007fc46edd8ad3 in ?? ()
96 LWP 4569 "rpc worker-4569" 0x00007fc46edd8ad3 in ?? ()
97 LWP 4570 "rpc worker-4570" 0x00007fc46edd8ad3 in ?? ()
98 LWP 4571 "rpc worker-4571" 0x00007fc46edd8ad3 in ?? ()
99 LWP 4572 "rpc worker-4572" 0x00007fc46edd8ad3 in ?? ()
100 LWP 4573 "rpc worker-4573" 0x00007fc46edd8ad3 in ?? ()
101 LWP 4574 "rpc worker-4574" 0x00007fc46edd8ad3 in ?? ()
102 LWP 4575 "rpc worker-4575" 0x00007fc46edd8ad3 in ?? ()
103 LWP 4576 "rpc worker-4576" 0x00007fc46edd8ad3 in ?? ()
104 LWP 4577 "rpc worker-4577" 0x00007fc46edd8ad3 in ?? ()
105 LWP 4578 "rpc worker-4578" 0x00007fc46edd8ad3 in ?? ()
106 LWP 4579 "rpc worker-4579" 0x00007fc46edd8ad3 in ?? ()
107 LWP 4580 "rpc worker-4580" 0x00007fc46edd8ad3 in ?? ()
108 LWP 4581 "rpc worker-4581" 0x00007fc46edd8ad3 in ?? ()
109 LWP 4582 "rpc worker-4582" 0x00007fc46edd8ad3 in ?? ()
110 LWP 4583 "rpc worker-4583" 0x00007fc46edd8ad3 in ?? ()
111 LWP 4584 "rpc worker-4584" 0x00007fc46edd8ad3 in ?? ()
112 LWP 4585 "rpc worker-4585" 0x00007fc46edd8ad3 in ?? ()
113 LWP 4586 "rpc worker-4586" 0x00007fc46edd8ad3 in ?? ()
114 LWP 4587 "rpc worker-4587" 0x00007fc46edd8ad3 in ?? ()
115 LWP 4588 "rpc worker-4588" 0x00007fc46edd8ad3 in ?? ()
116 LWP 4589 "rpc worker-4589" 0x00007fc46edd8ad3 in ?? ()
117 LWP 4590 "diag-logger-459" 0x00007fc46edd8fb9 in ?? ()
118 LWP 4591 "result-tracker-" 0x00007fc46edd8fb9 in ?? ()
119 LWP 4592 "excess-log-dele" 0x00007fc46edd8fb9 in ?? ()
120 LWP 4593 "acceptor-4593" 0x00007fc4678fdfc7 in ?? ()
121 LWP 4594 "heartbeat-4594" 0x00007fc46edd8fb9 in ?? ()
122 LWP 4595 "maintenance_sch" 0x00007fc46edd8fb9 in ?? ()
Thread 122 (LWP 4595):
#0 0x00007fc46edd8fb9 in ?? ()
#1 0x00007fc423394700 in ?? ()
#2 0x0000000000000053 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x0000616000016ca0 in ?? ()
#5 0x00007fc423394750 in ?? ()
#6 0x00000000000000a6 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 121 (LWP 4594):
#0 0x00007fc46edd8fb9 in ?? ()
#1 0xe2b340df1b29b749 in ?? ()
#2 0x0000000000000015 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061300001bc40 in ?? ()
#5 0x00007fc423bac610 in ?? ()
#6 0x000000000000002a in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 120 (LWP 4593):
#0 0x00007fc4678fdfc7 in ?? ()
#1 0x00006140000222a8 in ?? ()
#2 0x00007fc4243d3d70 in ?? ()
#3 0x00007fc4243d3da0 in ?? ()
#4 0x00007fc4243d3ea0 in ?? ()
#5 0x00007fc4243d3d90 in ?? ()
#6 0x00007fc4243d3e00 in ?? ()
#7 0x0000000000000080 in ?? ()
#8 0x00000000008d957b in __sanitizer::theDepot ()
#9 0x0000000500000014 in ?? ()
#10 0x00007fc4243d3f20 in ?? ()
#11 0x00007fc4243d365c in ?? ()
#12 0x00000032243d35d0 in ?? ()
#13 0x00007fc423bd7000 in ?? ()
#14 0x0000000000000000 in ?? ()
Thread 119 (LWP 4592):
#0 0x00007fc46edd8fb9 in ?? ()
#1 0x00007fc424becf60 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 118 (LWP 4591):
#0 0x00007fc46edd8fb9 in ?? ()
#1 0x00007fc425406120 in ?? ()
#2 0x0000000000000015 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061100008caf0 in ?? ()
#5 0x00007fc425406110 in ?? ()
#6 0x000000000000002a in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 117 (LWP 4590):
#0 0x00007fc46edd8fb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 116 (LWP 4589):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000008 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d0002b6848 in ?? ()
#4 0x00007fc426435ef0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fc426435f10 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 115 (LWP 4588):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000004 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d0002b0048 in ?? ()
#4 0x00007fc426c4def0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fc426c4df10 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 114 (LWP 4587):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 113 (LWP 4586):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 112 (LWP 4585):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 111 (LWP 4584):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 110 (LWP 4583):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 109 (LWP 4582):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 108 (LWP 4581):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 107 (LWP 4580):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 106 (LWP 4579):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 105 (LWP 4578):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 104 (LWP 4577):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 103 (LWP 4576):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 102 (LWP 4575):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 101 (LWP 4574):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 100 (LWP 4573):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 99 (LWP 4572):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 98 (LWP 4571):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 97 (LWP 4570):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 96 (LWP 4569):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 95 (LWP 4568):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 94 (LWP 4567):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 93 (LWP 4566):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 92 (LWP 4565):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 91 (LWP 4564):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 90 (LWP 4563):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 89 (LWP 4562):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 88 (LWP 4561):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 87 (LWP 4560):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 86 (LWP 4559):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 85 (LWP 4558):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 84 (LWP 4557):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 83 (LWP 4556):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 82 (LWP 4555):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 81 (LWP 4554):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 80 (LWP 4553):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 79 (LWP 4552):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 78 (LWP 4551):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 77 (LWP 4550):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 76 (LWP 4549):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000229 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d0001ad08c in ?? ()
#4 0x00007fc43a806ef0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fc43a806f10 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0001ad040 in ?? ()
#9 0x00007fc46edd8770 in ?? ()
#10 0x00007fc43a806f10 in ?? ()
#11 0x00007fc43a806ed0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 75 (LWP 4548):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x00000000000001e5 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d0001a688c in ?? ()
#4 0x00007fc43b01eef0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fc43b01ef10 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0001a6840 in ?? ()
#9 0x00007fc46edd8770 in ?? ()
#10 0x00007fc43b01ef10 in ?? ()
#11 0x00007fc43b01eed0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 74 (LWP 4547):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x000000000000000e in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d0001a0088 in ?? ()
#4 0x00007fc43b836ef0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fc43b836f10 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 73 (LWP 4546):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 72 (LWP 4545):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 71 (LWP 4544):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 70 (LWP 4543):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 69 (LWP 4542):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 68 (LWP 4541):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 67 (LWP 4540):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 66 (LWP 4539):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 65 (LWP 4538):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 64 (LWP 4537):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 63 (LWP 4536):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 62 (LWP 4535):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 61 (LWP 4534):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 60 (LWP 4533):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 59 (LWP 4532):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 58 (LWP 4531):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 57 (LWP 4530):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 56 (LWP 4529):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000003 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00012683c in ?? ()
#4 0x00007fc4449e7ef0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fc4449e7f10 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0001267f0 in ?? ()
#9 0x00007fc46edd8770 in ?? ()
#10 0x00007fc4449e7f10 in ?? ()
#11 0x00007fc4449e7ed0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 55 (LWP 4528):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 54 (LWP 4527):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 53 (LWP 4526):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 52 (LWP 4525):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 51 (LWP 4524):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 50 (LWP 4523):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 49 (LWP 4522):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 48 (LWP 4521):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 47 (LWP 4520):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 46 (LWP 4519):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 45 (LWP 4518):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 44 (LWP 4517):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 43 (LWP 4516):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 42 (LWP 4515):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 41 (LWP 4514):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 40 (LWP 4513):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 39 (LWP 4512):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 38 (LWP 4511):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 37 (LWP 4510):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 36 (LWP 4509):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000021 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d0000a67ec in ?? ()
#4 0x00007fc44ebc8ef0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fc44ebc8f10 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0000a67a0 in ?? ()
#9 0x00007fc46edd8770 in ?? ()
#10 0x00007fc44ebc8f10 in ?? ()
#11 0x00007fc44ebc8ed0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 35 (LWP 4508):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000049 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00009ffec in ?? ()
#4 0x00007fc44f3e0ef0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fc44f3e0f10 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d00009ffa0 in ?? ()
#9 0x00007fc46edd8770 in ?? ()
#10 0x00007fc44f3e0f10 in ?? ()
#11 0x00007fc44f3e0ed0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 34 (LWP 4507):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 33 (LWP 4506):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 32 (LWP 4505):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 31 (LWP 4504):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 30 (LWP 4503):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 29 (LWP 4502):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 28 (LWP 4501):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 27 (LWP 4500):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 26 (LWP 4499):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 25 (LWP 4498):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 24 (LWP 4497):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 23 (LWP 4496):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 22 (LWP 4495):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 21 (LWP 4494):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 20 (LWP 4493):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 19 (LWP 4492):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 18 (LWP 4491):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 17 (LWP 4490):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 16 (LWP 4489):
#0 0x00007fc46edd8fb9 in ?? ()
#1 0x00007fc458dddce0 in ?? ()
#2 0x0000000000000002 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061300001cbe0 in ?? ()
#5 0x00007fc458dddcd0 in ?? ()
#6 0x0000000000000004 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 15 (LWP 4488):
#0 0x00007fc46edd8fb9 in ?? ()
#1 0x4008000000000000 in ?? ()
#2 0x0000000000000004 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061200001fe98 in ?? ()
#5 0x00007fc459616270 in ?? ()
#6 0x0000000000000008 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 14 (LWP 4486):
#0 0x00007fc46edd8fb9 in ?? ()
#1 0x00007fc45a663260 in ?? ()
#2 0x0000000000000002 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061800000c9a8 in ?? ()
#5 0x00007fc45a663250 in ?? ()
#6 0x0000000000000004 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 13 (LWP 4485):
#0 0x00007fc46edd8ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 12 (LWP 4484):
#0 0x00007fc4678fc947 in ?? ()
#1 0x00007fc45b6b2340 in ?? ()
#2 0x000061a00000c680 in ?? ()
#3 0x00007fc45b6b2330 in ?? ()
#4 0x00007fc45b6b2540 in ?? ()
#5 0x00007fc45b6b2380 in ?? ()
#6 0x0000614000022298 in ?? ()
#7 0x00007fc45b6b2400 in ?? ()
#8 0x00007fc469f7125d in ?? ()
#9 0x3fb95d1bd3ba3000 in ?? ()
#10 0x000061a00000c680 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000c680 in ?? ()
#13 0x0000000072726e80 in ?? ()
#14 0x00007fc400000000 in ?? ()
#15 0x41da7de9d0230c86 in ?? ()
#16 0x00000ff90b6ce480 in ?? ()
#17 0x00007fc45b6b23e0 in ?? ()
#18 0x00007fc469f75ba3 in ?? ()
#19 0x00007fc45b6b23b0 in ?? ()
#20 0x3fb95d1bd3ba3000 in ?? ()
#21 0x000000005b6b2400 in ?? ()
#22 0x000061a00000c680 in ?? ()
#23 0x0000614000022298 in ?? ()
#24 0x3fb95d1bd3ba3000 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 11 (LWP 4483):
#0 0x00007fc4678fc947 in ?? ()
#1 0x00007fc45beb3340 in ?? ()
#2 0x000061a00000c080 in ?? ()
#3 0x00007fc45beb3330 in ?? ()
#4 0x00007fc45beb3540 in ?? ()
#5 0x00007fc45beb3380 in ?? ()
#6 0x0000614000022098 in ?? ()
#7 0x00007fc45beb3400 in ?? ()
#8 0x00007fc469f7125d in ?? ()
#9 0x3fb97564f5c22000 in ?? ()
#10 0x000061a00000c080 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000c080 in ?? ()
#13 0x0000000072726e80 in ?? ()
#14 0x00007fc400000000 in ?? ()
#15 0x41da7de9d0230c82 in ?? ()
#16 0x00000ff90b7ce680 in ?? ()
#17 0x00007fc45beb33e0 in ?? ()
#18 0x00007fc469f75ba3 in ?? ()
#19 0x00007fc45beb33b0 in ?? ()
#20 0x3fb97564f5c22000 in ?? ()
#21 0x000000005beb3400 in ?? ()
#22 0x000061a00000c080 in ?? ()
#23 0x0000614000022098 in ?? ()
#24 0x3fb97564f5c22000 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 10 (LWP 4482):
#0 0x00007fc4678fc947 in ?? ()
#1 0x00007fc45c6b4340 in ?? ()
#2 0x000061a00000ba80 in ?? ()
#3 0x00007fc45c6b4330 in ?? ()
#4 0x00007fc45c6b4540 in ?? ()
#5 0x00007fc45c6b4380 in ?? ()
#6 0x0000614000021e98 in ?? ()
#7 0x00007fc45c6b4400 in ?? ()
#8 0x00007fc469f7125d in ?? ()
#9 0x3fb969f7eb63d000 in ?? ()
#10 0x000061a00000ba80 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000ba80 in ?? ()
#13 0x0000000072726e80 in ?? ()
#14 0x00007fc400000000 in ?? ()
#15 0x41da7de9d0230c84 in ?? ()
#16 0x00000ff90b8ce880 in ?? ()
#17 0x00007fc45c6b43e0 in ?? ()
#18 0x00007fc469f75ba3 in ?? ()
#19 0x00007fc45c6b43b0 in ?? ()
#20 0x3fb969f7eb63d000 in ?? ()
#21 0x000000005c6b4400 in ?? ()
#22 0x000061a00000ba80 in ?? ()
#23 0x0000614000021e98 in ?? ()
#24 0x3fb969f7eb63d000 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 9 (LWP 4481):
#0 0x00007fc4678fc947 in ?? ()
#1 0x00007fc45e6ad340 in ?? ()
#2 0x000061a00000b480 in ?? ()
#3 0x00007fc45e6ad330 in ?? ()
#4 0x00007fc45e6ad540 in ?? ()
#5 0x00007fc45e6ad380 in ?? ()
#6 0x0000614000021c98 in ?? ()
#7 0x00007fc45e6ad400 in ?? ()
#8 0x00007fc469f7125d in ?? ()
#9 0x3fb9654dd9fa5000 in ?? ()
#10 0x000061a00000b480 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000b480 in ?? ()
#13 0x0000000072726e80 in ?? ()
#14 0x00007fc400000000 in ?? ()
#15 0x41da7de9d0230c87 in ?? ()
#16 0x00000ff90bccda80 in ?? ()
#17 0x00007fc45e6ad3e0 in ?? ()
#18 0x00007fc469f75ba3 in ?? ()
#19 0x0000000000000000 in ?? ()
Thread 8 (LWP 4478):
#0 0x00007fc4678efbb9 in ?? ()
#1 0x00000000000000c8 in ?? ()
#2 0x00007fc4600b77b8 in ?? ()
#3 0x0000602000020510 in ?? ()
#4 0x0000000000000002 in ?? ()
#5 0x00000000000000c8 in ?? ()
#6 0x00000000008d11c1 in __sanitizer::theDepot ()
#7 0x0000000000000000 in ?? ()
Thread 7 (LWP 4477):
#0 0x00007fc46edd8fb9 in ?? ()
#1 0x00007fc45f8b60e0 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 6 (LWP 4476):
#0 0x00007fc46eddc9e2 in ?? ()
#1 0x00007fc45f0b3bc0 in ?? ()
#2 0x00007fc45f0b3c60 in ?? ()
#3 0x000000000000001e in ?? ()
#4 0x0000000000000030 in ?? ()
#5 0x00007fc45f0b3c10 in ?? ()
#6 0x00000000017d0860 in ?? ()
#7 0x00007fc45f0b3c70 in ?? ()
#8 0x000061100008d450 in ?? ()
#9 0x00007fc45f0b3c60 in ?? ()
#10 0x00000000008cb6b7 in __sanitizer::theDepot ()
#11 0x00007fc474789bfc in ?? ()
#12 0x00007fc474779209 in ?? ()
#13 0x00007fc47477d7f6 in ?? ()
#14 0x00007fc474782230 in ?? ()
#15 0x00007fc474782059 in ?? ()
#16 0x0000000000aa4cad in __sanitizer::theDepot ()
#17 0x00007fc46b7e4529 in ?? ()
#18 0x00007fc46edd26db in ?? ()
#19 0x00000ff90be0e688 in ?? ()
#20 0x00007fc45f0b3460 in ?? ()
#21 0x0000000000000000 in ?? ()
Thread 5 (LWP 4470):
#0 0x00007fc46edd8fb9 in ?? ()
#1 0x00007fc4610b8ca0 in ?? ()
#2 0x0000000000000069 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061200000c728 in ?? ()
#5 0x00007fc4610b8c90 in ?? ()
#6 0x00000000000000d2 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 4 (LWP 4469):
#0 0x00007fc46edd8fb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 3 (LWP 4468):
#0 0x00007fc46edd8fb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 2 (LWP 4467):
#0 0x00007fc46edd8fb9 in ?? ()
#1 0x5f5347414c46000a in ?? ()
#2 0x0000000000000002 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x0000612000012b38 in ?? ()
#5 0x00007fc4628bc450 in ?? ()
#6 0x0000000000000004 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 1 (LWP 4465):
#0 0x00007fc46eddcd50 in ?? ()
#1 0x0000000000000000 in ?? ()
************************* END STACKS ***************************
I20260503 19:57:26.723582 420 external_mini_cluster-itest-base.cc:86] Attempting to dump stacks of TS 3 with UUID 24488daee7104583a6f986a6ae3f8fe0 and pid 4328
************************ BEGIN STACKS **************************
[New LWP 4330]
[New LWP 4331]
[New LWP 4332]
[New LWP 4333]
[New LWP 4339]
[New LWP 4340]
[New LWP 4341]
[New LWP 4344]
[New LWP 4345]
[New LWP 4346]
[New LWP 4347]
[New LWP 4348]
[New LWP 4349]
[New LWP 4351]
[New LWP 4352]
[New LWP 4353]
[New LWP 4354]
[New LWP 4355]
[New LWP 4356]
[New LWP 4357]
[New LWP 4358]
[New LWP 4359]
[New LWP 4360]
[New LWP 4361]
[New LWP 4362]
[New LWP 4363]
[New LWP 4364]
[New LWP 4365]
[New LWP 4366]
[New LWP 4367]
[New LWP 4368]
[New LWP 4369]
[New LWP 4370]
[New LWP 4371]
[New LWP 4372]
[New LWP 4373]
[New LWP 4374]
[New LWP 4375]
[New LWP 4376]
[New LWP 4377]
[New LWP 4378]
[New LWP 4379]
[New LWP 4380]
[New LWP 4381]
[New LWP 4382]
[New LWP 4383]
[New LWP 4384]
[New LWP 4385]
[New LWP 4386]
[New LWP 4387]
[New LWP 4388]
[New LWP 4389]
[New LWP 4390]
[New LWP 4391]
[New LWP 4392]
[New LWP 4393]
[New LWP 4394]
[New LWP 4395]
[New LWP 4396]
[New LWP 4397]
[New LWP 4398]
[New LWP 4399]
[New LWP 4400]
[New LWP 4401]
[New LWP 4402]
[New LWP 4403]
[New LWP 4404]
[New LWP 4405]
[New LWP 4406]
[New LWP 4407]
[New LWP 4408]
[New LWP 4409]
[New LWP 4410]
[New LWP 4411]
[New LWP 4412]
[New LWP 4413]
[New LWP 4414]
[New LWP 4415]
[New LWP 4416]
[New LWP 4417]
[New LWP 4418]
[New LWP 4419]
[New LWP 4420]
[New LWP 4421]
[New LWP 4422]
[New LWP 4423]
[New LWP 4424]
[New LWP 4425]
[New LWP 4426]
[New LWP 4427]
[New LWP 4428]
[New LWP 4429]
[New LWP 4430]
[New LWP 4431]
[New LWP 4432]
[New LWP 4433]
[New LWP 4434]
[New LWP 4435]
[New LWP 4436]
[New LWP 4437]
[New LWP 4438]
[New LWP 4439]
[New LWP 4440]
[New LWP 4441]
[New LWP 4442]
[New LWP 4443]
[New LWP 4444]
[New LWP 4445]
[New LWP 4446]
[New LWP 4447]
[New LWP 4448]
[New LWP 4449]
[New LWP 4450]
[New LWP 4451]
[New LWP 4452]
[New LWP 4453]
[New LWP 4454]
[New LWP 4455]
[New LWP 4456]
[New LWP 4457]
[New LWP 4458]
[New LWP 4848]
Cannot access memory at address 0x20666f2074756f28
Cannot access memory at address 0x20666f2074756f20
Cannot access memory at address 0x20666f2074756f28
Cannot access memory at address 0x20666f2074756f28
Cannot access memory at address 0x20666f2074756f20
0x00007fdee2227d50 in ?? ()
Id Target Id Frame
* 1 LWP 4328 "kudu" 0x00007fdee2227d50 in ?? ()
2 LWP 4330 "kudu" 0x00007fdee2223fb9 in ?? ()
3 LWP 4331 "kudu" 0x00007fdee2223fb9 in ?? ()
4 LWP 4332 "kudu" 0x00007fdee2223fb9 in ?? ()
5 LWP 4333 "kernel-watcher-" 0x00007fdee2223fb9 in ?? ()
6 LWP 4339 "ntp client-4339" 0x00007fdee22279e2 in ?? ()
7 LWP 4340 "file cache-evic" 0x00007fdee2223fb9 in ?? ()
8 LWP 4341 "sq_acceptor" 0x00007fdedad3abb9 in ?? ()
9 LWP 4344 "rpc reactor-434" 0x00007fdedad47947 in ?? ()
10 LWP 4345 "rpc reactor-434" 0x00007fdedad47947 in ?? ()
11 LWP 4346 "rpc reactor-434" 0x00007fdedad47947 in ?? ()
12 LWP 4347 "rpc reactor-434" 0x00007fdedad47947 in ?? ()
13 LWP 4348 "MaintenanceMgr " 0x00007fdee2223ad3 in ?? ()
14 LWP 4349 "txn-status-mana" 0x00007fdee2223fb9 in ?? ()
15 LWP 4351 "collect_and_rem" 0x00007fdee2223fb9 in ?? ()
16 LWP 4352 "tc-session-exp-" 0x00007fdee2223fb9 in ?? ()
17 LWP 4353 "rpc worker-4353" 0x00007fdee2223ad3 in ?? ()
18 LWP 4354 "rpc worker-4354" 0x00007fdee2223ad3 in ?? ()
19 LWP 4355 "rpc worker-4355" 0x00007fdee2223ad3 in ?? ()
20 LWP 4356 "rpc worker-4356" 0x00007fdee2223ad3 in ?? ()
21 LWP 4357 "rpc worker-4357" 0x00007fdee2223ad3 in ?? ()
22 LWP 4358 "rpc worker-4358" 0x00007fdee2223ad3 in ?? ()
23 LWP 4359 "rpc worker-4359" 0x00007fdee2223ad3 in ?? ()
24 LWP 4360 "rpc worker-4360" 0x00007fdee2223ad3 in ?? ()
25 LWP 4361 "rpc worker-4361" 0x00007fdee2223ad3 in ?? ()
26 LWP 4362 "rpc worker-4362" 0x00007fdee2223ad3 in ?? ()
27 LWP 4363 "rpc worker-4363" 0x00007fdee2223ad3 in ?? ()
28 LWP 4364 "rpc worker-4364" 0x00007fdee2223ad3 in ?? ()
29 LWP 4365 "rpc worker-4365" 0x00007fdee2223ad3 in ?? ()
30 LWP 4366 "rpc worker-4366" 0x00007fdee2223ad3 in ?? ()
31 LWP 4367 "rpc worker-4367" 0x00007fdee2223ad3 in ?? ()
32 LWP 4368 "rpc worker-4368" 0x00007fdee2223ad3 in ?? ()
33 LWP 4369 "rpc worker-4369" 0x00007fdee2223ad3 in ?? ()
34 LWP 4370 "rpc worker-4370" 0x00007fdee2223ad3 in ?? ()
35 LWP 4371 "rpc worker-4371" 0x00007fdee2223ad3 in ?? ()
36 LWP 4372 "rpc worker-4372" 0x00007fdee2223ad3 in ?? ()
37 LWP 4373 "rpc worker-4373" 0x00007fdee2223ad3 in ?? ()
38 LWP 4374 "rpc worker-4374" 0x00007fdee2223ad3 in ?? ()
39 LWP 4375 "rpc worker-4375" 0x00007fdee2223ad3 in ?? ()
40 LWP 4376 "rpc worker-4376" 0x00007fdee2223ad3 in ?? ()
41 LWP 4377 "rpc worker-4377" 0x00007fdee2223ad3 in ?? ()
42 LWP 4378 "rpc worker-4378" 0x00007fdee2223ad3 in ?? ()
43 LWP 4379 "rpc worker-4379" 0x00007fdee2223ad3 in ?? ()
44 LWP 4380 "rpc worker-4380" 0x00007fdee2223ad3 in ?? ()
45 LWP 4381 "rpc worker-4381" 0x00007fdee2223ad3 in ?? ()
46 LWP 4382 "rpc worker-4382" 0x00007fdee2223ad3 in ?? ()
47 LWP 4383 "rpc worker-4383" 0x00007fdee2223ad3 in ?? ()
48 LWP 4384 "rpc worker-4384" 0x00007fdee2223ad3 in ?? ()
49 LWP 4385 "rpc worker-4385" 0x00007fdee2223ad3 in ?? ()
50 LWP 4386 "rpc worker-4386" 0x00007fdee2223ad3 in ?? ()
51 LWP 4387 "rpc worker-4387" 0x00007fdee2223ad3 in ?? ()
52 LWP 4388 "rpc worker-4388" 0x00007fdee2223ad3 in ?? ()
53 LWP 4389 "rpc worker-4389" 0x00007fdee2223ad3 in ?? ()
54 LWP 4390 "rpc worker-4390" 0x00007fdee2223ad3 in ?? ()
55 LWP 4391 "rpc worker-4391" 0x00007fdee2223ad3 in ?? ()
56 LWP 4392 "rpc worker-4392" 0x00007fdee2223ad3 in ?? ()
57 LWP 4393 "rpc worker-4393" 0x00007fdee2223ad3 in ?? ()
58 LWP 4394 "rpc worker-4394" 0x00007fdee2223ad3 in ?? ()
59 LWP 4395 "rpc worker-4395" 0x00007fdee2223ad3 in ?? ()
60 LWP 4396 "rpc worker-4396" 0x00007fdee2223ad3 in ?? ()
61 LWP 4397 "rpc worker-4397" 0x00007fdee2223ad3 in ?? ()
62 LWP 4398 "rpc worker-4398" 0x00007fdee2223ad3 in ?? ()
63 LWP 4399 "rpc worker-4399" 0x00007fdee2223ad3 in ?? ()
64 LWP 4400 "rpc worker-4400" 0x00007fdee2223ad3 in ?? ()
65 LWP 4401 "rpc worker-4401" 0x00007fdee2223ad3 in ?? ()
66 LWP 4402 "rpc worker-4402" 0x00007fdee2223ad3 in ?? ()
67 LWP 4403 "rpc worker-4403" 0x00007fdee2223ad3 in ?? ()
68 LWP 4404 "rpc worker-4404" 0x00007fdee2223ad3 in ?? ()
69 LWP 4405 "rpc worker-4405" 0x00007fdee2223ad3 in ?? ()
70 LWP 4406 "rpc worker-4406" 0x00007fdee2223ad3 in ?? ()
71 LWP 4407 "rpc worker-4407" 0x00007fdee2223ad3 in ?? ()
72 LWP 4408 "rpc worker-4408" 0x00007fdee2223ad3 in ?? ()
73 LWP 4409 "rpc worker-4409" 0x00007fdee2223ad3 in ?? ()
74 LWP 4410 "rpc worker-4410" 0x00007fdee2223ad3 in ?? ()
75 LWP 4411 "rpc worker-4411" 0x00007fdee2223ad3 in ?? ()
76 LWP 4412 "rpc worker-4412" 0x00007fdee2223ad3 in ?? ()
77 LWP 4413 "rpc worker-4413" 0x00007fdee2223ad3 in ?? ()
78 LWP 4414 "rpc worker-4414" 0x00007fdee2223ad3 in ?? ()
79 LWP 4415 "rpc worker-4415" 0x00007fdee2223ad3 in ?? ()
80 LWP 4416 "rpc worker-4416" 0x00007fdee2223ad3 in ?? ()
81 LWP 4417 "rpc worker-4417" 0x00007fdee2223ad3 in ?? ()
82 LWP 4418 "rpc worker-4418" 0x00007fdee2223ad3 in ?? ()
83 LWP 4419 "rpc worker-4419" 0x00007fdee2223ad3 in ?? ()
84 LWP 4420 "rpc worker-4420" 0x00007fdee2223ad3 in ?? ()
85 LWP 4421 "rpc worker-4421" 0x00007fdee2223ad3 in ?? ()
86 LWP 4422 "rpc worker-4422" 0x00007fdee2223ad3 in ?? ()
87 LWP 4423 "rpc worker-4423" 0x00007fdee2223ad3 in ?? ()
88 LWP 4424 "rpc worker-4424" 0x00007fdee2223ad3 in ?? ()
89 LWP 4425 "rpc worker-4425" 0x00007fdee2223ad3 in ?? ()
90 LWP 4426 "rpc worker-4426" 0x00007fdee2223ad3 in ?? ()
91 LWP 4427 "rpc worker-4427" 0x00007fdee2223ad3 in ?? ()
92 LWP 4428 "rpc worker-4428" 0x00007fdee2223ad3 in ?? ()
93 LWP 4429 "rpc worker-4429" 0x00007fdee2223ad3 in ?? ()
94 LWP 4430 "rpc worker-4430" 0x00007fdee2223ad3 in ?? ()
95 LWP 4431 "rpc worker-4431" 0x00007fdee2223ad3 in ?? ()
96 LWP 4432 "rpc worker-4432" 0x00007fdee2223ad3 in ?? ()
97 LWP 4433 "rpc worker-4433" 0x00007fdee2223ad3 in ?? ()
98 LWP 4434 "rpc worker-4434" 0x00007fdee2223ad3 in ?? ()
99 LWP 4435 "rpc worker-4435" 0x00007fdee2223ad3 in ?? ()
100 LWP 4436 "rpc worker-4436" 0x00007fdee2223ad3 in ?? ()
101 LWP 4437 "rpc worker-4437" 0x00007fdee2223ad3 in ?? ()
102 LWP 4438 "rpc worker-4438" 0x00007fdee2223ad3 in ?? ()
103 LWP 4439 "rpc worker-4439" 0x00007fdee2223ad3 in ?? ()
104 LWP 4440 "rpc worker-4440" 0x00007fdee2223ad3 in ?? ()
105 LWP 4441 "rpc worker-4441" 0x00007fdee2223ad3 in ?? ()
106 LWP 4442 "rpc worker-4442" 0x00007fdee2223ad3 in ?? ()
107 LWP 4443 "rpc worker-4443" 0x00007fdee2223ad3 in ?? ()
108 LWP 4444 "rpc worker-4444" 0x00007fdee2223ad3 in ?? ()
109 LWP 4445 "rpc worker-4445" 0x00007fdee2223ad3 in ?? ()
110 LWP 4446 "rpc worker-4446" 0x00007fdee2223ad3 in ?? ()
111 LWP 4447 "rpc worker-4447" 0x00007fdee2223ad3 in ?? ()
112 LWP 4448 "rpc worker-4448" 0x00007fdee2223ad3 in ?? ()
113 LWP 4449 "rpc worker-4449" 0x00007fdee2223ad3 in ?? ()
114 LWP 4450 "rpc worker-4450" 0x00007fdee2223ad3 in ?? ()
115 LWP 4451 "rpc worker-4451" 0x00007fdee2223ad3 in ?? ()
116 LWP 4452 "rpc worker-4452" 0x00007fdee2223ad3 in ?? ()
117 LWP 4453 "diag-logger-445" 0x00007fdee2223fb9 in ?? ()
118 LWP 4454 "result-tracker-" 0x00007fdee2223fb9 in ?? ()
119 LWP 4455 "excess-log-dele" 0x00007fdee2223fb9 in ?? ()
120 LWP 4456 "acceptor-4456" 0x00007fdedad48fc7 in ?? ()
121 LWP 4457 "heartbeat-4457" 0x00007fdee2223fb9 in ?? ()
122 LWP 4458 "maintenance_sch" 0x00007fdee2223fb9 in ?? ()
123 LWP 4848 "raft [worker]-4" 0x00007fdee2223fb9 in ?? ()
Thread 123 (LWP 4848):
#0 0x00007fdee2223fb9 in ?? ()
#1 0x0000000045e0360e in ?? ()
#2 0x00000000000001fc in ?? ()
#3 0x0000000100000081 in ?? ()
#4 0x00007fde91478bc4 in ?? ()
#5 0x00007fde91478850 in ?? ()
#6 0x00000000000003f9 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x00007fde91478870 in ?? ()
#9 0x0000000200000000 in ?? ()
#10 0x0000008000000189 in ?? ()
#11 0x0000000000000000 in ?? ()
Thread 122 (LWP 4458):
#0 0x00007fdee2223fb9 in ?? ()
#1 0x00007fde967df700 in ?? ()
#2 0x000000000000005b in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x0000616000016ca0 in ?? ()
#5 0x00007fde967df750 in ?? ()
#6 0x00000000000000b6 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 121 (LWP 4457):
#0 0x00007fdee2223fb9 in ?? ()
#1 0xe2b340df1b29b749 in ?? ()
#2 0x0000000000000019 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061300001bc40 in ?? ()
#5 0x00007fde96ff7610 in ?? ()
#6 0x0000000000000032 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 120 (LWP 4456):
#0 0x00007fdedad48fc7 in ?? ()
#1 0x0000614000021ca8 in ?? ()
#2 0x000000000092d55c in __sanitizer::theDepot ()
#3 0x00007fde9781eda0 in ?? ()
#4 0x00007fde9781eea0 in ?? ()
#5 0x00007fde9781ed90 in ?? ()
#6 0x00007fde9781ee00 in ?? ()
#7 0x0000000000000080 in ?? ()
#8 0x00000000008d957b in __sanitizer::theDepot ()
#9 0x0000000500000014 in ?? ()
#10 0x00007fde9781ef20 in ?? ()
#11 0x00007fde9781e65c in ?? ()
#12 0x000000329781e5d0 in ?? ()
#13 0x00007fde97022000 in ?? ()
#14 0x0000000000000000 in ?? ()
Thread 119 (LWP 4455):
#0 0x00007fdee2223fb9 in ?? ()
#1 0x00007fde98037f60 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 118 (LWP 4454):
#0 0x00007fdee2223fb9 in ?? ()
#1 0x00007fde98851120 in ?? ()
#2 0x0000000000000016 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061100008caf0 in ?? ()
#5 0x00007fde98851110 in ?? ()
#6 0x000000000000002c in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 117 (LWP 4453):
#0 0x00007fdee2223fb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 116 (LWP 4452):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x000000000000000c in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d0002b6848 in ?? ()
#4 0x00007fde99880ef0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fde99880f10 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 115 (LWP 4451):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 114 (LWP 4450):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 113 (LWP 4449):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 112 (LWP 4448):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 111 (LWP 4447):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 110 (LWP 4446):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 109 (LWP 4445):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 108 (LWP 4444):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 107 (LWP 4443):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 106 (LWP 4442):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 105 (LWP 4441):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 104 (LWP 4440):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 103 (LWP 4439):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 102 (LWP 4438):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 101 (LWP 4437):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 100 (LWP 4436):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 99 (LWP 4435):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 98 (LWP 4434):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 97 (LWP 4433):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 96 (LWP 4432):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 95 (LWP 4431):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 94 (LWP 4430):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 93 (LWP 4429):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 92 (LWP 4428):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 91 (LWP 4427):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 90 (LWP 4426):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 89 (LWP 4425):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 88 (LWP 4424):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 87 (LWP 4423):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 86 (LWP 4422):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 85 (LWP 4421):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 84 (LWP 4420):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 83 (LWP 4419):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 82 (LWP 4418):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 81 (LWP 4417):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 80 (LWP 4416):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 79 (LWP 4415):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 78 (LWP 4414):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 77 (LWP 4413):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 76 (LWP 4412):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000005 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d0001ad08c in ?? ()
#4 0x00007fdeadc51ef0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fdeadc51f10 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0001ad040 in ?? ()
#9 0x00007fdee2223770 in ?? ()
#10 0x00007fdeadc51f10 in ?? ()
#11 0x00007fdeadc51ed0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 75 (LWP 4411):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 74 (LWP 4410):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 73 (LWP 4409):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 72 (LWP 4408):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 71 (LWP 4407):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 70 (LWP 4406):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 69 (LWP 4405):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 68 (LWP 4404):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 67 (LWP 4403):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 66 (LWP 4402):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 65 (LWP 4401):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 64 (LWP 4400):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 63 (LWP 4399):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 62 (LWP 4398):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 61 (LWP 4397):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 60 (LWP 4396):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 59 (LWP 4395):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 58 (LWP 4394):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 57 (LWP 4393):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 56 (LWP 4392):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000003 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00012683c in ?? ()
#4 0x00007fdeb7e32ef0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fdeb7e32f10 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0001267f0 in ?? ()
#9 0x00007fdee2223770 in ?? ()
#10 0x00007fdeb7e32f10 in ?? ()
#11 0x00007fdeb7e32ed0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 55 (LWP 4391):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 54 (LWP 4390):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 53 (LWP 4389):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 52 (LWP 4388):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 51 (LWP 4387):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 50 (LWP 4386):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 49 (LWP 4385):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 48 (LWP 4384):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 47 (LWP 4383):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 46 (LWP 4382):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 45 (LWP 4381):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 44 (LWP 4380):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 43 (LWP 4379):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 42 (LWP 4378):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 41 (LWP 4377):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 40 (LWP 4376):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 39 (LWP 4375):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 38 (LWP 4374):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 37 (LWP 4373):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 36 (LWP 4372):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000136 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d0000a67e8 in ?? ()
#4 0x00007fdec2013ef0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fdec2013f10 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 35 (LWP 4371):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000120 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d00009ffe8 in ?? ()
#4 0x00007fdec282bef0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fdec282bf10 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 34 (LWP 4370):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000149 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d0000967fc in ?? ()
#4 0x00007fdec3043ef0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fdec3043f10 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0000967b0 in ?? ()
#9 0x00007fdee2223770 in ?? ()
#10 0x00007fdec3043f10 in ?? ()
#11 0x00007fdec3043ed0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 33 (LWP 4369):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 32 (LWP 4368):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 31 (LWP 4367):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 30 (LWP 4366):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 29 (LWP 4365):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 28 (LWP 4364):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 27 (LWP 4363):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 26 (LWP 4362):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 25 (LWP 4361):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 24 (LWP 4360):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 23 (LWP 4359):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 22 (LWP 4358):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 21 (LWP 4357):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 20 (LWP 4356):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 19 (LWP 4355):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 18 (LWP 4354):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 17 (LWP 4353):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 16 (LWP 4352):
#0 0x00007fdee2223fb9 in ?? ()
#1 0x00007fdecc228ce0 in ?? ()
#2 0x0000000000000002 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061300001cbe0 in ?? ()
#5 0x00007fdecc228cd0 in ?? ()
#6 0x0000000000000004 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 15 (LWP 4351):
#0 0x00007fdee2223fb9 in ?? ()
#1 0x4008000000000000 in ?? ()
#2 0x0000000000000004 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061200001fe98 in ?? ()
#5 0x00007fdecca61270 in ?? ()
#6 0x0000000000000008 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 14 (LWP 4349):
#0 0x00007fdee2223fb9 in ?? ()
#1 0x00007fdecdaae260 in ?? ()
#2 0x0000000000000002 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061800000c9a8 in ?? ()
#5 0x00007fdecdaae250 in ?? ()
#6 0x0000000000000004 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 13 (LWP 4348):
#0 0x00007fdee2223ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 12 (LWP 4347):
#0 0x00007fdedad47947 in ?? ()
#1 0x00007fdeceafd340 in ?? ()
#2 0x000061a00000c680 in ?? ()
#3 0x00007fdeceafd330 in ?? ()
#4 0x00007fdeceafd540 in ?? ()
#5 0x00007fdeceafd380 in ?? ()
#6 0x0000614000022298 in ?? ()
#7 0x00007fdeceafd400 in ?? ()
#8 0x00007fdedd3bc25d in ?? ()
#9 0x3fae3e8fddb9a000 in ?? ()
#10 0x000061a00000c680 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000c680 in ?? ()
#13 0x00000000e5b71e80 in ?? ()
#14 0x00007fde00000000 in ?? ()
#15 0x41da7de9d0230c88 in ?? ()
#16 0x00000ffc59d57a80 in ?? ()
#17 0x00007fdeceafd3e0 in ?? ()
#18 0x00007fdedd3c0ba3 in ?? ()
#19 0x00007fdeceafd3b0 in ?? ()
#20 0x3fae3e8fddb9a000 in ?? ()
#21 0x00000000ceafd400 in ?? ()
#22 0x000061a00000c680 in ?? ()
#23 0x0000614000022298 in ?? ()
#24 0x3fae3e8fddb9a000 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 11 (LWP 4346):
#0 0x00007fdedad47947 in ?? ()
#1 0x00007fdecf314340 in ?? ()
#2 0x000061a00000c080 in ?? ()
#3 0x00007fdecf314330 in ?? ()
#4 0x00007fdecf314540 in ?? ()
#5 0x00007fdecf314380 in ?? ()
#6 0x0000614000022098 in ?? ()
#7 0x00007fdecf314400 in ?? ()
#8 0x00007fdedd3bc25d in ?? ()
#9 0x3fb332936e39f000 in ?? ()
#10 0x000061a00000c080 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000c080 in ?? ()
#13 0x00000000e5b71e80 in ?? ()
#14 0x00007fde00000000 in ?? ()
#15 0x41da7de9d0230c86 in ?? ()
#16 0x00000ffc59e5a880 in ?? ()
#17 0x00007fdecf3143e0 in ?? ()
#18 0x00007fdedd3c0ba3 in ?? ()
#19 0x00007fdecf3143b0 in ?? ()
#20 0x3fb332936e39f000 in ?? ()
#21 0x00000000cf314400 in ?? ()
#22 0x000061a00000c080 in ?? ()
#23 0x0000614000022098 in ?? ()
#24 0x3fb332936e39f000 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 10 (LWP 4345):
#0 0x00007fdedad47947 in ?? ()
#1 0x00007fdecfb2b340 in ?? ()
#2 0x000061a00000ba80 in ?? ()
#3 0x00007fdecfb2b330 in ?? ()
#4 0x00007fdecfb2b540 in ?? ()
#5 0x00007fdecfb2b380 in ?? ()
#6 0x0000614000021e98 in ?? ()
#7 0x00007fdecfb2b400 in ?? ()
#8 0x00007fdedd3bc25d in ?? ()
#9 0x3fb95bddeeb05000 in ?? ()
#10 0x000061a00000ba80 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000ba80 in ?? ()
#13 0x00000000e5b71e80 in ?? ()
#14 0x00007fde00000000 in ?? ()
#15 0x41da7de9d0230c83 in ?? ()
#16 0x00000ffc59f5d680 in ?? ()
#17 0x00007fdecfb2b3e0 in ?? ()
#18 0x00007fdedd3c0ba3 in ?? ()
#19 0x00007fdecfb2b3b0 in ?? ()
#20 0x3fb95bddeeb05000 in ?? ()
#21 0x00000000cfb2b400 in ?? ()
#22 0x000061a00000ba80 in ?? ()
#23 0x0000614000021e98 in ?? ()
#24 0x3fb95bddeeb05000 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 9 (LWP 4344):
#0 0x00007fdedad47947 in ?? ()
#1 0x00007fded1b51340 in ?? ()
#2 0x000061a00000b480 in ?? ()
#3 0x00007fded1b51330 in ?? ()
#4 0x00007fded1b51540 in ?? ()
#5 0x00007fded1b51380 in ?? ()
#6 0x0000614000021c98 in ?? ()
#7 0x00007fded1b51400 in ?? ()
#8 0x00007fdedd3bc25d in ?? ()
#9 0x3facfec1669dc000 in ?? ()
#10 0x000061a00000b480 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000b480 in ?? ()
#13 0x00000000e5b71e80 in ?? ()
#14 0x00007fde00000000 in ?? ()
#15 0x41da7de9d0230c82 in ?? ()
#16 0x00000ffc5a362280 in ?? ()
#17 0x00007fded1b513e0 in ?? ()
#18 0x00007fdedd3c0ba3 in ?? ()
#19 0x0000000000000000 in ?? ()
Thread 8 (LWP 4341):
#0 0x00007fdedad3abb9 in ?? ()
#1 0x00000000000000c8 in ?? ()
#2 0x00007fded35b77b8 in ?? ()
#3 0x000060200001e790 in ?? ()
#4 0x0000000000000002 in ?? ()
#5 0x00000000000000c8 in ?? ()
#6 0x00000000008d11c1 in __sanitizer::theDepot ()
#7 0x0000000000000000 in ?? ()
Thread 7 (LWP 4340):
#0 0x00007fdee2223fb9 in ?? ()
#1 0x00007fded2db60e0 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 6 (LWP 4339):
#0 0x00007fdee22279e2 in ?? ()
#1 0x00007fded25b3bc0 in ?? ()
#2 0x00007fded25b3c60 in ?? ()
#3 0x000000000000001e in ?? ()
#4 0x0000000000000030 in ?? ()
#5 0x00007fded25b3c10 in ?? ()
#6 0x00000000017d0860 in ?? ()
#7 0x00007fded25b3c70 in ?? ()
#8 0x000061100008d450 in ?? ()
#9 0x00007fded25b3c60 in ?? ()
#10 0x00000000008cb6b7 in __sanitizer::theDepot ()
#11 0x00007fdee7bd4bfc in ?? ()
#12 0x00007fdee7bc4209 in ?? ()
#13 0x00007fdee7bc87f6 in ?? ()
#14 0x00007fdee7bcd230 in ?? ()
#15 0x00007fdee7bcd059 in ?? ()
#16 0x0000000000aa4cad in __sanitizer::theDepot ()
#17 0x00007fdedec2f529 in ?? ()
#18 0x00007fdee221d6db in ?? ()
#19 0x00000ffc5a4ae688 in ?? ()
#20 0x00007fded25b3460 in ?? ()
#21 0x0000000000000000 in ?? ()
Thread 5 (LWP 4333):
#0 0x00007fdee2223fb9 in ?? ()
#1 0x00007fded45b8ca0 in ?? ()
#2 0x0000000000000073 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061200000c728 in ?? ()
#5 0x00007fded45b8c90 in ?? ()
#6 0x00000000000000e6 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 4 (LWP 4332):
#0 0x00007fdee2223fb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 3 (LWP 4331):
#0 0x00007fdee2223fb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 2 (LWP 4330):
#0 0x00007fdee2223fb9 in ?? ()
#1 0x5f5347414c46000a in ?? ()
#2 0x0000000000000002 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x0000612000012b38 in ?? ()
#5 0x00007fded5dbc450 in ?? ()
#6 0x0000000000000004 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 1 (LWP 4328):
#0 0x00007fdee2227d50 in ?? ()
#1 0x0000000000000000 in ?? ()
************************* END STACKS ***************************
I20260503 19:57:27.596457 420 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-task4vf7p3/build/asan/bin/kudu pid 4602
I20260503 19:57:27.610054 4725 generic_service.cc:196] Checking for leaks (request via RPC)
I20260503 19:57:27.903064 4980 raft_consensus.cc:493] T 305dbeef23b540c69080a3b2d03c9c35 P a417bd6c4b7d4bab8e96e65908ec2385 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 24488daee7104583a6f986a6ae3f8fe0)
I20260503 19:57:27.903474 420 external_mini_cluster.cc:1658] Killing /tmp/dist-test-task4vf7p3/build/asan/bin/kudu with pid 4602
I20260503 19:57:27.903362 4980 raft_consensus.cc:515] T 305dbeef23b540c69080a3b2d03c9c35 P a417bd6c4b7d4bab8e96e65908ec2385 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d32022b7ea94ea48926c65f7a62d687" member_type: VOTER last_known_addr { host: "127.0.105.3" port: 33995 } } peers { permanent_uuid: "a417bd6c4b7d4bab8e96e65908ec2385" member_type: VOTER last_known_addr { host: "127.0.105.1" port: 37957 } } peers { permanent_uuid: "24488daee7104583a6f986a6ae3f8fe0" member_type: VOTER last_known_addr { host: "127.0.105.4" port: 34213 } }
W20260503 19:57:27.968593 1734 connection.cc:570] server connection from 127.0.105.1:60465 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260503 19:57:27.969478 420 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-task4vf7p3/build/asan/bin/kudu pid 4194
W20260503 19:57:27.980985 4347 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37957: connect: Connection refused (error 111)
I20260503 19:57:27.982861 4315 generic_service.cc:196] Checking for leaks (request via RPC)
W20260503 19:57:27.985086 4347 consensus_peers.cc:597] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 -> Peer a417bd6c4b7d4bab8e96e65908ec2385 (127.0.105.1:37957): Couldn't send request to peer a417bd6c4b7d4bab8e96e65908ec2385. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37957: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260503 19:57:28.141590 420 external_mini_cluster.cc:1658] Killing /tmp/dist-test-task4vf7p3/build/asan/bin/kudu with pid 4194
I20260503 19:57:28.169122 420 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-task4vf7p3/build/asan/bin/kudu pid 4465
I20260503 19:57:28.177085 4589 generic_service.cc:196] Checking for leaks (request via RPC)
W20260503 19:57:28.494350 4347 consensus_peers.cc:597] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 -> Peer a417bd6c4b7d4bab8e96e65908ec2385 (127.0.105.1:37957): Couldn't send request to peer a417bd6c4b7d4bab8e96e65908ec2385. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.1:37957: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260503 19:57:28.505455 4988 raft_consensus.cc:493] T 305dbeef23b540c69080a3b2d03c9c35 P 6d32022b7ea94ea48926c65f7a62d687 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 24488daee7104583a6f986a6ae3f8fe0)
I20260503 19:57:28.505810 420 external_mini_cluster.cc:1658] Killing /tmp/dist-test-task4vf7p3/build/asan/bin/kudu with pid 4465
I20260503 19:57:28.559442 420 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-task4vf7p3/build/asan/bin/kudu pid 4328
W20260503 19:57:28.560382 4344 consensus_peers.cc:597] T 305dbeef23b540c69080a3b2d03c9c35 P 24488daee7104583a6f986a6ae3f8fe0 -> Peer 6d32022b7ea94ea48926c65f7a62d687 (127.0.105.3:33995): Couldn't send request to peer 6d32022b7ea94ea48926c65f7a62d687. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.3:33995: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260503 19:57:28.567054 4452 generic_service.cc:196] Checking for leaks (request via RPC)
I20260503 19:57:28.899149 420 external_mini_cluster.cc:1658] Killing /tmp/dist-test-task4vf7p3/build/asan/bin/kudu with pid 4328
W20260503 19:57:28.965481 1734 connection.cc:570] server connection from 127.0.105.4:45005 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260503 19:57:28.965869 420 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-task4vf7p3/build/asan/bin/kudu pid 1717
I20260503 19:57:28.973706 1778 generic_service.cc:196] Checking for leaks (request via RPC)
I20260503 19:57:29.149123 420 external_mini_cluster.cc:1658] Killing /tmp/dist-test-task4vf7p3/build/asan/bin/kudu with pid 1717
2026-05-03T19:57:29Z chronyd exiting
I20260503 19:57:29.206157 420 test_util.cc:182] -----------------------------------------------
I20260503 19:57:29.206307 420 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-task4vf7p3/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1777838121084241-420-0
[ FAILED ] RollingRestartArgs/RollingRestartITest.TestWorkloads/4, where GetParam() = 800-byte object <01-00 00-00 01-53 32-35 04-00 00-00 BE-BE BE-BE A0-24 00-00 80-61 00-00 00-00 00-00 00-00 00-00 00-BE BE-BE BE-BE BE-BE BE-BE BE-BE BE-BE BE-BE C0-24 00-00 80-61 00-00 00-00 00-00 00-00 00-00 ... BE-BE BE-BE BE-BE BE-BE 78-27 00-00 80-61 00-00 00-00 00-00 00-00 00-00 00-BE BE-BE BE-BE BE-BE BE-BE BE-BE BE-BE BE-BE 00-01 00-BE BE-BE BE-BE 04-00 00-00 03-00 00-00 01-BE BE-BE BE-BE BE-BE> (73562 ms)
[----------] 1 test from RollingRestartArgs/RollingRestartITest (73562 ms total)
[----------] Global test environment tear-down
[==========] 2 tests from 2 test suites ran. (128027 ms total)
[ PASSED ] 1 test.
[ FAILED ] 1 test, listed below:
[ FAILED ] RollingRestartArgs/RollingRestartITest.TestWorkloads/4, where GetParam() = 800-byte object <01-00 00-00 01-53 32-35 04-00 00-00 BE-BE BE-BE A0-24 00-00 80-61 00-00 00-00 00-00 00-00 00-00 00-BE BE-BE BE-BE BE-BE BE-BE BE-BE BE-BE BE-BE C0-24 00-00 80-61 00-00 00-00 00-00 00-00 00-00 ... BE-BE BE-BE BE-BE BE-BE 78-27 00-00 80-61 00-00 00-00 00-00 00-00 00-00 00-BE BE-BE BE-BE BE-BE BE-BE BE-BE BE-BE BE-BE 00-01 00-BE BE-BE BE-BE 04-00 00-00 03-00 00-00 01-BE BE-BE BE-BE BE-BE>
1 FAILED TEST
I20260503 19:57:29.208216 420 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/client/meta_cache.cc:302: suppressed but not reported on 5 messages since previous log ~22 seconds ago