Note: This is test shard 1 of 8.
[==========] Running 2 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 1 test from MaintenanceModeRF3ITest
[ RUN ] MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate
2026-11-17T14:49:14Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-11-17T14:49:14Z Disabled control of system clock
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20261117 14:49:14.397207 6346 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskUafhB0/build/asan/bin/kudu
/tmp/dist-test-taskUafhB0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.50.190:39807
--webserver_interface=127.6.50.190
--webserver_port=0
--builtin_ntp_servers=127.6.50.148:42811
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.50.190:39807 with env {}
W20261117 14:49:14.747025 6354 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261117 14:49:14.747335 6354 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261117 14:49:14.747404 6354 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261117 14:49:14.755888 6354 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20261117 14:49:14.755988 6354 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261117 14:49:14.756044 6354 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20261117 14:49:14.756089 6354 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20261117 14:49:14.766548 6354 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.50.148:42811
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.6.50.190:39807
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.50.190:39807
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.6.50.190
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type FASTDEBUG
built by None at 17 Nov 2026 14:43:24 UTC on bdcb31816ec0
build id 14829
ASAN enabled
I20261117 14:49:14.768217 6354 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261117 14:49:14.770041 6354 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261117 14:49:14.778879 6359 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261117 14:49:14.779006 6362 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261117 14:49:14.778837 6360 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261117 14:49:14.779852 6354 server_base.cc:1061] running on GCE node
I20261117 14:49:14.780678 6354 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261117 14:49:14.782119 6354 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261117 14:49:14.783439 6354 hybrid_clock.cc:648] HybridClock initialized: now 1794926954783332 us; error 64 us; skew 500 ppm
I20261117 14:49:14.783815 6354 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261117 14:49:14.786264 6354 webserver.cc:577] Webserver started at http://127.6.50.190:41151/ using document root <none> and password file <none>
I20261117 14:49:14.787040 6354 fs_manager.cc:362] Metadata directory not provided
I20261117 14:49:14.787180 6354 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261117 14:49:14.787590 6354 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261117 14:49:14.790195 6354 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/master-0/data/instance:
uuid: "77877f9f184644d8acf4c8c6b307a230"
format_stamp: "Formatted at 2026-11-17 14:49:14 on dist-test-slave-jwg6"
I20261117 14:49:14.791035 6354 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/master-0/wal/instance:
uuid: "77877f9f184644d8acf4c8c6b307a230"
format_stamp: "Formatted at 2026-11-17 14:49:14 on dist-test-slave-jwg6"
I20261117 14:49:14.797470 6354 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.005s sys 0.002s
I20261117 14:49:14.801651 6368 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20261117 14:49:14.803249 6354 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20261117 14:49:14.803485 6354 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/master-0/data,/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/master-0/wal
uuid: "77877f9f184644d8acf4c8c6b307a230"
format_stamp: "Formatted at 2026-11-17 14:49:14 on dist-test-slave-jwg6"
I20261117 14:49:14.803743 6354 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261117 14:49:14.846606 6354 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20261117 14:49:14.847582 6354 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261117 14:49:14.847882 6354 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261117 14:49:14.869163 6354 rpc_server.cc:307] RPC server started. Bound to: 127.6.50.190:39807
I20261117 14:49:14.869194 6419 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.50.190:39807 every 8 connection(s)
I20261117 14:49:14.870934 6354 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/master-0/data/info.pb
I20261117 14:49:14.875885 6420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20261117 14:49:14.877951 6346 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskUafhB0/build/asan/bin/kudu as pid 6354
I20261117 14:49:14.878319 6346 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/master-0/wal/instance
I20261117 14:49:14.890982 6420 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77877f9f184644d8acf4c8c6b307a230: Bootstrap starting.
I20261117 14:49:14.894747 6420 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 77877f9f184644d8acf4c8c6b307a230: Neither blocks nor log segments found. Creating new log.
I20261117 14:49:14.896045 6420 log.cc:826] T 00000000000000000000000000000000 P 77877f9f184644d8acf4c8c6b307a230: Log is configured to *not* fsync() on all Append() calls
I20261117 14:49:14.899555 6420 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77877f9f184644d8acf4c8c6b307a230: No bootstrap required, opened a new log
I20261117 14:49:14.907315 6420 raft_consensus.cc:360] T 00000000000000000000000000000000 P 77877f9f184644d8acf4c8c6b307a230 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77877f9f184644d8acf4c8c6b307a230" member_type: VOTER last_known_addr { host: "127.6.50.190" port: 39807 } }
I20261117 14:49:14.907770 6420 raft_consensus.cc:386] T 00000000000000000000000000000000 P 77877f9f184644d8acf4c8c6b307a230 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261117 14:49:14.907898 6420 raft_consensus.cc:748] T 00000000000000000000000000000000 P 77877f9f184644d8acf4c8c6b307a230 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77877f9f184644d8acf4c8c6b307a230, State: Initialized, Role: FOLLOWER
I20261117 14:49:14.908674 6420 consensus_queue.cc:261] T 00000000000000000000000000000000 P 77877f9f184644d8acf4c8c6b307a230 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77877f9f184644d8acf4c8c6b307a230" member_type: VOTER last_known_addr { host: "127.6.50.190" port: 39807 } }
I20261117 14:49:14.908929 6420 raft_consensus.cc:400] T 00000000000000000000000000000000 P 77877f9f184644d8acf4c8c6b307a230 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20261117 14:49:14.909103 6420 raft_consensus.cc:499] T 00000000000000000000000000000000 P 77877f9f184644d8acf4c8c6b307a230 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20261117 14:49:14.909310 6420 raft_consensus.cc:3096] T 00000000000000000000000000000000 P 77877f9f184644d8acf4c8c6b307a230 [term 0 FOLLOWER]: Advancing to term 1
I20261117 14:49:14.911790 6420 raft_consensus.cc:521] T 00000000000000000000000000000000 P 77877f9f184644d8acf4c8c6b307a230 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77877f9f184644d8acf4c8c6b307a230" member_type: VOTER last_known_addr { host: "127.6.50.190" port: 39807 } }
I20261117 14:49:14.912322 6420 leader_election.cc:304] T 00000000000000000000000000000000 P 77877f9f184644d8acf4c8c6b307a230 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 77877f9f184644d8acf4c8c6b307a230; no voters:
I20261117 14:49:14.913064 6420 leader_election.cc:290] T 00000000000000000000000000000000 P 77877f9f184644d8acf4c8c6b307a230 [CANDIDATE]: Term 1 election: Requested vote from peers
I20261117 14:49:14.913211 6425 raft_consensus.cc:2826] T 00000000000000000000000000000000 P 77877f9f184644d8acf4c8c6b307a230 [term 1 FOLLOWER]: Leader election won for term 1
I20261117 14:49:14.913928 6425 raft_consensus.cc:705] T 00000000000000000000000000000000 P 77877f9f184644d8acf4c8c6b307a230 [term 1 LEADER]: Becoming Leader. State: Replica: 77877f9f184644d8acf4c8c6b307a230, State: Running, Role: LEADER
I20261117 14:49:14.914491 6425 consensus_queue.cc:238] T 00000000000000000000000000000000 P 77877f9f184644d8acf4c8c6b307a230 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77877f9f184644d8acf4c8c6b307a230" member_type: VOTER last_known_addr { host: "127.6.50.190" port: 39807 } }
I20261117 14:49:14.915375 6420 sys_catalog.cc:565] T 00000000000000000000000000000000 P 77877f9f184644d8acf4c8c6b307a230 [sys.catalog]: configured and running, proceeding with master startup.
I20261117 14:49:14.917457 6426 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77877f9f184644d8acf4c8c6b307a230 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "77877f9f184644d8acf4c8c6b307a230" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77877f9f184644d8acf4c8c6b307a230" member_type: VOTER last_known_addr { host: "127.6.50.190" port: 39807 } } }
I20261117 14:49:14.917734 6426 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77877f9f184644d8acf4c8c6b307a230 [sys.catalog]: This master's current role is: LEADER
I20261117 14:49:14.918290 6427 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77877f9f184644d8acf4c8c6b307a230 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 77877f9f184644d8acf4c8c6b307a230. Latest consensus state: current_term: 1 leader_uuid: "77877f9f184644d8acf4c8c6b307a230" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77877f9f184644d8acf4c8c6b307a230" member_type: VOTER last_known_addr { host: "127.6.50.190" port: 39807 } } }
I20261117 14:49:14.918558 6427 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77877f9f184644d8acf4c8c6b307a230 [sys.catalog]: This master's current role is: LEADER
I20261117 14:49:14.918732 6431 catalog_manager.cc:1526] Loading table and tablet metadata into memory...
I20261117 14:49:14.927169 6431 catalog_manager.cc:1535] Initializing Kudu cluster ID...
I20261117 14:49:14.938548 6431 catalog_manager.cc:1398] Generated new cluster ID: bcb55fc8eb994d7f892409a03681fdde
I20261117 14:49:14.938679 6431 catalog_manager.cc:1546] Initializing Kudu internal certificate authority...
I20261117 14:49:14.970813 6431 catalog_manager.cc:1421] Generated new certificate authority record
I20261117 14:49:14.972122 6431 catalog_manager.cc:1555] Loading token signing keys...
I20261117 14:49:14.983850 6431 catalog_manager.cc:6221] T 00000000000000000000000000000000 P 77877f9f184644d8acf4c8c6b307a230: Generated new TSK 0
I20261117 14:49:14.984805 6431 catalog_manager.cc:1565] Initializing in-progress tserver states...
I20261117 14:49:15.001902 6346 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskUafhB0/build/asan/bin/kudu
/tmp/dist-test-taskUafhB0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.50.129:0
--local_ip_for_outbound_sockets=127.6.50.129
--webserver_interface=127.6.50.129
--webserver_port=0
--tserver_master_addrs=127.6.50.190:39807
--builtin_ntp_servers=127.6.50.148:42811
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--follower_unavailable_considered_failed_sec=2
--enable_log_gc=false with env {}
W20261117 14:49:15.363788 6445 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261117 14:49:15.364105 6445 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261117 14:49:15.364171 6445 flags.cc:432] Enabled unsafe flag: --enable_log_gc=false
W20261117 14:49:15.364239 6445 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261117 14:49:15.372866 6445 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261117 14:49:15.373064 6445 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.50.129
I20261117 14:49:15.383620 6445 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.50.148:42811
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=2
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.50.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.6.50.129
--webserver_port=0
--enable_log_gc=false
--tserver_master_addrs=127.6.50.190:39807
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.50.129
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type FASTDEBUG
built by None at 17 Nov 2026 14:43:24 UTC on bdcb31816ec0
build id 14829
ASAN enabled
I20261117 14:49:15.385419 6445 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261117 14:49:15.387392 6445 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20261117 14:49:15.391525 6445 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20261117 14:49:15.398139 6451 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261117 14:49:15.398097 6450 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261117 14:49:15.398900 6453 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261117 14:49:15.399706 6445 server_base.cc:1061] running on GCE node
I20261117 14:49:15.400350 6445 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261117 14:49:15.401499 6445 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261117 14:49:15.402738 6445 hybrid_clock.cc:648] HybridClock initialized: now 1794926955402698 us; error 40 us; skew 500 ppm
I20261117 14:49:15.403095 6445 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261117 14:49:15.405633 6445 webserver.cc:577] Webserver started at http://127.6.50.129:39443/ using document root <none> and password file <none>
I20261117 14:49:15.406563 6445 fs_manager.cc:362] Metadata directory not provided
I20261117 14:49:15.406708 6445 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261117 14:49:15.407109 6445 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261117 14:49:15.409943 6445 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-0/data/instance:
uuid: "ec41d6947a4a4eadadf90c3756899704"
format_stamp: "Formatted at 2026-11-17 14:49:15 on dist-test-slave-jwg6"
I20261117 14:49:15.410712 6445 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-0/wal/instance:
uuid: "ec41d6947a4a4eadadf90c3756899704"
format_stamp: "Formatted at 2026-11-17 14:49:15 on dist-test-slave-jwg6"
I20261117 14:49:15.416836 6445 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20261117 14:49:15.420650 6459 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20261117 14:49:15.422338 6445 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20261117 14:49:15.422555 6445 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-0/data,/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-0/wal
uuid: "ec41d6947a4a4eadadf90c3756899704"
format_stamp: "Formatted at 2026-11-17 14:49:15 on dist-test-slave-jwg6"
I20261117 14:49:15.422780 6445 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261117 14:49:15.449143 6445 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20261117 14:49:15.450059 6445 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261117 14:49:15.450343 6445 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261117 14:49:15.451355 6445 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261117 14:49:15.453253 6445 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261117 14:49:15.453347 6445 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20261117 14:49:15.453508 6445 ts_tablet_manager.cc:662] Registered 0 tablets
I20261117 14:49:15.453612 6445 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20261117 14:49:15.488646 6445 rpc_server.cc:307] RPC server started. Bound to: 127.6.50.129:42937
I20261117 14:49:15.488703 6571 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.50.129:42937 every 8 connection(s)
I20261117 14:49:15.490223 6445 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-0/data/info.pb
I20261117 14:49:15.492985 6346 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskUafhB0/build/asan/bin/kudu as pid 6445
I20261117 14:49:15.493224 6346 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-0/wal/instance
I20261117 14:49:15.497342 6346 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskUafhB0/build/asan/bin/kudu
/tmp/dist-test-taskUafhB0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.50.130:0
--local_ip_for_outbound_sockets=127.6.50.130
--webserver_interface=127.6.50.130
--webserver_port=0
--tserver_master_addrs=127.6.50.190:39807
--builtin_ntp_servers=127.6.50.148:42811
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--follower_unavailable_considered_failed_sec=2
--enable_log_gc=false with env {}
I20261117 14:49:15.510299 6572 heartbeater.cc:345] Connected to a master server at 127.6.50.190:39807
I20261117 14:49:15.510691 6572 heartbeater.cc:462] Registering TS with master...
I20261117 14:49:15.511597 6572 heartbeater.cc:508] Master 127.6.50.190:39807 requested a full tablet report, sending...
I20261117 14:49:15.513906 6385 ts_manager.cc:210] Registered new tserver with Master: ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937)
I20261117 14:49:15.515563 6385 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.6.50.129:50803
W20261117 14:49:15.849776 6576 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261117 14:49:15.850167 6576 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261117 14:49:15.850312 6576 flags.cc:432] Enabled unsafe flag: --enable_log_gc=false
W20261117 14:49:15.850443 6576 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261117 14:49:15.859315 6576 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261117 14:49:15.859601 6576 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.50.130
I20261117 14:49:15.870182 6576 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.50.148:42811
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=2
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.50.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.6.50.130
--webserver_port=0
--enable_log_gc=false
--tserver_master_addrs=127.6.50.190:39807
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.50.130
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type FASTDEBUG
built by None at 17 Nov 2026 14:43:24 UTC on bdcb31816ec0
build id 14829
ASAN enabled
I20261117 14:49:15.871842 6576 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261117 14:49:15.873736 6576 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20261117 14:49:15.877820 6576 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20261117 14:49:15.883466 6582 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261117 14:49:15.883540 6581 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261117 14:49:15.885097 6584 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261117 14:49:15.885525 6576 server_base.cc:1061] running on GCE node
I20261117 14:49:15.886204 6576 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261117 14:49:15.887518 6576 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261117 14:49:15.888743 6576 hybrid_clock.cc:648] HybridClock initialized: now 1794926955888672 us; error 65 us; skew 500 ppm
I20261117 14:49:15.889092 6576 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261117 14:49:15.891435 6576 webserver.cc:577] Webserver started at http://127.6.50.130:42361/ using document root <none> and password file <none>
I20261117 14:49:15.892215 6576 fs_manager.cc:362] Metadata directory not provided
I20261117 14:49:15.892335 6576 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261117 14:49:15.892772 6576 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261117 14:49:15.895357 6576 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-1/data/instance:
uuid: "c7900e455dd64c68bccfc499bda413f7"
format_stamp: "Formatted at 2026-11-17 14:49:15 on dist-test-slave-jwg6"
I20261117 14:49:15.896184 6576 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-1/wal/instance:
uuid: "c7900e455dd64c68bccfc499bda413f7"
format_stamp: "Formatted at 2026-11-17 14:49:15 on dist-test-slave-jwg6"
I20261117 14:49:15.902125 6576 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20261117 14:49:15.905905 6590 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20261117 14:49:15.907825 6576 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20261117 14:49:15.908032 6576 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-1/data,/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-1/wal
uuid: "c7900e455dd64c68bccfc499bda413f7"
format_stamp: "Formatted at 2026-11-17 14:49:15 on dist-test-slave-jwg6"
I20261117 14:49:15.908257 6576 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261117 14:49:15.927937 6576 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20261117 14:49:15.929080 6576 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261117 14:49:15.929374 6576 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261117 14:49:15.930421 6576 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261117 14:49:15.932242 6576 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261117 14:49:15.932379 6576 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20261117 14:49:15.932529 6576 ts_tablet_manager.cc:662] Registered 0 tablets
I20261117 14:49:15.932638 6576 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20261117 14:49:15.967732 6576 rpc_server.cc:307] RPC server started. Bound to: 127.6.50.130:36271
I20261117 14:49:15.967792 6702 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.50.130:36271 every 8 connection(s)
I20261117 14:49:15.969334 6576 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-1/data/info.pb
I20261117 14:49:15.977000 6346 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskUafhB0/build/asan/bin/kudu as pid 6576
I20261117 14:49:15.977169 6346 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-1/wal/instance
I20261117 14:49:15.980625 6346 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskUafhB0/build/asan/bin/kudu
/tmp/dist-test-taskUafhB0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.50.131:0
--local_ip_for_outbound_sockets=127.6.50.131
--webserver_interface=127.6.50.131
--webserver_port=0
--tserver_master_addrs=127.6.50.190:39807
--builtin_ntp_servers=127.6.50.148:42811
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--follower_unavailable_considered_failed_sec=2
--enable_log_gc=false with env {}
I20261117 14:49:15.983388 6703 heartbeater.cc:345] Connected to a master server at 127.6.50.190:39807
I20261117 14:49:15.983747 6703 heartbeater.cc:462] Registering TS with master...
I20261117 14:49:15.984778 6703 heartbeater.cc:508] Master 127.6.50.190:39807 requested a full tablet report, sending...
I20261117 14:49:15.986407 6385 ts_manager.cc:210] Registered new tserver with Master: c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271)
I20261117 14:49:15.987274 6385 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.6.50.130:33519
W20261117 14:49:16.339143 6706 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261117 14:49:16.339478 6706 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261117 14:49:16.339636 6706 flags.cc:432] Enabled unsafe flag: --enable_log_gc=false
W20261117 14:49:16.339762 6706 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261117 14:49:16.349079 6706 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261117 14:49:16.349331 6706 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.50.131
I20261117 14:49:16.360342 6706 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.50.148:42811
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=2
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.50.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.6.50.131
--webserver_port=0
--enable_log_gc=false
--tserver_master_addrs=127.6.50.190:39807
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.50.131
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type FASTDEBUG
built by None at 17 Nov 2026 14:43:24 UTC on bdcb31816ec0
build id 14829
ASAN enabled
I20261117 14:49:16.362133 6706 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261117 14:49:16.364035 6706 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20261117 14:49:16.368237 6706 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20261117 14:49:16.374260 6711 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261117 14:49:16.374228 6712 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261117 14:49:16.375108 6714 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261117 14:49:16.375764 6706 server_base.cc:1061] running on GCE node
I20261117 14:49:16.376397 6706 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261117 14:49:16.377449 6706 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261117 14:49:16.378696 6706 hybrid_clock.cc:648] HybridClock initialized: now 1794926956378658 us; error 51 us; skew 500 ppm
I20261117 14:49:16.379040 6706 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261117 14:49:16.381484 6706 webserver.cc:577] Webserver started at http://127.6.50.131:35849/ using document root <none> and password file <none>
I20261117 14:49:16.382253 6706 fs_manager.cc:362] Metadata directory not provided
I20261117 14:49:16.382395 6706 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261117 14:49:16.382777 6706 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261117 14:49:16.385386 6706 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-2/data/instance:
uuid: "def6b23bccc94a78a47118da331f2798"
format_stamp: "Formatted at 2026-11-17 14:49:16 on dist-test-slave-jwg6"
I20261117 14:49:16.386207 6706 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-2/wal/instance:
uuid: "def6b23bccc94a78a47118da331f2798"
format_stamp: "Formatted at 2026-11-17 14:49:16 on dist-test-slave-jwg6"
I20261117 14:49:16.391819 6706 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20261117 14:49:16.395385 6720 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20261117 14:49:16.397147 6706 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20261117 14:49:16.397372 6706 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-2/data,/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-2/wal
uuid: "def6b23bccc94a78a47118da331f2798"
format_stamp: "Formatted at 2026-11-17 14:49:16 on dist-test-slave-jwg6"
I20261117 14:49:16.397591 6706 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261117 14:49:16.415067 6706 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20261117 14:49:16.416006 6706 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261117 14:49:16.416393 6706 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261117 14:49:16.417552 6706 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261117 14:49:16.419417 6706 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261117 14:49:16.419571 6706 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20261117 14:49:16.419715 6706 ts_tablet_manager.cc:662] Registered 0 tablets
I20261117 14:49:16.419806 6706 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20261117 14:49:16.455312 6706 rpc_server.cc:307] RPC server started. Bound to: 127.6.50.131:33611
I20261117 14:49:16.455354 6832 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.50.131:33611 every 8 connection(s)
I20261117 14:49:16.456954 6706 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-2/data/info.pb
I20261117 14:49:16.460132 6346 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskUafhB0/build/asan/bin/kudu as pid 6706
I20261117 14:49:16.460374 6346 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-2/wal/instance
I20261117 14:49:16.471517 6833 heartbeater.cc:345] Connected to a master server at 127.6.50.190:39807
I20261117 14:49:16.471917 6833 heartbeater.cc:462] Registering TS with master...
I20261117 14:49:16.472878 6833 heartbeater.cc:508] Master 127.6.50.190:39807 requested a full tablet report, sending...
I20261117 14:49:16.474530 6385 ts_manager.cc:210] Registered new tserver with Master: def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611)
I20261117 14:49:16.475366 6385 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.6.50.131:59625
I20261117 14:49:16.477718 6346 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20261117 14:49:16.519196 6572 heartbeater.cc:500] Master 127.6.50.190:39807 was elected leader, sending a full tablet report...
I20261117 14:49:16.520197 6385 catalog_manager.cc:2298] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41192:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\004\001\000UUU\025\004\001\000\252\252\252*\004\001\000\377\377\377?\004\001\000TUUU\004\001\000\251\252\252j"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20261117 14:49:16.522361 6385 catalog_manager.cc:7228] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20261117 14:49:16.557132 6637 tablet_service.cc:1500] Processing CreateTablet for tablet d1732d75bf044feb8884fc3135373072 (DEFAULT_TABLE table=test-workload [id=bc9c637ec15b4834b6657bcd92c82f8b]), partition=RANGE (key) PARTITION 357913941 <= VALUES < 715827882
I20261117 14:49:16.557116 6504 tablet_service.cc:1500] Processing CreateTablet for tablet 57984748adc7482a9a2d999a447a81af (DEFAULT_TABLE table=test-workload [id=bc9c637ec15b4834b6657bcd92c82f8b]), partition=RANGE (key) PARTITION 1073741823 <= VALUES < 1431655764
I20261117 14:49:16.558112 6506 tablet_service.cc:1500] Processing CreateTablet for tablet d1732d75bf044feb8884fc3135373072 (DEFAULT_TABLE table=test-workload [id=bc9c637ec15b4834b6657bcd92c82f8b]), partition=RANGE (key) PARTITION 357913941 <= VALUES < 715827882
I20261117 14:49:16.559233 6504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57984748adc7482a9a2d999a447a81af. 1 dirs total, 0 dirs full, 0 dirs failed
I20261117 14:49:16.559265 6637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1732d75bf044feb8884fc3135373072. 1 dirs total, 0 dirs full, 0 dirs failed
I20261117 14:49:16.559098 6502 tablet_service.cc:1500] Processing CreateTablet for tablet 5c849aa2a21a4c13b2e31d2ca3f692cc (DEFAULT_TABLE table=test-workload [id=bc9c637ec15b4834b6657bcd92c82f8b]), partition=RANGE (key) PARTITION 1789569705 <= VALUES
I20261117 14:49:16.557693 6635 tablet_service.cc:1500] Processing CreateTablet for tablet 57984748adc7482a9a2d999a447a81af (DEFAULT_TABLE table=test-workload [id=bc9c637ec15b4834b6657bcd92c82f8b]), partition=RANGE (key) PARTITION 1073741823 <= VALUES < 1431655764
I20261117 14:49:16.560106 6635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57984748adc7482a9a2d999a447a81af. 1 dirs total, 0 dirs full, 0 dirs failed
I20261117 14:49:16.560647 6507 tablet_service.cc:1500] Processing CreateTablet for tablet b74e748e97c84edeabc1c0cb41ddae99 (DEFAULT_TABLE table=test-workload [id=bc9c637ec15b4834b6657bcd92c82f8b]), partition=RANGE (key) PARTITION VALUES < 357913941
I20261117 14:49:16.560658 6634 tablet_service.cc:1500] Processing CreateTablet for tablet 47d9af37b05545f0b5b0c033f4ec953f (DEFAULT_TABLE table=test-workload [id=bc9c637ec15b4834b6657bcd92c82f8b]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1789569705
I20261117 14:49:16.561043 6505 tablet_service.cc:1500] Processing CreateTablet for tablet 3cea00abcccd4b1284393ef8b406cab1 (DEFAULT_TABLE table=test-workload [id=bc9c637ec15b4834b6657bcd92c82f8b]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 1073741823
I20261117 14:49:16.561259 6636 tablet_service.cc:1500] Processing CreateTablet for tablet 3cea00abcccd4b1284393ef8b406cab1 (DEFAULT_TABLE table=test-workload [id=bc9c637ec15b4834b6657bcd92c82f8b]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 1073741823
I20261117 14:49:16.561718 6634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47d9af37b05545f0b5b0c033f4ec953f. 1 dirs total, 0 dirs full, 0 dirs failed
I20261117 14:49:16.562376 6636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cea00abcccd4b1284393ef8b406cab1. 1 dirs total, 0 dirs full, 0 dirs failed
I20261117 14:49:16.563604 6502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c849aa2a21a4c13b2e31d2ca3f692cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20261117 14:49:16.564431 6507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b74e748e97c84edeabc1c0cb41ddae99. 1 dirs total, 0 dirs full, 0 dirs failed
I20261117 14:49:16.565231 6505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cea00abcccd4b1284393ef8b406cab1. 1 dirs total, 0 dirs full, 0 dirs failed
I20261117 14:49:16.566176 6506 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1732d75bf044feb8884fc3135373072. 1 dirs total, 0 dirs full, 0 dirs failed
I20261117 14:49:16.569463 6638 tablet_service.cc:1500] Processing CreateTablet for tablet b74e748e97c84edeabc1c0cb41ddae99 (DEFAULT_TABLE table=test-workload [id=bc9c637ec15b4834b6657bcd92c82f8b]), partition=RANGE (key) PARTITION VALUES < 357913941
I20261117 14:49:16.569994 6638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b74e748e97c84edeabc1c0cb41ddae99. 1 dirs total, 0 dirs full, 0 dirs failed
I20261117 14:49:16.579542 6503 tablet_service.cc:1500] Processing CreateTablet for tablet 47d9af37b05545f0b5b0c033f4ec953f (DEFAULT_TABLE table=test-workload [id=bc9c637ec15b4834b6657bcd92c82f8b]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1789569705
I20261117 14:49:16.580288 6503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47d9af37b05545f0b5b0c033f4ec953f. 1 dirs total, 0 dirs full, 0 dirs failed
I20261117 14:49:16.588546 6633 tablet_service.cc:1500] Processing CreateTablet for tablet 5c849aa2a21a4c13b2e31d2ca3f692cc (DEFAULT_TABLE table=test-workload [id=bc9c637ec15b4834b6657bcd92c82f8b]), partition=RANGE (key) PARTITION 1789569705 <= VALUES
I20261117 14:49:16.589392 6633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c849aa2a21a4c13b2e31d2ca3f692cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20261117 14:49:16.612695 6857 tablet_bootstrap.cc:492] T 47d9af37b05545f0b5b0c033f4ec953f P c7900e455dd64c68bccfc499bda413f7: Bootstrap starting.
I20261117 14:49:16.619058 6857 tablet_bootstrap.cc:654] T 47d9af37b05545f0b5b0c033f4ec953f P c7900e455dd64c68bccfc499bda413f7: Neither blocks nor log segments found. Creating new log.
I20261117 14:49:16.621079 6857 log.cc:826] T 47d9af37b05545f0b5b0c033f4ec953f P c7900e455dd64c68bccfc499bda413f7: Log is configured to *not* fsync() on all Append() calls
I20261117 14:49:16.633104 6856 tablet_bootstrap.cc:492] T 57984748adc7482a9a2d999a447a81af P ec41d6947a4a4eadadf90c3756899704: Bootstrap starting.
I20261117 14:49:16.635028 6857 tablet_bootstrap.cc:492] T 47d9af37b05545f0b5b0c033f4ec953f P c7900e455dd64c68bccfc499bda413f7: No bootstrap required, opened a new log
I20261117 14:49:16.635376 6857 ts_tablet_manager.cc:1449] T 47d9af37b05545f0b5b0c033f4ec953f P c7900e455dd64c68bccfc499bda413f7: Time spent bootstrapping tablet: real 0.023s user 0.010s sys 0.010s
I20261117 14:49:16.636976 6856 tablet_bootstrap.cc:654] T 57984748adc7482a9a2d999a447a81af P ec41d6947a4a4eadadf90c3756899704: Neither blocks nor log segments found. Creating new log.
I20261117 14:49:16.638227 6856 log.cc:826] T 57984748adc7482a9a2d999a447a81af P ec41d6947a4a4eadadf90c3756899704: Log is configured to *not* fsync() on all Append() calls
I20261117 14:49:16.642385 6856 tablet_bootstrap.cc:492] T 57984748adc7482a9a2d999a447a81af P ec41d6947a4a4eadadf90c3756899704: No bootstrap required, opened a new log
I20261117 14:49:16.642711 6856 ts_tablet_manager.cc:1449] T 57984748adc7482a9a2d999a447a81af P ec41d6947a4a4eadadf90c3756899704: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20261117 14:49:16.643889 6857 raft_consensus.cc:360] T 47d9af37b05545f0b5b0c033f4ec953f P c7900e455dd64c68bccfc499bda413f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:16.644304 6857 raft_consensus.cc:386] T 47d9af37b05545f0b5b0c033f4ec953f P c7900e455dd64c68bccfc499bda413f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261117 14:49:16.644402 6857 raft_consensus.cc:748] T 47d9af37b05545f0b5b0c033f4ec953f P c7900e455dd64c68bccfc499bda413f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7900e455dd64c68bccfc499bda413f7, State: Initialized, Role: FOLLOWER
I20261117 14:49:16.645454 6857 consensus_queue.cc:261] T 47d9af37b05545f0b5b0c033f4ec953f P c7900e455dd64c68bccfc499bda413f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:16.645170 6766 tablet_service.cc:1500] Processing CreateTablet for tablet 3cea00abcccd4b1284393ef8b406cab1 (DEFAULT_TABLE table=test-workload [id=bc9c637ec15b4834b6657bcd92c82f8b]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 1073741823
I20261117 14:49:16.647297 6766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cea00abcccd4b1284393ef8b406cab1. 1 dirs total, 0 dirs full, 0 dirs failed
I20261117 14:49:16.648850 6764 tablet_service.cc:1500] Processing CreateTablet for tablet 47d9af37b05545f0b5b0c033f4ec953f (DEFAULT_TABLE table=test-workload [id=bc9c637ec15b4834b6657bcd92c82f8b]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1789569705
I20261117 14:49:16.648908 6768 tablet_service.cc:1500] Processing CreateTablet for tablet b74e748e97c84edeabc1c0cb41ddae99 (DEFAULT_TABLE table=test-workload [id=bc9c637ec15b4834b6657bcd92c82f8b]), partition=RANGE (key) PARTITION VALUES < 357913941
I20261117 14:49:16.649415 6764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47d9af37b05545f0b5b0c033f4ec953f. 1 dirs total, 0 dirs full, 0 dirs failed
I20261117 14:49:16.649837 6768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b74e748e97c84edeabc1c0cb41ddae99. 1 dirs total, 0 dirs full, 0 dirs failed
I20261117 14:49:16.650100 6856 raft_consensus.cc:360] T 57984748adc7482a9a2d999a447a81af P ec41d6947a4a4eadadf90c3756899704 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:16.650568 6856 raft_consensus.cc:386] T 57984748adc7482a9a2d999a447a81af P ec41d6947a4a4eadadf90c3756899704 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261117 14:49:16.650807 6856 raft_consensus.cc:748] T 57984748adc7482a9a2d999a447a81af P ec41d6947a4a4eadadf90c3756899704 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec41d6947a4a4eadadf90c3756899704, State: Initialized, Role: FOLLOWER
I20261117 14:49:16.651525 6703 heartbeater.cc:500] Master 127.6.50.190:39807 was elected leader, sending a full tablet report...
I20261117 14:49:16.651692 6856 consensus_queue.cc:261] T 57984748adc7482a9a2d999a447a81af P ec41d6947a4a4eadadf90c3756899704 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:16.652747 6765 tablet_service.cc:1500] Processing CreateTablet for tablet 57984748adc7482a9a2d999a447a81af (DEFAULT_TABLE table=test-workload [id=bc9c637ec15b4834b6657bcd92c82f8b]), partition=RANGE (key) PARTITION 1073741823 <= VALUES < 1431655764
I20261117 14:49:16.653249 6765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57984748adc7482a9a2d999a447a81af. 1 dirs total, 0 dirs full, 0 dirs failed
I20261117 14:49:16.653832 6856 ts_tablet_manager.cc:1480] T 57984748adc7482a9a2d999a447a81af P ec41d6947a4a4eadadf90c3756899704: Time spent starting tablet: real 0.011s user 0.010s sys 0.000s
I20261117 14:49:16.654361 6856 tablet_bootstrap.cc:492] T 5c849aa2a21a4c13b2e31d2ca3f692cc P ec41d6947a4a4eadadf90c3756899704: Bootstrap starting.
I20261117 14:49:16.654242 6763 tablet_service.cc:1500] Processing CreateTablet for tablet 5c849aa2a21a4c13b2e31d2ca3f692cc (DEFAULT_TABLE table=test-workload [id=bc9c637ec15b4834b6657bcd92c82f8b]), partition=RANGE (key) PARTITION 1789569705 <= VALUES
I20261117 14:49:16.654695 6763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c849aa2a21a4c13b2e31d2ca3f692cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20261117 14:49:16.656286 6857 ts_tablet_manager.cc:1480] T 47d9af37b05545f0b5b0c033f4ec953f P c7900e455dd64c68bccfc499bda413f7: Time spent starting tablet: real 0.021s user 0.015s sys 0.001s
I20261117 14:49:16.657022 6857 tablet_bootstrap.cc:492] T 3cea00abcccd4b1284393ef8b406cab1 P c7900e455dd64c68bccfc499bda413f7: Bootstrap starting.
I20261117 14:49:16.659425 6857 tablet_bootstrap.cc:654] T 3cea00abcccd4b1284393ef8b406cab1 P c7900e455dd64c68bccfc499bda413f7: Neither blocks nor log segments found. Creating new log.
I20261117 14:49:16.662127 6856 tablet_bootstrap.cc:654] T 5c849aa2a21a4c13b2e31d2ca3f692cc P ec41d6947a4a4eadadf90c3756899704: Neither blocks nor log segments found. Creating new log.
I20261117 14:49:16.662825 6857 tablet_bootstrap.cc:492] T 3cea00abcccd4b1284393ef8b406cab1 P c7900e455dd64c68bccfc499bda413f7: No bootstrap required, opened a new log
I20261117 14:49:16.663024 6857 ts_tablet_manager.cc:1449] T 3cea00abcccd4b1284393ef8b406cab1 P c7900e455dd64c68bccfc499bda413f7: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20261117 14:49:16.663776 6767 tablet_service.cc:1500] Processing CreateTablet for tablet d1732d75bf044feb8884fc3135373072 (DEFAULT_TABLE table=test-workload [id=bc9c637ec15b4834b6657bcd92c82f8b]), partition=RANGE (key) PARTITION 357913941 <= VALUES < 715827882
I20261117 14:49:16.663868 6857 raft_consensus.cc:360] T 3cea00abcccd4b1284393ef8b406cab1 P c7900e455dd64c68bccfc499bda413f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:16.664116 6857 raft_consensus.cc:386] T 3cea00abcccd4b1284393ef8b406cab1 P c7900e455dd64c68bccfc499bda413f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261117 14:49:16.664255 6857 raft_consensus.cc:748] T 3cea00abcccd4b1284393ef8b406cab1 P c7900e455dd64c68bccfc499bda413f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7900e455dd64c68bccfc499bda413f7, State: Initialized, Role: FOLLOWER
I20261117 14:49:16.664336 6767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1732d75bf044feb8884fc3135373072. 1 dirs total, 0 dirs full, 0 dirs failed
I20261117 14:49:16.664618 6857 consensus_queue.cc:261] T 3cea00abcccd4b1284393ef8b406cab1 P c7900e455dd64c68bccfc499bda413f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:16.665212 6857 ts_tablet_manager.cc:1480] T 3cea00abcccd4b1284393ef8b406cab1 P c7900e455dd64c68bccfc499bda413f7: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20261117 14:49:16.665539 6857 tablet_bootstrap.cc:492] T 57984748adc7482a9a2d999a447a81af P c7900e455dd64c68bccfc499bda413f7: Bootstrap starting.
I20261117 14:49:16.667228 6857 tablet_bootstrap.cc:654] T 57984748adc7482a9a2d999a447a81af P c7900e455dd64c68bccfc499bda413f7: Neither blocks nor log segments found. Creating new log.
I20261117 14:49:16.678478 6860 raft_consensus.cc:499] T 47d9af37b05545f0b5b0c033f4ec953f P c7900e455dd64c68bccfc499bda413f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261117 14:49:16.678736 6860 raft_consensus.cc:521] T 47d9af37b05545f0b5b0c033f4ec953f P c7900e455dd64c68bccfc499bda413f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:16.680224 6865 tablet_bootstrap.cc:492] T b74e748e97c84edeabc1c0cb41ddae99 P def6b23bccc94a78a47118da331f2798: Bootstrap starting.
I20261117 14:49:16.681932 6856 tablet_bootstrap.cc:492] T 5c849aa2a21a4c13b2e31d2ca3f692cc P ec41d6947a4a4eadadf90c3756899704: No bootstrap required, opened a new log
I20261117 14:49:16.682194 6856 ts_tablet_manager.cc:1449] T 5c849aa2a21a4c13b2e31d2ca3f692cc P ec41d6947a4a4eadadf90c3756899704: Time spent bootstrapping tablet: real 0.028s user 0.002s sys 0.006s
I20261117 14:49:16.682801 6860 leader_election.cc:290] T 47d9af37b05545f0b5b0c033f4ec953f P c7900e455dd64c68bccfc499bda413f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937), def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611)
I20261117 14:49:16.683509 6856 raft_consensus.cc:360] T 5c849aa2a21a4c13b2e31d2ca3f692cc P ec41d6947a4a4eadadf90c3756899704 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:16.683884 6856 raft_consensus.cc:386] T 5c849aa2a21a4c13b2e31d2ca3f692cc P ec41d6947a4a4eadadf90c3756899704 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261117 14:49:16.684051 6856 raft_consensus.cc:748] T 5c849aa2a21a4c13b2e31d2ca3f692cc P ec41d6947a4a4eadadf90c3756899704 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec41d6947a4a4eadadf90c3756899704, State: Initialized, Role: FOLLOWER
I20261117 14:49:16.684402 6856 consensus_queue.cc:261] T 5c849aa2a21a4c13b2e31d2ca3f692cc P ec41d6947a4a4eadadf90c3756899704 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:16.685232 6856 ts_tablet_manager.cc:1480] T 5c849aa2a21a4c13b2e31d2ca3f692cc P ec41d6947a4a4eadadf90c3756899704: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20261117 14:49:16.685634 6856 tablet_bootstrap.cc:492] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704: Bootstrap starting.
I20261117 14:49:16.686933 6861 raft_consensus.cc:499] T 57984748adc7482a9a2d999a447a81af P ec41d6947a4a4eadadf90c3756899704 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261117 14:49:16.687178 6861 raft_consensus.cc:521] T 57984748adc7482a9a2d999a447a81af P ec41d6947a4a4eadadf90c3756899704 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:16.688199 6856 tablet_bootstrap.cc:654] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704: Neither blocks nor log segments found. Creating new log.
I20261117 14:49:16.688652 6865 tablet_bootstrap.cc:654] T b74e748e97c84edeabc1c0cb41ddae99 P def6b23bccc94a78a47118da331f2798: Neither blocks nor log segments found. Creating new log.
I20261117 14:49:16.689543 6861 leader_election.cc:290] T 57984748adc7482a9a2d999a447a81af P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271), def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611)
I20261117 14:49:16.690105 6865 log.cc:826] T b74e748e97c84edeabc1c0cb41ddae99 P def6b23bccc94a78a47118da331f2798: Log is configured to *not* fsync() on all Append() calls
I20261117 14:49:16.701483 6857 tablet_bootstrap.cc:492] T 57984748adc7482a9a2d999a447a81af P c7900e455dd64c68bccfc499bda413f7: No bootstrap required, opened a new log
I20261117 14:49:16.701756 6857 ts_tablet_manager.cc:1449] T 57984748adc7482a9a2d999a447a81af P c7900e455dd64c68bccfc499bda413f7: Time spent bootstrapping tablet: real 0.036s user 0.007s sys 0.004s
I20261117 14:49:16.702692 6857 raft_consensus.cc:360] T 57984748adc7482a9a2d999a447a81af P c7900e455dd64c68bccfc499bda413f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:16.702970 6857 raft_consensus.cc:386] T 57984748adc7482a9a2d999a447a81af P c7900e455dd64c68bccfc499bda413f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261117 14:49:16.703069 6857 raft_consensus.cc:748] T 57984748adc7482a9a2d999a447a81af P c7900e455dd64c68bccfc499bda413f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7900e455dd64c68bccfc499bda413f7, State: Initialized, Role: FOLLOWER
I20261117 14:49:16.705920 6860 raft_consensus.cc:499] T 3cea00abcccd4b1284393ef8b406cab1 P c7900e455dd64c68bccfc499bda413f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261117 14:49:16.706238 6860 raft_consensus.cc:521] T 3cea00abcccd4b1284393ef8b406cab1 P c7900e455dd64c68bccfc499bda413f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:16.706856 6857 consensus_queue.cc:261] T 57984748adc7482a9a2d999a447a81af P c7900e455dd64c68bccfc499bda413f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:16.707255 6860 leader_election.cc:290] T 3cea00abcccd4b1284393ef8b406cab1 P c7900e455dd64c68bccfc499bda413f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937), def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611)
I20261117 14:49:16.710454 6857 ts_tablet_manager.cc:1480] T 57984748adc7482a9a2d999a447a81af P c7900e455dd64c68bccfc499bda413f7: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20261117 14:49:16.710852 6857 tablet_bootstrap.cc:492] T 5c849aa2a21a4c13b2e31d2ca3f692cc P c7900e455dd64c68bccfc499bda413f7: Bootstrap starting.
I20261117 14:49:16.721432 6527 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "47d9af37b05545f0b5b0c033f4ec953f" candidate_uuid: "c7900e455dd64c68bccfc499bda413f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec41d6947a4a4eadadf90c3756899704" is_pre_election: true
W20261117 14:49:16.723280 6704 tablet.cc:2441] T 3cea00abcccd4b1284393ef8b406cab1 P c7900e455dd64c68bccfc499bda413f7: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20261117 14:49:16.723989 6704 tablet_replica_mm_ops.cc:318] Log GC is disabled (check --enable_log_gc)
I20261117 14:49:16.721827 6788 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "47d9af37b05545f0b5b0c033f4ec953f" candidate_uuid: "c7900e455dd64c68bccfc499bda413f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "def6b23bccc94a78a47118da331f2798" is_pre_election: true
I20261117 14:49:16.724988 6527 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "3cea00abcccd4b1284393ef8b406cab1" candidate_uuid: "c7900e455dd64c68bccfc499bda413f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec41d6947a4a4eadadf90c3756899704" is_pre_election: true
I20261117 14:49:16.726172 6788 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "3cea00abcccd4b1284393ef8b406cab1" candidate_uuid: "c7900e455dd64c68bccfc499bda413f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "def6b23bccc94a78a47118da331f2798" is_pre_election: true
I20261117 14:49:16.727351 6857 tablet_bootstrap.cc:654] T 5c849aa2a21a4c13b2e31d2ca3f692cc P c7900e455dd64c68bccfc499bda413f7: Neither blocks nor log segments found. Creating new log.
W20261117 14:49:16.728236 6594 leader_election.cc:343] T 47d9af37b05545f0b5b0c033f4ec953f P c7900e455dd64c68bccfc499bda413f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611): Illegal state: must be running to vote when last-logged opid is not known
W20261117 14:49:16.728610 6594 leader_election.cc:343] T 3cea00abcccd4b1284393ef8b406cab1 P c7900e455dd64c68bccfc499bda413f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611): Illegal state: must be running to vote when last-logged opid is not known
W20261117 14:49:16.728837 6594 leader_election.cc:343] T 47d9af37b05545f0b5b0c033f4ec953f P c7900e455dd64c68bccfc499bda413f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Illegal state: must be running to vote when last-logged opid is not known
I20261117 14:49:16.728986 6594 leader_election.cc:304] T 47d9af37b05545f0b5b0c033f4ec953f P c7900e455dd64c68bccfc499bda413f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7900e455dd64c68bccfc499bda413f7; no voters: def6b23bccc94a78a47118da331f2798, ec41d6947a4a4eadadf90c3756899704
I20261117 14:49:16.729454 6873 raft_consensus.cc:2771] T 47d9af37b05545f0b5b0c033f4ec953f P c7900e455dd64c68bccfc499bda413f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20261117 14:49:16.729764 6594 leader_election.cc:343] T 3cea00abcccd4b1284393ef8b406cab1 P c7900e455dd64c68bccfc499bda413f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Illegal state: must be running to vote when last-logged opid is not known
I20261117 14:49:16.729899 6594 leader_election.cc:304] T 3cea00abcccd4b1284393ef8b406cab1 P c7900e455dd64c68bccfc499bda413f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7900e455dd64c68bccfc499bda413f7; no voters: def6b23bccc94a78a47118da331f2798, ec41d6947a4a4eadadf90c3756899704
I20261117 14:49:16.730072 6865 tablet_bootstrap.cc:492] T b74e748e97c84edeabc1c0cb41ddae99 P def6b23bccc94a78a47118da331f2798: No bootstrap required, opened a new log
I20261117 14:49:16.730261 6873 raft_consensus.cc:2771] T 3cea00abcccd4b1284393ef8b406cab1 P c7900e455dd64c68bccfc499bda413f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20261117 14:49:16.730399 6865 ts_tablet_manager.cc:1449] T b74e748e97c84edeabc1c0cb41ddae99 P def6b23bccc94a78a47118da331f2798: Time spent bootstrapping tablet: real 0.050s user 0.006s sys 0.014s
I20261117 14:49:16.731536 6856 tablet_bootstrap.cc:492] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704: No bootstrap required, opened a new log
I20261117 14:49:16.731853 6856 ts_tablet_manager.cc:1449] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704: Time spent bootstrapping tablet: real 0.046s user 0.021s sys 0.021s
I20261117 14:49:16.733271 6856 raft_consensus.cc:360] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:16.733707 6856 raft_consensus.cc:386] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261117 14:49:16.733894 6856 raft_consensus.cc:748] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec41d6947a4a4eadadf90c3756899704, State: Initialized, Role: FOLLOWER
I20261117 14:49:16.734499 6856 consensus_queue.cc:261] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:16.735350 6856 ts_tablet_manager.cc:1480] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20261117 14:49:16.736006 6856 tablet_bootstrap.cc:492] T b74e748e97c84edeabc1c0cb41ddae99 P ec41d6947a4a4eadadf90c3756899704: Bootstrap starting.
I20261117 14:49:16.736058 6865 raft_consensus.cc:360] T b74e748e97c84edeabc1c0cb41ddae99 P def6b23bccc94a78a47118da331f2798 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:16.738476 6856 tablet_bootstrap.cc:654] T b74e748e97c84edeabc1c0cb41ddae99 P ec41d6947a4a4eadadf90c3756899704: Neither blocks nor log segments found. Creating new log.
I20261117 14:49:16.736424 6865 raft_consensus.cc:386] T b74e748e97c84edeabc1c0cb41ddae99 P def6b23bccc94a78a47118da331f2798 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261117 14:49:16.738821 6865 raft_consensus.cc:748] T b74e748e97c84edeabc1c0cb41ddae99 P def6b23bccc94a78a47118da331f2798 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: def6b23bccc94a78a47118da331f2798, State: Initialized, Role: FOLLOWER
I20261117 14:49:16.739285 6788 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "57984748adc7482a9a2d999a447a81af" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "def6b23bccc94a78a47118da331f2798" is_pre_election: true
I20261117 14:49:16.739647 6865 consensus_queue.cc:261] T b74e748e97c84edeabc1c0cb41ddae99 P def6b23bccc94a78a47118da331f2798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
W20261117 14:49:16.739934 6463 leader_election.cc:343] T 57984748adc7482a9a2d999a447a81af P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611): Illegal state: must be running to vote when last-logged opid is not known
I20261117 14:49:16.740880 6857 tablet_bootstrap.cc:492] T 5c849aa2a21a4c13b2e31d2ca3f692cc P c7900e455dd64c68bccfc499bda413f7: No bootstrap required, opened a new log
I20261117 14:49:16.741071 6857 ts_tablet_manager.cc:1449] T 5c849aa2a21a4c13b2e31d2ca3f692cc P c7900e455dd64c68bccfc499bda413f7: Time spent bootstrapping tablet: real 0.030s user 0.009s sys 0.003s
I20261117 14:49:16.740965 6658 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "57984748adc7482a9a2d999a447a81af" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7900e455dd64c68bccfc499bda413f7" is_pre_election: true
I20261117 14:49:16.741379 6658 raft_consensus.cc:2490] T 57984748adc7482a9a2d999a447a81af P c7900e455dd64c68bccfc499bda413f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec41d6947a4a4eadadf90c3756899704 in term 0.
I20261117 14:49:16.741523 6833 heartbeater.cc:500] Master 127.6.50.190:39807 was elected leader, sending a full tablet report...
I20261117 14:49:16.741937 6857 raft_consensus.cc:360] T 5c849aa2a21a4c13b2e31d2ca3f692cc P c7900e455dd64c68bccfc499bda413f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:16.742128 6857 raft_consensus.cc:386] T 5c849aa2a21a4c13b2e31d2ca3f692cc P c7900e455dd64c68bccfc499bda413f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261117 14:49:16.742057 6462 leader_election.cc:304] T 57984748adc7482a9a2d999a447a81af P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c7900e455dd64c68bccfc499bda413f7, ec41d6947a4a4eadadf90c3756899704; no voters: def6b23bccc94a78a47118da331f2798
I20261117 14:49:16.742208 6857 raft_consensus.cc:748] T 5c849aa2a21a4c13b2e31d2ca3f692cc P c7900e455dd64c68bccfc499bda413f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7900e455dd64c68bccfc499bda413f7, State: Initialized, Role: FOLLOWER
I20261117 14:49:16.742417 6857 consensus_queue.cc:261] T 5c849aa2a21a4c13b2e31d2ca3f692cc P c7900e455dd64c68bccfc499bda413f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:16.742782 6861 raft_consensus.cc:2826] T 57984748adc7482a9a2d999a447a81af P ec41d6947a4a4eadadf90c3756899704 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20261117 14:49:16.742918 6861 raft_consensus.cc:499] T 57984748adc7482a9a2d999a447a81af P ec41d6947a4a4eadadf90c3756899704 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20261117 14:49:16.743012 6861 raft_consensus.cc:3096] T 57984748adc7482a9a2d999a447a81af P ec41d6947a4a4eadadf90c3756899704 [term 0 FOLLOWER]: Advancing to term 1
I20261117 14:49:16.743067 6865 ts_tablet_manager.cc:1480] T b74e748e97c84edeabc1c0cb41ddae99 P def6b23bccc94a78a47118da331f2798: Time spent starting tablet: real 0.013s user 0.005s sys 0.004s
I20261117 14:49:16.743290 6857 ts_tablet_manager.cc:1480] T 5c849aa2a21a4c13b2e31d2ca3f692cc P c7900e455dd64c68bccfc499bda413f7: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20261117 14:49:16.743563 6865 tablet_bootstrap.cc:492] T 57984748adc7482a9a2d999a447a81af P def6b23bccc94a78a47118da331f2798: Bootstrap starting.
I20261117 14:49:16.745875 6865 tablet_bootstrap.cc:654] T 57984748adc7482a9a2d999a447a81af P def6b23bccc94a78a47118da331f2798: Neither blocks nor log segments found. Creating new log.
I20261117 14:49:16.746090 6861 raft_consensus.cc:521] T 57984748adc7482a9a2d999a447a81af P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
W20261117 14:49:16.742781 6573 tablet.cc:2441] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20261117 14:49:16.747888 6573 tablet_replica_mm_ops.cc:318] Log GC is disabled (check --enable_log_gc)
I20261117 14:49:16.748420 6658 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "57984748adc7482a9a2d999a447a81af" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7900e455dd64c68bccfc499bda413f7"
I20261117 14:49:16.748503 6856 tablet_bootstrap.cc:492] T b74e748e97c84edeabc1c0cb41ddae99 P ec41d6947a4a4eadadf90c3756899704: No bootstrap required, opened a new log
I20261117 14:49:16.748636 6658 raft_consensus.cc:3096] T 57984748adc7482a9a2d999a447a81af P c7900e455dd64c68bccfc499bda413f7 [term 0 FOLLOWER]: Advancing to term 1
I20261117 14:49:16.748703 6856 ts_tablet_manager.cc:1449] T b74e748e97c84edeabc1c0cb41ddae99 P ec41d6947a4a4eadadf90c3756899704: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.003s
I20261117 14:49:16.749837 6856 raft_consensus.cc:360] T b74e748e97c84edeabc1c0cb41ddae99 P ec41d6947a4a4eadadf90c3756899704 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:16.750115 6856 raft_consensus.cc:386] T b74e748e97c84edeabc1c0cb41ddae99 P ec41d6947a4a4eadadf90c3756899704 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261117 14:49:16.750229 6856 raft_consensus.cc:748] T b74e748e97c84edeabc1c0cb41ddae99 P ec41d6947a4a4eadadf90c3756899704 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec41d6947a4a4eadadf90c3756899704, State: Initialized, Role: FOLLOWER
I20261117 14:49:16.750550 6856 consensus_queue.cc:261] T b74e748e97c84edeabc1c0cb41ddae99 P ec41d6947a4a4eadadf90c3756899704 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:16.751241 6857 tablet_bootstrap.cc:492] T d1732d75bf044feb8884fc3135373072 P c7900e455dd64c68bccfc499bda413f7: Bootstrap starting.
I20261117 14:49:16.751691 6658 raft_consensus.cc:2490] T 57984748adc7482a9a2d999a447a81af P c7900e455dd64c68bccfc499bda413f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec41d6947a4a4eadadf90c3756899704 in term 1.
I20261117 14:49:16.752503 6462 leader_election.cc:304] T 57984748adc7482a9a2d999a447a81af P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c7900e455dd64c68bccfc499bda413f7, ec41d6947a4a4eadadf90c3756899704; no voters:
I20261117 14:49:16.753213 6857 tablet_bootstrap.cc:654] T d1732d75bf044feb8884fc3135373072 P c7900e455dd64c68bccfc499bda413f7: Neither blocks nor log segments found. Creating new log.
I20261117 14:49:16.753333 6861 leader_election.cc:290] T 57984748adc7482a9a2d999a447a81af P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 1 election: Requested vote from peers c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271), def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611)
I20261117 14:49:16.754685 6861 raft_consensus.cc:2826] T 57984748adc7482a9a2d999a447a81af P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Leader election won for term 1
I20261117 14:49:16.755167 6861 raft_consensus.cc:705] T 57984748adc7482a9a2d999a447a81af P ec41d6947a4a4eadadf90c3756899704 [term 1 LEADER]: Becoming Leader. State: Replica: ec41d6947a4a4eadadf90c3756899704, State: Running, Role: LEADER
I20261117 14:49:16.756042 6861 consensus_queue.cc:238] T 57984748adc7482a9a2d999a447a81af P ec41d6947a4a4eadadf90c3756899704 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:16.757380 6788 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "57984748adc7482a9a2d999a447a81af" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "def6b23bccc94a78a47118da331f2798"
W20261117 14:49:16.758095 6463 leader_election.cc:343] T 57984748adc7482a9a2d999a447a81af P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611): Illegal state: must be running to vote when last-logged opid is not known
I20261117 14:49:16.759456 6873 raft_consensus.cc:499] T 5c849aa2a21a4c13b2e31d2ca3f692cc P c7900e455dd64c68bccfc499bda413f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261117 14:49:16.759678 6873 raft_consensus.cc:521] T 5c849aa2a21a4c13b2e31d2ca3f692cc P c7900e455dd64c68bccfc499bda413f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:16.760589 6873 leader_election.cc:290] T 5c849aa2a21a4c13b2e31d2ca3f692cc P c7900e455dd64c68bccfc499bda413f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937), def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611)
I20261117 14:49:16.760749 6856 ts_tablet_manager.cc:1480] T b74e748e97c84edeabc1c0cb41ddae99 P ec41d6947a4a4eadadf90c3756899704: Time spent starting tablet: real 0.012s user 0.004s sys 0.008s
I20261117 14:49:16.761200 6527 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5c849aa2a21a4c13b2e31d2ca3f692cc" candidate_uuid: "c7900e455dd64c68bccfc499bda413f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec41d6947a4a4eadadf90c3756899704" is_pre_election: true
I20261117 14:49:16.761334 6856 tablet_bootstrap.cc:492] T d1732d75bf044feb8884fc3135373072 P ec41d6947a4a4eadadf90c3756899704: Bootstrap starting.
I20261117 14:49:16.761281 6788 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5c849aa2a21a4c13b2e31d2ca3f692cc" candidate_uuid: "c7900e455dd64c68bccfc499bda413f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "def6b23bccc94a78a47118da331f2798" is_pre_election: true
I20261117 14:49:16.761415 6527 raft_consensus.cc:2490] T 5c849aa2a21a4c13b2e31d2ca3f692cc P ec41d6947a4a4eadadf90c3756899704 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7900e455dd64c68bccfc499bda413f7 in term 0.
W20261117 14:49:16.761911 6594 leader_election.cc:343] T 5c849aa2a21a4c13b2e31d2ca3f692cc P c7900e455dd64c68bccfc499bda413f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611): Illegal state: must be running to vote when last-logged opid is not known
I20261117 14:49:16.762181 6594 leader_election.cc:304] T 5c849aa2a21a4c13b2e31d2ca3f692cc P c7900e455dd64c68bccfc499bda413f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c7900e455dd64c68bccfc499bda413f7, ec41d6947a4a4eadadf90c3756899704; no voters: def6b23bccc94a78a47118da331f2798
I20261117 14:49:16.762755 6857 tablet_bootstrap.cc:492] T d1732d75bf044feb8884fc3135373072 P c7900e455dd64c68bccfc499bda413f7: No bootstrap required, opened a new log
I20261117 14:49:16.762727 6873 raft_consensus.cc:2826] T 5c849aa2a21a4c13b2e31d2ca3f692cc P c7900e455dd64c68bccfc499bda413f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20261117 14:49:16.762874 6873 raft_consensus.cc:499] T 5c849aa2a21a4c13b2e31d2ca3f692cc P c7900e455dd64c68bccfc499bda413f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20261117 14:49:16.762948 6857 ts_tablet_manager.cc:1449] T d1732d75bf044feb8884fc3135373072 P c7900e455dd64c68bccfc499bda413f7: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.003s
I20261117 14:49:16.762995 6873 raft_consensus.cc:3096] T 5c849aa2a21a4c13b2e31d2ca3f692cc P c7900e455dd64c68bccfc499bda413f7 [term 0 FOLLOWER]: Advancing to term 1
I20261117 14:49:16.763748 6856 tablet_bootstrap.cc:654] T d1732d75bf044feb8884fc3135373072 P ec41d6947a4a4eadadf90c3756899704: Neither blocks nor log segments found. Creating new log.
I20261117 14:49:16.763785 6857 raft_consensus.cc:360] T d1732d75bf044feb8884fc3135373072 P c7900e455dd64c68bccfc499bda413f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:16.764014 6857 raft_consensus.cc:386] T d1732d75bf044feb8884fc3135373072 P c7900e455dd64c68bccfc499bda413f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261117 14:49:16.764110 6857 raft_consensus.cc:748] T d1732d75bf044feb8884fc3135373072 P c7900e455dd64c68bccfc499bda413f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7900e455dd64c68bccfc499bda413f7, State: Initialized, Role: FOLLOWER
I20261117 14:49:16.764346 6857 consensus_queue.cc:261] T d1732d75bf044feb8884fc3135373072 P c7900e455dd64c68bccfc499bda413f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:16.766151 6873 raft_consensus.cc:521] T 5c849aa2a21a4c13b2e31d2ca3f692cc P c7900e455dd64c68bccfc499bda413f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:16.767333 6857 ts_tablet_manager.cc:1480] T d1732d75bf044feb8884fc3135373072 P c7900e455dd64c68bccfc499bda413f7: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20261117 14:49:16.767560 6527 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5c849aa2a21a4c13b2e31d2ca3f692cc" candidate_uuid: "c7900e455dd64c68bccfc499bda413f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec41d6947a4a4eadadf90c3756899704"
I20261117 14:49:16.767691 6857 tablet_bootstrap.cc:492] T b74e748e97c84edeabc1c0cb41ddae99 P c7900e455dd64c68bccfc499bda413f7: Bootstrap starting.
I20261117 14:49:16.767764 6527 raft_consensus.cc:3096] T 5c849aa2a21a4c13b2e31d2ca3f692cc P ec41d6947a4a4eadadf90c3756899704 [term 0 FOLLOWER]: Advancing to term 1
I20261117 14:49:16.770398 6865 tablet_bootstrap.cc:492] T 57984748adc7482a9a2d999a447a81af P def6b23bccc94a78a47118da331f2798: No bootstrap required, opened a new log
I20261117 14:49:16.770565 6865 ts_tablet_manager.cc:1449] T 57984748adc7482a9a2d999a447a81af P def6b23bccc94a78a47118da331f2798: Time spent bootstrapping tablet: real 0.027s user 0.011s sys 0.005s
I20261117 14:49:16.771574 6865 raft_consensus.cc:360] T 57984748adc7482a9a2d999a447a81af P def6b23bccc94a78a47118da331f2798 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:16.771716 6527 raft_consensus.cc:2490] T 5c849aa2a21a4c13b2e31d2ca3f692cc P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7900e455dd64c68bccfc499bda413f7 in term 1.
I20261117 14:49:16.771766 6865 raft_consensus.cc:386] T 57984748adc7482a9a2d999a447a81af P def6b23bccc94a78a47118da331f2798 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261117 14:49:16.771857 6865 raft_consensus.cc:748] T 57984748adc7482a9a2d999a447a81af P def6b23bccc94a78a47118da331f2798 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: def6b23bccc94a78a47118da331f2798, State: Initialized, Role: FOLLOWER
I20261117 14:49:16.772091 6865 consensus_queue.cc:261] T 57984748adc7482a9a2d999a447a81af P def6b23bccc94a78a47118da331f2798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:16.772611 6865 ts_tablet_manager.cc:1480] T 57984748adc7482a9a2d999a447a81af P def6b23bccc94a78a47118da331f2798: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20261117 14:49:16.773928 6865 tablet_bootstrap.cc:492] T 5c849aa2a21a4c13b2e31d2ca3f692cc P def6b23bccc94a78a47118da331f2798: Bootstrap starting.
I20261117 14:49:16.774693 6594 leader_election.cc:304] T 5c849aa2a21a4c13b2e31d2ca3f692cc P c7900e455dd64c68bccfc499bda413f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c7900e455dd64c68bccfc499bda413f7, ec41d6947a4a4eadadf90c3756899704; no voters:
I20261117 14:49:16.775028 6860 raft_consensus.cc:2826] T 5c849aa2a21a4c13b2e31d2ca3f692cc P c7900e455dd64c68bccfc499bda413f7 [term 1 FOLLOWER]: Leader election won for term 1
I20261117 14:49:16.776021 6865 tablet_bootstrap.cc:654] T 5c849aa2a21a4c13b2e31d2ca3f692cc P def6b23bccc94a78a47118da331f2798: Neither blocks nor log segments found. Creating new log.
I20261117 14:49:16.777648 6873 leader_election.cc:290] T 5c849aa2a21a4c13b2e31d2ca3f692cc P c7900e455dd64c68bccfc499bda413f7 [CANDIDATE]: Term 1 election: Requested vote from peers ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937), def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611)
I20261117 14:49:16.778355 6788 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5c849aa2a21a4c13b2e31d2ca3f692cc" candidate_uuid: "c7900e455dd64c68bccfc499bda413f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "def6b23bccc94a78a47118da331f2798"
I20261117 14:49:16.778898 6857 tablet_bootstrap.cc:654] T b74e748e97c84edeabc1c0cb41ddae99 P c7900e455dd64c68bccfc499bda413f7: Neither blocks nor log segments found. Creating new log.
W20261117 14:49:16.779196 6594 leader_election.cc:343] T 5c849aa2a21a4c13b2e31d2ca3f692cc P c7900e455dd64c68bccfc499bda413f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611): Illegal state: must be running to vote when last-logged opid is not known
I20261117 14:49:16.779934 6860 raft_consensus.cc:705] T 5c849aa2a21a4c13b2e31d2ca3f692cc P c7900e455dd64c68bccfc499bda413f7 [term 1 LEADER]: Becoming Leader. State: Replica: c7900e455dd64c68bccfc499bda413f7, State: Running, Role: LEADER
I20261117 14:49:16.780759 6860 consensus_queue.cc:238] T 5c849aa2a21a4c13b2e31d2ca3f692cc P c7900e455dd64c68bccfc499bda413f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:16.784340 6878 raft_consensus.cc:499] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261117 14:49:16.784667 6878 raft_consensus.cc:521] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:16.786043 6857 tablet_bootstrap.cc:492] T b74e748e97c84edeabc1c0cb41ddae99 P c7900e455dd64c68bccfc499bda413f7: No bootstrap required, opened a new log
I20261117 14:49:16.786183 6658 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "3cea00abcccd4b1284393ef8b406cab1" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7900e455dd64c68bccfc499bda413f7" is_pre_election: true
I20261117 14:49:16.786430 6658 raft_consensus.cc:2490] T 3cea00abcccd4b1284393ef8b406cab1 P c7900e455dd64c68bccfc499bda413f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec41d6947a4a4eadadf90c3756899704 in term 0.
I20261117 14:49:16.786945 6462 leader_election.cc:304] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c7900e455dd64c68bccfc499bda413f7, ec41d6947a4a4eadadf90c3756899704; no voters:
I20261117 14:49:16.787226 6865 tablet_bootstrap.cc:492] T 5c849aa2a21a4c13b2e31d2ca3f692cc P def6b23bccc94a78a47118da331f2798: No bootstrap required, opened a new log
I20261117 14:49:16.787523 6876 raft_consensus.cc:499] T 57984748adc7482a9a2d999a447a81af P def6b23bccc94a78a47118da331f2798 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261117 14:49:16.787564 6879 raft_consensus.cc:2826] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20261117 14:49:16.787658 6879 raft_consensus.cc:499] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20261117 14:49:16.787765 6879 raft_consensus.cc:3096] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 [term 0 FOLLOWER]: Advancing to term 1
I20261117 14:49:16.787743 6876 raft_consensus.cc:521] T 57984748adc7482a9a2d999a447a81af P def6b23bccc94a78a47118da331f2798 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:16.789711 6876 leader_election.cc:290] T 57984748adc7482a9a2d999a447a81af P def6b23bccc94a78a47118da331f2798 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937), c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271)
I20261117 14:49:16.787389 6865 ts_tablet_manager.cc:1449] T 5c849aa2a21a4c13b2e31d2ca3f692cc P def6b23bccc94a78a47118da331f2798: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.006s
I20261117 14:49:16.790977 6879 raft_consensus.cc:521] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:16.791656 6865 raft_consensus.cc:360] T 5c849aa2a21a4c13b2e31d2ca3f692cc P def6b23bccc94a78a47118da331f2798 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:16.791839 6865 raft_consensus.cc:386] T 5c849aa2a21a4c13b2e31d2ca3f692cc P def6b23bccc94a78a47118da331f2798 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261117 14:49:16.791934 6865 raft_consensus.cc:748] T 5c849aa2a21a4c13b2e31d2ca3f692cc P def6b23bccc94a78a47118da331f2798 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: def6b23bccc94a78a47118da331f2798, State: Initialized, Role: FOLLOWER
I20261117 14:49:16.792307 6865 consensus_queue.cc:261] T 5c849aa2a21a4c13b2e31d2ca3f692cc P def6b23bccc94a78a47118da331f2798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:16.794765 6788 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "3cea00abcccd4b1284393ef8b406cab1" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "def6b23bccc94a78a47118da331f2798"
W20261117 14:49:16.797010 6463 leader_election.cc:343] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611): Illegal state: must be running to vote when last-logged opid is not known
I20261117 14:49:16.797590 6879 leader_election.cc:290] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 1 election: Requested vote from peers c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271), def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611)
I20261117 14:49:16.798597 6657 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "3cea00abcccd4b1284393ef8b406cab1" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7900e455dd64c68bccfc499bda413f7"
I20261117 14:49:16.798950 6657 raft_consensus.cc:3096] T 3cea00abcccd4b1284393ef8b406cab1 P c7900e455dd64c68bccfc499bda413f7 [term 0 FOLLOWER]: Advancing to term 1
I20261117 14:49:16.801337 6879 raft_consensus.cc:499] T b74e748e97c84edeabc1c0cb41ddae99 P ec41d6947a4a4eadadf90c3756899704 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261117 14:49:16.801512 6879 raft_consensus.cc:521] T b74e748e97c84edeabc1c0cb41ddae99 P ec41d6947a4a4eadadf90c3756899704 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:16.802578 6788 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "b74e748e97c84edeabc1c0cb41ddae99" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "def6b23bccc94a78a47118da331f2798" is_pre_election: true
I20261117 14:49:16.802836 6788 raft_consensus.cc:2490] T b74e748e97c84edeabc1c0cb41ddae99 P def6b23bccc94a78a47118da331f2798 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec41d6947a4a4eadadf90c3756899704 in term 0.
I20261117 14:49:16.803294 6463 leader_election.cc:304] T b74e748e97c84edeabc1c0cb41ddae99 P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: def6b23bccc94a78a47118da331f2798, ec41d6947a4a4eadadf90c3756899704; no voters:
I20261117 14:49:16.804553 6876 raft_consensus.cc:499] T b74e748e97c84edeabc1c0cb41ddae99 P def6b23bccc94a78a47118da331f2798 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261117 14:49:16.804708 6876 raft_consensus.cc:521] T b74e748e97c84edeabc1c0cb41ddae99 P def6b23bccc94a78a47118da331f2798 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:16.805426 6876 leader_election.cc:290] T b74e748e97c84edeabc1c0cb41ddae99 P def6b23bccc94a78a47118da331f2798 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271), ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937)
I20261117 14:49:16.806356 6879 leader_election.cc:290] T b74e748e97c84edeabc1c0cb41ddae99 P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271), def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611)
I20261117 14:49:16.806574 6879 raft_consensus.cc:2826] T b74e748e97c84edeabc1c0cb41ddae99 P ec41d6947a4a4eadadf90c3756899704 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20261117 14:49:16.806655 6879 raft_consensus.cc:499] T b74e748e97c84edeabc1c0cb41ddae99 P ec41d6947a4a4eadadf90c3756899704 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20261117 14:49:16.806753 6879 raft_consensus.cc:3096] T b74e748e97c84edeabc1c0cb41ddae99 P ec41d6947a4a4eadadf90c3756899704 [term 0 FOLLOWER]: Advancing to term 1
I20261117 14:49:16.809283 6526 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "b74e748e97c84edeabc1c0cb41ddae99" candidate_uuid: "def6b23bccc94a78a47118da331f2798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec41d6947a4a4eadadf90c3756899704" is_pre_election: true
I20261117 14:49:16.809563 6865 ts_tablet_manager.cc:1480] T 5c849aa2a21a4c13b2e31d2ca3f692cc P def6b23bccc94a78a47118da331f2798: Time spent starting tablet: real 0.019s user 0.002s sys 0.000s
I20261117 14:49:16.809741 6657 raft_consensus.cc:2490] T 3cea00abcccd4b1284393ef8b406cab1 P c7900e455dd64c68bccfc499bda413f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec41d6947a4a4eadadf90c3756899704 in term 1.
I20261117 14:49:16.809931 6527 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "57984748adc7482a9a2d999a447a81af" candidate_uuid: "def6b23bccc94a78a47118da331f2798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec41d6947a4a4eadadf90c3756899704" is_pre_election: true
I20261117 14:49:16.810528 6462 leader_election.cc:304] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c7900e455dd64c68bccfc499bda413f7, ec41d6947a4a4eadadf90c3756899704; no voters: def6b23bccc94a78a47118da331f2798
I20261117 14:49:16.810657 6865 tablet_bootstrap.cc:492] T d1732d75bf044feb8884fc3135373072 P def6b23bccc94a78a47118da331f2798: Bootstrap starting.
I20261117 14:49:16.812582 6857 ts_tablet_manager.cc:1449] T b74e748e97c84edeabc1c0cb41ddae99 P c7900e455dd64c68bccfc499bda413f7: Time spent bootstrapping tablet: real 0.045s user 0.003s sys 0.003s
I20261117 14:49:16.813225 6658 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "b74e748e97c84edeabc1c0cb41ddae99" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7900e455dd64c68bccfc499bda413f7" is_pre_election: true
I20261117 14:49:16.813536 6857 raft_consensus.cc:360] T b74e748e97c84edeabc1c0cb41ddae99 P c7900e455dd64c68bccfc499bda413f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:16.813748 6857 raft_consensus.cc:386] T b74e748e97c84edeabc1c0cb41ddae99 P c7900e455dd64c68bccfc499bda413f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261117 14:49:16.813855 6857 raft_consensus.cc:748] T b74e748e97c84edeabc1c0cb41ddae99 P c7900e455dd64c68bccfc499bda413f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7900e455dd64c68bccfc499bda413f7, State: Initialized, Role: FOLLOWER
I20261117 14:49:16.814105 6857 consensus_queue.cc:261] T b74e748e97c84edeabc1c0cb41ddae99 P c7900e455dd64c68bccfc499bda413f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:16.814764 6857 ts_tablet_manager.cc:1480] T b74e748e97c84edeabc1c0cb41ddae99 P c7900e455dd64c68bccfc499bda413f7: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
W20261117 14:49:16.814891 6462 leader_election.cc:343] T b74e748e97c84edeabc1c0cb41ddae99 P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271): Illegal state: must be running to vote when last-logged opid is not known
I20261117 14:49:16.815181 6865 tablet_bootstrap.cc:654] T d1732d75bf044feb8884fc3135373072 P def6b23bccc94a78a47118da331f2798: Neither blocks nor log segments found. Creating new log.
I20261117 14:49:16.817071 6888 raft_consensus.cc:2826] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Leader election won for term 1
I20261117 14:49:16.817693 6658 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "57984748adc7482a9a2d999a447a81af" candidate_uuid: "def6b23bccc94a78a47118da331f2798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7900e455dd64c68bccfc499bda413f7" is_pre_election: true
I20261117 14:49:16.817749 6657 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "b74e748e97c84edeabc1c0cb41ddae99" candidate_uuid: "def6b23bccc94a78a47118da331f2798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7900e455dd64c68bccfc499bda413f7" is_pre_election: true
I20261117 14:49:16.818018 6657 raft_consensus.cc:2490] T b74e748e97c84edeabc1c0cb41ddae99 P c7900e455dd64c68bccfc499bda413f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate def6b23bccc94a78a47118da331f2798 in term 0.
I20261117 14:49:16.818270 6658 raft_consensus.cc:2415] T 57984748adc7482a9a2d999a447a81af P c7900e455dd64c68bccfc499bda413f7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate def6b23bccc94a78a47118da331f2798 in current term 1: Already voted for candidate ec41d6947a4a4eadadf90c3756899704 in this term.
I20261117 14:49:16.819067 6723 leader_election.cc:304] T b74e748e97c84edeabc1c0cb41ddae99 P def6b23bccc94a78a47118da331f2798 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c7900e455dd64c68bccfc499bda413f7, def6b23bccc94a78a47118da331f2798; no voters:
I20261117 14:49:16.819727 6876 raft_consensus.cc:2826] T b74e748e97c84edeabc1c0cb41ddae99 P def6b23bccc94a78a47118da331f2798 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20261117 14:49:16.819795 6723 leader_election.cc:304] T 57984748adc7482a9a2d999a447a81af P def6b23bccc94a78a47118da331f2798 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: def6b23bccc94a78a47118da331f2798; no voters: c7900e455dd64c68bccfc499bda413f7, ec41d6947a4a4eadadf90c3756899704
I20261117 14:49:16.819903 6876 raft_consensus.cc:499] T b74e748e97c84edeabc1c0cb41ddae99 P def6b23bccc94a78a47118da331f2798 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20261117 14:49:16.820014 6876 raft_consensus.cc:3096] T b74e748e97c84edeabc1c0cb41ddae99 P def6b23bccc94a78a47118da331f2798 [term 0 FOLLOWER]: Advancing to term 1
I20261117 14:49:16.821524 6879 raft_consensus.cc:521] T b74e748e97c84edeabc1c0cb41ddae99 P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:16.821935 6526 raft_consensus.cc:2415] T b74e748e97c84edeabc1c0cb41ddae99 P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate def6b23bccc94a78a47118da331f2798 in current term 1: Already voted for candidate ec41d6947a4a4eadadf90c3756899704 in this term.
I20261117 14:49:16.823221 6876 raft_consensus.cc:521] T b74e748e97c84edeabc1c0cb41ddae99 P def6b23bccc94a78a47118da331f2798 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:16.823912 6876 leader_election.cc:290] T b74e748e97c84edeabc1c0cb41ddae99 P def6b23bccc94a78a47118da331f2798 [CANDIDATE]: Term 1 election: Requested vote from peers c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271), ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937)
I20261117 14:49:16.824118 6876 raft_consensus.cc:3096] T 57984748adc7482a9a2d999a447a81af P def6b23bccc94a78a47118da331f2798 [term 0 FOLLOWER]: Advancing to term 1
I20261117 14:49:16.824319 6879 leader_election.cc:290] T b74e748e97c84edeabc1c0cb41ddae99 P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 1 election: Requested vote from peers c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271), def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611)
I20261117 14:49:16.825049 6658 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "b74e748e97c84edeabc1c0cb41ddae99" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7900e455dd64c68bccfc499bda413f7"
I20261117 14:49:16.825107 6788 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "b74e748e97c84edeabc1c0cb41ddae99" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "def6b23bccc94a78a47118da331f2798"
I20261117 14:49:16.825305 6658 raft_consensus.cc:3096] T b74e748e97c84edeabc1c0cb41ddae99 P c7900e455dd64c68bccfc499bda413f7 [term 0 FOLLOWER]: Advancing to term 1
I20261117 14:49:16.825496 6788 raft_consensus.cc:2415] T b74e748e97c84edeabc1c0cb41ddae99 P def6b23bccc94a78a47118da331f2798 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ec41d6947a4a4eadadf90c3756899704 in current term 1: Already voted for candidate def6b23bccc94a78a47118da331f2798 in this term.
I20261117 14:49:16.825994 6526 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "b74e748e97c84edeabc1c0cb41ddae99" candidate_uuid: "def6b23bccc94a78a47118da331f2798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec41d6947a4a4eadadf90c3756899704"
I20261117 14:49:16.826242 6526 raft_consensus.cc:2415] T b74e748e97c84edeabc1c0cb41ddae99 P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate def6b23bccc94a78a47118da331f2798 in current term 1: Already voted for candidate ec41d6947a4a4eadadf90c3756899704 in this term.
I20261117 14:49:16.828145 6876 raft_consensus.cc:2771] T 57984748adc7482a9a2d999a447a81af P def6b23bccc94a78a47118da331f2798 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20261117 14:49:16.829610 6658 raft_consensus.cc:2490] T b74e748e97c84edeabc1c0cb41ddae99 P c7900e455dd64c68bccfc499bda413f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec41d6947a4a4eadadf90c3756899704 in term 1.
I20261117 14:49:16.830235 6462 leader_election.cc:304] T b74e748e97c84edeabc1c0cb41ddae99 P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c7900e455dd64c68bccfc499bda413f7, ec41d6947a4a4eadadf90c3756899704; no voters: def6b23bccc94a78a47118da331f2798
I20261117 14:49:16.830935 6879 raft_consensus.cc:2826] T b74e748e97c84edeabc1c0cb41ddae99 P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Leader election won for term 1
I20261117 14:49:16.831219 6879 raft_consensus.cc:705] T b74e748e97c84edeabc1c0cb41ddae99 P ec41d6947a4a4eadadf90c3756899704 [term 1 LEADER]: Becoming Leader. State: Replica: ec41d6947a4a4eadadf90c3756899704, State: Running, Role: LEADER
I20261117 14:49:16.831686 6879 consensus_queue.cc:238] T b74e748e97c84edeabc1c0cb41ddae99 P ec41d6947a4a4eadadf90c3756899704 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:16.831842 6788 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "3cea00abcccd4b1284393ef8b406cab1" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "def6b23bccc94a78a47118da331f2798" is_pre_election: true
W20261117 14:49:16.832698 6463 leader_election.cc:343] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611): Illegal state: must be running to vote when last-logged opid is not known
I20261117 14:49:16.833666 6657 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "b74e748e97c84edeabc1c0cb41ddae99" candidate_uuid: "def6b23bccc94a78a47118da331f2798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7900e455dd64c68bccfc499bda413f7"
I20261117 14:49:16.834003 6657 raft_consensus.cc:2415] T b74e748e97c84edeabc1c0cb41ddae99 P c7900e455dd64c68bccfc499bda413f7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate def6b23bccc94a78a47118da331f2798 in current term 1: Already voted for candidate ec41d6947a4a4eadadf90c3756899704 in this term.
I20261117 14:49:16.834470 6878 leader_election.cc:290] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271), def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611)
I20261117 14:49:16.835177 6865 tablet_bootstrap.cc:492] T d1732d75bf044feb8884fc3135373072 P def6b23bccc94a78a47118da331f2798: No bootstrap required, opened a new log
I20261117 14:49:16.834820 6723 leader_election.cc:304] T b74e748e97c84edeabc1c0cb41ddae99 P def6b23bccc94a78a47118da331f2798 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: def6b23bccc94a78a47118da331f2798; no voters: c7900e455dd64c68bccfc499bda413f7, ec41d6947a4a4eadadf90c3756899704
I20261117 14:49:16.835323 6865 ts_tablet_manager.cc:1449] T d1732d75bf044feb8884fc3135373072 P def6b23bccc94a78a47118da331f2798: Time spent bootstrapping tablet: real 0.025s user 0.003s sys 0.005s
I20261117 14:49:16.835736 6891 raft_consensus.cc:2771] T b74e748e97c84edeabc1c0cb41ddae99 P def6b23bccc94a78a47118da331f2798 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20261117 14:49:16.836071 6888 raft_consensus.cc:705] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 [term 1 LEADER]: Becoming Leader. State: Replica: ec41d6947a4a4eadadf90c3756899704, State: Running, Role: LEADER
I20261117 14:49:16.836505 6888 consensus_queue.cc:238] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:16.836678 6865 raft_consensus.cc:360] T d1732d75bf044feb8884fc3135373072 P def6b23bccc94a78a47118da331f2798 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:16.836851 6865 raft_consensus.cc:386] T d1732d75bf044feb8884fc3135373072 P def6b23bccc94a78a47118da331f2798 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261117 14:49:16.836953 6865 raft_consensus.cc:748] T d1732d75bf044feb8884fc3135373072 P def6b23bccc94a78a47118da331f2798 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: def6b23bccc94a78a47118da331f2798, State: Initialized, Role: FOLLOWER
I20261117 14:49:16.837204 6865 consensus_queue.cc:261] T d1732d75bf044feb8884fc3135373072 P def6b23bccc94a78a47118da331f2798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:16.837786 6865 ts_tablet_manager.cc:1480] T d1732d75bf044feb8884fc3135373072 P def6b23bccc94a78a47118da331f2798: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20261117 14:49:16.838034 6865 tablet_bootstrap.cc:492] T 47d9af37b05545f0b5b0c033f4ec953f P def6b23bccc94a78a47118da331f2798: Bootstrap starting.
I20261117 14:49:16.839866 6865 tablet_bootstrap.cc:654] T 47d9af37b05545f0b5b0c033f4ec953f P def6b23bccc94a78a47118da331f2798: Neither blocks nor log segments found. Creating new log.
I20261117 14:49:16.842895 6890 consensus_queue.cc:1049] T b74e748e97c84edeabc1c0cb41ddae99 P ec41d6947a4a4eadadf90c3756899704 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261117 14:49:16.847697 6883 consensus_queue.cc:1049] T 5c849aa2a21a4c13b2e31d2ca3f692cc P c7900e455dd64c68bccfc499bda413f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261117 14:49:16.847231 6384 catalog_manager.cc:5840] T 5c849aa2a21a4c13b2e31d2ca3f692cc P c7900e455dd64c68bccfc499bda413f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to c7900e455dd64c68bccfc499bda413f7 (127.6.50.130). New cstate: current_term: 1 leader_uuid: "c7900e455dd64c68bccfc499bda413f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } health_report { overall_health: UNKNOWN } } }
I20261117 14:49:16.848876 6788 raft_consensus.cc:3096] T 5c849aa2a21a4c13b2e31d2ca3f692cc P def6b23bccc94a78a47118da331f2798 [term 0 FOLLOWER]: Advancing to term 1
I20261117 14:49:16.850855 6385 catalog_manager.cc:5840] T 57984748adc7482a9a2d999a447a81af P ec41d6947a4a4eadadf90c3756899704 reported cstate change: term changed from 0 to 1, leader changed from <none> to ec41d6947a4a4eadadf90c3756899704 (127.6.50.129). New cstate: current_term: 1 leader_uuid: "ec41d6947a4a4eadadf90c3756899704" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } health_report { overall_health: UNKNOWN } } }
I20261117 14:49:16.852895 6883 consensus_queue.cc:1049] T 5c849aa2a21a4c13b2e31d2ca3f692cc P c7900e455dd64c68bccfc499bda413f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261117 14:49:16.854768 6890 consensus_queue.cc:1049] T b74e748e97c84edeabc1c0cb41ddae99 P ec41d6947a4a4eadadf90c3756899704 [LEADER]: Connected to new peer: Peer: permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261117 14:49:16.856189 6883 raft_consensus.cc:499] T d1732d75bf044feb8884fc3135373072 P c7900e455dd64c68bccfc499bda413f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261117 14:49:16.856350 6883 raft_consensus.cc:521] T d1732d75bf044feb8884fc3135373072 P c7900e455dd64c68bccfc499bda413f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:16.857311 6883 leader_election.cc:290] T d1732d75bf044feb8884fc3135373072 P c7900e455dd64c68bccfc499bda413f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937), def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611)
I20261117 14:49:16.859138 6786 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "d1732d75bf044feb8884fc3135373072" candidate_uuid: "c7900e455dd64c68bccfc499bda413f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "def6b23bccc94a78a47118da331f2798" is_pre_election: true
I20261117 14:49:16.859514 6786 raft_consensus.cc:2490] T d1732d75bf044feb8884fc3135373072 P def6b23bccc94a78a47118da331f2798 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7900e455dd64c68bccfc499bda413f7 in term 0.
I20261117 14:49:16.858366 6527 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "d1732d75bf044feb8884fc3135373072" candidate_uuid: "c7900e455dd64c68bccfc499bda413f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec41d6947a4a4eadadf90c3756899704" is_pre_election: true
W20261117 14:49:16.860261 6594 leader_election.cc:343] T d1732d75bf044feb8884fc3135373072 P c7900e455dd64c68bccfc499bda413f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Illegal state: must be running to vote when last-logged opid is not known
I20261117 14:49:16.860519 6594 leader_election.cc:304] T d1732d75bf044feb8884fc3135373072 P c7900e455dd64c68bccfc499bda413f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c7900e455dd64c68bccfc499bda413f7, def6b23bccc94a78a47118da331f2798; no voters: ec41d6947a4a4eadadf90c3756899704
I20261117 14:49:16.860997 6883 raft_consensus.cc:2826] T d1732d75bf044feb8884fc3135373072 P c7900e455dd64c68bccfc499bda413f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20261117 14:49:16.861158 6883 raft_consensus.cc:499] T d1732d75bf044feb8884fc3135373072 P c7900e455dd64c68bccfc499bda413f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20261117 14:49:16.861320 6883 raft_consensus.cc:3096] T d1732d75bf044feb8884fc3135373072 P c7900e455dd64c68bccfc499bda413f7 [term 0 FOLLOWER]: Advancing to term 1
I20261117 14:49:16.862848 6384 catalog_manager.cc:5840] T b74e748e97c84edeabc1c0cb41ddae99 P c7900e455dd64c68bccfc499bda413f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to ec41d6947a4a4eadadf90c3756899704 (127.6.50.129). New cstate: current_term: 1 leader_uuid: "ec41d6947a4a4eadadf90c3756899704" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } } }
I20261117 14:49:16.864604 6883 raft_consensus.cc:521] T d1732d75bf044feb8884fc3135373072 P c7900e455dd64c68bccfc499bda413f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:16.865758 6527 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "d1732d75bf044feb8884fc3135373072" candidate_uuid: "c7900e455dd64c68bccfc499bda413f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec41d6947a4a4eadadf90c3756899704"
W20261117 14:49:16.866576 6594 leader_election.cc:343] T d1732d75bf044feb8884fc3135373072 P c7900e455dd64c68bccfc499bda413f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Illegal state: must be running to vote when last-logged opid is not known
I20261117 14:49:16.867208 6883 leader_election.cc:290] T d1732d75bf044feb8884fc3135373072 P c7900e455dd64c68bccfc499bda413f7 [CANDIDATE]: Term 1 election: Requested vote from peers ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937), def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611)
I20261117 14:49:16.867539 6786 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "d1732d75bf044feb8884fc3135373072" candidate_uuid: "c7900e455dd64c68bccfc499bda413f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "def6b23bccc94a78a47118da331f2798"
I20261117 14:49:16.867744 6786 raft_consensus.cc:3096] T d1732d75bf044feb8884fc3135373072 P def6b23bccc94a78a47118da331f2798 [term 0 FOLLOWER]: Advancing to term 1
I20261117 14:49:16.871338 6786 raft_consensus.cc:2490] T d1732d75bf044feb8884fc3135373072 P def6b23bccc94a78a47118da331f2798 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7900e455dd64c68bccfc499bda413f7 in term 1.
I20261117 14:49:16.871666 6896 consensus_queue.cc:1049] T 57984748adc7482a9a2d999a447a81af P ec41d6947a4a4eadadf90c3756899704 [LEADER]: Connected to new peer: Peer: permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261117 14:49:16.873227 6856 tablet_bootstrap.cc:492] T d1732d75bf044feb8884fc3135373072 P ec41d6947a4a4eadadf90c3756899704: No bootstrap required, opened a new log
I20261117 14:49:16.873477 6856 ts_tablet_manager.cc:1449] T d1732d75bf044feb8884fc3135373072 P ec41d6947a4a4eadadf90c3756899704: Time spent bootstrapping tablet: real 0.112s user 0.033s sys 0.045s
I20261117 14:49:16.874884 6865 tablet_bootstrap.cc:492] T 47d9af37b05545f0b5b0c033f4ec953f P def6b23bccc94a78a47118da331f2798: No bootstrap required, opened a new log
I20261117 14:49:16.875036 6865 ts_tablet_manager.cc:1449] T 47d9af37b05545f0b5b0c033f4ec953f P def6b23bccc94a78a47118da331f2798: Time spent bootstrapping tablet: real 0.037s user 0.004s sys 0.003s
I20261117 14:49:16.875700 6865 raft_consensus.cc:360] T 47d9af37b05545f0b5b0c033f4ec953f P def6b23bccc94a78a47118da331f2798 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:16.875876 6865 raft_consensus.cc:386] T 47d9af37b05545f0b5b0c033f4ec953f P def6b23bccc94a78a47118da331f2798 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261117 14:49:16.875943 6865 raft_consensus.cc:748] T 47d9af37b05545f0b5b0c033f4ec953f P def6b23bccc94a78a47118da331f2798 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: def6b23bccc94a78a47118da331f2798, State: Initialized, Role: FOLLOWER
I20261117 14:49:16.876750 6890 consensus_queue.cc:1049] T 57984748adc7482a9a2d999a447a81af P ec41d6947a4a4eadadf90c3756899704 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261117 14:49:16.877482 6865 consensus_queue.cc:261] T 47d9af37b05545f0b5b0c033f4ec953f P def6b23bccc94a78a47118da331f2798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:16.878057 6865 ts_tablet_manager.cc:1480] T 47d9af37b05545f0b5b0c033f4ec953f P def6b23bccc94a78a47118da331f2798: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20261117 14:49:16.878348 6865 tablet_bootstrap.cc:492] T 3cea00abcccd4b1284393ef8b406cab1 P def6b23bccc94a78a47118da331f2798: Bootstrap starting.
I20261117 14:49:16.878405 6594 leader_election.cc:304] T d1732d75bf044feb8884fc3135373072 P c7900e455dd64c68bccfc499bda413f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c7900e455dd64c68bccfc499bda413f7, def6b23bccc94a78a47118da331f2798; no voters: ec41d6947a4a4eadadf90c3756899704
I20261117 14:49:16.878706 6883 raft_consensus.cc:2826] T d1732d75bf044feb8884fc3135373072 P c7900e455dd64c68bccfc499bda413f7 [term 1 FOLLOWER]: Leader election won for term 1
I20261117 14:49:16.878945 6883 raft_consensus.cc:705] T d1732d75bf044feb8884fc3135373072 P c7900e455dd64c68bccfc499bda413f7 [term 1 LEADER]: Becoming Leader. State: Replica: c7900e455dd64c68bccfc499bda413f7, State: Running, Role: LEADER
I20261117 14:49:16.879271 6883 consensus_queue.cc:238] T d1732d75bf044feb8884fc3135373072 P c7900e455dd64c68bccfc499bda413f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:16.880560 6865 tablet_bootstrap.cc:654] T 3cea00abcccd4b1284393ef8b406cab1 P def6b23bccc94a78a47118da331f2798: Neither blocks nor log segments found. Creating new log.
I20261117 14:49:16.881887 6856 raft_consensus.cc:360] T d1732d75bf044feb8884fc3135373072 P ec41d6947a4a4eadadf90c3756899704 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:16.882093 6856 raft_consensus.cc:386] T d1732d75bf044feb8884fc3135373072 P ec41d6947a4a4eadadf90c3756899704 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261117 14:49:16.882177 6856 raft_consensus.cc:748] T d1732d75bf044feb8884fc3135373072 P ec41d6947a4a4eadadf90c3756899704 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec41d6947a4a4eadadf90c3756899704, State: Initialized, Role: FOLLOWER
I20261117 14:49:16.882473 6856 consensus_queue.cc:261] T d1732d75bf044feb8884fc3135373072 P ec41d6947a4a4eadadf90c3756899704 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:16.883106 6856 ts_tablet_manager.cc:1480] T d1732d75bf044feb8884fc3135373072 P ec41d6947a4a4eadadf90c3756899704: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20261117 14:49:16.883423 6856 tablet_bootstrap.cc:492] T 47d9af37b05545f0b5b0c033f4ec953f P ec41d6947a4a4eadadf90c3756899704: Bootstrap starting.
I20261117 14:49:16.885350 6856 tablet_bootstrap.cc:654] T 47d9af37b05545f0b5b0c033f4ec953f P ec41d6947a4a4eadadf90c3756899704: Neither blocks nor log segments found. Creating new log.
I20261117 14:49:16.890996 6873 consensus_queue.cc:1049] T d1732d75bf044feb8884fc3135373072 P c7900e455dd64c68bccfc499bda413f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261117 14:49:16.898012 6384 catalog_manager.cc:5840] T d1732d75bf044feb8884fc3135373072 P c7900e455dd64c68bccfc499bda413f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to c7900e455dd64c68bccfc499bda413f7 (127.6.50.130). New cstate: current_term: 1 leader_uuid: "c7900e455dd64c68bccfc499bda413f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } health_report { overall_health: UNKNOWN } } }
I20261117 14:49:16.907181 6527 raft_consensus.cc:3096] T d1732d75bf044feb8884fc3135373072 P ec41d6947a4a4eadadf90c3756899704 [term 0 FOLLOWER]: Advancing to term 1
I20261117 14:49:16.913043 6890 raft_consensus.cc:499] T d1732d75bf044feb8884fc3135373072 P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261117 14:49:16.913056 6873 consensus_queue.cc:1049] T d1732d75bf044feb8884fc3135373072 P c7900e455dd64c68bccfc499bda413f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261117 14:49:16.913450 6890 raft_consensus.cc:521] T d1732d75bf044feb8884fc3135373072 P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:16.919103 6658 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "d1732d75bf044feb8884fc3135373072" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7900e455dd64c68bccfc499bda413f7" is_pre_election: true
I20261117 14:49:16.919519 6890 leader_election.cc:290] T d1732d75bf044feb8884fc3135373072 P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271), def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611)
I20261117 14:49:16.919782 6788 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "d1732d75bf044feb8884fc3135373072" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "def6b23bccc94a78a47118da331f2798" is_pre_election: true
I20261117 14:49:16.920495 6463 leader_election.cc:304] T d1732d75bf044feb8884fc3135373072 P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec41d6947a4a4eadadf90c3756899704; no voters: c7900e455dd64c68bccfc499bda413f7, def6b23bccc94a78a47118da331f2798
I20261117 14:49:16.929382 6876 raft_consensus.cc:499] T 47d9af37b05545f0b5b0c033f4ec953f P def6b23bccc94a78a47118da331f2798 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261117 14:49:16.929593 6876 raft_consensus.cc:521] T 47d9af37b05545f0b5b0c033f4ec953f P def6b23bccc94a78a47118da331f2798 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:16.930320 6876 leader_election.cc:290] T 47d9af37b05545f0b5b0c033f4ec953f P def6b23bccc94a78a47118da331f2798 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937), c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271)
I20261117 14:49:16.932353 6657 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "47d9af37b05545f0b5b0c033f4ec953f" candidate_uuid: "def6b23bccc94a78a47118da331f2798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7900e455dd64c68bccfc499bda413f7" is_pre_election: true
I20261117 14:49:16.932650 6657 raft_consensus.cc:2490] T 47d9af37b05545f0b5b0c033f4ec953f P c7900e455dd64c68bccfc499bda413f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate def6b23bccc94a78a47118da331f2798 in term 0.
I20261117 14:49:16.933352 6723 leader_election.cc:304] T 47d9af37b05545f0b5b0c033f4ec953f P def6b23bccc94a78a47118da331f2798 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c7900e455dd64c68bccfc499bda413f7, def6b23bccc94a78a47118da331f2798; no voters:
I20261117 14:49:16.934078 6876 raft_consensus.cc:2826] T 47d9af37b05545f0b5b0c033f4ec953f P def6b23bccc94a78a47118da331f2798 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20261117 14:49:16.934186 6876 raft_consensus.cc:499] T 47d9af37b05545f0b5b0c033f4ec953f P def6b23bccc94a78a47118da331f2798 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20261117 14:49:16.934302 6876 raft_consensus.cc:3096] T 47d9af37b05545f0b5b0c033f4ec953f P def6b23bccc94a78a47118da331f2798 [term 0 FOLLOWER]: Advancing to term 1
I20261117 14:49:16.934312 6879 raft_consensus.cc:2771] T d1732d75bf044feb8884fc3135373072 P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20261117 14:49:16.937304 6876 raft_consensus.cc:521] T 47d9af37b05545f0b5b0c033f4ec953f P def6b23bccc94a78a47118da331f2798 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:16.938539 6658 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "47d9af37b05545f0b5b0c033f4ec953f" candidate_uuid: "def6b23bccc94a78a47118da331f2798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7900e455dd64c68bccfc499bda413f7"
I20261117 14:49:16.938853 6658 raft_consensus.cc:3096] T 47d9af37b05545f0b5b0c033f4ec953f P c7900e455dd64c68bccfc499bda413f7 [term 0 FOLLOWER]: Advancing to term 1
I20261117 14:49:16.941550 6856 tablet_bootstrap.cc:492] T 47d9af37b05545f0b5b0c033f4ec953f P ec41d6947a4a4eadadf90c3756899704: No bootstrap required, opened a new log
I20261117 14:49:16.941748 6856 ts_tablet_manager.cc:1449] T 47d9af37b05545f0b5b0c033f4ec953f P ec41d6947a4a4eadadf90c3756899704: Time spent bootstrapping tablet: real 0.058s user 0.006s sys 0.021s
I20261117 14:49:16.942052 6658 raft_consensus.cc:2490] T 47d9af37b05545f0b5b0c033f4ec953f P c7900e455dd64c68bccfc499bda413f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate def6b23bccc94a78a47118da331f2798 in term 1.
I20261117 14:49:16.942488 6723 leader_election.cc:304] T 47d9af37b05545f0b5b0c033f4ec953f P def6b23bccc94a78a47118da331f2798 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c7900e455dd64c68bccfc499bda413f7, def6b23bccc94a78a47118da331f2798; no voters:
I20261117 14:49:16.942595 6856 raft_consensus.cc:360] T 47d9af37b05545f0b5b0c033f4ec953f P ec41d6947a4a4eadadf90c3756899704 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:16.942775 6856 raft_consensus.cc:386] T 47d9af37b05545f0b5b0c033f4ec953f P ec41d6947a4a4eadadf90c3756899704 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261117 14:49:16.942780 6891 raft_consensus.cc:2826] T 47d9af37b05545f0b5b0c033f4ec953f P def6b23bccc94a78a47118da331f2798 [term 1 FOLLOWER]: Leader election won for term 1
I20261117 14:49:16.942873 6856 raft_consensus.cc:748] T 47d9af37b05545f0b5b0c033f4ec953f P ec41d6947a4a4eadadf90c3756899704 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec41d6947a4a4eadadf90c3756899704, State: Initialized, Role: FOLLOWER
I20261117 14:49:16.943102 6856 consensus_queue.cc:261] T 47d9af37b05545f0b5b0c033f4ec953f P ec41d6947a4a4eadadf90c3756899704 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:16.943509 6891 raft_consensus.cc:705] T 47d9af37b05545f0b5b0c033f4ec953f P def6b23bccc94a78a47118da331f2798 [term 1 LEADER]: Becoming Leader. State: Replica: def6b23bccc94a78a47118da331f2798, State: Running, Role: LEADER
I20261117 14:49:16.944096 6891 consensus_queue.cc:238] T 47d9af37b05545f0b5b0c033f4ec953f P def6b23bccc94a78a47118da331f2798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:16.944537 6527 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "47d9af37b05545f0b5b0c033f4ec953f" candidate_uuid: "def6b23bccc94a78a47118da331f2798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec41d6947a4a4eadadf90c3756899704" is_pre_election: true
I20261117 14:49:16.944762 6527 raft_consensus.cc:2490] T 47d9af37b05545f0b5b0c033f4ec953f P ec41d6947a4a4eadadf90c3756899704 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate def6b23bccc94a78a47118da331f2798 in term 0.
I20261117 14:49:16.945966 6527 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "47d9af37b05545f0b5b0c033f4ec953f" candidate_uuid: "def6b23bccc94a78a47118da331f2798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec41d6947a4a4eadadf90c3756899704"
I20261117 14:49:16.946178 6527 raft_consensus.cc:3096] T 47d9af37b05545f0b5b0c033f4ec953f P ec41d6947a4a4eadadf90c3756899704 [term 0 FOLLOWER]: Advancing to term 1
I20261117 14:49:16.946305 6876 leader_election.cc:290] T 47d9af37b05545f0b5b0c033f4ec953f P def6b23bccc94a78a47118da331f2798 [CANDIDATE]: Term 1 election: Requested vote from peers ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937), c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271)
I20261117 14:49:16.946717 6856 ts_tablet_manager.cc:1480] T 47d9af37b05545f0b5b0c033f4ec953f P ec41d6947a4a4eadadf90c3756899704: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20261117 14:49:16.951150 6385 catalog_manager.cc:5840] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 reported cstate change: term changed from 0 to 1, leader changed from <none> to ec41d6947a4a4eadadf90c3756899704 (127.6.50.129). New cstate: current_term: 1 leader_uuid: "ec41d6947a4a4eadadf90c3756899704" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } health_report { overall_health: UNKNOWN } } }
W20261117 14:49:16.958915 6834 tablet.cc:2441] T 47d9af37b05545f0b5b0c033f4ec953f P def6b23bccc94a78a47118da331f2798: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20261117 14:49:16.959231 6865 tablet_bootstrap.cc:492] T 3cea00abcccd4b1284393ef8b406cab1 P def6b23bccc94a78a47118da331f2798: No bootstrap required, opened a new log
I20261117 14:49:16.959380 6865 ts_tablet_manager.cc:1449] T 3cea00abcccd4b1284393ef8b406cab1 P def6b23bccc94a78a47118da331f2798: Time spent bootstrapping tablet: real 0.081s user 0.005s sys 0.018s
W20261117 14:49:16.959448 6463 consensus_peers.cc:597] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 -> Peer def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611): Couldn't send request to peer def6b23bccc94a78a47118da331f2798. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20261117 14:49:16.959812 6834 tablet_replica_mm_ops.cc:318] Log GC is disabled (check --enable_log_gc)
I20261117 14:49:16.960253 6865 raft_consensus.cc:360] T 3cea00abcccd4b1284393ef8b406cab1 P def6b23bccc94a78a47118da331f2798 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:16.960496 6865 raft_consensus.cc:386] T 3cea00abcccd4b1284393ef8b406cab1 P def6b23bccc94a78a47118da331f2798 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261117 14:49:16.960600 6865 raft_consensus.cc:748] T 3cea00abcccd4b1284393ef8b406cab1 P def6b23bccc94a78a47118da331f2798 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: def6b23bccc94a78a47118da331f2798, State: Initialized, Role: FOLLOWER
I20261117 14:49:16.960824 6865 consensus_queue.cc:261] T 3cea00abcccd4b1284393ef8b406cab1 P def6b23bccc94a78a47118da331f2798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:16.961313 6865 ts_tablet_manager.cc:1480] T 3cea00abcccd4b1284393ef8b406cab1 P def6b23bccc94a78a47118da331f2798: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20261117 14:49:16.961140 6385 catalog_manager.cc:5840] T 47d9af37b05545f0b5b0c033f4ec953f P def6b23bccc94a78a47118da331f2798 reported cstate change: term changed from 0 to 1, leader changed from <none> to def6b23bccc94a78a47118da331f2798 (127.6.50.131). New cstate: current_term: 1 leader_uuid: "def6b23bccc94a78a47118da331f2798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } health_report { overall_health: HEALTHY } } }
I20261117 14:49:16.962420 6915 consensus_queue.cc:1049] T 47d9af37b05545f0b5b0c033f4ec953f P def6b23bccc94a78a47118da331f2798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261117 14:49:16.963218 6527 raft_consensus.cc:2490] T 47d9af37b05545f0b5b0c033f4ec953f P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate def6b23bccc94a78a47118da331f2798 in term 1.
I20261117 14:49:16.966971 6915 consensus_queue.cc:1049] T 47d9af37b05545f0b5b0c033f4ec953f P def6b23bccc94a78a47118da331f2798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261117 14:49:16.982026 6915 raft_consensus.cc:499] T 3cea00abcccd4b1284393ef8b406cab1 P def6b23bccc94a78a47118da331f2798 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261117 14:49:16.982216 6915 raft_consensus.cc:521] T 3cea00abcccd4b1284393ef8b406cab1 P def6b23bccc94a78a47118da331f2798 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:16.983055 6915 leader_election.cc:290] T 3cea00abcccd4b1284393ef8b406cab1 P def6b23bccc94a78a47118da331f2798 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937), c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271)
I20261117 14:49:16.983510 6527 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "3cea00abcccd4b1284393ef8b406cab1" candidate_uuid: "def6b23bccc94a78a47118da331f2798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec41d6947a4a4eadadf90c3756899704" is_pre_election: true
I20261117 14:49:16.983609 6658 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "3cea00abcccd4b1284393ef8b406cab1" candidate_uuid: "def6b23bccc94a78a47118da331f2798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7900e455dd64c68bccfc499bda413f7" is_pre_election: true
I20261117 14:49:16.984210 6723 leader_election.cc:304] T 3cea00abcccd4b1284393ef8b406cab1 P def6b23bccc94a78a47118da331f2798 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: def6b23bccc94a78a47118da331f2798; no voters: c7900e455dd64c68bccfc499bda413f7, ec41d6947a4a4eadadf90c3756899704
I20261117 14:49:16.984503 6915 raft_consensus.cc:2771] T 3cea00abcccd4b1284393ef8b406cab1 P def6b23bccc94a78a47118da331f2798 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20261117 14:49:17.014197 6346 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskUafhB0/build/asan/bin/kudu
/tmp/dist-test-taskUafhB0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.50.132:0
--local_ip_for_outbound_sockets=127.6.50.132
--webserver_interface=127.6.50.132
--webserver_port=0
--tserver_master_addrs=127.6.50.190:39807
--builtin_ntp_servers=127.6.50.148:42811
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--follower_unavailable_considered_failed_sec=2
--enable_log_gc=false with env {}
I20261117 14:49:17.045009 6786 raft_consensus.cc:3096] T 3cea00abcccd4b1284393ef8b406cab1 P def6b23bccc94a78a47118da331f2798 [term 0 FOLLOWER]: Advancing to term 1
W20261117 14:49:17.843712 6462 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.50.130:36271, user_credentials={real_user=slave}} blocked reactor thread for 64729.3us
W20261117 14:49:18.025584 6923 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261117 14:49:18.026087 6923 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261117 14:49:18.026284 6923 flags.cc:432] Enabled unsafe flag: --enable_log_gc=false
W20261117 14:49:18.026429 6923 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261117 14:49:18.040167 6923 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261117 14:49:18.040598 6923 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.50.132
I20261117 14:49:18.057233 6923 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-3/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.50.148:42811
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=2
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.50.132:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-3/data/info.pb
--webserver_interface=127.6.50.132
--webserver_port=0
--enable_log_gc=false
--tserver_master_addrs=127.6.50.190:39807
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.50.132
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type FASTDEBUG
built by None at 17 Nov 2026 14:43:24 UTC on bdcb31816ec0
build id 14829
ASAN enabled
I20261117 14:49:18.059849 6923 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261117 14:49:18.062901 6923 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20261117 14:49:18.068785 6923 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20261117 14:49:18.293049 6961 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261117 14:49:18.300252 6962 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261117 14:49:18.313324 6965 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261117 14:49:18.314970 6923 server_base.cc:1061] running on GCE node
I20261117 14:49:18.316123 6923 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261117 14:49:18.318197 6923 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261117 14:49:18.319725 6923 hybrid_clock.cc:648] HybridClock initialized: now 1794926958319594 us; error 109 us; skew 500 ppm
I20261117 14:49:18.320158 6923 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261117 14:49:18.485683 6923 webserver.cc:577] Webserver started at http://127.6.50.132:33437/ using document root <none> and password file <none>
I20261117 14:49:18.487449 6923 fs_manager.cc:362] Metadata directory not provided
I20261117 14:49:18.487619 6923 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261117 14:49:18.488125 6923 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261117 14:49:18.491886 6923 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-3/data/instance:
uuid: "b1357297ed3e46b78f7b1b44c1eec2d1"
format_stamp: "Formatted at 2026-11-17 14:49:18 on dist-test-slave-jwg6"
I20261117 14:49:18.493046 6923 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-3/wal/instance:
uuid: "b1357297ed3e46b78f7b1b44c1eec2d1"
format_stamp: "Formatted at 2026-11-17 14:49:18 on dist-test-slave-jwg6"
I20261117 14:49:18.520805 6923 fs_manager.cc:696] Time spent creating directory manager: real 0.027s user 0.003s sys 0.005s
I20261117 14:49:18.538692 6972 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20261117 14:49:18.542093 6923 fs_manager.cc:730] Time spent opening block manager: real 0.017s user 0.001s sys 0.001s
I20261117 14:49:18.542397 6923 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-3/data,/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-3/wal
uuid: "b1357297ed3e46b78f7b1b44c1eec2d1"
format_stamp: "Formatted at 2026-11-17 14:49:18 on dist-test-slave-jwg6"
I20261117 14:49:18.542753 6923 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-3/wal
metadata directory: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-3/wal
1 data directories: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261117 14:49:18.626609 6923 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20261117 14:49:18.627844 6923 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261117 14:49:18.628271 6923 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261117 14:49:18.877561 6923 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261117 14:49:18.886375 6923 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261117 14:49:18.886592 6923 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20261117 14:49:18.886793 6923 ts_tablet_manager.cc:662] Registered 0 tablets
I20261117 14:49:18.886927 6923 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
W20261117 14:49:20.851361 6922 meta_cache.cc:1261] Time spent looking up entry by key: real 0.064s user 0.000s sys 0.000s
I20261117 14:49:21.374019 6923 rpc_server.cc:307] RPC server started. Bound to: 127.6.50.132:45815
I20261117 14:49:21.374140 7095 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.50.132:45815 every 8 connection(s)
I20261117 14:49:21.379281 6923 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-3/data/info.pb
I20261117 14:49:21.380869 6346 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskUafhB0/build/asan/bin/kudu as pid 6923
I20261117 14:49:21.381094 6346 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-3/wal/instance
I20261117 14:49:21.490098 7096 heartbeater.cc:345] Connected to a master server at 127.6.50.190:39807
I20261117 14:49:21.490542 7096 heartbeater.cc:462] Registering TS with master...
I20261117 14:49:21.491817 7096 heartbeater.cc:508] Master 127.6.50.190:39807 requested a full tablet report, sending...
I20261117 14:49:21.493997 6379 ts_manager.cc:210] Registered new tserver with Master: b1357297ed3e46b78f7b1b44c1eec2d1 (127.6.50.132:45815)
I20261117 14:49:21.495205 6379 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.6.50.132:55969
I20261117 14:49:22.082230 6379 ts_manager.cc:311] Set tserver state for ec41d6947a4a4eadadf90c3756899704 to MAINTENANCE_MODE
I20261117 14:49:22.084311 6346 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskUafhB0/build/asan/bin/kudu pid 6445
I20261117 14:49:22.086145 6567 generic_service.cc:196] Checking for leaks (request via RPC)
I20261117 14:49:22.275126 6346 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskUafhB0/build/asan/bin/kudu with pid 6445
W20261117 14:49:22.300699 6844 meta_cache.cc:302] tablet 57984748adc7482a9a2d999a447a81af: replica ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937) has failed: Network error: recv got EOF from 127.6.50.129:42937 (error 108)
W20261117 14:49:22.301187 6594 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.6.50.129:42937 (error 108)
W20261117 14:49:22.301290 6372 connection.cc:573] server connection from 127.6.50.129:50803 recv error: Network error: recv error from unknown peer: Connection reset by peer (error 104)
W20261117 14:49:22.301648 6724 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.6.50.129:42937 (error 108)
W20261117 14:49:22.303676 6724 connection.cc:573] server connection from 127.6.50.129:39895 recv error: Network error: recv error from unknown peer: Connection reset by peer (error 104)
W20261117 14:49:22.303773 6594 consensus_peers.cc:597] T d1732d75bf044feb8884fc3135373072 P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20261117 14:49:22.303972 6594 consensus_peers.cc:597] T 5c849aa2a21a4c13b2e31d2ca3f692cc P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20261117 14:49:22.305269 6612 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57154: Illegal state: replica c7900e455dd64c68bccfc499bda413f7 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.305518 6615 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57154: Illegal state: replica c7900e455dd64c68bccfc499bda413f7 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.305799 6617 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57154: Illegal state: replica c7900e455dd64c68bccfc499bda413f7 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.306746 6618 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57154: Illegal state: replica c7900e455dd64c68bccfc499bda413f7 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.307628 6617 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57154: Illegal state: replica c7900e455dd64c68bccfc499bda413f7 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.307946 6615 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57154: Illegal state: replica c7900e455dd64c68bccfc499bda413f7 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.308063 6612 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57154: Illegal state: replica c7900e455dd64c68bccfc499bda413f7 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.308238 6724 consensus_peers.cc:597] T 47d9af37b05545f0b5b0c033f4ec953f P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20261117 14:49:22.308367 6618 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57154: Illegal state: replica c7900e455dd64c68bccfc499bda413f7 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.309062 6612 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57154: Illegal state: replica c7900e455dd64c68bccfc499bda413f7 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.309391 6618 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57154: Illegal state: replica c7900e455dd64c68bccfc499bda413f7 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.309911 6615 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57154: Illegal state: replica c7900e455dd64c68bccfc499bda413f7 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.310151 6617 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57154: Illegal state: replica c7900e455dd64c68bccfc499bda413f7 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.312366 6746 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57788: Illegal state: replica def6b23bccc94a78a47118da331f2798 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.312397 6748 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57788: Illegal state: replica def6b23bccc94a78a47118da331f2798 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.314435 6748 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57788: Illegal state: replica def6b23bccc94a78a47118da331f2798 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.314632 6746 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57788: Illegal state: replica def6b23bccc94a78a47118da331f2798 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.316071 6748 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57788: Illegal state: replica def6b23bccc94a78a47118da331f2798 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.316380 6747 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57788: Illegal state: replica def6b23bccc94a78a47118da331f2798 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.316890 6745 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57788: Illegal state: replica def6b23bccc94a78a47118da331f2798 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.317942 6745 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57788: Illegal state: replica def6b23bccc94a78a47118da331f2798 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.318894 6745 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57788: Illegal state: replica def6b23bccc94a78a47118da331f2798 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.319815 6747 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57788: Illegal state: replica def6b23bccc94a78a47118da331f2798 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.324999 6746 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57788: Illegal state: replica def6b23bccc94a78a47118da331f2798 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.325184 6744 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57788: Illegal state: replica def6b23bccc94a78a47118da331f2798 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.328516 6617 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57154: Illegal state: replica c7900e455dd64c68bccfc499bda413f7 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.338313 6744 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57788: Illegal state: replica def6b23bccc94a78a47118da331f2798 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.338581 6746 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57788: Illegal state: replica def6b23bccc94a78a47118da331f2798 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.339901 6746 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57788: Illegal state: replica def6b23bccc94a78a47118da331f2798 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.340178 6615 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57154: Illegal state: replica c7900e455dd64c68bccfc499bda413f7 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.340786 6617 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57154: Illegal state: replica c7900e455dd64c68bccfc499bda413f7 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.342075 6746 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57788: Illegal state: replica def6b23bccc94a78a47118da331f2798 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.342612 6617 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57154: Illegal state: replica c7900e455dd64c68bccfc499bda413f7 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.343078 6615 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57154: Illegal state: replica c7900e455dd64c68bccfc499bda413f7 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.347360 6615 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57154: Illegal state: replica c7900e455dd64c68bccfc499bda413f7 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.347790 6746 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57788: Illegal state: replica def6b23bccc94a78a47118da331f2798 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.348690 6615 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57154: Illegal state: replica c7900e455dd64c68bccfc499bda413f7 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.351552 6615 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57154: Illegal state: replica c7900e455dd64c68bccfc499bda413f7 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.351825 6617 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57154: Illegal state: replica c7900e455dd64c68bccfc499bda413f7 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.353106 6617 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57154: Illegal state: replica c7900e455dd64c68bccfc499bda413f7 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.353291 6615 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57154: Illegal state: replica c7900e455dd64c68bccfc499bda413f7 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.354034 6746 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57788: Illegal state: replica def6b23bccc94a78a47118da331f2798 is not leader of this config: current role FOLLOWER
I20261117 14:49:22.354470 7048 raft_consensus.cc:499] T 3cea00abcccd4b1284393ef8b406cab1 P c7900e455dd64c68bccfc499bda413f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ec41d6947a4a4eadadf90c3756899704)
I20261117 14:49:22.354615 7048 raft_consensus.cc:521] T 3cea00abcccd4b1284393ef8b406cab1 P c7900e455dd64c68bccfc499bda413f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:22.355183 7048 leader_election.cc:290] T 3cea00abcccd4b1284393ef8b406cab1 P c7900e455dd64c68bccfc499bda413f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937), def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611)
W20261117 14:49:22.356328 6746 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57788: Illegal state: replica def6b23bccc94a78a47118da331f2798 is not leader of this config: current role FOLLOWER
I20261117 14:49:22.356546 6783 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "3cea00abcccd4b1284393ef8b406cab1" candidate_uuid: "c7900e455dd64c68bccfc499bda413f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 176 } } ignore_live_leader: false dest_uuid: "def6b23bccc94a78a47118da331f2798" is_pre_election: true
W20261117 14:49:22.357008 6615 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57154: Illegal state: replica c7900e455dd64c68bccfc499bda413f7 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.357645 6594 leader_election.cc:336] T 3cea00abcccd4b1284393ef8b406cab1 P c7900e455dd64c68bccfc499bda413f7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111)
I20261117 14:49:22.357808 6594 leader_election.cc:304] T 3cea00abcccd4b1284393ef8b406cab1 P c7900e455dd64c68bccfc499bda413f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7900e455dd64c68bccfc499bda413f7; no voters: def6b23bccc94a78a47118da331f2798, ec41d6947a4a4eadadf90c3756899704
I20261117 14:49:22.358114 7048 raft_consensus.cc:2771] T 3cea00abcccd4b1284393ef8b406cab1 P c7900e455dd64c68bccfc499bda413f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20261117 14:49:22.359027 6615 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57154: Illegal state: replica c7900e455dd64c68bccfc499bda413f7 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.359171 6746 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57788: Illegal state: replica def6b23bccc94a78a47118da331f2798 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.359361 6744 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57788: Illegal state: replica def6b23bccc94a78a47118da331f2798 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.360656 6744 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57788: Illegal state: replica def6b23bccc94a78a47118da331f2798 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.366950 6744 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57788: Illegal state: replica def6b23bccc94a78a47118da331f2798 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.373159 6615 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57154: Illegal state: replica c7900e455dd64c68bccfc499bda413f7 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.373260 6744 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57788: Illegal state: replica def6b23bccc94a78a47118da331f2798 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.376289 6615 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57154: Illegal state: replica c7900e455dd64c68bccfc499bda413f7 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.376344 6744 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57788: Illegal state: replica def6b23bccc94a78a47118da331f2798 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.377848 6615 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57154: Illegal state: replica c7900e455dd64c68bccfc499bda413f7 is not leader of this config: current role FOLLOWER
I20261117 14:49:22.383411 6915 raft_consensus.cc:499] T b74e748e97c84edeabc1c0cb41ddae99 P def6b23bccc94a78a47118da331f2798 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ec41d6947a4a4eadadf90c3756899704)
I20261117 14:49:22.383644 6915 raft_consensus.cc:521] T b74e748e97c84edeabc1c0cb41ddae99 P def6b23bccc94a78a47118da331f2798 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
W20261117 14:49:22.384122 6744 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57788: Illegal state: replica def6b23bccc94a78a47118da331f2798 is not leader of this config: current role FOLLOWER
I20261117 14:49:22.384464 6915 leader_election.cc:290] T b74e748e97c84edeabc1c0cb41ddae99 P def6b23bccc94a78a47118da331f2798 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271), ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937)
I20261117 14:49:22.385571 6654 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "b74e748e97c84edeabc1c0cb41ddae99" candidate_uuid: "def6b23bccc94a78a47118da331f2798" candidate_term: 2 candidate_status { last_received { term: 1 index: 176 } } ignore_live_leader: false dest_uuid: "c7900e455dd64c68bccfc499bda413f7" is_pre_election: true
W20261117 14:49:22.385970 6617 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57154: Illegal state: replica c7900e455dd64c68bccfc499bda413f7 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.386483 6615 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57154: Illegal state: replica c7900e455dd64c68bccfc499bda413f7 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.386580 6724 leader_election.cc:336] T b74e748e97c84edeabc1c0cb41ddae99 P def6b23bccc94a78a47118da331f2798 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111)
I20261117 14:49:22.386732 6724 leader_election.cc:304] T b74e748e97c84edeabc1c0cb41ddae99 P def6b23bccc94a78a47118da331f2798 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: def6b23bccc94a78a47118da331f2798; no voters: c7900e455dd64c68bccfc499bda413f7, ec41d6947a4a4eadadf90c3756899704
I20261117 14:49:22.387029 6915 raft_consensus.cc:2771] T b74e748e97c84edeabc1c0cb41ddae99 P def6b23bccc94a78a47118da331f2798 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20261117 14:49:22.389278 6744 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57788: Illegal state: replica def6b23bccc94a78a47118da331f2798 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.389766 6615 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57154: Illegal state: replica c7900e455dd64c68bccfc499bda413f7 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.390151 6746 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57788: Illegal state: replica def6b23bccc94a78a47118da331f2798 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.390929 6615 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57154: Illegal state: replica c7900e455dd64c68bccfc499bda413f7 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.393261 6615 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57154: Illegal state: replica c7900e455dd64c68bccfc499bda413f7 is not leader of this config: current role FOLLOWER
I20261117 14:49:22.397817 7048 raft_consensus.cc:499] T 57984748adc7482a9a2d999a447a81af P c7900e455dd64c68bccfc499bda413f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ec41d6947a4a4eadadf90c3756899704)
I20261117 14:49:22.398005 7048 raft_consensus.cc:521] T 57984748adc7482a9a2d999a447a81af P c7900e455dd64c68bccfc499bda413f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
W20261117 14:49:22.398519 6615 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57154: Illegal state: replica c7900e455dd64c68bccfc499bda413f7 is not leader of this config: current role FOLLOWER
I20261117 14:49:22.398785 7048 leader_election.cc:290] T 57984748adc7482a9a2d999a447a81af P c7900e455dd64c68bccfc499bda413f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937), def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611)
I20261117 14:49:22.399742 6783 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "57984748adc7482a9a2d999a447a81af" candidate_uuid: "c7900e455dd64c68bccfc499bda413f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 176 } } ignore_live_leader: false dest_uuid: "def6b23bccc94a78a47118da331f2798" is_pre_election: true
W20261117 14:49:22.400959 6594 leader_election.cc:336] T 57984748adc7482a9a2d999a447a81af P c7900e455dd64c68bccfc499bda413f7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111)
I20261117 14:49:22.401089 6594 leader_election.cc:304] T 57984748adc7482a9a2d999a447a81af P c7900e455dd64c68bccfc499bda413f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7900e455dd64c68bccfc499bda413f7; no voters: def6b23bccc94a78a47118da331f2798, ec41d6947a4a4eadadf90c3756899704
I20261117 14:49:22.401396 7048 raft_consensus.cc:2771] T 57984748adc7482a9a2d999a447a81af P c7900e455dd64c68bccfc499bda413f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20261117 14:49:22.402370 6746 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57788: Illegal state: replica def6b23bccc94a78a47118da331f2798 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.403436 6744 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57788: Illegal state: replica def6b23bccc94a78a47118da331f2798 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.406327 6744 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57788: Illegal state: replica def6b23bccc94a78a47118da331f2798 is not leader of this config: current role FOLLOWER
I20261117 14:49:22.409034 7048 raft_consensus.cc:499] T b74e748e97c84edeabc1c0cb41ddae99 P c7900e455dd64c68bccfc499bda413f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ec41d6947a4a4eadadf90c3756899704)
I20261117 14:49:22.409250 7048 raft_consensus.cc:521] T b74e748e97c84edeabc1c0cb41ddae99 P c7900e455dd64c68bccfc499bda413f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:22.410192 7048 leader_election.cc:290] T b74e748e97c84edeabc1c0cb41ddae99 P c7900e455dd64c68bccfc499bda413f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937), def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611)
I20261117 14:49:22.411129 6783 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "b74e748e97c84edeabc1c0cb41ddae99" candidate_uuid: "c7900e455dd64c68bccfc499bda413f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 176 } } ignore_live_leader: false dest_uuid: "def6b23bccc94a78a47118da331f2798" is_pre_election: true
I20261117 14:49:22.411396 6783 raft_consensus.cc:2490] T b74e748e97c84edeabc1c0cb41ddae99 P def6b23bccc94a78a47118da331f2798 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7900e455dd64c68bccfc499bda413f7 in term 1.
W20261117 14:49:22.411733 6594 leader_election.cc:336] T b74e748e97c84edeabc1c0cb41ddae99 P c7900e455dd64c68bccfc499bda413f7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111)
I20261117 14:49:22.412024 6594 leader_election.cc:304] T b74e748e97c84edeabc1c0cb41ddae99 P c7900e455dd64c68bccfc499bda413f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c7900e455dd64c68bccfc499bda413f7, def6b23bccc94a78a47118da331f2798; no voters: ec41d6947a4a4eadadf90c3756899704
I20261117 14:49:22.412313 7048 raft_consensus.cc:2826] T b74e748e97c84edeabc1c0cb41ddae99 P c7900e455dd64c68bccfc499bda413f7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20261117 14:49:22.412513 7048 raft_consensus.cc:499] T b74e748e97c84edeabc1c0cb41ddae99 P c7900e455dd64c68bccfc499bda413f7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ec41d6947a4a4eadadf90c3756899704)
I20261117 14:49:22.412648 7048 raft_consensus.cc:3096] T b74e748e97c84edeabc1c0cb41ddae99 P c7900e455dd64c68bccfc499bda413f7 [term 1 FOLLOWER]: Advancing to term 2
I20261117 14:49:22.416965 7048 raft_consensus.cc:521] T b74e748e97c84edeabc1c0cb41ddae99 P c7900e455dd64c68bccfc499bda413f7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:22.417562 7048 leader_election.cc:290] T b74e748e97c84edeabc1c0cb41ddae99 P c7900e455dd64c68bccfc499bda413f7 [CANDIDATE]: Term 2 election: Requested vote from peers ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937), def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611)
W20261117 14:49:22.418859 6617 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57154: Illegal state: replica c7900e455dd64c68bccfc499bda413f7 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.419075 6618 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57154: Illegal state: replica c7900e455dd64c68bccfc499bda413f7 is not leader of this config: current role FOLLOWER
I20261117 14:49:22.419265 6783 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "b74e748e97c84edeabc1c0cb41ddae99" candidate_uuid: "c7900e455dd64c68bccfc499bda413f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 176 } } ignore_live_leader: false dest_uuid: "def6b23bccc94a78a47118da331f2798"
I20261117 14:49:22.419478 6783 raft_consensus.cc:3096] T b74e748e97c84edeabc1c0cb41ddae99 P def6b23bccc94a78a47118da331f2798 [term 1 FOLLOWER]: Advancing to term 2
W20261117 14:49:22.418860 6615 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57154: Illegal state: replica c7900e455dd64c68bccfc499bda413f7 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.420506 6744 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57788: Illegal state: replica def6b23bccc94a78a47118da331f2798 is not leader of this config: current role FOLLOWER
I20261117 14:49:22.422461 6783 raft_consensus.cc:2490] T b74e748e97c84edeabc1c0cb41ddae99 P def6b23bccc94a78a47118da331f2798 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7900e455dd64c68bccfc499bda413f7 in term 2.
W20261117 14:49:22.422498 6744 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57788: Illegal state: replica def6b23bccc94a78a47118da331f2798 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.423715 6744 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57788: Illegal state: replica def6b23bccc94a78a47118da331f2798 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.423995 6594 leader_election.cc:336] T b74e748e97c84edeabc1c0cb41ddae99 P c7900e455dd64c68bccfc499bda413f7 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111)
I20261117 14:49:22.424329 6594 leader_election.cc:304] T b74e748e97c84edeabc1c0cb41ddae99 P c7900e455dd64c68bccfc499bda413f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c7900e455dd64c68bccfc499bda413f7, def6b23bccc94a78a47118da331f2798; no voters: ec41d6947a4a4eadadf90c3756899704
I20261117 14:49:22.424705 7048 raft_consensus.cc:2826] T b74e748e97c84edeabc1c0cb41ddae99 P c7900e455dd64c68bccfc499bda413f7 [term 2 FOLLOWER]: Leader election won for term 2
I20261117 14:49:22.424975 7048 raft_consensus.cc:705] T b74e748e97c84edeabc1c0cb41ddae99 P c7900e455dd64c68bccfc499bda413f7 [term 2 LEADER]: Becoming Leader. State: Replica: c7900e455dd64c68bccfc499bda413f7, State: Running, Role: LEADER
I20261117 14:49:22.425293 7048 consensus_queue.cc:238] T b74e748e97c84edeabc1c0cb41ddae99 P c7900e455dd64c68bccfc499bda413f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 176, Committed index: 176, Last appended: 1.176, Last appended by leader: 176, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:22.427121 6783 raft_consensus.cc:1285] T b74e748e97c84edeabc1c0cb41ddae99 P def6b23bccc94a78a47118da331f2798 [term 2 FOLLOWER]: Refusing update from remote peer c7900e455dd64c68bccfc499bda413f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 176. Preceding OpId from leader: term: 2 index: 177. (index mismatch)
W20261117 14:49:22.427994 6744 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57788: Illegal state: replica def6b23bccc94a78a47118da331f2798 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.428172 6594 consensus_peers.cc:597] T b74e748e97c84edeabc1c0cb41ddae99 P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20261117 14:49:22.428200 7048 consensus_queue.cc:1049] T b74e748e97c84edeabc1c0cb41ddae99 P c7900e455dd64c68bccfc499bda413f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 177, Last known committed idx: 176, Time since last communication: 0.000s
I20261117 14:49:22.429101 6378 catalog_manager.cc:5840] T b74e748e97c84edeabc1c0cb41ddae99 P c7900e455dd64c68bccfc499bda413f7 reported cstate change: term changed from 1 to 2, leader changed from ec41d6947a4a4eadadf90c3756899704 (127.6.50.129) to c7900e455dd64c68bccfc499bda413f7 (127.6.50.130). New cstate: current_term: 2 leader_uuid: "c7900e455dd64c68bccfc499bda413f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } health_report { overall_health: UNKNOWN } } }
W20261117 14:49:22.436923 6615 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57154: Illegal state: replica c7900e455dd64c68bccfc499bda413f7 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.438777 6746 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57788: Illegal state: replica def6b23bccc94a78a47118da331f2798 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.438988 6747 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57788: Illegal state: replica def6b23bccc94a78a47118da331f2798 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.439630 6744 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57788: Illegal state: replica def6b23bccc94a78a47118da331f2798 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.454991 6744 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57788: Illegal state: replica def6b23bccc94a78a47118da331f2798 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.458616 6615 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57154: Illegal state: replica c7900e455dd64c68bccfc499bda413f7 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.459904 6615 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57154: Illegal state: replica c7900e455dd64c68bccfc499bda413f7 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.464460 6615 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57154: Illegal state: replica c7900e455dd64c68bccfc499bda413f7 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.479839 6744 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57788: Illegal state: replica def6b23bccc94a78a47118da331f2798 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.480311 6747 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57788: Illegal state: replica def6b23bccc94a78a47118da331f2798 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.480517 6746 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57788: Illegal state: replica def6b23bccc94a78a47118da331f2798 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.481789 6615 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57154: Illegal state: replica c7900e455dd64c68bccfc499bda413f7 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.483527 6746 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57788: Illegal state: replica def6b23bccc94a78a47118da331f2798 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.491532 6746 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57788: Illegal state: replica def6b23bccc94a78a47118da331f2798 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.495426 6746 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57788: Illegal state: replica def6b23bccc94a78a47118da331f2798 is not leader of this config: current role FOLLOWER
I20261117 14:49:22.499439 7096 heartbeater.cc:500] Master 127.6.50.190:39807 was elected leader, sending a full tablet report...
W20261117 14:49:22.500630 6618 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57154: Illegal state: replica c7900e455dd64c68bccfc499bda413f7 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.501190 6615 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57154: Illegal state: replica c7900e455dd64c68bccfc499bda413f7 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.503705 6615 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57154: Illegal state: replica c7900e455dd64c68bccfc499bda413f7 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.512274 6615 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57154: Illegal state: replica c7900e455dd64c68bccfc499bda413f7 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.519289 6615 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57154: Illegal state: replica c7900e455dd64c68bccfc499bda413f7 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.521394 6746 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57788: Illegal state: replica def6b23bccc94a78a47118da331f2798 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.524297 6746 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57788: Illegal state: replica def6b23bccc94a78a47118da331f2798 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.541666 6746 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57788: Illegal state: replica def6b23bccc94a78a47118da331f2798 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.541666 6747 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57788: Illegal state: replica def6b23bccc94a78a47118da331f2798 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.543751 6615 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57154: Illegal state: replica c7900e455dd64c68bccfc499bda413f7 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.546100 6746 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57788: Illegal state: replica def6b23bccc94a78a47118da331f2798 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.558084 6746 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57788: Illegal state: replica def6b23bccc94a78a47118da331f2798 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.561429 6615 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57154: Illegal state: replica c7900e455dd64c68bccfc499bda413f7 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.562752 6615 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57154: Illegal state: replica c7900e455dd64c68bccfc499bda413f7 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.566345 6615 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57154: Illegal state: replica c7900e455dd64c68bccfc499bda413f7 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.569778 6615 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57154: Illegal state: replica c7900e455dd64c68bccfc499bda413f7 is not leader of this config: current role FOLLOWER
I20261117 14:49:22.578925 6876 raft_consensus.cc:499] T 3cea00abcccd4b1284393ef8b406cab1 P def6b23bccc94a78a47118da331f2798 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ec41d6947a4a4eadadf90c3756899704)
I20261117 14:49:22.579208 6876 raft_consensus.cc:521] T 3cea00abcccd4b1284393ef8b406cab1 P def6b23bccc94a78a47118da331f2798 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
W20261117 14:49:22.579684 6615 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57154: Illegal state: replica c7900e455dd64c68bccfc499bda413f7 is not leader of this config: current role FOLLOWER
I20261117 14:49:22.579960 6876 leader_election.cc:290] T 3cea00abcccd4b1284393ef8b406cab1 P def6b23bccc94a78a47118da331f2798 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937), c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271)
I20261117 14:49:22.578924 7117 raft_consensus.cc:499] T 57984748adc7482a9a2d999a447a81af P def6b23bccc94a78a47118da331f2798 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ec41d6947a4a4eadadf90c3756899704)
I20261117 14:49:22.580183 7117 raft_consensus.cc:521] T 57984748adc7482a9a2d999a447a81af P def6b23bccc94a78a47118da331f2798 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:22.580600 6654 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "3cea00abcccd4b1284393ef8b406cab1" candidate_uuid: "def6b23bccc94a78a47118da331f2798" candidate_term: 2 candidate_status { last_received { term: 1 index: 176 } } ignore_live_leader: false dest_uuid: "c7900e455dd64c68bccfc499bda413f7" is_pre_election: true
I20261117 14:49:22.580828 6654 raft_consensus.cc:2490] T 3cea00abcccd4b1284393ef8b406cab1 P c7900e455dd64c68bccfc499bda413f7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate def6b23bccc94a78a47118da331f2798 in term 1.
I20261117 14:49:22.581146 7117 leader_election.cc:290] T 57984748adc7482a9a2d999a447a81af P def6b23bccc94a78a47118da331f2798 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937), c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271)
I20261117 14:49:22.581426 6723 leader_election.cc:304] T 3cea00abcccd4b1284393ef8b406cab1 P def6b23bccc94a78a47118da331f2798 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c7900e455dd64c68bccfc499bda413f7, def6b23bccc94a78a47118da331f2798; no voters:
W20261117 14:49:22.581694 6724 leader_election.cc:336] T 3cea00abcccd4b1284393ef8b406cab1 P def6b23bccc94a78a47118da331f2798 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111)
I20261117 14:49:22.581955 6654 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "57984748adc7482a9a2d999a447a81af" candidate_uuid: "def6b23bccc94a78a47118da331f2798" candidate_term: 2 candidate_status { last_received { term: 1 index: 176 } } ignore_live_leader: false dest_uuid: "c7900e455dd64c68bccfc499bda413f7" is_pre_election: true
I20261117 14:49:22.582093 7117 raft_consensus.cc:2826] T 3cea00abcccd4b1284393ef8b406cab1 P def6b23bccc94a78a47118da331f2798 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20261117 14:49:22.582204 6654 raft_consensus.cc:2490] T 57984748adc7482a9a2d999a447a81af P c7900e455dd64c68bccfc499bda413f7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate def6b23bccc94a78a47118da331f2798 in term 1.
I20261117 14:49:22.582270 7117 raft_consensus.cc:499] T 3cea00abcccd4b1284393ef8b406cab1 P def6b23bccc94a78a47118da331f2798 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ec41d6947a4a4eadadf90c3756899704)
I20261117 14:49:22.582388 7117 raft_consensus.cc:3096] T 3cea00abcccd4b1284393ef8b406cab1 P def6b23bccc94a78a47118da331f2798 [term 1 FOLLOWER]: Advancing to term 2
I20261117 14:49:22.582697 6723 leader_election.cc:304] T 57984748adc7482a9a2d999a447a81af P def6b23bccc94a78a47118da331f2798 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c7900e455dd64c68bccfc499bda413f7, def6b23bccc94a78a47118da331f2798; no voters:
W20261117 14:49:22.582888 6724 leader_election.cc:336] T 57984748adc7482a9a2d999a447a81af P def6b23bccc94a78a47118da331f2798 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111)
I20261117 14:49:22.583220 6876 raft_consensus.cc:2826] T 57984748adc7482a9a2d999a447a81af P def6b23bccc94a78a47118da331f2798 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20261117 14:49:22.583335 6876 raft_consensus.cc:499] T 57984748adc7482a9a2d999a447a81af P def6b23bccc94a78a47118da331f2798 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ec41d6947a4a4eadadf90c3756899704)
I20261117 14:49:22.583478 6876 raft_consensus.cc:3096] T 57984748adc7482a9a2d999a447a81af P def6b23bccc94a78a47118da331f2798 [term 1 FOLLOWER]: Advancing to term 2
W20261117 14:49:22.584559 6615 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57154: Illegal state: replica c7900e455dd64c68bccfc499bda413f7 is not leader of this config: current role FOLLOWER
I20261117 14:49:22.585336 7117 raft_consensus.cc:521] T 3cea00abcccd4b1284393ef8b406cab1 P def6b23bccc94a78a47118da331f2798 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:22.586109 7117 leader_election.cc:290] T 3cea00abcccd4b1284393ef8b406cab1 P def6b23bccc94a78a47118da331f2798 [CANDIDATE]: Term 2 election: Requested vote from peers ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937), c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271)
I20261117 14:49:22.586361 6654 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "3cea00abcccd4b1284393ef8b406cab1" candidate_uuid: "def6b23bccc94a78a47118da331f2798" candidate_term: 2 candidate_status { last_received { term: 1 index: 176 } } ignore_live_leader: false dest_uuid: "c7900e455dd64c68bccfc499bda413f7"
I20261117 14:49:22.586565 6654 raft_consensus.cc:3096] T 3cea00abcccd4b1284393ef8b406cab1 P c7900e455dd64c68bccfc499bda413f7 [term 1 FOLLOWER]: Advancing to term 2
W20261117 14:49:22.587831 6746 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57788: Illegal state: replica def6b23bccc94a78a47118da331f2798 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.587895 6747 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57788: Illegal state: replica def6b23bccc94a78a47118da331f2798 is not leader of this config: current role FOLLOWER
I20261117 14:49:22.588287 6876 raft_consensus.cc:521] T 57984748adc7482a9a2d999a447a81af P def6b23bccc94a78a47118da331f2798 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:22.588917 6876 leader_election.cc:290] T 57984748adc7482a9a2d999a447a81af P def6b23bccc94a78a47118da331f2798 [CANDIDATE]: Term 2 election: Requested vote from peers ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937), c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271)
W20261117 14:49:22.589454 6724 leader_election.cc:336] T 3cea00abcccd4b1284393ef8b406cab1 P def6b23bccc94a78a47118da331f2798 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111)
I20261117 14:49:22.589500 6654 raft_consensus.cc:2490] T 3cea00abcccd4b1284393ef8b406cab1 P c7900e455dd64c68bccfc499bda413f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate def6b23bccc94a78a47118da331f2798 in term 2.
I20261117 14:49:22.589563 6657 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "57984748adc7482a9a2d999a447a81af" candidate_uuid: "def6b23bccc94a78a47118da331f2798" candidate_term: 2 candidate_status { last_received { term: 1 index: 176 } } ignore_live_leader: false dest_uuid: "c7900e455dd64c68bccfc499bda413f7"
I20261117 14:49:22.589735 6657 raft_consensus.cc:3096] T 57984748adc7482a9a2d999a447a81af P c7900e455dd64c68bccfc499bda413f7 [term 1 FOLLOWER]: Advancing to term 2
I20261117 14:49:22.589952 6723 leader_election.cc:304] T 3cea00abcccd4b1284393ef8b406cab1 P def6b23bccc94a78a47118da331f2798 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c7900e455dd64c68bccfc499bda413f7, def6b23bccc94a78a47118da331f2798; no voters: ec41d6947a4a4eadadf90c3756899704
I20261117 14:49:22.590626 6876 raft_consensus.cc:2826] T 3cea00abcccd4b1284393ef8b406cab1 P def6b23bccc94a78a47118da331f2798 [term 2 FOLLOWER]: Leader election won for term 2
I20261117 14:49:22.590782 6876 raft_consensus.cc:705] T 3cea00abcccd4b1284393ef8b406cab1 P def6b23bccc94a78a47118da331f2798 [term 2 LEADER]: Becoming Leader. State: Replica: def6b23bccc94a78a47118da331f2798, State: Running, Role: LEADER
W20261117 14:49:22.591116 6747 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57788: Illegal state: replica def6b23bccc94a78a47118da331f2798 is not leader of this config: current role FOLLOWER
I20261117 14:49:22.591063 6876 consensus_queue.cc:238] T 3cea00abcccd4b1284393ef8b406cab1 P def6b23bccc94a78a47118da331f2798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 176, Committed index: 176, Last appended: 1.176, Last appended by leader: 176, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
W20261117 14:49:22.591566 6724 leader_election.cc:336] T 57984748adc7482a9a2d999a447a81af P def6b23bccc94a78a47118da331f2798 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111)
I20261117 14:49:22.592564 6657 raft_consensus.cc:2490] T 57984748adc7482a9a2d999a447a81af P c7900e455dd64c68bccfc499bda413f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate def6b23bccc94a78a47118da331f2798 in term 2.
I20261117 14:49:22.593204 6723 leader_election.cc:304] T 57984748adc7482a9a2d999a447a81af P def6b23bccc94a78a47118da331f2798 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c7900e455dd64c68bccfc499bda413f7, def6b23bccc94a78a47118da331f2798; no voters: ec41d6947a4a4eadadf90c3756899704
I20261117 14:49:22.593479 6378 catalog_manager.cc:5840] T 3cea00abcccd4b1284393ef8b406cab1 P def6b23bccc94a78a47118da331f2798 reported cstate change: term changed from 1 to 2, leader changed from ec41d6947a4a4eadadf90c3756899704 (127.6.50.129) to def6b23bccc94a78a47118da331f2798 (127.6.50.131). New cstate: current_term: 2 leader_uuid: "def6b23bccc94a78a47118da331f2798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } health_report { overall_health: HEALTHY } } }
I20261117 14:49:22.593871 6657 raft_consensus.cc:1285] T 3cea00abcccd4b1284393ef8b406cab1 P c7900e455dd64c68bccfc499bda413f7 [term 2 FOLLOWER]: Refusing update from remote peer def6b23bccc94a78a47118da331f2798: Log matching property violated. Preceding OpId in replica: term: 1 index: 176. Preceding OpId from leader: term: 2 index: 177. (index mismatch)
I20261117 14:49:22.594287 6876 raft_consensus.cc:2826] T 57984748adc7482a9a2d999a447a81af P def6b23bccc94a78a47118da331f2798 [term 2 FOLLOWER]: Leader election won for term 2
I20261117 14:49:22.594439 6876 raft_consensus.cc:705] T 57984748adc7482a9a2d999a447a81af P def6b23bccc94a78a47118da331f2798 [term 2 LEADER]: Becoming Leader. State: Replica: def6b23bccc94a78a47118da331f2798, State: Running, Role: LEADER
I20261117 14:49:22.594611 6915 consensus_queue.cc:1049] T 3cea00abcccd4b1284393ef8b406cab1 P def6b23bccc94a78a47118da331f2798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 177, Last known committed idx: 174, Time since last communication: 0.000s
I20261117 14:49:22.595539 6876 consensus_queue.cc:238] T 57984748adc7482a9a2d999a447a81af P def6b23bccc94a78a47118da331f2798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 176, Committed index: 176, Last appended: 1.176, Last appended by leader: 176, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
W20261117 14:49:22.595916 6724 consensus_peers.cc:597] T 3cea00abcccd4b1284393ef8b406cab1 P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20261117 14:49:22.597892 6654 raft_consensus.cc:1285] T 57984748adc7482a9a2d999a447a81af P c7900e455dd64c68bccfc499bda413f7 [term 2 FOLLOWER]: Refusing update from remote peer def6b23bccc94a78a47118da331f2798: Log matching property violated. Preceding OpId in replica: term: 1 index: 176. Preceding OpId from leader: term: 2 index: 177. (index mismatch)
I20261117 14:49:22.598486 6876 consensus_queue.cc:1049] T 57984748adc7482a9a2d999a447a81af P def6b23bccc94a78a47118da331f2798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 177, Last known committed idx: 176, Time since last communication: 0.000s
W20261117 14:49:22.599409 6724 consensus_peers.cc:597] T 57984748adc7482a9a2d999a447a81af P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20261117 14:49:22.599699 6378 catalog_manager.cc:5840] T 57984748adc7482a9a2d999a447a81af P def6b23bccc94a78a47118da331f2798 reported cstate change: term changed from 1 to 2, leader changed from ec41d6947a4a4eadadf90c3756899704 (127.6.50.129) to def6b23bccc94a78a47118da331f2798 (127.6.50.131). New cstate: current_term: 2 leader_uuid: "def6b23bccc94a78a47118da331f2798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } health_report { overall_health: HEALTHY } } }
W20261117 14:49:22.615585 6615 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57154: Illegal state: replica c7900e455dd64c68bccfc499bda413f7 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.651990 6612 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:57154: Illegal state: replica c7900e455dd64c68bccfc499bda413f7 is not leader of this config: current role FOLLOWER
W20261117 14:49:22.755264 6594 consensus_peers.cc:597] T 5c849aa2a21a4c13b2e31d2ca3f692cc P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20261117 14:49:22.772003 6594 consensus_peers.cc:597] T d1732d75bf044feb8884fc3135373072 P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20261117 14:49:22.802583 6724 consensus_peers.cc:597] T 47d9af37b05545f0b5b0c033f4ec953f P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20261117 14:49:23.012120 6594 consensus_peers.cc:597] T b74e748e97c84edeabc1c0cb41ddae99 P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20261117 14:49:23.077890 6724 consensus_peers.cc:597] T 57984748adc7482a9a2d999a447a81af P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20261117 14:49:23.187619 6724 consensus_peers.cc:597] T 3cea00abcccd4b1284393ef8b406cab1 P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20261117 14:49:23.226413 6594 consensus_peers.cc:597] T 5c849aa2a21a4c13b2e31d2ca3f692cc P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20261117 14:49:23.240402 6594 consensus_peers.cc:597] T d1732d75bf044feb8884fc3135373072 P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20261117 14:49:23.312601 6724 consensus_peers.cc:597] T 47d9af37b05545f0b5b0c033f4ec953f P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20261117 14:49:23.486454 6594 consensus_peers.cc:597] T b74e748e97c84edeabc1c0cb41ddae99 P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20261117 14:49:23.601297 6724 consensus_peers.cc:597] T 57984748adc7482a9a2d999a447a81af P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20261117 14:49:23.683665 6724 consensus_peers.cc:597] T 3cea00abcccd4b1284393ef8b406cab1 P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20261117 14:49:23.713003 6594 consensus_peers.cc:597] T 5c849aa2a21a4c13b2e31d2ca3f692cc P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20261117 14:49:23.777707 6594 consensus_peers.cc:597] T d1732d75bf044feb8884fc3135373072 P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20261117 14:49:23.786811 6724 consensus_peers.cc:597] T 47d9af37b05545f0b5b0c033f4ec953f P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20261117 14:49:24.018267 6594 consensus_peers.cc:597] T b74e748e97c84edeabc1c0cb41ddae99 P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20261117 14:49:24.110723 6724 consensus_peers.cc:597] T 57984748adc7482a9a2d999a447a81af P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20261117 14:49:24.132302 7118 consensus_queue.cc:580] T 47d9af37b05545f0b5b0c033f4ec953f P def6b23bccc94a78a47118da331f2798 [LEADER]: Leader has been unable to successfully communicate with peer ec41d6947a4a4eadadf90c3756899704 for more than 2 seconds (2.049s)
I20261117 14:49:24.138033 7126 consensus_queue.cc:580] T 5c849aa2a21a4c13b2e31d2ca3f692cc P c7900e455dd64c68bccfc499bda413f7 [LEADER]: Leader has been unable to successfully communicate with peer ec41d6947a4a4eadadf90c3756899704 for more than 2 seconds (2.063s)
I20261117 14:49:24.167479 7126 consensus_queue.cc:580] T d1732d75bf044feb8884fc3135373072 P c7900e455dd64c68bccfc499bda413f7 [LEADER]: Leader has been unable to successfully communicate with peer ec41d6947a4a4eadadf90c3756899704 for more than 2 seconds (2.093s)
W20261117 14:49:24.229434 6594 consensus_peers.cc:597] T 5c849aa2a21a4c13b2e31d2ca3f692cc P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20261117 14:49:24.243274 6724 consensus_peers.cc:597] T 3cea00abcccd4b1284393ef8b406cab1 P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20261117 14:49:24.266467 6724 consensus_peers.cc:597] T 47d9af37b05545f0b5b0c033f4ec953f P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20261117 14:49:24.301164 6594 consensus_peers.cc:597] T d1732d75bf044feb8884fc3135373072 P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20261117 14:49:24.452011 7121 consensus_queue.cc:580] T b74e748e97c84edeabc1c0cb41ddae99 P c7900e455dd64c68bccfc499bda413f7 [LEADER]: Leader has been unable to successfully communicate with peer ec41d6947a4a4eadadf90c3756899704 for more than 2 seconds (2.026s)
W20261117 14:49:24.568949 6594 consensus_peers.cc:597] T b74e748e97c84edeabc1c0cb41ddae99 P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20261117 14:49:24.614678 7119 consensus_queue.cc:580] T 57984748adc7482a9a2d999a447a81af P def6b23bccc94a78a47118da331f2798 [LEADER]: Leader has been unable to successfully communicate with peer ec41d6947a4a4eadadf90c3756899704 for more than 2 seconds (2.019s)
W20261117 14:49:24.620289 6724 consensus_peers.cc:597] T 57984748adc7482a9a2d999a447a81af P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20261117 14:49:24.673099 7135 consensus_queue.cc:580] T 3cea00abcccd4b1284393ef8b406cab1 P def6b23bccc94a78a47118da331f2798 [LEADER]: Leader has been unable to successfully communicate with peer ec41d6947a4a4eadadf90c3756899704 for more than 2 seconds (2.082s)
W20261117 14:49:24.767735 6724 consensus_peers.cc:597] T 3cea00abcccd4b1284393ef8b406cab1 P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20261117 14:49:24.768142 6724 consensus_peers.cc:597] T 47d9af37b05545f0b5b0c033f4ec953f P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20261117 14:49:24.779505 6594 consensus_peers.cc:597] T 5c849aa2a21a4c13b2e31d2ca3f692cc P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20261117 14:49:24.852631 6594 consensus_peers.cc:597] T d1732d75bf044feb8884fc3135373072 P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20261117 14:49:25.072947 6724 consensus_peers.cc:597] T 57984748adc7482a9a2d999a447a81af P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20261117 14:49:25.112150 6594 consensus_peers.cc:597] T b74e748e97c84edeabc1c0cb41ddae99 P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20261117 14:49:25.276599 6594 consensus_peers.cc:597] T 5c849aa2a21a4c13b2e31d2ca3f692cc P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20261117 14:49:25.284514 6724 consensus_peers.cc:597] T 3cea00abcccd4b1284393ef8b406cab1 P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20261117 14:49:25.343376 6724 consensus_peers.cc:597] T 47d9af37b05545f0b5b0c033f4ec953f P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20261117 14:49:25.381660 6594 consensus_peers.cc:597] T d1732d75bf044feb8884fc3135373072 P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20261117 14:49:25.522284 6346 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskUafhB0/build/asan/bin/kudu pid 6354
I20261117 14:49:25.525044 6415 generic_service.cc:196] Checking for leaks (request via RPC)
W20261117 14:49:25.598423 6594 consensus_peers.cc:597] T b74e748e97c84edeabc1c0cb41ddae99 P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20261117 14:49:25.665803 6724 consensus_peers.cc:597] T 57984748adc7482a9a2d999a447a81af P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20261117 14:49:25.807680 6594 consensus_peers.cc:597] T 5c849aa2a21a4c13b2e31d2ca3f692cc P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20261117 14:49:25.818173 6724 consensus_peers.cc:597] T 3cea00abcccd4b1284393ef8b406cab1 P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20261117 14:49:25.838048 6346 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskUafhB0/build/asan/bin/kudu with pid 6354
W20261117 14:49:25.890873 6833 heartbeater.cc:648] Failed to heartbeat to 127.6.50.190:39807 (0 consecutive failures): Network error: Failed to send heartbeat to master: recv got EOF from 127.6.50.190:39807 (error 108)
I20261117 14:49:25.892109 6346 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskUafhB0/build/asan/bin/kudu
/tmp/dist-test-taskUafhB0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.50.190:39807
--webserver_interface=127.6.50.190
--webserver_port=41151
--builtin_ntp_servers=127.6.50.148:42811
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.50.190:39807 with env {}
W20261117 14:49:25.911669 6594 consensus_peers.cc:597] T d1732d75bf044feb8884fc3135373072 P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20261117 14:49:25.921555 6724 consensus_peers.cc:597] T 47d9af37b05545f0b5b0c033f4ec953f P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20261117 14:49:26.123217 6594 consensus_peers.cc:597] T b74e748e97c84edeabc1c0cb41ddae99 P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20261117 14:49:26.183676 6724 consensus_peers.cc:597] T 57984748adc7482a9a2d999a447a81af P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20261117 14:49:26.347295 6724 consensus_peers.cc:597] T 3cea00abcccd4b1284393ef8b406cab1 P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20261117 14:49:26.376945 6594 consensus_peers.cc:597] T 5c849aa2a21a4c13b2e31d2ca3f692cc P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20261117 14:49:26.408785 6594 consensus_peers.cc:597] T d1732d75bf044feb8884fc3135373072 P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20261117 14:49:26.437134 6724 consensus_peers.cc:597] T 47d9af37b05545f0b5b0c033f4ec953f P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20261117 14:49:26.484268 6703 heartbeater.cc:648] Failed to heartbeat to 127.6.50.190:39807 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.6.50.190:39807: connect: Connection refused (error 111)
W20261117 14:49:26.510071 7096 heartbeater.cc:648] Failed to heartbeat to 127.6.50.190:39807 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.6.50.190:39807: connect: Connection refused (error 111)
W20261117 14:49:26.566242 7145 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261117 14:49:26.566800 7145 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261117 14:49:26.566964 7145 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261117 14:49:26.583762 7145 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20261117 14:49:26.584023 7145 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261117 14:49:26.584192 7145 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20261117 14:49:26.584322 7145 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20261117 14:49:26.602795 7145 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.50.148:42811
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.6.50.190:39807
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.50.190:39807
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.6.50.190
--webserver_port=41151
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type FASTDEBUG
built by None at 17 Nov 2026 14:43:24 UTC on bdcb31816ec0
build id 14829
ASAN enabled
I20261117 14:49:26.609189 7145 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261117 14:49:26.611825 7145 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261117 14:49:26.663807 7152 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261117 14:49:26.672703 7153 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261117 14:49:26.688619 6594 consensus_peers.cc:597] T b74e748e97c84edeabc1c0cb41ddae99 P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20261117 14:49:26.689399 7145 server_base.cc:1061] running on GCE node
W20261117 14:49:26.689934 7156 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261117 14:49:26.691082 7145 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261117 14:49:26.701610 7145 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261117 14:49:26.715468 7145 hybrid_clock.cc:648] HybridClock initialized: now 1794926966711464 us; error 3976 us; skew 500 ppm
I20261117 14:49:26.716137 7145 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
W20261117 14:49:26.773563 6724 consensus_peers.cc:597] T 57984748adc7482a9a2d999a447a81af P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20261117 14:49:26.793362 7145 webserver.cc:577] Webserver started at http://127.6.50.190:41151/ using document root <none> and password file <none>
I20261117 14:49:26.794641 7145 fs_manager.cc:362] Metadata directory not provided
I20261117 14:49:26.794844 7145 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261117 14:49:26.814443 7145 fs_manager.cc:714] Time spent opening directory manager: real 0.017s user 0.010s sys 0.001s
I20261117 14:49:26.818526 7161 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20261117 14:49:26.820981 7145 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20261117 14:49:26.821257 7145 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/master-0/data,/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/master-0/wal
uuid: "77877f9f184644d8acf4c8c6b307a230"
format_stamp: "Formatted at 2026-11-17 14:49:14 on dist-test-slave-jwg6"
I20261117 14:49:26.822221 7145 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20261117 14:49:26.842831 6594 consensus_peers.cc:597] T 5c849aa2a21a4c13b2e31d2ca3f692cc P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20261117 14:49:26.887497 7145 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20261117 14:49:26.888756 7145 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261117 14:49:26.889201 7145 kserver.cc:163] Server-wide thread pool size limit: 3276
W20261117 14:49:26.944116 6594 consensus_peers.cc:597] T d1732d75bf044feb8884fc3135373072 P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20261117 14:49:26.999778 6724 consensus_peers.cc:597] T 47d9af37b05545f0b5b0c033f4ec953f P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20261117 14:49:27.000867 6724 consensus_peers.cc:597] T 3cea00abcccd4b1284393ef8b406cab1 P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20261117 14:49:27.235071 6724 consensus_peers.cc:597] T 57984748adc7482a9a2d999a447a81af P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20261117 14:49:27.308761 6724 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111) [suppressed 141 similar messages]
W20261117 14:49:27.321651 6594 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111) [suppressed 147 similar messages]
W20261117 14:49:27.322763 6594 consensus_peers.cc:597] T b74e748e97c84edeabc1c0cb41ddae99 P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20261117 14:49:27.375931 6594 consensus_peers.cc:597] T 5c849aa2a21a4c13b2e31d2ca3f692cc P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20261117 14:49:27.405515 7145 rpc_server.cc:307] RPC server started. Bound to: 127.6.50.190:39807
I20261117 14:49:27.405536 7212 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.50.190:39807 every 8 connection(s)
I20261117 14:49:27.408969 7145 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/master-0/data/info.pb
I20261117 14:49:27.419131 6346 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskUafhB0/build/asan/bin/kudu as pid 7145
I20261117 14:49:27.430238 7213 sys_catalog.cc:263] Verifying existing consensus state
I20261117 14:49:27.435526 7213 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77877f9f184644d8acf4c8c6b307a230: Bootstrap starting.
W20261117 14:49:27.475716 6594 consensus_peers.cc:597] T d1732d75bf044feb8884fc3135373072 P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20261117 14:49:27.489429 7213 log.cc:826] T 00000000000000000000000000000000 P 77877f9f184644d8acf4c8c6b307a230: Log is configured to *not* fsync() on all Append() calls
I20261117 14:49:27.522183 7213 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77877f9f184644d8acf4c8c6b307a230: Bootstrap replayed 1/1 log segments. Stats: ops{read=16 overwritten=0 applied=16 ignored=0} inserts{seen=11 ignored=0} mutations{seen=15 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20261117 14:49:27.522984 7213 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77877f9f184644d8acf4c8c6b307a230: Bootstrap complete.
W20261117 14:49:27.525213 6724 consensus_peers.cc:597] T 47d9af37b05545f0b5b0c033f4ec953f P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20261117 14:49:27.537711 7213 raft_consensus.cc:360] T 00000000000000000000000000000000 P 77877f9f184644d8acf4c8c6b307a230 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77877f9f184644d8acf4c8c6b307a230" member_type: VOTER last_known_addr { host: "127.6.50.190" port: 39807 } }
I20261117 14:49:27.538806 7213 raft_consensus.cc:748] T 00000000000000000000000000000000 P 77877f9f184644d8acf4c8c6b307a230 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77877f9f184644d8acf4c8c6b307a230, State: Initialized, Role: FOLLOWER
I20261117 14:49:27.539724 7213 consensus_queue.cc:261] T 00000000000000000000000000000000 P 77877f9f184644d8acf4c8c6b307a230 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 16, Last appended: 1.16, Last appended by leader: 16, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77877f9f184644d8acf4c8c6b307a230" member_type: VOTER last_known_addr { host: "127.6.50.190" port: 39807 } }
I20261117 14:49:27.539978 7213 raft_consensus.cc:400] T 00000000000000000000000000000000 P 77877f9f184644d8acf4c8c6b307a230 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20261117 14:49:27.540088 7213 raft_consensus.cc:499] T 00000000000000000000000000000000 P 77877f9f184644d8acf4c8c6b307a230 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20261117 14:49:27.540277 7213 raft_consensus.cc:3096] T 00000000000000000000000000000000 P 77877f9f184644d8acf4c8c6b307a230 [term 1 FOLLOWER]: Advancing to term 2
I20261117 14:49:27.545764 7213 raft_consensus.cc:521] T 00000000000000000000000000000000 P 77877f9f184644d8acf4c8c6b307a230 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77877f9f184644d8acf4c8c6b307a230" member_type: VOTER last_known_addr { host: "127.6.50.190" port: 39807 } }
I20261117 14:49:27.546484 7213 leader_election.cc:304] T 00000000000000000000000000000000 P 77877f9f184644d8acf4c8c6b307a230 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 77877f9f184644d8acf4c8c6b307a230; no voters:
I20261117 14:49:27.553382 7218 raft_consensus.cc:2826] T 00000000000000000000000000000000 P 77877f9f184644d8acf4c8c6b307a230 [term 2 FOLLOWER]: Leader election won for term 2
I20261117 14:49:27.553670 7213 leader_election.cc:290] T 00000000000000000000000000000000 P 77877f9f184644d8acf4c8c6b307a230 [CANDIDATE]: Term 2 election: Requested vote from peers
I20261117 14:49:27.570716 7218 raft_consensus.cc:705] T 00000000000000000000000000000000 P 77877f9f184644d8acf4c8c6b307a230 [term 2 LEADER]: Becoming Leader. State: Replica: 77877f9f184644d8acf4c8c6b307a230, State: Running, Role: LEADER
I20261117 14:49:27.571837 7218 consensus_queue.cc:238] T 00000000000000000000000000000000 P 77877f9f184644d8acf4c8c6b307a230 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 1.16, Last appended by leader: 16, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77877f9f184644d8acf4c8c6b307a230" member_type: VOTER last_known_addr { host: "127.6.50.190" port: 39807 } }
W20261117 14:49:27.572425 6724 consensus_peers.cc:597] T 3cea00abcccd4b1284393ef8b406cab1 P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20261117 14:49:27.577654 7213 sys_catalog.cc:565] T 00000000000000000000000000000000 P 77877f9f184644d8acf4c8c6b307a230 [sys.catalog]: configured and running, proceeding with master startup.
I20261117 14:49:27.587556 7220 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77877f9f184644d8acf4c8c6b307a230 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "77877f9f184644d8acf4c8c6b307a230" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77877f9f184644d8acf4c8c6b307a230" member_type: VOTER last_known_addr { host: "127.6.50.190" port: 39807 } } }
I20261117 14:49:27.587989 7220 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77877f9f184644d8acf4c8c6b307a230 [sys.catalog]: This master's current role is: LEADER
I20261117 14:49:27.595085 7219 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77877f9f184644d8acf4c8c6b307a230 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 77877f9f184644d8acf4c8c6b307a230. Latest consensus state: current_term: 2 leader_uuid: "77877f9f184644d8acf4c8c6b307a230" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77877f9f184644d8acf4c8c6b307a230" member_type: VOTER last_known_addr { host: "127.6.50.190" port: 39807 } } }
I20261117 14:49:27.595737 7219 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77877f9f184644d8acf4c8c6b307a230 [sys.catalog]: This master's current role is: LEADER
I20261117 14:49:27.598572 7227 catalog_manager.cc:1526] Loading table and tablet metadata into memory...
I20261117 14:49:27.614934 7227 catalog_manager.cc:694] Loaded metadata for table test-workload [id=bc9c637ec15b4834b6657bcd92c82f8b]
I20261117 14:49:27.617673 7227 tablet_loader.cc:96] loaded metadata for tablet 3cea00abcccd4b1284393ef8b406cab1 (table test-workload [id=bc9c637ec15b4834b6657bcd92c82f8b])
I20261117 14:49:27.618487 7227 tablet_loader.cc:96] loaded metadata for tablet 47d9af37b05545f0b5b0c033f4ec953f (table test-workload [id=bc9c637ec15b4834b6657bcd92c82f8b])
I20261117 14:49:27.625200 6703 heartbeater.cc:345] Connected to a master server at 127.6.50.190:39807
I20261117 14:49:27.625824 7227 tablet_loader.cc:96] loaded metadata for tablet 57984748adc7482a9a2d999a447a81af (table test-workload [id=bc9c637ec15b4834b6657bcd92c82f8b])
I20261117 14:49:27.628309 7227 tablet_loader.cc:96] loaded metadata for tablet 5c849aa2a21a4c13b2e31d2ca3f692cc (table test-workload [id=bc9c637ec15b4834b6657bcd92c82f8b])
I20261117 14:49:27.628901 7227 tablet_loader.cc:96] loaded metadata for tablet b74e748e97c84edeabc1c0cb41ddae99 (table test-workload [id=bc9c637ec15b4834b6657bcd92c82f8b])
I20261117 14:49:27.629451 7227 tablet_loader.cc:96] loaded metadata for tablet d1732d75bf044feb8884fc3135373072 (table test-workload [id=bc9c637ec15b4834b6657bcd92c82f8b])
I20261117 14:49:27.629850 7227 catalog_manager.cc:1535] Initializing Kudu cluster ID...
I20261117 14:49:27.631670 7227 catalog_manager.cc:1310] Loaded cluster ID: bcb55fc8eb994d7f892409a03681fdde
I20261117 14:49:27.631832 7227 catalog_manager.cc:1546] Initializing Kudu internal certificate authority...
I20261117 14:49:27.639050 7227 catalog_manager.cc:1555] Loading token signing keys...
I20261117 14:49:27.651485 7227 catalog_manager.cc:6232] T 00000000000000000000000000000000 P 77877f9f184644d8acf4c8c6b307a230: Loaded TSK: 0
I20261117 14:49:27.655272 7227 catalog_manager.cc:1565] Initializing in-progress tserver states...
I20261117 14:49:27.735533 7096 heartbeater.cc:345] Connected to a master server at 127.6.50.190:39807
W20261117 14:49:27.793810 6724 consensus_peers.cc:597] T 57984748adc7482a9a2d999a447a81af P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20261117 14:49:27.836067 7238 catalog_manager.cc:820] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20261117 14:49:27.903545 6833 heartbeater.cc:345] Connected to a master server at 127.6.50.190:39807
I20261117 14:49:27.906347 7178 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "def6b23bccc94a78a47118da331f2798" instance_seqno: 1794926956446875) as {username='slave'} at 127.6.50.131:50031; Asking this server to re-register.
I20261117 14:49:27.907485 6833 heartbeater.cc:462] Registering TS with master...
I20261117 14:49:27.907750 6833 heartbeater.cc:508] Master 127.6.50.190:39807 requested a full tablet report, sending...
I20261117 14:49:27.910391 7178 ts_manager.cc:210] Registered new tserver with Master: def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611)
W20261117 14:49:27.937459 6594 consensus_peers.cc:597] T 5c849aa2a21a4c13b2e31d2ca3f692cc P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20261117 14:49:27.943972 6594 consensus_peers.cc:597] T b74e748e97c84edeabc1c0cb41ddae99 P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20261117 14:49:28.038798 6594 consensus_peers.cc:597] T d1732d75bf044feb8884fc3135373072 P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20261117 14:49:28.083353 6724 consensus_peers.cc:597] T 3cea00abcccd4b1284393ef8b406cab1 P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20261117 14:49:28.121212 6724 consensus_peers.cc:597] T 47d9af37b05545f0b5b0c033f4ec953f P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20261117 14:49:28.394389 6724 consensus_peers.cc:597] T 57984748adc7482a9a2d999a447a81af P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20261117 14:49:28.436380 6594 consensus_peers.cc:597] T 5c849aa2a21a4c13b2e31d2ca3f692cc P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20261117 14:49:28.518193 6594 consensus_peers.cc:597] T b74e748e97c84edeabc1c0cb41ddae99 P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20261117 14:49:28.531464 6594 consensus_peers.cc:597] T d1732d75bf044feb8884fc3135373072 P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20261117 14:49:28.572466 6724 consensus_peers.cc:597] T 3cea00abcccd4b1284393ef8b406cab1 P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20261117 14:49:28.611927 6724 consensus_peers.cc:597] T 47d9af37b05545f0b5b0c033f4ec953f P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20261117 14:49:28.631491 7178 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" instance_seqno: 1794926955959357) as {username='slave'} at 127.6.50.130:37691; Asking this server to re-register.
I20261117 14:49:28.633507 6703 heartbeater.cc:462] Registering TS with master...
I20261117 14:49:28.633781 6703 heartbeater.cc:508] Master 127.6.50.190:39807 requested a full tablet report, sending...
I20261117 14:49:28.638782 7178 ts_manager.cc:210] Registered new tserver with Master: c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271)
I20261117 14:49:28.738651 7178 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "b1357297ed3e46b78f7b1b44c1eec2d1" instance_seqno: 1794926961108381) as {username='slave'} at 127.6.50.132:58003; Asking this server to re-register.
I20261117 14:49:28.739588 7096 heartbeater.cc:462] Registering TS with master...
I20261117 14:49:28.739897 7096 heartbeater.cc:508] Master 127.6.50.190:39807 requested a full tablet report, sending...
I20261117 14:49:28.742254 7178 ts_manager.cc:210] Registered new tserver with Master: b1357297ed3e46b78f7b1b44c1eec2d1 (127.6.50.132:45815)
W20261117 14:49:28.937604 6724 consensus_peers.cc:597] T 57984748adc7482a9a2d999a447a81af P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20261117 14:49:28.944891 6594 consensus_peers.cc:597] T 5c849aa2a21a4c13b2e31d2ca3f692cc P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20261117 14:49:29.021523 6594 consensus_peers.cc:597] T d1732d75bf044feb8884fc3135373072 P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20261117 14:49:29.059067 6594 consensus_peers.cc:597] T b74e748e97c84edeabc1c0cb41ddae99 P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20261117 14:49:29.107544 6724 consensus_peers.cc:597] T 3cea00abcccd4b1284393ef8b406cab1 P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20261117 14:49:29.116799 6724 consensus_peers.cc:597] T 47d9af37b05545f0b5b0c033f4ec953f P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20261117 14:49:29.415786 6594 consensus_peers.cc:597] T 5c849aa2a21a4c13b2e31d2ca3f692cc P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20261117 14:49:29.436615 6724 consensus_peers.cc:597] T 57984748adc7482a9a2d999a447a81af P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20261117 14:49:29.539139 6594 consensus_peers.cc:597] T d1732d75bf044feb8884fc3135373072 P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20261117 14:49:29.658871 6724 consensus_peers.cc:597] T 47d9af37b05545f0b5b0c033f4ec953f P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20261117 14:49:29.682957 6594 consensus_peers.cc:597] T b74e748e97c84edeabc1c0cb41ddae99 P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20261117 14:49:29.686932 6724 consensus_peers.cc:597] T 3cea00abcccd4b1284393ef8b406cab1 P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20261117 14:49:29.957506 6594 consensus_peers.cc:597] T 5c849aa2a21a4c13b2e31d2ca3f692cc P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20261117 14:49:30.016731 6724 consensus_peers.cc:597] T 57984748adc7482a9a2d999a447a81af P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20261117 14:49:30.037199 6594 consensus_peers.cc:597] T d1732d75bf044feb8884fc3135373072 P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20261117 14:49:30.215086 6724 consensus_peers.cc:597] T 47d9af37b05545f0b5b0c033f4ec953f P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20261117 14:49:30.253777 6724 consensus_peers.cc:597] T 3cea00abcccd4b1284393ef8b406cab1 P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20261117 14:49:30.313623 6594 consensus_peers.cc:597] T b74e748e97c84edeabc1c0cb41ddae99 P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
I20261117 14:49:30.487041 6346 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskUafhB0/build/asan/bin/kudu
/tmp/dist-test-taskUafhB0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.50.129:42937
--local_ip_for_outbound_sockets=127.6.50.129
--tserver_master_addrs=127.6.50.190:39807
--webserver_port=39443
--webserver_interface=127.6.50.129
--builtin_ntp_servers=127.6.50.148:42811
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--follower_unavailable_considered_failed_sec=2
--enable_log_gc=false with env {}
W20261117 14:49:30.534471 6724 consensus_peers.cc:597] T 57984748adc7482a9a2d999a447a81af P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20261117 14:49:30.539774 6594 consensus_peers.cc:597] T 5c849aa2a21a4c13b2e31d2ca3f692cc P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 81: this message will repeat every 5th retry.
W20261117 14:49:30.540017 6594 consensus_peers.cc:597] T d1732d75bf044feb8884fc3135373072 P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 81: this message will repeat every 5th retry.
W20261117 14:49:30.720867 6724 consensus_peers.cc:597] T 47d9af37b05545f0b5b0c033f4ec953f P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 81: this message will repeat every 5th retry.
W20261117 14:49:30.915776 6594 consensus_peers.cc:597] T b74e748e97c84edeabc1c0cb41ddae99 P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20261117 14:49:30.929769 6724 consensus_peers.cc:597] T 3cea00abcccd4b1284393ef8b406cab1 P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20261117 14:49:30.979270 6594 consensus_peers.cc:597] T d1732d75bf044feb8884fc3135373072 P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 86: this message will repeat every 5th retry.
W20261117 14:49:31.095263 6724 consensus_peers.cc:597] T 57984748adc7482a9a2d999a447a81af P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 81: this message will repeat every 5th retry.
W20261117 14:49:31.099352 6594 consensus_peers.cc:597] T 5c849aa2a21a4c13b2e31d2ca3f692cc P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 86: this message will repeat every 5th retry.
W20261117 14:49:31.332551 6724 consensus_peers.cc:597] T 47d9af37b05545f0b5b0c033f4ec953f P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 86: this message will repeat every 5th retry.
W20261117 14:49:31.397007 7247 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261117 14:49:31.397595 7247 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261117 14:49:31.397769 7247 flags.cc:432] Enabled unsafe flag: --enable_log_gc=false
W20261117 14:49:31.397928 7247 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261117 14:49:31.423247 7247 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261117 14:49:31.423611 7247 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.50.129
I20261117 14:49:31.445696 7247 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.50.148:42811
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=2
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.50.129:42937
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.6.50.129
--webserver_port=39443
--enable_log_gc=false
--tserver_master_addrs=127.6.50.190:39807
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.50.129
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type FASTDEBUG
built by None at 17 Nov 2026 14:43:24 UTC on bdcb31816ec0
build id 14829
ASAN enabled
I20261117 14:49:31.448477 7247 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261117 14:49:31.451223 7247 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20261117 14:49:31.458168 7247 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20261117 14:49:31.519454 6594 consensus_peers.cc:597] T b74e748e97c84edeabc1c0cb41ddae99 P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 81: this message will repeat every 5th retry.
W20261117 14:49:31.520109 7254 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261117 14:49:31.526089 7256 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261117 14:49:31.526501 7253 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261117 14:49:31.536216 7247 server_base.cc:1061] running on GCE node
I20261117 14:49:31.538079 7247 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
W20261117 14:49:31.547662 6594 consensus_peers.cc:597] T d1732d75bf044feb8884fc3135373072 P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 91: this message will repeat every 5th retry.
I20261117 14:49:31.553558 7247 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261117 14:49:31.557121 7247 hybrid_clock.cc:648] HybridClock initialized: now 1794926971557025 us; error 83 us; skew 500 ppm
I20261117 14:49:31.558118 7247 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261117 14:49:31.561491 7247 webserver.cc:577] Webserver started at http://127.6.50.129:39443/ using document root <none> and password file <none>
I20261117 14:49:31.562554 7247 fs_manager.cc:362] Metadata directory not provided
I20261117 14:49:31.562738 7247 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261117 14:49:31.578823 7247 fs_manager.cc:714] Time spent opening directory manager: real 0.012s user 0.005s sys 0.003s
W20261117 14:49:31.641609 6724 consensus_peers.cc:597] T 57984748adc7482a9a2d999a447a81af P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 86: this message will repeat every 5th retry.
W20261117 14:49:31.660362 6724 consensus_peers.cc:597] T 3cea00abcccd4b1284393ef8b406cab1 P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 81: this message will repeat every 5th retry.
I20261117 14:49:31.667794 7263 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20261117 14:49:31.669775 7247 fs_manager.cc:730] Time spent opening block manager: real 0.068s user 0.006s sys 0.003s
I20261117 14:49:31.669965 7247 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-0/data,/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-0/wal
uuid: "ec41d6947a4a4eadadf90c3756899704"
format_stamp: "Formatted at 2026-11-17 14:49:15 on dist-test-slave-jwg6"
I20261117 14:49:31.670921 7247 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20261117 14:49:31.779445 6594 consensus_peers.cc:597] T 5c849aa2a21a4c13b2e31d2ca3f692cc P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 91: this message will repeat every 5th retry.
I20261117 14:49:31.811781 7247 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20261117 14:49:31.812965 7247 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261117 14:49:31.813359 7247 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261117 14:49:31.830147 7247 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
W20261117 14:49:31.872248 6724 consensus_peers.cc:597] T 47d9af37b05545f0b5b0c033f4ec953f P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 91: this message will repeat every 5th retry.
I20261117 14:49:31.875752 7270 ts_tablet_manager.cc:594] Loading tablet metadata (0/6 complete)
I20261117 14:49:31.902041 7247 ts_tablet_manager.cc:631] Loaded tablet metadata (6 total tablets, 6 live tablets)
I20261117 14:49:31.902175 7247 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.061s user 0.006s sys 0.024s
I20261117 14:49:31.902328 7247 ts_tablet_manager.cc:646] Registering tablets (0/6 complete)
I20261117 14:49:31.920529 7270 tablet_bootstrap.cc:492] T d1732d75bf044feb8884fc3135373072 P ec41d6947a4a4eadadf90c3756899704: Bootstrap starting.
I20261117 14:49:31.920876 7247 ts_tablet_manager.cc:662] Registered 6 tablets
I20261117 14:49:31.921049 7247 ts_tablet_manager.cc:641] Time spent register tablets: real 0.019s user 0.017s sys 0.000s
W20261117 14:49:32.078621 6724 consensus_peers.cc:597] T 57984748adc7482a9a2d999a447a81af P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 91: this message will repeat every 5th retry.
I20261117 14:49:32.083714 7270 log.cc:826] T d1732d75bf044feb8884fc3135373072 P ec41d6947a4a4eadadf90c3756899704: Log is configured to *not* fsync() on all Append() calls
W20261117 14:49:32.190716 6724 consensus_peers.cc:597] T 3cea00abcccd4b1284393ef8b406cab1 P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 86: this message will repeat every 5th retry.
W20261117 14:49:32.341809 6724 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111) [suppressed 135 similar messages]
I20261117 14:49:32.409973 7270 tablet_bootstrap.cc:492] T d1732d75bf044feb8884fc3135373072 P ec41d6947a4a4eadadf90c3756899704: Bootstrap replayed 1/1 log segments. Stats: ops{read=174 overwritten=0 applied=174 ignored=0} inserts{seen=1470 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20261117 14:49:32.410743 7270 tablet_bootstrap.cc:492] T d1732d75bf044feb8884fc3135373072 P ec41d6947a4a4eadadf90c3756899704: Bootstrap complete.
I20261117 14:49:32.412372 7270 ts_tablet_manager.cc:1449] T d1732d75bf044feb8884fc3135373072 P ec41d6947a4a4eadadf90c3756899704: Time spent bootstrapping tablet: real 0.492s user 0.342s sys 0.038s
I20261117 14:49:32.422080 7270 raft_consensus.cc:360] T d1732d75bf044feb8884fc3135373072 P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:32.423643 7270 raft_consensus.cc:748] T d1732d75bf044feb8884fc3135373072 P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec41d6947a4a4eadadf90c3756899704, State: Initialized, Role: FOLLOWER
I20261117 14:49:32.425294 7270 consensus_queue.cc:261] T d1732d75bf044feb8884fc3135373072 P ec41d6947a4a4eadadf90c3756899704 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 174, Last appended: 1.174, Last appended by leader: 174, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:32.434347 7270 ts_tablet_manager.cc:1480] T d1732d75bf044feb8884fc3135373072 P ec41d6947a4a4eadadf90c3756899704: Time spent starting tablet: real 0.022s user 0.010s sys 0.008s
I20261117 14:49:32.435546 7270 tablet_bootstrap.cc:492] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704: Bootstrap starting.
W20261117 14:49:32.485152 6594 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111) [suppressed 129 similar messages]
W20261117 14:49:32.532799 6594 consensus_peers.cc:597] T b74e748e97c84edeabc1c0cb41ddae99 P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 86: this message will repeat every 5th retry.
W20261117 14:49:32.571411 6594 consensus_peers.cc:597] T d1732d75bf044feb8884fc3135373072 P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 96: this message will repeat every 5th retry.
W20261117 14:49:32.660545 6724 consensus_peers.cc:597] T 47d9af37b05545f0b5b0c033f4ec953f P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 96: this message will repeat every 5th retry.
W20261117 14:49:32.676134 6594 consensus_peers.cc:597] T 5c849aa2a21a4c13b2e31d2ca3f692cc P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 96: this message will repeat every 5th retry.
W20261117 14:49:32.688290 6724 consensus_peers.cc:597] T 57984748adc7482a9a2d999a447a81af P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 96: this message will repeat every 5th retry.
I20261117 14:49:32.728736 7311 raft_consensus.cc:499] T d1732d75bf044feb8884fc3135373072 P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261117 14:49:32.728995 7311 raft_consensus.cc:521] T d1732d75bf044feb8884fc3135373072 P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:32.732540 7311 leader_election.cc:290] T d1732d75bf044feb8884fc3135373072 P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271), def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611)
I20261117 14:49:32.793459 6657 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "d1732d75bf044feb8884fc3135373072" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 2 candidate_status { last_received { term: 1 index: 174 } } ignore_live_leader: false dest_uuid: "c7900e455dd64c68bccfc499bda413f7" is_pre_election: true
I20261117 14:49:32.805730 6788 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "d1732d75bf044feb8884fc3135373072" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 2 candidate_status { last_received { term: 1 index: 174 } } ignore_live_leader: false dest_uuid: "def6b23bccc94a78a47118da331f2798" is_pre_election: true
I20261117 14:49:32.806501 7267 leader_election.cc:304] T d1732d75bf044feb8884fc3135373072 P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec41d6947a4a4eadadf90c3756899704; no voters: c7900e455dd64c68bccfc499bda413f7, def6b23bccc94a78a47118da331f2798
I20261117 14:49:32.807682 7311 raft_consensus.cc:2771] T d1732d75bf044feb8884fc3135373072 P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20261117 14:49:32.911865 6724 consensus_peers.cc:597] T 3cea00abcccd4b1284393ef8b406cab1 P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 91: this message will repeat every 5th retry.
I20261117 14:49:32.983723 7270 tablet_bootstrap.cc:492] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704: Bootstrap replayed 1/1 log segments. Stats: ops{read=176 overwritten=0 applied=176 ignored=0} inserts{seen=1431 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20261117 14:49:32.984377 7270 tablet_bootstrap.cc:492] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704: Bootstrap complete.
I20261117 14:49:32.985711 7270 ts_tablet_manager.cc:1449] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704: Time spent bootstrapping tablet: real 0.550s user 0.393s sys 0.018s
I20261117 14:49:32.986776 7270 raft_consensus.cc:360] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:32.987046 7270 raft_consensus.cc:748] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec41d6947a4a4eadadf90c3756899704, State: Initialized, Role: FOLLOWER
I20261117 14:49:32.987424 7270 consensus_queue.cc:261] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 176, Last appended: 1.176, Last appended by leader: 176, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:32.988078 7270 ts_tablet_manager.cc:1480] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20261117 14:49:32.988379 7270 tablet_bootstrap.cc:492] T b74e748e97c84edeabc1c0cb41ddae99 P ec41d6947a4a4eadadf90c3756899704: Bootstrap starting.
I20261117 14:49:33.158730 7311 raft_consensus.cc:499] T d1732d75bf044feb8884fc3135373072 P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261117 14:49:33.158895 7311 raft_consensus.cc:521] T d1732d75bf044feb8884fc3135373072 P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:33.159543 7311 leader_election.cc:290] T d1732d75bf044feb8884fc3135373072 P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271), def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611)
I20261117 14:49:33.160319 6788 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "d1732d75bf044feb8884fc3135373072" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 2 candidate_status { last_received { term: 1 index: 174 } } ignore_live_leader: false dest_uuid: "def6b23bccc94a78a47118da331f2798" is_pre_election: true
I20261117 14:49:33.161037 6654 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "d1732d75bf044feb8884fc3135373072" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 2 candidate_status { last_received { term: 1 index: 174 } } ignore_live_leader: false dest_uuid: "c7900e455dd64c68bccfc499bda413f7" is_pre_election: true
I20261117 14:49:33.161576 7266 leader_election.cc:304] T d1732d75bf044feb8884fc3135373072 P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec41d6947a4a4eadadf90c3756899704; no voters: c7900e455dd64c68bccfc499bda413f7, def6b23bccc94a78a47118da331f2798
I20261117 14:49:33.162228 7311 raft_consensus.cc:2771] T d1732d75bf044feb8884fc3135373072 P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20261117 14:49:33.297576 7311 raft_consensus.cc:499] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261117 14:49:33.297842 7311 raft_consensus.cc:521] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:33.301219 7311 leader_election.cc:290] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271), def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611)
I20261117 14:49:33.301895 6654 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "3cea00abcccd4b1284393ef8b406cab1" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 2 candidate_status { last_received { term: 1 index: 176 } } ignore_live_leader: false dest_uuid: "c7900e455dd64c68bccfc499bda413f7" is_pre_election: true
I20261117 14:49:33.302342 6788 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "3cea00abcccd4b1284393ef8b406cab1" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 2 candidate_status { last_received { term: 1 index: 176 } } ignore_live_leader: false dest_uuid: "def6b23bccc94a78a47118da331f2798" is_pre_election: true
W20261117 14:49:33.307307 6594 consensus_peers.cc:597] T b74e748e97c84edeabc1c0cb41ddae99 P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 91: this message will repeat every 5th retry.
I20261117 14:49:33.308154 7266 leader_election.cc:304] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec41d6947a4a4eadadf90c3756899704; no voters: c7900e455dd64c68bccfc499bda413f7, def6b23bccc94a78a47118da331f2798
I20261117 14:49:33.308748 7311 raft_consensus.cc:2771] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20261117 14:49:33.328568 6594 consensus_peers.cc:597] T d1732d75bf044feb8884fc3135373072 P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 101: this message will repeat every 5th retry.
W20261117 14:49:33.461299 6724 consensus_peers.cc:597] T 47d9af37b05545f0b5b0c033f4ec953f P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 101: this message will repeat every 5th retry.
W20261117 14:49:33.466272 6724 consensus_peers.cc:597] T 57984748adc7482a9a2d999a447a81af P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 101: this message will repeat every 5th retry.
I20261117 14:49:33.494652 7270 tablet_bootstrap.cc:492] T b74e748e97c84edeabc1c0cb41ddae99 P ec41d6947a4a4eadadf90c3756899704: Bootstrap replayed 1/1 log segments. Stats: ops{read=176 overwritten=0 applied=176 ignored=0} inserts{seen=1427 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20261117 14:49:33.495342 7270 tablet_bootstrap.cc:492] T b74e748e97c84edeabc1c0cb41ddae99 P ec41d6947a4a4eadadf90c3756899704: Bootstrap complete.
I20261117 14:49:33.496718 7270 ts_tablet_manager.cc:1449] T b74e748e97c84edeabc1c0cb41ddae99 P ec41d6947a4a4eadadf90c3756899704: Time spent bootstrapping tablet: real 0.508s user 0.347s sys 0.041s
I20261117 14:49:33.497550 7270 raft_consensus.cc:360] T b74e748e97c84edeabc1c0cb41ddae99 P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:33.497829 7270 raft_consensus.cc:748] T b74e748e97c84edeabc1c0cb41ddae99 P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec41d6947a4a4eadadf90c3756899704, State: Initialized, Role: FOLLOWER
I20261117 14:49:33.498157 7270 consensus_queue.cc:261] T b74e748e97c84edeabc1c0cb41ddae99 P ec41d6947a4a4eadadf90c3756899704 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 176, Last appended: 1.176, Last appended by leader: 176, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:33.498837 7270 ts_tablet_manager.cc:1480] T b74e748e97c84edeabc1c0cb41ddae99 P ec41d6947a4a4eadadf90c3756899704: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20261117 14:49:33.499154 7270 tablet_bootstrap.cc:492] T 47d9af37b05545f0b5b0c033f4ec953f P ec41d6947a4a4eadadf90c3756899704: Bootstrap starting.
W20261117 14:49:33.526523 6724 consensus_peers.cc:597] T 3cea00abcccd4b1284393ef8b406cab1 P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 96: this message will repeat every 5th retry.
W20261117 14:49:33.619973 6594 consensus_peers.cc:597] T 5c849aa2a21a4c13b2e31d2ca3f692cc P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 101: this message will repeat every 5th retry.
I20261117 14:49:33.680320 7311 raft_consensus.cc:499] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261117 14:49:33.680534 7311 raft_consensus.cc:521] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:33.681250 7311 leader_election.cc:290] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271), def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611)
I20261117 14:49:33.681959 6655 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "3cea00abcccd4b1284393ef8b406cab1" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 2 candidate_status { last_received { term: 1 index: 176 } } ignore_live_leader: false dest_uuid: "c7900e455dd64c68bccfc499bda413f7" is_pre_election: true
I20261117 14:49:33.682626 6786 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "3cea00abcccd4b1284393ef8b406cab1" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 2 candidate_status { last_received { term: 1 index: 176 } } ignore_live_leader: false dest_uuid: "def6b23bccc94a78a47118da331f2798" is_pre_election: true
I20261117 14:49:33.689083 7267 leader_election.cc:304] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec41d6947a4a4eadadf90c3756899704; no voters: c7900e455dd64c68bccfc499bda413f7, def6b23bccc94a78a47118da331f2798
I20261117 14:49:33.701380 7311 raft_consensus.cc:2771] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20261117 14:49:33.765853 7311 raft_consensus.cc:499] T d1732d75bf044feb8884fc3135373072 P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261117 14:49:33.766050 7311 raft_consensus.cc:521] T d1732d75bf044feb8884fc3135373072 P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:33.766804 7311 leader_election.cc:290] T d1732d75bf044feb8884fc3135373072 P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271), def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611)
I20261117 14:49:33.767671 6783 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "d1732d75bf044feb8884fc3135373072" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 2 candidate_status { last_received { term: 1 index: 174 } } ignore_live_leader: false dest_uuid: "def6b23bccc94a78a47118da331f2798" is_pre_election: true
I20261117 14:49:33.769852 6657 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "d1732d75bf044feb8884fc3135373072" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 2 candidate_status { last_received { term: 1 index: 174 } } ignore_live_leader: false dest_uuid: "c7900e455dd64c68bccfc499bda413f7" is_pre_election: true
I20261117 14:49:33.770488 7266 leader_election.cc:304] T d1732d75bf044feb8884fc3135373072 P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec41d6947a4a4eadadf90c3756899704; no voters: c7900e455dd64c68bccfc499bda413f7, def6b23bccc94a78a47118da331f2798
I20261117 14:49:33.770979 7311 raft_consensus.cc:2771] T d1732d75bf044feb8884fc3135373072 P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20261117 14:49:33.832993 7311 raft_consensus.cc:499] T b74e748e97c84edeabc1c0cb41ddae99 P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261117 14:49:33.833185 7311 raft_consensus.cc:521] T b74e748e97c84edeabc1c0cb41ddae99 P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:33.833922 7311 leader_election.cc:290] T b74e748e97c84edeabc1c0cb41ddae99 P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271), def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611)
I20261117 14:49:33.834918 6788 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "b74e748e97c84edeabc1c0cb41ddae99" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 2 candidate_status { last_received { term: 1 index: 176 } } ignore_live_leader: false dest_uuid: "def6b23bccc94a78a47118da331f2798" is_pre_election: true
I20261117 14:49:33.849803 6658 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "b74e748e97c84edeabc1c0cb41ddae99" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 2 candidate_status { last_received { term: 1 index: 176 } } ignore_live_leader: false dest_uuid: "c7900e455dd64c68bccfc499bda413f7" is_pre_election: true
I20261117 14:49:33.854512 7266 leader_election.cc:304] T b74e748e97c84edeabc1c0cb41ddae99 P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec41d6947a4a4eadadf90c3756899704; no voters: c7900e455dd64c68bccfc499bda413f7, def6b23bccc94a78a47118da331f2798
I20261117 14:49:33.855068 7311 raft_consensus.cc:2771] T b74e748e97c84edeabc1c0cb41ddae99 P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20261117 14:49:33.924825 7270 tablet_bootstrap.cc:492] T 47d9af37b05545f0b5b0c033f4ec953f P ec41d6947a4a4eadadf90c3756899704: Bootstrap replayed 1/1 log segments. Stats: ops{read=176 overwritten=0 applied=176 ignored=0} inserts{seen=1472 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20261117 14:49:33.925902 7270 tablet_bootstrap.cc:492] T 47d9af37b05545f0b5b0c033f4ec953f P ec41d6947a4a4eadadf90c3756899704: Bootstrap complete.
I20261117 14:49:33.927615 7270 ts_tablet_manager.cc:1449] T 47d9af37b05545f0b5b0c033f4ec953f P ec41d6947a4a4eadadf90c3756899704: Time spent bootstrapping tablet: real 0.429s user 0.346s sys 0.028s
I20261117 14:49:33.928725 7270 raft_consensus.cc:360] T 47d9af37b05545f0b5b0c033f4ec953f P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:33.930323 7270 raft_consensus.cc:748] T 47d9af37b05545f0b5b0c033f4ec953f P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec41d6947a4a4eadadf90c3756899704, State: Initialized, Role: FOLLOWER
I20261117 14:49:33.930800 7270 consensus_queue.cc:261] T 47d9af37b05545f0b5b0c033f4ec953f P ec41d6947a4a4eadadf90c3756899704 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 176, Last appended: 1.176, Last appended by leader: 176, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:33.931699 7270 ts_tablet_manager.cc:1480] T 47d9af37b05545f0b5b0c033f4ec953f P ec41d6947a4a4eadadf90c3756899704: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20261117 14:49:33.932029 7270 tablet_bootstrap.cc:492] T 57984748adc7482a9a2d999a447a81af P ec41d6947a4a4eadadf90c3756899704: Bootstrap starting.
W20261117 14:49:33.941128 6594 consensus_peers.cc:597] T d1732d75bf044feb8884fc3135373072 P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 106: this message will repeat every 5th retry.
W20261117 14:49:33.977078 6594 consensus_peers.cc:597] T b74e748e97c84edeabc1c0cb41ddae99 P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 96: this message will repeat every 5th retry.
W20261117 14:49:34.000290 6724 consensus_peers.cc:597] T 47d9af37b05545f0b5b0c033f4ec953f P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 106: this message will repeat every 5th retry.
I20261117 14:49:34.081739 7311 raft_consensus.cc:499] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261117 14:49:34.081950 7311 raft_consensus.cc:521] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:34.082801 7311 leader_election.cc:290] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271), def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611)
I20261117 14:49:34.083603 6788 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "3cea00abcccd4b1284393ef8b406cab1" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 2 candidate_status { last_received { term: 1 index: 176 } } ignore_live_leader: false dest_uuid: "def6b23bccc94a78a47118da331f2798" is_pre_election: true
I20261117 14:49:34.083667 6657 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "3cea00abcccd4b1284393ef8b406cab1" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 2 candidate_status { last_received { term: 1 index: 176 } } ignore_live_leader: false dest_uuid: "c7900e455dd64c68bccfc499bda413f7" is_pre_election: true
I20261117 14:49:34.084491 7267 leader_election.cc:304] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec41d6947a4a4eadadf90c3756899704; no voters: c7900e455dd64c68bccfc499bda413f7, def6b23bccc94a78a47118da331f2798
I20261117 14:49:34.085124 7311 raft_consensus.cc:2771] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20261117 14:49:34.170560 6724 consensus_peers.cc:597] T 57984748adc7482a9a2d999a447a81af P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 106: this message will repeat every 5th retry.
I20261117 14:49:34.191228 7311 raft_consensus.cc:499] T b74e748e97c84edeabc1c0cb41ddae99 P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261117 14:49:34.191412 7311 raft_consensus.cc:521] T b74e748e97c84edeabc1c0cb41ddae99 P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:34.192158 7311 leader_election.cc:290] T b74e748e97c84edeabc1c0cb41ddae99 P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271), def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611)
I20261117 14:49:34.196586 6786 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "b74e748e97c84edeabc1c0cb41ddae99" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 2 candidate_status { last_received { term: 1 index: 176 } } ignore_live_leader: false dest_uuid: "def6b23bccc94a78a47118da331f2798" is_pre_election: true
I20261117 14:49:34.215596 6655 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "b74e748e97c84edeabc1c0cb41ddae99" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 2 candidate_status { last_received { term: 1 index: 176 } } ignore_live_leader: false dest_uuid: "c7900e455dd64c68bccfc499bda413f7" is_pre_election: true
I20261117 14:49:34.221650 7266 leader_election.cc:304] T b74e748e97c84edeabc1c0cb41ddae99 P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec41d6947a4a4eadadf90c3756899704; no voters: c7900e455dd64c68bccfc499bda413f7, def6b23bccc94a78a47118da331f2798
I20261117 14:49:34.222694 7311 raft_consensus.cc:499] T 47d9af37b05545f0b5b0c033f4ec953f P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261117 14:49:34.222883 7311 raft_consensus.cc:521] T 47d9af37b05545f0b5b0c033f4ec953f P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:34.223783 7311 leader_election.cc:290] T 47d9af37b05545f0b5b0c033f4ec953f P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271), def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611)
I20261117 14:49:34.224004 7311 raft_consensus.cc:2771] T b74e748e97c84edeabc1c0cb41ddae99 P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20261117 14:49:34.228083 6786 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "47d9af37b05545f0b5b0c033f4ec953f" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 2 candidate_status { last_received { term: 1 index: 176 } } ignore_live_leader: false dest_uuid: "def6b23bccc94a78a47118da331f2798" is_pre_election: true
I20261117 14:49:34.257665 6657 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "47d9af37b05545f0b5b0c033f4ec953f" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 2 candidate_status { last_received { term: 1 index: 176 } } ignore_live_leader: false dest_uuid: "c7900e455dd64c68bccfc499bda413f7" is_pre_election: true
I20261117 14:49:34.261370 7266 leader_election.cc:304] T 47d9af37b05545f0b5b0c033f4ec953f P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec41d6947a4a4eadadf90c3756899704; no voters: c7900e455dd64c68bccfc499bda413f7, def6b23bccc94a78a47118da331f2798
I20261117 14:49:34.261952 7383 raft_consensus.cc:2771] T 47d9af37b05545f0b5b0c033f4ec953f P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20261117 14:49:34.296036 6724 consensus_peers.cc:597] T 3cea00abcccd4b1284393ef8b406cab1 P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 101: this message will repeat every 5th retry.
I20261117 14:49:34.326365 7383 raft_consensus.cc:499] T d1732d75bf044feb8884fc3135373072 P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261117 14:49:34.326599 7383 raft_consensus.cc:521] T d1732d75bf044feb8884fc3135373072 P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:34.328707 6655 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "d1732d75bf044feb8884fc3135373072" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 2 candidate_status { last_received { term: 1 index: 174 } } ignore_live_leader: false dest_uuid: "c7900e455dd64c68bccfc499bda413f7" is_pre_election: true
I20261117 14:49:34.330683 7383 leader_election.cc:290] T d1732d75bf044feb8884fc3135373072 P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271), def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611)
I20261117 14:49:34.348680 6788 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "d1732d75bf044feb8884fc3135373072" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 2 candidate_status { last_received { term: 1 index: 174 } } ignore_live_leader: false dest_uuid: "def6b23bccc94a78a47118da331f2798" is_pre_election: true
I20261117 14:49:34.349658 7267 leader_election.cc:304] T d1732d75bf044feb8884fc3135373072 P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec41d6947a4a4eadadf90c3756899704; no voters: c7900e455dd64c68bccfc499bda413f7, def6b23bccc94a78a47118da331f2798
I20261117 14:49:34.351277 7383 raft_consensus.cc:2771] T d1732d75bf044feb8884fc3135373072 P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20261117 14:49:34.530814 6594 consensus_peers.cc:597] T 5c849aa2a21a4c13b2e31d2ca3f692cc P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 106: this message will repeat every 5th retry.
I20261117 14:49:34.588378 7383 raft_consensus.cc:499] T 47d9af37b05545f0b5b0c033f4ec953f P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261117 14:49:34.588685 7383 raft_consensus.cc:521] T 47d9af37b05545f0b5b0c033f4ec953f P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:34.589512 7383 leader_election.cc:290] T 47d9af37b05545f0b5b0c033f4ec953f P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271), def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611)
I20261117 14:49:34.592098 6788 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "47d9af37b05545f0b5b0c033f4ec953f" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 2 candidate_status { last_received { term: 1 index: 176 } } ignore_live_leader: false dest_uuid: "def6b23bccc94a78a47118da331f2798" is_pre_election: true
I20261117 14:49:34.592911 6654 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "47d9af37b05545f0b5b0c033f4ec953f" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 2 candidate_status { last_received { term: 1 index: 176 } } ignore_live_leader: false dest_uuid: "c7900e455dd64c68bccfc499bda413f7" is_pre_election: true
I20261117 14:49:34.593547 7266 leader_election.cc:304] T 47d9af37b05545f0b5b0c033f4ec953f P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec41d6947a4a4eadadf90c3756899704; no voters: c7900e455dd64c68bccfc499bda413f7, def6b23bccc94a78a47118da331f2798
I20261117 14:49:34.594044 7383 raft_consensus.cc:2771] T 47d9af37b05545f0b5b0c033f4ec953f P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20261117 14:49:34.594113 7311 raft_consensus.cc:499] T b74e748e97c84edeabc1c0cb41ddae99 P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261117 14:49:34.594344 7311 raft_consensus.cc:521] T b74e748e97c84edeabc1c0cb41ddae99 P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:34.595206 7311 leader_election.cc:290] T b74e748e97c84edeabc1c0cb41ddae99 P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271), def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611)
I20261117 14:49:34.596721 6783 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "b74e748e97c84edeabc1c0cb41ddae99" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 2 candidate_status { last_received { term: 1 index: 176 } } ignore_live_leader: false dest_uuid: "def6b23bccc94a78a47118da331f2798" is_pre_election: true
I20261117 14:49:34.623471 6655 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "b74e748e97c84edeabc1c0cb41ddae99" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 2 candidate_status { last_received { term: 1 index: 176 } } ignore_live_leader: false dest_uuid: "c7900e455dd64c68bccfc499bda413f7" is_pre_election: true
I20261117 14:49:34.625593 7266 leader_election.cc:304] T b74e748e97c84edeabc1c0cb41ddae99 P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec41d6947a4a4eadadf90c3756899704; no voters: c7900e455dd64c68bccfc499bda413f7, def6b23bccc94a78a47118da331f2798
I20261117 14:49:34.626331 7311 raft_consensus.cc:2771] T b74e748e97c84edeabc1c0cb41ddae99 P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20261117 14:49:34.673013 6724 consensus_peers.cc:597] T 47d9af37b05545f0b5b0c033f4ec953f P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 111: this message will repeat every 5th retry.
I20261117 14:49:34.725493 7270 tablet_bootstrap.cc:492] T 57984748adc7482a9a2d999a447a81af P ec41d6947a4a4eadadf90c3756899704: Bootstrap replayed 1/1 log segments. Stats: ops{read=176 overwritten=0 applied=176 ignored=0} inserts{seen=1474 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20261117 14:49:34.726215 7270 tablet_bootstrap.cc:492] T 57984748adc7482a9a2d999a447a81af P ec41d6947a4a4eadadf90c3756899704: Bootstrap complete.
I20261117 14:49:34.727891 7270 ts_tablet_manager.cc:1449] T 57984748adc7482a9a2d999a447a81af P ec41d6947a4a4eadadf90c3756899704: Time spent bootstrapping tablet: real 0.796s user 0.316s sys 0.047s
I20261117 14:49:34.728853 7270 raft_consensus.cc:360] T 57984748adc7482a9a2d999a447a81af P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:34.729148 7270 raft_consensus.cc:748] T 57984748adc7482a9a2d999a447a81af P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec41d6947a4a4eadadf90c3756899704, State: Initialized, Role: FOLLOWER
I20261117 14:49:34.729537 7270 consensus_queue.cc:261] T 57984748adc7482a9a2d999a447a81af P ec41d6947a4a4eadadf90c3756899704 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 176, Last appended: 1.176, Last appended by leader: 176, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:34.730253 7270 ts_tablet_manager.cc:1480] T 57984748adc7482a9a2d999a447a81af P ec41d6947a4a4eadadf90c3756899704: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20261117 14:49:34.730561 7270 tablet_bootstrap.cc:492] T 5c849aa2a21a4c13b2e31d2ca3f692cc P ec41d6947a4a4eadadf90c3756899704: Bootstrap starting.
W20261117 14:49:34.758836 6724 consensus_peers.cc:597] T 57984748adc7482a9a2d999a447a81af P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 111: this message will repeat every 5th retry.
W20261117 14:49:34.821533 6594 consensus_peers.cc:597] T b74e748e97c84edeabc1c0cb41ddae99 P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 101: this message will repeat every 5th retry.
W20261117 14:49:34.839694 6594 consensus_peers.cc:597] T d1732d75bf044feb8884fc3135373072 P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 111: this message will repeat every 5th retry.
I20261117 14:49:34.957087 7311 raft_consensus.cc:499] T 57984748adc7482a9a2d999a447a81af P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261117 14:49:34.957365 7311 raft_consensus.cc:521] T 57984748adc7482a9a2d999a447a81af P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:34.958309 7311 leader_election.cc:290] T 57984748adc7482a9a2d999a447a81af P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271), def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611)
I20261117 14:49:34.959656 6788 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "57984748adc7482a9a2d999a447a81af" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 2 candidate_status { last_received { term: 1 index: 176 } } ignore_live_leader: false dest_uuid: "def6b23bccc94a78a47118da331f2798" is_pre_election: true
I20261117 14:49:34.960717 6655 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "57984748adc7482a9a2d999a447a81af" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 2 candidate_status { last_received { term: 1 index: 176 } } ignore_live_leader: false dest_uuid: "c7900e455dd64c68bccfc499bda413f7" is_pre_election: true
I20261117 14:49:35.000145 7406 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.50.129:42937 every 8 connection(s)
I20261117 14:49:35.009563 7247 rpc_server.cc:307] RPC server started. Bound to: 127.6.50.129:42937
I20261117 14:49:35.021252 7266 leader_election.cc:304] T 57984748adc7482a9a2d999a447a81af P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec41d6947a4a4eadadf90c3756899704; no voters: c7900e455dd64c68bccfc499bda413f7, def6b23bccc94a78a47118da331f2798
I20261117 14:49:35.021818 7311 raft_consensus.cc:2771] T 57984748adc7482a9a2d999a447a81af P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20261117 14:49:35.022053 7247 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate.1794926954293095-6346-0/minicluster-data/ts-0/data/info.pb
I20261117 14:49:35.022488 6346 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskUafhB0/build/asan/bin/kudu as pid 7247
I20261117 14:49:35.056422 7311 raft_consensus.cc:499] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261117 14:49:35.056679 7311 raft_consensus.cc:521] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:35.057420 7311 leader_election.cc:290] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271), def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611)
I20261117 14:49:35.058485 6654 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "3cea00abcccd4b1284393ef8b406cab1" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 2 candidate_status { last_received { term: 1 index: 176 } } ignore_live_leader: false dest_uuid: "c7900e455dd64c68bccfc499bda413f7" is_pre_election: true
I20261117 14:49:35.058516 6788 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "3cea00abcccd4b1284393ef8b406cab1" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 2 candidate_status { last_received { term: 1 index: 176 } } ignore_live_leader: false dest_uuid: "def6b23bccc94a78a47118da331f2798" is_pre_election: true
I20261117 14:49:35.059265 7266 leader_election.cc:304] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec41d6947a4a4eadadf90c3756899704; no voters: c7900e455dd64c68bccfc499bda413f7, def6b23bccc94a78a47118da331f2798
I20261117 14:49:35.059746 7311 raft_consensus.cc:2771] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20261117 14:49:35.268203 7311 raft_consensus.cc:499] T 47d9af37b05545f0b5b0c033f4ec953f P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261117 14:49:35.268471 7311 raft_consensus.cc:521] T 47d9af37b05545f0b5b0c033f4ec953f P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:35.269227 7311 leader_election.cc:290] T 47d9af37b05545f0b5b0c033f4ec953f P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271), def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611)
I20261117 14:49:35.271519 7311 raft_consensus.cc:499] T d1732d75bf044feb8884fc3135373072 P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261117 14:49:35.271683 7311 raft_consensus.cc:521] T d1732d75bf044feb8884fc3135373072 P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:35.272922 6658 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "47d9af37b05545f0b5b0c033f4ec953f" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 2 candidate_status { last_received { term: 1 index: 176 } } ignore_live_leader: false dest_uuid: "c7900e455dd64c68bccfc499bda413f7" is_pre_election: true
I20261117 14:49:35.272380 7311 leader_election.cc:290] T d1732d75bf044feb8884fc3135373072 P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271), def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611)
I20261117 14:49:35.278215 6655 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "d1732d75bf044feb8884fc3135373072" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 2 candidate_status { last_received { term: 1 index: 174 } } ignore_live_leader: false dest_uuid: "c7900e455dd64c68bccfc499bda413f7" is_pre_election: true
I20261117 14:49:35.284940 6788 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "47d9af37b05545f0b5b0c033f4ec953f" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 2 candidate_status { last_received { term: 1 index: 176 } } ignore_live_leader: false dest_uuid: "def6b23bccc94a78a47118da331f2798" is_pre_election: true
I20261117 14:49:35.285332 6786 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "d1732d75bf044feb8884fc3135373072" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 2 candidate_status { last_received { term: 1 index: 174 } } ignore_live_leader: false dest_uuid: "def6b23bccc94a78a47118da331f2798" is_pre_election: true
I20261117 14:49:35.285902 7267 leader_election.cc:304] T 47d9af37b05545f0b5b0c033f4ec953f P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec41d6947a4a4eadadf90c3756899704; no voters: c7900e455dd64c68bccfc499bda413f7, def6b23bccc94a78a47118da331f2798
I20261117 14:49:35.294126 7267 leader_election.cc:304] T d1732d75bf044feb8884fc3135373072 P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec41d6947a4a4eadadf90c3756899704; no voters: c7900e455dd64c68bccfc499bda413f7, def6b23bccc94a78a47118da331f2798
W20261117 14:49:35.291116 7414 tablet_replica_mm_ops.cc:318] Log GC is disabled (check --enable_log_gc)
I20261117 14:49:35.313055 7415 raft_consensus.cc:2771] T d1732d75bf044feb8884fc3135373072 P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20261117 14:49:35.313392 7408 heartbeater.cc:345] Connected to a master server at 127.6.50.190:39807
I20261117 14:49:35.324294 7408 heartbeater.cc:462] Registering TS with master...
I20261117 14:49:35.325693 7408 heartbeater.cc:508] Master 127.6.50.190:39807 requested a full tablet report, sending...
I20261117 14:49:35.336707 7346 raft_consensus.cc:3096] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Advancing to term 2
I20261117 14:49:35.494613 7347 raft_consensus.cc:3096] T 57984748adc7482a9a2d999a447a81af P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Advancing to term 2
I20261117 14:49:35.733301 7341 raft_consensus.cc:3096] T b74e748e97c84edeabc1c0cb41ddae99 P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Advancing to term 2
I20261117 14:49:35.963378 7270 tablet_bootstrap.cc:492] T 5c849aa2a21a4c13b2e31d2ca3f692cc P ec41d6947a4a4eadadf90c3756899704: Bootstrap replayed 1/1 log segments. Stats: ops{read=175 overwritten=0 applied=175 ignored=0} inserts{seen=1454 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20261117 14:49:35.964417 7270 tablet_bootstrap.cc:492] T 5c849aa2a21a4c13b2e31d2ca3f692cc P ec41d6947a4a4eadadf90c3756899704: Bootstrap complete.
I20261117 14:49:35.965758 7270 ts_tablet_manager.cc:1449] T 5c849aa2a21a4c13b2e31d2ca3f692cc P ec41d6947a4a4eadadf90c3756899704: Time spent bootstrapping tablet: real 1.235s user 0.283s sys 0.042s
I20261117 14:49:35.972524 7270 raft_consensus.cc:360] T 5c849aa2a21a4c13b2e31d2ca3f692cc P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:35.972831 7270 raft_consensus.cc:748] T 5c849aa2a21a4c13b2e31d2ca3f692cc P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec41d6947a4a4eadadf90c3756899704, State: Initialized, Role: FOLLOWER
W20261117 14:49:36.019639 6594 consensus_peers.cc:597] T 5c849aa2a21a4c13b2e31d2ca3f692cc P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 111: this message will repeat every 5th retry.
I20261117 14:49:35.973168 7270 consensus_queue.cc:261] T 5c849aa2a21a4c13b2e31d2ca3f692cc P ec41d6947a4a4eadadf90c3756899704 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 175, Last appended: 1.175, Last appended by leader: 175, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:36.021116 7270 ts_tablet_manager.cc:1480] T 5c849aa2a21a4c13b2e31d2ca3f692cc P ec41d6947a4a4eadadf90c3756899704: Time spent starting tablet: real 0.055s user 0.001s sys 0.001s
I20261117 14:49:36.370893 7425 raft_consensus.cc:499] T 5c849aa2a21a4c13b2e31d2ca3f692cc P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261117 14:49:36.400020 7425 raft_consensus.cc:521] T 5c849aa2a21a4c13b2e31d2ca3f692cc P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:36.401818 6655 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5c849aa2a21a4c13b2e31d2ca3f692cc" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 2 candidate_status { last_received { term: 1 index: 175 } } ignore_live_leader: false dest_uuid: "c7900e455dd64c68bccfc499bda413f7" is_pre_election: true
I20261117 14:49:36.401919 7425 leader_election.cc:290] T 5c849aa2a21a4c13b2e31d2ca3f692cc P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271), def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611)
I20261117 14:49:36.402873 6788 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5c849aa2a21a4c13b2e31d2ca3f692cc" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 2 candidate_status { last_received { term: 1 index: 175 } } ignore_live_leader: false dest_uuid: "def6b23bccc94a78a47118da331f2798" is_pre_election: true
I20261117 14:49:36.403489 7267 leader_election.cc:304] T 5c849aa2a21a4c13b2e31d2ca3f692cc P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec41d6947a4a4eadadf90c3756899704; no voters: c7900e455dd64c68bccfc499bda413f7, def6b23bccc94a78a47118da331f2798
I20261117 14:49:37.760319 7311 raft_consensus.cc:2771] T 47d9af37b05545f0b5b0c033f4ec953f P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20261117 14:49:37.770740 7345 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.6.50.131:58395 (request call id 2) took 2657 ms. Trace:
I20261117 14:49:37.831804 7346 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.6.50.131:58395 (request call id 1) took 2697 ms. Trace:
I20261117 14:49:37.850453 7418 raft_consensus.cc:499] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader def6b23bccc94a78a47118da331f2798)
I20261117 14:49:37.884586 7340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.GetConsensusState from 127.0.0.1:35168 (request call id 5) took 2577 ms. Trace:
I20261117 14:49:37.850668 7418 raft_consensus.cc:521] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:37.884750 7340 rpcz_store.cc:276] 1117 14:49:35.283696 (+ 0us) service_pool.cc:167] Inserting onto call queue
1117 14:49:35.283741 (+ 45us) service_pool.cc:224] Handling call
1117 14:49:37.837709 (+2553968us) spinlock_profiling.cc:245] Waited 2.52 s on lock 0x61600001c654. stack: 00007f9a08fa33a6 00007f9a08fa3160 00007f9a07f9434d 00007f9a1f567704 00007f9a1f5676cd 00007f9a184b982d 00007f9a184b9923 00007f9a15023221 00007f9a18ee594b 00007f9a13044aa7 00007f9a130447d5 00007f9a100eb8de 00007f9a100ea7be 00007f9a100f09f8 00007f9a100f135f 00007f9a100f1188
1117 14:49:37.860751 (+ 23042us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5797622656}
I20261117 14:49:37.907229 6783 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "3cea00abcccd4b1284393ef8b406cab1" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 3 candidate_status { last_received { term: 2 index: 785 } } ignore_live_leader: false dest_uuid: "def6b23bccc94a78a47118da331f2798" is_pre_election: true
I20261117 14:49:37.907208 6654 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "3cea00abcccd4b1284393ef8b406cab1" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 3 candidate_status { last_received { term: 2 index: 785 } } ignore_live_leader: false dest_uuid: "c7900e455dd64c68bccfc499bda413f7" is_pre_election: true
I20261117 14:49:37.912366 7418 leader_election.cc:290] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271), def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611)
I20261117 14:49:37.912380 7267 leader_election.cc:304] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec41d6947a4a4eadadf90c3756899704; no voters: c7900e455dd64c68bccfc499bda413f7, def6b23bccc94a78a47118da331f2798
I20261117 14:49:37.912865 7418 raft_consensus.cc:2771] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20261117 14:49:37.920609 7438 log.cc:927] Time spent T 57984748adc7482a9a2d999a447a81af P ec41d6947a4a4eadadf90c3756899704: Append to log took a long time: real 0.057s user 0.000s sys 0.001s
W20261117 14:49:38.064500 7439 log.cc:927] Time spent T b74e748e97c84edeabc1c0cb41ddae99 P ec41d6947a4a4eadadf90c3756899704: Append to log took a long time: real 0.130s user 0.000s sys 0.000s
I20261117 14:49:38.128773 7418 raft_consensus.cc:499] T 47d9af37b05545f0b5b0c033f4ec953f P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader def6b23bccc94a78a47118da331f2798)
I20261117 14:49:38.128968 7418 raft_consensus.cc:521] T 47d9af37b05545f0b5b0c033f4ec953f P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:38.129683 7418 leader_election.cc:290] T 47d9af37b05545f0b5b0c033f4ec953f P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271), def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611)
I20261117 14:49:38.132375 6786 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "47d9af37b05545f0b5b0c033f4ec953f" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 2 candidate_status { last_received { term: 1 index: 784 } } ignore_live_leader: false dest_uuid: "def6b23bccc94a78a47118da331f2798" is_pre_election: true
I20261117 14:49:38.133698 6654 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "47d9af37b05545f0b5b0c033f4ec953f" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 2 candidate_status { last_received { term: 1 index: 784 } } ignore_live_leader: false dest_uuid: "c7900e455dd64c68bccfc499bda413f7" is_pre_election: true
I20261117 14:49:38.134443 7266 leader_election.cc:304] T 47d9af37b05545f0b5b0c033f4ec953f P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec41d6947a4a4eadadf90c3756899704; no voters: c7900e455dd64c68bccfc499bda413f7, def6b23bccc94a78a47118da331f2798
I20261117 14:49:38.135001 7418 raft_consensus.cc:2771] T 47d9af37b05545f0b5b0c033f4ec953f P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20261117 14:49:38.229936 7419 raft_consensus.cc:499] T b74e748e97c84edeabc1c0cb41ddae99 P ec41d6947a4a4eadadf90c3756899704 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c7900e455dd64c68bccfc499bda413f7)
I20261117 14:49:38.257813 7341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.6.50.130:39451 (request call id 2) took 2936 ms. Trace:
I20261117 14:49:38.248646 7419 raft_consensus.cc:521] T b74e748e97c84edeabc1c0cb41ddae99 P ec41d6947a4a4eadadf90c3756899704 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:38.276762 7419 leader_election.cc:290] T b74e748e97c84edeabc1c0cb41ddae99 P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271), def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611)
I20261117 14:49:38.277714 6783 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "b74e748e97c84edeabc1c0cb41ddae99" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 3 candidate_status { last_received { term: 2 index: 785 } } ignore_live_leader: false dest_uuid: "def6b23bccc94a78a47118da331f2798" is_pre_election: true
I20261117 14:49:38.280236 7347 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.6.50.131:58395 (request call id 0) took 3165 ms. Trace:
I20261117 14:49:38.278231 6658 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "b74e748e97c84edeabc1c0cb41ddae99" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 3 candidate_status { last_received { term: 2 index: 785 } } ignore_live_leader: false dest_uuid: "c7900e455dd64c68bccfc499bda413f7" is_pre_election: true
I20261117 14:49:38.300522 7266 leader_election.cc:304] T b74e748e97c84edeabc1c0cb41ddae99 P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec41d6947a4a4eadadf90c3756899704; no voters: c7900e455dd64c68bccfc499bda413f7, def6b23bccc94a78a47118da331f2798
I20261117 14:49:38.300997 7419 raft_consensus.cc:2771] T b74e748e97c84edeabc1c0cb41ddae99 P ec41d6947a4a4eadadf90c3756899704 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20261117 14:49:38.305584 7415 raft_consensus.cc:499] T 57984748adc7482a9a2d999a447a81af P ec41d6947a4a4eadadf90c3756899704 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader def6b23bccc94a78a47118da331f2798)
I20261117 14:49:38.314093 7415 raft_consensus.cc:521] T 57984748adc7482a9a2d999a447a81af P ec41d6947a4a4eadadf90c3756899704 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:38.345151 6788 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "57984748adc7482a9a2d999a447a81af" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 3 candidate_status { last_received { term: 2 index: 784 } } ignore_live_leader: false dest_uuid: "def6b23bccc94a78a47118da331f2798" is_pre_election: true
I20261117 14:49:38.345309 6655 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "57984748adc7482a9a2d999a447a81af" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 3 candidate_status { last_received { term: 2 index: 784 } } ignore_live_leader: false dest_uuid: "c7900e455dd64c68bccfc499bda413f7" is_pre_election: true
I20261117 14:49:38.346971 7342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.6.50.130:39451 (request call id 1) took 3081 ms. Trace:
I20261117 14:49:38.347528 7419 raft_consensus.cc:499] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader def6b23bccc94a78a47118da331f2798)
I20261117 14:49:38.347720 7419 raft_consensus.cc:521] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:38.348395 7419 leader_election.cc:290] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271), def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611)
I20261117 14:49:38.347275 7421 raft_consensus.cc:499] T d1732d75bf044feb8884fc3135373072 P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7900e455dd64c68bccfc499bda413f7)
I20261117 14:49:38.350123 6655 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "3cea00abcccd4b1284393ef8b406cab1" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 3 candidate_status { last_received { term: 2 index: 785 } } ignore_live_leader: false dest_uuid: "c7900e455dd64c68bccfc499bda413f7" is_pre_election: true
I20261117 14:49:38.350144 7267 leader_election.cc:304] T 57984748adc7482a9a2d999a447a81af P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec41d6947a4a4eadadf90c3756899704; no voters: c7900e455dd64c68bccfc499bda413f7, def6b23bccc94a78a47118da331f2798
I20261117 14:49:38.350432 7419 raft_consensus.cc:2771] T 57984748adc7482a9a2d999a447a81af P ec41d6947a4a4eadadf90c3756899704 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20261117 14:49:38.343640 7415 leader_election.cc:290] T 57984748adc7482a9a2d999a447a81af P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271), def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611)
I20261117 14:49:38.354535 6783 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "3cea00abcccd4b1284393ef8b406cab1" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 3 candidate_status { last_received { term: 2 index: 785 } } ignore_live_leader: false dest_uuid: "def6b23bccc94a78a47118da331f2798" is_pre_election: true
I20261117 14:49:38.349160 7421 raft_consensus.cc:521] T d1732d75bf044feb8884fc3135373072 P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:38.355201 7267 leader_election.cc:304] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec41d6947a4a4eadadf90c3756899704; no voters: c7900e455dd64c68bccfc499bda413f7, def6b23bccc94a78a47118da331f2798
I20261117 14:49:38.355724 7421 leader_election.cc:290] T d1732d75bf044feb8884fc3135373072 P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271), def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611)
I20261117 14:49:38.355912 7419 raft_consensus.cc:2771] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20261117 14:49:38.357992 6655 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "d1732d75bf044feb8884fc3135373072" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 2 candidate_status { last_received { term: 1 index: 784 } } ignore_live_leader: false dest_uuid: "c7900e455dd64c68bccfc499bda413f7" is_pre_election: true
I20261117 14:49:38.362298 6783 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "d1732d75bf044feb8884fc3135373072" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 2 candidate_status { last_received { term: 1 index: 784 } } ignore_live_leader: false dest_uuid: "def6b23bccc94a78a47118da331f2798" is_pre_election: true
I20261117 14:49:38.408581 7267 leader_election.cc:304] T d1732d75bf044feb8884fc3135373072 P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec41d6947a4a4eadadf90c3756899704; no voters: c7900e455dd64c68bccfc499bda413f7, def6b23bccc94a78a47118da331f2798
W20261117 14:49:38.409039 7267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.50.131:33611, user_credentials={real_user=slave}} blocked reactor thread for 46127.6us
I20261117 14:49:38.412634 7415 raft_consensus.cc:2771] T d1732d75bf044feb8884fc3135373072 P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20261117 14:49:38.604846 7415 raft_consensus.cc:499] T 47d9af37b05545f0b5b0c033f4ec953f P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader def6b23bccc94a78a47118da331f2798)
I20261117 14:49:38.610100 7415 raft_consensus.cc:521] T 47d9af37b05545f0b5b0c033f4ec953f P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:38.610888 7415 leader_election.cc:290] T 47d9af37b05545f0b5b0c033f4ec953f P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271), def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611)
I20261117 14:49:38.612136 6658 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "47d9af37b05545f0b5b0c033f4ec953f" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 2 candidate_status { last_received { term: 1 index: 784 } } ignore_live_leader: false dest_uuid: "c7900e455dd64c68bccfc499bda413f7" is_pre_election: true
I20261117 14:49:38.612643 6783 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "47d9af37b05545f0b5b0c033f4ec953f" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 2 candidate_status { last_received { term: 1 index: 784 } } ignore_live_leader: false dest_uuid: "def6b23bccc94a78a47118da331f2798" is_pre_election: true
I20261117 14:49:38.618655 7415 raft_consensus.cc:499] T b74e748e97c84edeabc1c0cb41ddae99 P ec41d6947a4a4eadadf90c3756899704 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c7900e455dd64c68bccfc499bda413f7)
I20261117 14:49:38.618849 7415 raft_consensus.cc:521] T b74e748e97c84edeabc1c0cb41ddae99 P ec41d6947a4a4eadadf90c3756899704 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:38.631309 6658 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "b74e748e97c84edeabc1c0cb41ddae99" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 3 candidate_status { last_received { term: 2 index: 785 } } ignore_live_leader: false dest_uuid: "c7900e455dd64c68bccfc499bda413f7" is_pre_election: true
I20261117 14:49:38.630010 7267 leader_election.cc:304] T 47d9af37b05545f0b5b0c033f4ec953f P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec41d6947a4a4eadadf90c3756899704; no voters: c7900e455dd64c68bccfc499bda413f7, def6b23bccc94a78a47118da331f2798
I20261117 14:49:38.633340 6783 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "b74e748e97c84edeabc1c0cb41ddae99" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 3 candidate_status { last_received { term: 2 index: 785 } } ignore_live_leader: false dest_uuid: "def6b23bccc94a78a47118da331f2798" is_pre_election: true
I20261117 14:49:38.641616 7419 raft_consensus.cc:2771] T 47d9af37b05545f0b5b0c033f4ec953f P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20261117 14:49:38.641646 7415 leader_election.cc:290] T b74e748e97c84edeabc1c0cb41ddae99 P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271), def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611)
I20261117 14:49:38.644852 7267 leader_election.cc:304] T b74e748e97c84edeabc1c0cb41ddae99 P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec41d6947a4a4eadadf90c3756899704; no voters: c7900e455dd64c68bccfc499bda413f7, def6b23bccc94a78a47118da331f2798
I20261117 14:49:38.649820 7415 raft_consensus.cc:2771] T b74e748e97c84edeabc1c0cb41ddae99 P ec41d6947a4a4eadadf90c3756899704 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20261117 14:49:38.757349 7415 raft_consensus.cc:499] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader def6b23bccc94a78a47118da331f2798)
I20261117 14:49:38.757568 7415 raft_consensus.cc:521] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:38.758827 6786 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "3cea00abcccd4b1284393ef8b406cab1" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 3 candidate_status { last_received { term: 2 index: 785 } } ignore_live_leader: false dest_uuid: "def6b23bccc94a78a47118da331f2798" is_pre_election: true
I20261117 14:49:38.761960 6655 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "3cea00abcccd4b1284393ef8b406cab1" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 3 candidate_status { last_received { term: 2 index: 785 } } ignore_live_leader: false dest_uuid: "c7900e455dd64c68bccfc499bda413f7" is_pre_election: true
I20261117 14:49:38.780411 7419 raft_consensus.cc:499] T d1732d75bf044feb8884fc3135373072 P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7900e455dd64c68bccfc499bda413f7)
I20261117 14:49:38.780669 7419 raft_consensus.cc:521] T d1732d75bf044feb8884fc3135373072 P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:38.783205 7415 leader_election.cc:290] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271), def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611)
I20261117 14:49:38.784893 7266 leader_election.cc:304] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec41d6947a4a4eadadf90c3756899704; no voters: c7900e455dd64c68bccfc499bda413f7, def6b23bccc94a78a47118da331f2798
I20261117 14:49:38.785527 7421 raft_consensus.cc:2771] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20261117 14:49:38.792672 7421 raft_consensus.cc:499] T 57984748adc7482a9a2d999a447a81af P ec41d6947a4a4eadadf90c3756899704 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader def6b23bccc94a78a47118da331f2798)
I20261117 14:49:38.792846 7421 raft_consensus.cc:521] T 57984748adc7482a9a2d999a447a81af P ec41d6947a4a4eadadf90c3756899704 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:38.796180 6654 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "57984748adc7482a9a2d999a447a81af" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 3 candidate_status { last_received { term: 2 index: 784 } } ignore_live_leader: false dest_uuid: "c7900e455dd64c68bccfc499bda413f7" is_pre_election: true
I20261117 14:49:38.796201 6658 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "d1732d75bf044feb8884fc3135373072" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 2 candidate_status { last_received { term: 1 index: 784 } } ignore_live_leader: false dest_uuid: "c7900e455dd64c68bccfc499bda413f7" is_pre_election: true
I20261117 14:49:38.802423 6783 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "d1732d75bf044feb8884fc3135373072" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 2 candidate_status { last_received { term: 1 index: 784 } } ignore_live_leader: false dest_uuid: "def6b23bccc94a78a47118da331f2798" is_pre_election: true
I20261117 14:49:38.807689 7419 leader_election.cc:290] T d1732d75bf044feb8884fc3135373072 P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271), def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611)
I20261117 14:49:38.808558 6783 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "57984748adc7482a9a2d999a447a81af" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 3 candidate_status { last_received { term: 2 index: 784 } } ignore_live_leader: false dest_uuid: "def6b23bccc94a78a47118da331f2798" is_pre_election: true
I20261117 14:49:38.809473 7421 leader_election.cc:290] T 57984748adc7482a9a2d999a447a81af P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271), def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611)
I20261117 14:49:38.809633 7266 leader_election.cc:304] T d1732d75bf044feb8884fc3135373072 P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec41d6947a4a4eadadf90c3756899704; no voters: c7900e455dd64c68bccfc499bda413f7, def6b23bccc94a78a47118da331f2798
I20261117 14:49:38.810053 7421 raft_consensus.cc:2771] T d1732d75bf044feb8884fc3135373072 P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20261117 14:49:38.817003 7267 leader_election.cc:304] T 57984748adc7482a9a2d999a447a81af P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec41d6947a4a4eadadf90c3756899704; no voters: c7900e455dd64c68bccfc499bda413f7, def6b23bccc94a78a47118da331f2798
I20261117 14:49:38.817536 7421 raft_consensus.cc:2771] T 57984748adc7482a9a2d999a447a81af P ec41d6947a4a4eadadf90c3756899704 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20261117 14:49:38.982280 7421 raft_consensus.cc:499] T b74e748e97c84edeabc1c0cb41ddae99 P ec41d6947a4a4eadadf90c3756899704 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c7900e455dd64c68bccfc499bda413f7)
I20261117 14:49:38.984840 7421 raft_consensus.cc:521] T b74e748e97c84edeabc1c0cb41ddae99 P ec41d6947a4a4eadadf90c3756899704 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:38.985636 7421 leader_election.cc:290] T b74e748e97c84edeabc1c0cb41ddae99 P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271), def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611)
I20261117 14:49:38.985927 6654 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "b74e748e97c84edeabc1c0cb41ddae99" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 3 candidate_status { last_received { term: 2 index: 785 } } ignore_live_leader: false dest_uuid: "c7900e455dd64c68bccfc499bda413f7" is_pre_election: true
I20261117 14:49:38.987757 6783 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "b74e748e97c84edeabc1c0cb41ddae99" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 3 candidate_status { last_received { term: 2 index: 785 } } ignore_live_leader: false dest_uuid: "def6b23bccc94a78a47118da331f2798" is_pre_election: true
I20261117 14:49:38.988418 7267 leader_election.cc:304] T b74e748e97c84edeabc1c0cb41ddae99 P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec41d6947a4a4eadadf90c3756899704; no voters: c7900e455dd64c68bccfc499bda413f7, def6b23bccc94a78a47118da331f2798
I20261117 14:49:39.000036 7421 raft_consensus.cc:2771] T b74e748e97c84edeabc1c0cb41ddae99 P ec41d6947a4a4eadadf90c3756899704 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20261117 14:49:39.092283 7421 raft_consensus.cc:499] T 47d9af37b05545f0b5b0c033f4ec953f P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader def6b23bccc94a78a47118da331f2798)
I20261117 14:49:39.094734 7421 raft_consensus.cc:521] T 47d9af37b05545f0b5b0c033f4ec953f P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:39.095487 7421 leader_election.cc:290] T 47d9af37b05545f0b5b0c033f4ec953f P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271), def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611)
I20261117 14:49:39.096122 6786 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "47d9af37b05545f0b5b0c033f4ec953f" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 2 candidate_status { last_received { term: 1 index: 784 } } ignore_live_leader: false dest_uuid: "def6b23bccc94a78a47118da331f2798" is_pre_election: true
I20261117 14:49:39.096171 6655 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "47d9af37b05545f0b5b0c033f4ec953f" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 2 candidate_status { last_received { term: 1 index: 784 } } ignore_live_leader: false dest_uuid: "c7900e455dd64c68bccfc499bda413f7" is_pre_election: true
I20261117 14:49:39.096951 7267 leader_election.cc:304] T 47d9af37b05545f0b5b0c033f4ec953f P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec41d6947a4a4eadadf90c3756899704; no voters: c7900e455dd64c68bccfc499bda413f7, def6b23bccc94a78a47118da331f2798
I20261117 14:49:39.100785 7421 raft_consensus.cc:2771] T 47d9af37b05545f0b5b0c033f4ec953f P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20261117 14:49:37.835709 7346 rpcz_store.cc:276] 1117 14:49:35.107791 (+ 0us) service_pool.cc:167] Inserting onto call queue
1117 14:49:35.113388 (+ 5597us) service_pool.cc:224] Handling call
1117 14:49:35.267244 (+153856us) raft_consensus.cc:1481] Updating replica for 609 ops
1117 14:49:35.347717 (+ 80473us) raft_consensus.cc:1545] Early marking committed up to index 0
1117 14:49:35.347728 (+ 11us) raft_consensus.cc:1550] Triggering prepare for 609 ops
1117 14:49:35.348626 (+ 898us) write_op.cc:270] Start()
1117 14:49:35.348685 (+ 59us) write_op.cc:276] Timestamp: P: 1794926962606890 usec, L: 0
1117 14:49:35.368096 (+ 19411us) write_op.cc:270] Start()
1117 14:49:35.368127 (+ 31us) write_op.cc:276] Timestamp: P: 1794926962610504 usec, L: 0
1117 14:49:35.368366 (+ 239us) write_op.cc:270] Start()
1117 14:49:35.368406 (+ 40us) write_op.cc:276] Timestamp: P: 1794926962618196 usec, L: 0
1117 14:49:35.368660 (+ 254us) write_op.cc:270] Start()
1117 14:49:35.368684 (+ 24us) write_op.cc:276] Timestamp: P: 1794926962618907 usec, L: 0
1117 14:49:35.368834 (+ 150us) write_op.cc:270] Start()
1117 14:49:35.368854 (+ 20us) write_op.cc:276] Timestamp: P: 1794926962636012 usec, L: 0
1117 14:49:35.369010 (+ 156us) write_op.cc:270] Start()
1117 14:49:35.369030 (+ 20us) write_op.cc:276] Timestamp: P: 1794926962641354 usec, L: 0
1117 14:49:35.369199 (+ 169us) write_op.cc:270] Start()
1117 14:49:35.369269 (+ 70us) write_op.cc:276] Timestamp: P: 1794926962675106 usec, L: 0
1117 14:49:35.369641 (+ 372us) write_op.cc:270] Start()
1117 14:49:35.369666 (+ 25us) write_op.cc:276] Timestamp: P: 1794926962700682 usec, L: 0
1117 14:49:35.369889 (+ 223us) write_op.cc:270] Start()
1117 14:49:35.369916 (+ 27us) write_op.cc:276] Timestamp: P: 1794926962719472 usec, L: 0
1117 14:49:35.370086 (+ 170us) write_op.cc:270] Start()
1117 14:49:35.370113 (+ 27us) write_op.cc:276] Timestamp: P: 1794926962720858 usec, L: 0
1117 14:49:35.370308 (+ 195us) write_op.cc:270] Start()
1117 14:49:35.370336 (+ 28us) write_op.cc:276] Timestamp: P: 1794926962732234 usec, L: 0
1117 14:49:35.370511 (+ 175us) write_op.cc:270] Start()
1117 14:49:35.370537 (+ 26us) write_op.cc:276] Timestamp: P: 1794926962787908 usec, L: 0
1117 14:49:35.371025 (+ 488us) write_op.cc:270] Start()
1117 14:49:35.371051 (+ 26us) write_op.cc:276] Timestamp: P: 1794926962788586 usec, L: 0
1117 14:49:35.371253 (+ 202us) write_op.cc:270] Start()
1117 14:49:35.371277 (+ 24us) write_op.cc:276] Timestamp: P: 1794926962791911 usec, L: 0
1117 14:49:35.371439 (+ 162us) write_op.cc:270] Start()
1117 14:49:35.371463 (+ 24us) write_op.cc:276] Timestamp: P: 1794926962811355 usec, L: 0
1117 14:49:35.371689 (+ 226us) write_op.cc:270] Start()
1117 14:49:35.371715 (+ 26us) write_op.cc:276] Timestamp: P: 1794926962840395 usec, L: 0
1117 14:49:35.371980 (+ 265us) write_op.cc:270] Start()
1117 14:49:35.372013 (+ 33us) write_op.cc:276] Timestamp: P: 1794926962843683 usec, L: 0
1117 14:49:35.372197 (+ 184us) write_op.cc:270] Start()
1117 14:49:35.372216 (+ 19us) write_op.cc:276] Timestamp: P: 1794926962845198 usec, L: 0
1117 14:49:35.372388 (+ 172us) write_op.cc:270] Start()
1117 14:49:35.372409 (+ 21us) write_op.cc:276] Timestamp: P: 1794926962862607 usec, L: 0
1117 14:49:35.381064 (+ 8655us) write_op.cc:270] Start()
1117 14:49:35.381092 (+ 28us) write_op.cc:276] Timestamp: P: 1794926962887282 usec, L: 0
1117 14:49:35.381287 (+ 195us) write_op.cc:270] Start()
1117 14:49:35.381307 (+ 20us) write_op.cc:276] Timestamp: P: 1794926962893475 usec, L: 0
1117 14:49:35.382902 (+ 1595us) write_op.cc:270] Start()
1117 14:49:35.382929 (+ 27us) write_op.cc:276] Timestamp: P: 1794926962907360 usec, L: 0
1117 14:49:35.383100 (+ 171us) write_op.cc:270] Start()
1117 14:49:35.383190 (+ 90us) write_op.cc:276] Timestamp: P: 1794926962910228 usec, L: 0
1117 14:49:35.383376 (+ 186us) write_op.cc:270] Start()
1117 14:49:35.383397 (+ 21us) write_op.cc:276] Timestamp: P: 1794926962943827 usec, L: 0
1117 14:49:35.384142 (+ 745us) write_op.cc:270] Start()
1117 14:49:35.384182 (+ 40us) write_op.cc:276] Timestamp: P: 1794926962972435 usec, L: 0
1117 14:49:35.384342 (+ 160us) write_op.cc:270] Start()
1117 14:49:35.384361 (+ 19us) write_op.cc:276] Timestamp: P: 1794926962973246 usec, L: 0
1117 14:49:35.384562 (+ 201us) write_op.cc:270] Start()
1117 14:49:35.384582 (+ 20us) write_op.cc:276] Timestamp: P: 1794926962974451 usec, L: 0
1117 14:49:35.384746 (+ 164us) write_op.cc:270] Start()
1117 14:49:35.384768 (+ 22us) write_op.cc:276] Timestamp: P: 1794926963004513 usec, L: 0
1117 14:49:35.384911 (+ 143us) write_op.cc:270] Start()
1117 14:49:35.384935 (+ 24us) write_op.cc:276] Timestamp: P: 1794926963028706 usec, L: 0
1117 14:49:35.385093 (+ 158us) write_op.cc:270] Start()
1117 14:49:35.385118 (+ 25us) write_op.cc:276] Timestamp: P: 1794926963035200 usec, L: 0
1117 14:49:35.385301 (+ 183us) write_op.cc:270] Start()
1117 14:49:35.385323 (+ 22us) write_op.cc:276] Timestamp: P: 1794926963035937 usec, L: 0
1117 14:49:35.385497 (+ 174us) write_op.cc:270] Start()
1117 14:49:35.385522 (+ 25us) write_op.cc:276] Timestamp: P: 1794926963050116 usec, L: 0
1117 14:49:35.385705 (+ 183us) write_op.cc:270] Start()
1117 14:49:35.385728 (+ 23us) write_op.cc:276] Timestamp: P: 1794926963086198 usec, L: 0
1117 14:49:35.385875 (+ 147us) write_op.cc:270] Start()
1117 14:49:35.385894 (+ 19us) write_op.cc:276] Timestamp: P: 1794926963110479 usec, L: 0
1117 14:49:35.386039 (+ 145us) write_op.cc:270] Start()
1117 14:49:35.386065 (+ 26us) write_op.cc:276] Timestamp: P: 1794926963114696 usec, L: 0
1117 14:49:35.387862 (+ 1797us) write_op.cc:270] Start()
1117 14:49:35.387892 (+ 30us) write_op.cc:276] Timestamp: P: 1794926963118274 usec, L: 0
1117 14:49:35.389030 (+ 1138us) write_op.cc:270] Start()
1117 14:49:35.389069 (+ 39us) write_op.cc:276] Timestamp: P: 1794926963141414 usec, L: 0
1117 14:49:35.400870 (+ 11801us) write_op.cc:270] Start()
1117 14:49:35.400908 (+ 38us) write_op.cc:276] Timestamp: P: 1794926963163570 usec, L: 0
1117 14:49:35.401145 (+ 237us) write_op.cc:270] Start()
1117 14:49:35.401171 (+ 26us) write_op.cc:276] Timestamp: P: 1794926963197071 usec, L: 0
1117 14:49:35.402459 (+ 1288us) write_op.cc:270] Start()
1117 14:49:35.402487 (+ 28us) write_op.cc:276] Timestamp: P: 1794926963199635 usec, L: 0
1117 14:49:35.403111 (+ 624us) write_op.cc:270] Start()
1117 14:49:35.403137 (+ 26us) write_op.cc:276] Timestamp: P: 1794926963215633 usec, L: 0
1117 14:49:35.403347 (+ 210us) write_op.cc:270] Start()
1117 14:49:35.407542 (+ 4195us) write_op.cc:276] Timestamp: P: 1794926963257709 usec, L: 0
1117 14:49:35.408214 (+ 672us) write_op.cc:270] Start()
1117 14:49:35.408239 (+ 25us) write_op.cc:276] Timestamp: P: 1794926963277396 usec, L: 0
1117 14:49:35.413087 (+ 4848us) write_op.cc:270] Start()
1117 14:49:35.413119 (+ 32us) write_op.cc:276] Timestamp: P: 1794926963282265 usec, L: 0
1117 14:49:35.417632 (+ 4513us) write_op.cc:270] Start()
1117 14:49:35.417662 (+ 30us) write_op.cc:276] Timestamp: P: 1794926963296031 usec, L: 0
1117 14:49:35.423681 (+ 6019us) write_op.cc:270] Start()
1117 14:49:35.423714 (+ 33us) write_op.cc:276] Timestamp: P: 1794926963310604 usec, L: 0
1117 14:49:35.423893 (+ 179us) write_op.cc:270] Start()
1117 14:49:35.423910 (+ 17us) write_op.cc:276] Timestamp: P: 1794926963313096 usec, L: 0
1117 14:49:35.429816 (+ 5906us) write_op.cc:270] Start()
1117 14:49:35.429842 (+ 26us) write_op.cc:276] Timestamp: P: 1794926963333964 usec, L: 0
1117 14:49:35.430026 (+ 184us) write_op.cc:270] Start()
1117 14:49:35.430047 (+ 21us) write_op.cc:276] Timestamp: P: 1794926963372699 usec, L: 0
1117 14:49:35.457182 (+ 27135us) write_op.cc:270] Start()
1117 14:49:35.457233 (+ 51us) write_op.cc:276] Timestamp: P: 1794926963379229 usec, L: 0
1117 14:49:35.494119 (+ 36886us) write_op.cc:270] Start()
1117 14:49:35.494152 (+ 33us) write_op.cc:276] Timestamp: P: 1794926963396411 usec, L: 0
1117 14:49:35.494348 (+ 196us) write_op.cc:270] Start()
1117 14:49:35.494371 (+ 23us) write_op.cc:276] Timestamp: P: 1794926963397462 usec, L: 0
1117 14:49:35.499930 (+ 5559us) write_op.cc:270] Start()
1117 14:49:35.499960 (+ 30us) write_op.cc:276] Timestamp: P: 1794926963405463 usec, L: 0
1117 14:49:35.503018 (+ 3058us) write_op.cc:270] Start()
1117 14:49:35.503044 (+ 26us) write_op.cc:276] Timestamp: P: 1794926963431747 usec, L: 0
1117 14:49:35.503219 (+ 175us) write_op.cc:270] Start()
1117 14:49:35.503241 (+ 22us) write_op.cc:276] Timestamp: P: 1794926963455075 usec, L: 0
1117 14:49:35.503407 (+ 166us) write_op.cc:270] Start()
1117 14:49:35.503427 (+ 20us) write_op.cc:276] Timestamp: P: 1794926963465623 usec, L: 0
1117 14:49:35.525544 (+ 22117us) write_op.cc:270] Start()
1117 14:49:35.525583 (+ 39us) write_op.cc:276] Timestamp: P: 1794926963479969 usec, L: 0
1117 14:49:35.525892 (+ 309us) write_op.cc:270] Start()
1117 14:49:35.525922 (+ 30us) write_op.cc:276] Timestamp: P: 1794926963481137 usec, L: 0
1117 14:49:35.526110 (+ 188us) write_op.cc:270] Start()
1117 14:49:35.526136 (+ 26us) write_op.cc:276] Timestamp: P: 1794926963521064 usec, L: 0
1117 14:49:35.526352 (+ 216us) write_op.cc:270] Start()
1117 14:49:35.526404 (+ 52us) write_op.cc:276] Timestamp: P: 1794926963523295 usec, L: 0
1117 14:49:35.526600 (+ 196us) write_op.cc:270] Start()
1117 14:49:35.526625 (+ 25us) write_op.cc:276] Timestamp: P: 1794926963530988 usec, L: 0
1117 14:49:35.526799 (+ 174us) write_op.cc:270] Start()
1117 14:49:35.526823 (+ 24us) write_op.cc:276] Timestamp: P: 1794926963560699 usec, L: 0
1117 14:49:35.526976 (+ 153us) write_op.cc:270] Start()
1117 14:49:35.527000 (+ 24us) write_op.cc:276] Timestamp: P: 1794926963564280 usec, L: 0
1117 14:49:35.527180 (+ 180us) write_op.cc:270] Start()
1117 14:49:35.527204 (+ 24us) write_op.cc:276] Timestamp: P: 1794926963568372 usec, L: 0
1117 14:49:35.527398 (+ 194us) write_op.cc:270] Start()
1117 14:49:35.527426 (+ 28us) write_op.cc:276] Timestamp: P: 1794926963590253 usec, L: 0
1117 14:49:35.527596 (+ 170us) write_op.cc:270] Start()
1117 14:49:35.527621 (+ 25us) write_op.cc:276] Timestamp: P: 1794926963626539 usec, L: 0
1117 14:49:35.527804 (+ 183us) write_op.cc:270] Start()
1117 14:49:35.527829 (+ 25us) write_op.cc:276] Timestamp: P: 1794926963640044 usec, L: 0
1117 14:49:35.527993 (+ 164us) write_op.cc:270] Start()
1117 14:49:35.528018 (+ 25us) write_op.cc:276] Timestamp: P: 1794926963641383 usec, L: 0
1117 14:49:35.528205 (+ 187us) write_op.cc:270] Start()
1117 14:49:35.528230 (+ 25us) write_op.cc:276] Timestamp: P: 1794926963666389 usec, L: 0
1117 14:49:35.528419 (+ 189us) write_op.cc:270] Start()
1117 14:49:35.528470 (+ 51us) write_op.cc:276] Timestamp: P: 1794926963694532 usec, L: 0
1117 14:49:35.528668 (+ 198us) write_op.cc:270] Start()
1117 14:49:35.528694 (+ 26us) write_op.cc:276] Timestamp: P: 1794926963704448 usec, L: 0
1117 14:49:35.528864 (+ 170us) write_op.cc:270] Start()
1117 14:49:35.528889 (+ 25us) write_op.cc:276] Timestamp: P: 1794926963722937 usec, L: 0
1117 14:49:35.529124 (+ 235us) write_op.cc:270] Start()
1117 14:49:35.529150 (+ 26us) write_op.cc:276] Timestamp: P: 1794926963723594 usec, L: 0
1117 14:49:35.529316 (+ 166us) write_op.cc:270] Start()
1117 14:49:35.529340 (+ 24us) write_op.cc:276] Timestamp: P: 1794926963747345 usec, L: 0
1117 14:49:35.529506 (+ 166us) write_op.cc:270] Start()
1117 14:49:35.529525 (+ 19us) write_op.cc:276] Timestamp: P: 1794926963769509 usec, L: 0
1117 14:49:35.538091 (+ 8566us) write_op.cc:270] Start()
1117 14:49:35.538123 (+ 32us) write_op.cc:276] Timestamp: P: 1794926963770325 usec, L: 0
1117 14:49:35.538320 (+ 197us) write_op.cc:270] Start()
1117 14:49:35.538343 (+ 23us) write_op.cc:276] Timestamp: P: 1794926963798497 usec, L: 0
1117 14:49:35.539877 (+ 1534us) write_op.cc:270] Start()
1117 14:49:35.539904 (+ 27us) write_op.cc:276] Timestamp: P: 1794926963806899 usec, L: 0
1117 14:49:35.540094 (+ 190us) write_op.cc:270] Start()
1117 14:49:35.540135 (+ 41us) write_op.cc:276] Timestamp: P: 1794926963813787 usec, L: 0
1117 14:49:35.540300 (+ 165us) write_op.cc:270] Start()
1117 14:49:35.540319 (+ 19us) write_op.cc:276] Timestamp: P: 1794926963829706 usec, L: 0
1117 14:49:35.540508 (+ 189us) write_op.cc:270] Start()
1117 14:49:35.540529 (+ 21us) write_op.cc:276] Timestamp: P: 1794926963839896 usec, L: 0
1117 14:49:35.540685 (+ 156us) write_op.cc:270] Start()
1117 14:49:35.540706 (+ 21us) write_op.cc:276] Timestamp: P: 1794926963863929 usec, L: 0
1117 14:49:35.540903 (+ 197us) write_op.cc:270] Start()
1117 14:49:35.540930 (+ 27us) write_op.cc:276] Timestamp: P: 1794926963886259 usec, L: 0
1117 14:49:35.541102 (+ 172us) write_op.cc:270] Start()
1117 14:49:35.541132 (+ 30us) write_op.cc:276] Timestamp: P: 1794926963903737 usec, L: 0
1117 14:49:35.541305 (+ 173us) write_op.cc:270] Start()
1117 14:49:35.541330 (+ 25us) write_op.cc:276] Timestamp: P: 1794926963920582 usec, L: 0
1117 14:49:35.566117 (+ 24787us) write_op.cc:270] Start()
1117 14:49:35.566160 (+ 43us) write_op.cc:276] Timestamp: P: 1794926963930203 usec, L: 0
1117 14:49:35.566414 (+ 254us) write_op.cc:270] Start()
1117 14:49:35.566442 (+ 28us) write_op.cc:276] Timestamp: P: 1794926963946699 usec, L: 0
1117 14:49:35.566691 (+ 249us) write_op.cc:270] Start()
1117 14:49:35.566719 (+ 28us) write_op.cc:276] Timestamp: P: 1794926963956386 usec, L: 0
1117 14:49:35.566940 (+ 221us) write_op.cc:270] Start()
1117 14:49:35.566962 (+ 22us) write_op.cc:276] Timestamp: P: 1794926963963634 usec, L: 0
1117 14:49:35.567131 (+ 169us) write_op.cc:270] Start()
1117 14:49:35.567155 (+ 24us) write_op.cc:276] Timestamp: P: 1794926963988926 usec, L: 0
1117 14:49:35.567348 (+ 193us) write_op.cc:270] Start()
1117 14:49:35.567373 (+ 25us) write_op.cc:276] Timestamp: P: 1794926963999277 usec, L: 0
1117 14:49:35.588241 (+ 20868us) write_op.cc:270] Start()
1117 14:49:35.588289 (+ 48us) write_op.cc:276] Timestamp: P: 1794926964025145 usec, L: 0
1117 14:49:35.588550 (+ 261us) write_op.cc:270] Start()
1117 14:49:35.588576 (+ 26us) write_op.cc:276] Timestamp: P: 1794926964054864 usec, L: 0
1117 14:49:35.588755 (+ 179us) write_op.cc:270] Start()
1117 14:49:35.588778 (+ 23us) write_op.cc:276] Timestamp: P: 1794926964061064 usec, L: 0
1117 14:49:35.599238 (+ 10460us) write_op.cc:270] Start()
1117 14:49:35.599267 (+ 29us) write_op.cc:276] Timestamp: P: 1794926964062658 usec, L: 0
1117 14:49:35.599479 (+ 212us) write_op.cc:270] Start()
1117 14:49:35.599505 (+ 26us) write_op.cc:276] Timestamp: P: 1794926964075831 usec, L: 0
1117 14:49:35.599673 (+ 168us) write_op.cc:270] Start()
1117 14:49:35.599693 (+ 20us) write_op.cc:276] Timestamp: P: 1794926964123121 usec, L: 0
1117 14:49:35.599843 (+ 150us) write_op.cc:270] Start()
1117 14:49:35.599866 (+ 23us) write_op.cc:276] Timestamp: P: 1794926964123991 usec, L: 0
1117 14:49:35.600065 (+ 199us) write_op.cc:270] Start()
1117 14:49:35.600089 (+ 24us) write_op.cc:276] Timestamp: P: 1794926964133697 usec, L: 0
1117 14:49:35.600258 (+ 169us) write_op.cc:270] Start()
1117 14:49:35.600279 (+ 21us) write_op.cc:276] Timestamp: P: 1794926964160037 usec, L: 0
1117 14:49:35.600436 (+ 157us) write_op.cc:270] Start()
1117 14:49:35.600491 (+ 55us) write_op.cc:276] Timestamp: P: 1794926964173067 usec, L: 0
1117 14:49:35.600685 (+ 194us) write_op.cc:270] Start()
1117 14:49:35.600709 (+ 24us) write_op.cc:276] Timestamp: P: 1794926964174144 usec, L: 0
1117 14:49:35.600897 (+ 188us) write_op.cc:270] Start()
1117 14:49:35.600928 (+ 31us) write_op.cc:276] Timestamp: P: 1794926964196257 usec, L: 0
1117 14:49:35.601116 (+ 188us) write_op.cc:270] Start()
1117 14:49:35.601142 (+ 26us) write_op.cc:276] Timestamp: P: 1794926964223781 usec, L: 0
1117 14:49:35.601362 (+ 220us) write_op.cc:270] Start()
1117 14:49:35.601387 (+ 25us) write_op.cc:276] Timestamp: P: 1794926964233924 usec, L: 0
1117 14:49:35.601594 (+ 207us) write_op.cc:270] Start()
1117 14:49:35.601620 (+ 26us) write_op.cc:276] Timestamp: P: 1794926964244245 usec, L: 0
1117 14:49:35.601762 (+ 142us) write_op.cc:270] Start()
1117 14:49:35.601781 (+ 19us) write_op.cc:276] Timestamp: P: 1794926964260653 usec, L: 0
1117 14:49:35.635665 (+ 33884us) write_op.cc:270] Start()
1117 14:49:35.635703 (+ 38us) write_op.cc:276] Timestamp: P: 1794926964294558 usec, L: 0
1117 14:49:35.640805 (+ 5102us) write_op.cc:270] Start()
1117 14:49:35.640838 (+ 33us) write_op.cc:276] Timestamp: P: 1794926964300850 usec, L: 0
1117 14:49:35.656541 (+ 15703us) write_op.cc:270] Start()
1117 14:49:35.656573 (+ 32us) write_op.cc:276] Timestamp: P: 1794926964301904 usec, L: 0
1117 14:49:35.658146 (+ 1573us) write_op.cc:270] Start()
1117 14:49:35.658173 (+ 27us) write_op.cc:276] Timestamp: P: 1794926964305709 usec, L: 0
1117 14:49:35.658333 (+ 160us) write_op.cc:270] Start()
1117 14:49:35.658357 (+ 24us) write_op.cc:276] Timestamp: P: 1794926964335433 usec, L: 0
1117 14:49:35.663797 (+ 5440us) write_op.cc:270] Start()
1117 14:49:35.663827 (+ 30us) write_op.cc:276] Timestamp: P: 1794926964362510 usec, L: 0
1117 14:49:35.680002 (+ 16175us) write_op.cc:270] Start()
1117 14:49:35.680033 (+ 31us) write_op.cc:276] Timestamp: P: 1794926964363874 usec, L: 0
1117 14:49:35.689844 (+ 9811us) write_op.cc:270] Start()
1117 14:49:35.689876 (+ 32us) write_op.cc:276] Timestamp: P: 1794926964383242 usec, L: 0
1117 14:49:35.690124 (+ 248us) write_op.cc:270] Start()
1117 14:49:35.690148 (+ 24us) write_op.cc:276] Timestamp: P: 1794926964390681 usec, L: 0
1117 14:49:35.690317 (+ 169us) write_op.cc:270] Start()
1117 14:49:35.690340 (+ 23us) write_op.cc:276] Timestamp: P: 1794926964420179 usec, L: 0
1117 14:49:35.690516 (+ 176us) write_op.cc:270] Start()
1117 14:49:35.690538 (+ 22us) write_op.cc:276] Timestamp: P: 1794926964422512 usec, L: 0
1117 14:49:35.690696 (+ 158us) write_op.cc:270] Start()
1117 14:49:35.690721 (+ 25us) write_op.cc:276] Timestamp: P: 1794926964438222 usec, L: 0
1117 14:49:35.690875 (+ 154us) write_op.cc:270] Start()
1117 14:49:35.690897 (+ 22us) write_op.cc:276] Timestamp: P: 1794926964450564 usec, L: 0
1117 14:49:35.691106 (+ 209us) write_op.cc:270] Start()
1117 14:49:35.691125 (+ 19us) write_op.cc:276] Timestamp: P: 1794926964482232 usec, L: 0
1117 14:49:35.691280 (+ 155us) write_op.cc:270] Start()
1117 14:49:35.691305 (+ 25us) write_op.cc:276] Timestamp: P: 1794926964518811 usec, L: 0
1117 14:49:35.691486 (+ 181us) write_op.cc:270] Start()
1117 14:49:35.691509 (+ 23us) write_op.cc:276] Timestamp: P: 1794926964519478 usec, L: 0
1117 14:49:35.691687 (+ 178us) write_op.cc:270] Start()
1117 14:49:35.691707 (+ 20us) write_op.cc:276] Timestamp: P: 1794926964520717 usec, L: 0
1117 14:49:35.691890 (+ 183us) write_op.cc:270] Start()
1117 14:49:35.691912 (+ 22us) write_op.cc:276] Timestamp: P: 1794926964525906 usec, L: 0
1117 14:49:35.692037 (+ 125us) write_op.cc:270] Start()
1117 14:49:35.692052 (+ 15us) write_op.cc:276] Timestamp: P: 1794926964557910 usec, L: 0
1117 14:49:35.695399 (+ 3347us) write_op.cc:270] Start()
1117 14:49:35.695427 (+ 28us) write_op.cc:276] Timestamp: P: 1794926964575114 usec, L: 0
1117 14:49:35.695613 (+ 186us) write_op.cc:270] Start()
1117 14:49:35.695636 (+ 23us) write_op.cc:276] Timestamp: P: 1794926964577745 usec, L: 0
1117 14:49:35.705530 (+ 9894us) write_op.cc:270] Start()
1117 14:49:35.705555 (+ 25us) write_op.cc:276] Timestamp: P: 1794926964586396 usec, L: 0
1117 14:49:35.705724 (+ 169us) write_op.cc:270] Start()
1117 14:49:35.705744 (+ 20us) write_op.cc:276] Timestamp: P: 1794926964622111 usec, L: 0
1117 14:49:35.709311 (+ 3567us) write_op.cc:270] Start()
1117 14:49:35.711050 (+ 1739us) write_op.cc:276] Timestamp: P: 1794926964628954 usec, L: 0
1117 14:49:35.712519 (+ 1469us) write_op.cc:270] Start()
1117 14:49:35.712544 (+ 25us) write_op.cc:276] Timestamp: P: 1794926964633210 usec, L: 0
1117 14:49:35.712715 (+ 171us) write_op.cc:270] Start()
1117 14:49:35.712741 (+ 26us) write_op.cc:276] Timestamp: P: 1794926964654801 usec, L: 0
1117 14:49:35.712896 (+ 155us) write_op.cc:270] Start()
1117 14:49:35.712917 (+ 21us) write_op.cc:276] Timestamp: P: 1794926964683634 usec, L: 0
1117 14:49:35.718127 (+ 5210us) write_op.cc:270] Start()
1117 14:49:35.718152 (+ 25us) write_op.cc:276] Timestamp: P: 1794926964687828 usec, L: 0
1117 14:49:35.718312 (+ 160us) write_op.cc:270] Start()
1117 14:49:35.718336 (+ 24us) write_op.cc:276] Timestamp: P: 1794926964730723 usec, L: 0
1117 14:49:35.718525 (+ 189us) write_op.cc:270] Start()
1117 14:49:35.718546 (+ 21us) write_op.cc:276] Timestamp: P: 1794926964742534 usec, L: 0
1117 14:49:35.718685 (+ 139us) write_op.cc:270] Start()
1117 14:49:35.718704 (+ 19us) write_op.cc:276] Timestamp: P: 1794926964743606 usec, L: 0
1117 14:49:35.718856 (+ 152us) write_op.cc:270] Start()
1117 14:49:35.718879 (+ 23us) write_op.cc:276] Timestamp: P: 1794926964767286 usec, L: 0
1117 14:49:35.719046 (+ 167us) write_op.cc:270] Start()
1117 14:49:35.719068 (+ 22us) write_op.cc:276] Timestamp: P: 1794926964767950 usec, L: 0
1117 14:49:35.719251 (+ 183us) write_op.cc:270] Start()
1117 14:49:35.719270 (+ 19us) write_op.cc:276] Timestamp: P: 1794926964802590 usec, L: 0
1117 14:49:35.719741 (+ 471us) write_op.cc:270] Start()
1117 14:49:35.719761 (+ 20us) write_op.cc:276] Timestamp: P: 1794926964806118 usec, L: 0
1117 14:49:35.719907 (+ 146us) write_op.cc:270] Start()
1117 14:49:35.719935 (+ 28us) write_op.cc:276] Timestamp: P: 1794926964810918 usec, L: 0
1117 14:49:35.720071 (+ 136us) write_op.cc:270] Start()
1117 14:49:35.720090 (+ 19us) write_op.cc:276] Timestamp: P: 1794926964818313 usec, L: 0
1117 14:49:35.720250 (+ 160us) write_op.cc:270] Start()
1117 14:49:35.720271 (+ 21us) write_op.cc:276] Timestamp: P: 1794926964849181 usec, L: 0
1117 14:49:35.733475 (+ 13204us) write_op.cc:270] Start()
1117 14:49:35.733505 (+ 30us) write_op.cc:276] Timestamp: P: 1794926964871243 usec, L: 0
1117 14:49:35.733667 (+ 162us) write_op.cc:270] Start()
1117 14:49:35.733686 (+ 19us) write_op.cc:276] Timestamp: P: 1794926964888571 usec, L: 0
1117 14:49:35.733779 (+ 93us) write_op.cc:270] Start()
1117 14:49:35.733791 (+ 12us) write_op.cc:276] Timestamp: P: 1794926964890811 usec, L: 0
1117 14:49:35.733871 (+ 80us) write_op.cc:270] Start()
1117 14:49:35.733883 (+ 12us) write_op.cc:276] Timestamp: P: 1794926964915769 usec, L: 0
1117 14:49:35.733993 (+ 110us) write_op.cc:270] Start()
1117 14:49:35.734006 (+ 13us) write_op.cc:276] Timestamp: P: 1794926964919501 usec, L: 0
1117 14:49:35.734102 (+ 96us) write_op.cc:270] Start()
1117 14:49:35.734114 (+ 12us) write_op.cc:276] Timestamp: P: 1794926964920986 usec, L: 0
1117 14:49:35.734216 (+ 102us) write_op.cc:270] Start()
1117 14:49:35.734243 (+ 27us) write_op.cc:276] Timestamp: P: 1794926964949166 usec, L: 0
1117 14:49:35.735886 (+ 1643us) write_op.cc:270] Start()
1117 14:49:35.735915 (+ 29us) write_op.cc:276] Timestamp: P: 1794926964982075 usec, L: 0
1117 14:49:35.736161 (+ 246us) write_op.cc:270] Start()
1117 14:49:35.736189 (+ 28us) write_op.cc:276] Timestamp: P: 1794926964998159 usec, L: 0
1117 14:49:35.741489 (+ 5300us) write_op.cc:270] Start()
1117 14:49:35.741518 (+ 29us) write_op.cc:276] Timestamp: P: 1794926965009106 usec, L: 0
1117 14:49:35.741844 (+ 326us) write_op.cc:270] Start()
1117 14:49:35.741869 (+ 25us) write_op.cc:276] Timestamp: P: 1794926965011320 usec, L: 0
1117 14:49:35.742041 (+ 172us) write_op.cc:270] Start()
1117 14:49:35.742063 (+ 22us) write_op.cc:276] Timestamp: P: 1794926965038880 usec, L: 0
1117 14:49:35.759303 (+ 17240us) write_op.cc:270] Start()
1117 14:49:35.759334 (+ 31us) write_op.cc:276] Timestamp: P: 1794926965062286 usec, L: 0
1117 14:49:35.766975 (+ 7641us) write_op.cc:270] Start()
1117 14:49:35.767012 (+ 37us) write_op.cc:276] Timestamp: P: 1794926965075310 usec, L: 0
1117 14:49:35.775995 (+ 8983us) write_op.cc:270] Start()
1117 14:49:35.776023 (+ 28us) write_op.cc:276] Timestamp: P: 1794926965076629 usec, L: 0
1117 14:49:35.786680 (+ 10657us) write_op.cc:270] Start()
1117 14:49:35.786712 (+ 32us) write_op.cc:276] Timestamp: P: 1794926965102489 usec, L: 0
1117 14:49:35.791876 (+ 5164us) write_op.cc:270] Start()
1117 14:49:35.791907 (+ 31us) write_op.cc:276] Timestamp: P: 1794926965129631 usec, L: 0
1117 14:49:35.792126 (+ 219us) write_op.cc:270] Start()
1117 14:49:35.792149 (+ 23us) write_op.cc:276] Timestamp: P: 1794926965151830 usec, L: 0
1117 14:49:35.797673 (+ 5524us) write_op.cc:270] Start()
1117 14:49:35.797704 (+ 31us) write_op.cc:276] Timestamp: P: 1794926965170153 usec, L: 0
1117 14:49:35.797884 (+ 180us) write_op.cc:270] Start()
1117 14:49:35.797910 (+ 26us) write_op.cc:276] Timestamp: P: 1794926965175422 usec, L: 0
1117 14:49:35.798117 (+ 207us) write_op.cc:270] Start()
1117 14:49:35.798142 (+ 25us) write_op.cc:276] Timestamp: P: 1794926965176107 usec, L: 0
1117 14:49:35.798344 (+ 202us) write_op.cc:270] Start()
1117 14:49:35.798404 (+ 60us) write_op.cc:276] Timestamp: P: 1794926965189400 usec, L: 0
1117 14:49:35.798640 (+ 236us) write_op.cc:270] Start()
1117 14:49:35.798677 (+ 37us) write_op.cc:276] Timestamp: P: 1794926965218582 usec, L: 0
1117 14:49:35.798852 (+ 175us) write_op.cc:270] Start()
1117 14:49:35.798873 (+ 21us) write_op.cc:276] Timestamp: P: 1794926965251898 usec, L: 0
1117 14:49:35.799077 (+ 204us) write_op.cc:270] Start()
1117 14:49:35.799099 (+ 22us) write_op.cc:276] Timestamp: P: 1794926965259150 usec, L: 0
1117 14:49:35.799245 (+ 146us) write_op.cc:270] Start()
1117 14:49:35.799265 (+ 20us) write_op.cc:276] Timestamp: P: 1794926965259805 usec, L: 0
1117 14:49:35.799431 (+ 166us) write_op.cc:270] Start()
1117 14:49:35.799450 (+ 19us) write_op.cc:276] Timestamp: P: 1794926965266947 usec, L: 0
1117 14:49:35.799603 (+ 153us) write_op.cc:270] Start()
1117 14:49:35.799624 (+ 21us) write_op.cc:276] Timestamp: P: 1794926965294123 usec, L: 0
1117 14:49:35.799806 (+ 182us) write_op.cc:270] Start()
1117 14:49:35.799828 (+ 22us) write_op.cc:276] Timestamp: P: 1794926965317914 usec, L: 0
1117 14:49:35.806591 (+ 6763us) write_op.cc:270] Start()
1117 14:49:35.806617 (+ 26us) write_op.cc:276] Timestamp: P: 1794926965325249 usec, L: 0
1117 14:49:35.806779 (+ 162us) write_op.cc:270] Start()
1117 14:49:35.806801 (+ 22us) write_op.cc:276] Timestamp: P: 1794926965329504 usec, L: 0
1117 14:49:35.818696 (+ 11895us) write_op.cc:270] Start()
1117 14:49:35.818730 (+ 34us) write_op.cc:276] Timestamp: P: 1794926965376380 usec, L: 0
1117 14:49:35.834375 (+ 15645us) write_op.cc:270] Start()
1117 14:49:35.834412 (+ 37us) write_op.cc:276] Timestamp: P: 1794926965377215 usec, L: 0
1117 14:49:35.834580 (+ 168us) write_op.cc:270] Start()
1117 14:49:35.834597 (+ 17us) write_op.cc:276] Timestamp: P: 1794926965378139 usec, L: 0
1117 14:49:35.835795 (+ 1198us) write_op.cc:270] Start()
1117 14:49:35.835819 (+ 24us) write_op.cc:276] Timestamp: P: 1794926965431173 usec, L: 0
1117 14:49:35.868644 (+ 32825us) write_op.cc:270] Start()
1117 14:49:35.868670 (+ 26us) write_op.cc:276] Timestamp: P: 1794926965433125 usec, L: 0
1117 14:49:35.882192 (+ 13522us) write_op.cc:270] Start()
1117 14:49:35.882218 (+ 26us) write_op.cc:276] Timestamp: P: 1794926965451232 usec, L: 0
1117 14:49:35.904622 (+ 22404us) write_op.cc:270] Start()
1117 14:49:35.904650 (+ 28us) write_op.cc:276] Timestamp: P: 1794926965461030 usec, L: 0
1117 14:49:35.904841 (+ 191us) write_op.cc:270] Start()
1117 14:49:35.904877 (+ 36us) write_op.cc:276] Timestamp: P: 1794926965480267 usec, L: 0
1117 14:49:35.905035 (+ 158us) write_op.cc:270] Start()
1117 14:49:35.905063 (+ 28us) write_op.cc:276] Timestamp: P: 1794926965491949 usec, L: 0
1117 14:49:35.905273 (+ 210us) write_op.cc:270] Start()
1117 14:49:35.905295 (+ 22us) write_op.cc:276] Timestamp: P: 1794926965541425 usec, L: 0
1117 14:49:35.905459 (+ 164us) write_op.cc:270] Start()
1117 14:49:35.905480 (+ 21us) write_op.cc:276] Timestamp: P: 1794926965558164 usec, L: 0
1117 14:49:35.905640 (+ 160us) write_op.cc:270] Start()
1117 14:49:35.905660 (+ 20us) write_op.cc:276] Timestamp: P: 1794926965559798 usec, L: 0
1117 14:49:35.905811 (+ 151us) write_op.cc:270] Start()
1117 14:49:35.905831 (+ 20us) write_op.cc:276] Timestamp: P: 1794926965561744 usec, L: 0
1117 14:49:35.906005 (+ 174us) write_op.cc:270] Start()
1117 14:49:35.906027 (+ 22us) write_op.cc:276] Timestamp: P: 1794926965615277 usec, L: 0
1117 14:49:35.906214 (+ 187us) write_op.cc:270] Start()
1117 14:49:35.906235 (+ 21us) write_op.cc:276] Timestamp: P: 1794926965651126 usec, L: 0
1117 14:49:35.906375 (+ 140us) write_op.cc:270] Start()
1117 14:49:35.906393 (+ 18us) write_op.cc:276] Timestamp: P: 1794926965656889 usec, L: 0
1117 14:49:35.906532 (+ 139us) write_op.cc:270] Start()
1117 14:49:35.906552 (+ 20us) write_op.cc:276] Timestamp: P: 1794926965663861 usec, L: 0
1117 14:49:35.906712 (+ 160us) write_op.cc:270] Start()
1117 14:49:35.906735 (+ 23us) write_op.cc:276] Timestamp: P: 1794926965664966 usec, L: 0
1117 14:49:35.906891 (+ 156us) write_op.cc:270] Start()
1117 14:49:35.906909 (+ 18us) write_op.cc:276] Timestamp: P: 1794926965709801 usec, L: 0
1117 14:49:35.907070 (+ 161us) write_op.cc:270] Start()
1117 14:49:35.907090 (+ 20us) write_op.cc:276] Timestamp: P: 1794926965729083 usec, L: 0
1117 14:49:35.907229 (+ 139us) write_op.cc:270] Start()
1117 14:49:35.907248 (+ 19us) write_op.cc:276] Timestamp: P: 17949269
I20261117 14:49:39.268126 7421 raft_consensus.cc:499] T 57984748adc7482a9a2d999a447a81af P ec41d6947a4a4eadadf90c3756899704 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader def6b23bccc94a78a47118da331f2798)
I20261117 14:49:39.271165 7421 raft_consensus.cc:521] T 57984748adc7482a9a2d999a447a81af P ec41d6947a4a4eadadf90c3756899704 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:39.274683 6658 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "57984748adc7482a9a2d999a447a81af" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 3 candidate_status { last_received { term: 2 index: 784 } } ignore_live_leader: false dest_uuid: "c7900e455dd64c68bccfc499bda413f7" is_pre_election: true
I20261117 14:49:39.281371 7421 leader_election.cc:290] T 57984748adc7482a9a2d999a447a81af P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271), def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611)
I20261117 14:49:39.282459 6783 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "57984748adc7482a9a2d999a447a81af" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 3 candidate_status { last_received { term: 2 index: 784 } } ignore_live_leader: false dest_uuid: "def6b23bccc94a78a47118da331f2798" is_pre_election: true
I20261117 14:49:39.292055 7267 leader_election.cc:304] T 57984748adc7482a9a2d999a447a81af P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec41d6947a4a4eadadf90c3756899704; no voters: c7900e455dd64c68bccfc499bda413f7, def6b23bccc94a78a47118da331f2798
I20261117 14:49:39.308022 7421 raft_consensus.cc:2771] T 57984748adc7482a9a2d999a447a81af P ec41d6947a4a4eadadf90c3756899704 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20261117 14:49:39.330569 7421 raft_consensus.cc:499] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader def6b23bccc94a78a47118da331f2798)
I20261117 14:49:39.334317 7421 raft_consensus.cc:521] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:39.335129 7421 leader_election.cc:290] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271), def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611)
I20261117 14:49:39.335731 6658 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "3cea00abcccd4b1284393ef8b406cab1" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 3 candidate_status { last_received { term: 2 index: 785 } } ignore_live_leader: false dest_uuid: "c7900e455dd64c68bccfc499bda413f7" is_pre_election: true
I20261117 14:49:39.335772 6788 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "3cea00abcccd4b1284393ef8b406cab1" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 3 candidate_status { last_received { term: 2 index: 785 } } ignore_live_leader: false dest_uuid: "def6b23bccc94a78a47118da331f2798" is_pre_election: true
I20261117 14:49:39.338876 7266 leader_election.cc:304] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec41d6947a4a4eadadf90c3756899704; no voters: c7900e455dd64c68bccfc499bda413f7, def6b23bccc94a78a47118da331f2798
I20261117 14:49:39.342187 7421 raft_consensus.cc:2771] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20261117 14:49:39.446204 7421 raft_consensus.cc:499] T d1732d75bf044feb8884fc3135373072 P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7900e455dd64c68bccfc499bda413f7)
I20261117 14:49:39.447883 7421 raft_consensus.cc:521] T d1732d75bf044feb8884fc3135373072 P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:39.448666 7421 leader_election.cc:290] T d1732d75bf044feb8884fc3135373072 P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271), def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611)
I20261117 14:49:39.450995 6658 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "d1732d75bf044feb8884fc3135373072" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 2 candidate_status { last_received { term: 1 index: 784 } } ignore_live_leader: false dest_uuid: "c7900e455dd64c68bccfc499bda413f7" is_pre_election: true
I20261117 14:49:39.451196 6783 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "d1732d75bf044feb8884fc3135373072" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 2 candidate_status { last_received { term: 1 index: 784 } } ignore_live_leader: false dest_uuid: "def6b23bccc94a78a47118da331f2798" is_pre_election: true
I20261117 14:49:39.454896 7267 leader_election.cc:304] T d1732d75bf044feb8884fc3135373072 P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec41d6947a4a4eadadf90c3756899704; no voters: c7900e455dd64c68bccfc499bda413f7, def6b23bccc94a78a47118da331f2798
I20261117 14:49:39.465088 7421 raft_consensus.cc:2771] T d1732d75bf044feb8884fc3135373072 P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20261117 14:49:39.607477 7421 raft_consensus.cc:499] T 47d9af37b05545f0b5b0c033f4ec953f P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader def6b23bccc94a78a47118da331f2798)
I20261117 14:49:39.607715 7421 raft_consensus.cc:521] T 47d9af37b05545f0b5b0c033f4ec953f P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:39.608337 7421 leader_election.cc:290] T 47d9af37b05545f0b5b0c033f4ec953f P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271), def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611)
I20261117 14:49:39.609365 6783 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "47d9af37b05545f0b5b0c033f4ec953f" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 2 candidate_status { last_received { term: 1 index: 784 } } ignore_live_leader: false dest_uuid: "def6b23bccc94a78a47118da331f2798" is_pre_election: true
I20261117 14:49:39.613971 6654 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "47d9af37b05545f0b5b0c033f4ec953f" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 2 candidate_status { last_received { term: 1 index: 784 } } ignore_live_leader: false dest_uuid: "c7900e455dd64c68bccfc499bda413f7" is_pre_election: true
I20261117 14:49:39.620389 7266 leader_election.cc:304] T 47d9af37b05545f0b5b0c033f4ec953f P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec41d6947a4a4eadadf90c3756899704; no voters: c7900e455dd64c68bccfc499bda413f7, def6b23bccc94a78a47118da331f2798
I20261117 14:49:39.622696 7421 raft_consensus.cc:2771] T 47d9af37b05545f0b5b0c033f4ec953f P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20261117 14:49:38.347257 7342 rpcz_store.cc:276] 1117 14:49:35.265195 (+ 0us) service_pool.cc:167] Inserting onto call queue
1117 14:49:35.268195 (+ 3000us) service_pool.cc:224] Handling call
1117 14:49:35.424119 (+155924us) raft_consensus.cc:1481] Updating replica for 610 ops
1117 14:49:35.726066 (+301947us) raft_consensus.cc:1545] Early marking committed up to index 0
1117 14:49:35.726075 (+ 9us) raft_consensus.cc:1550] Triggering prepare for 610 ops
1117 14:49:35.745912 (+ 19837us) write_op.cc:270] Start()
1117 14:49:35.745937 (+ 25us) write_op.cc:276] Timestamp: P: 1794926962063818 usec, L: 0
1117 14:49:35.834856 (+ 88919us) write_op.cc:270] Start()
1117 14:49:35.834882 (+ 26us) write_op.cc:276] Timestamp: P: 1794926962065259 usec, L: 0
1117 14:49:35.836267 (+ 1385us) write_op.cc:270] Start()
1117 14:49:35.836296 (+ 29us) write_op.cc:276] Timestamp: P: 1794926962089275 usec, L: 0
1117 14:49:35.868955 (+ 32659us) write_op.cc:270] Start()
1117 14:49:35.868979 (+ 24us) write_op.cc:276] Timestamp: P: 1794926962096607 usec, L: 0
1117 14:49:35.869143 (+ 164us) write_op.cc:270] Start()
1117 14:49:35.869164 (+ 21us) write_op.cc:276] Timestamp: P: 1794926962112003 usec, L: 0
1117 14:49:35.869321 (+ 157us) write_op.cc:270] Start()
1117 14:49:35.869336 (+ 15us) write_op.cc:276] Timestamp: P: 1794926962121928 usec, L: 0
1117 14:49:35.869522 (+ 186us) write_op.cc:270] Start()
1117 14:49:35.869573 (+ 51us) write_op.cc:276] Timestamp: P: 1794926962644767 usec, L: 0
1117 14:49:35.869741 (+ 168us) write_op.cc:270] Start()
1117 14:49:35.869761 (+ 20us) write_op.cc:276] Timestamp: P: 1794926962652511 usec, L: 0
1117 14:49:35.869908 (+ 147us) write_op.cc:270] Start()
1117 14:49:35.869926 (+ 18us) write_op.cc:276] Timestamp: P: 1794926962678488 usec, L: 0
1117 14:49:35.913410 (+ 43484us) write_op.cc:270] Start()
1117 14:49:35.913434 (+ 24us) write_op.cc:276] Timestamp: P: 1794926962703031 usec, L: 0
1117 14:49:35.913666 (+ 232us) write_op.cc:270] Start()
1117 14:49:35.913689 (+ 23us) write_op.cc:276] Timestamp: P: 1794926962727097 usec, L: 0
1117 14:49:35.916547 (+ 2858us) write_op.cc:270] Start()
1117 14:49:35.916575 (+ 28us) write_op.cc:276] Timestamp: P: 1794926962728907 usec, L: 0
1117 14:49:35.916757 (+ 182us) write_op.cc:270] Start()
1117 14:49:35.916778 (+ 21us) write_op.cc:276] Timestamp: P: 1794926962742427 usec, L: 0
1117 14:49:35.916918 (+ 140us) write_op.cc:270] Start()
1117 14:49:35.916935 (+ 17us) write_op.cc:276] Timestamp: P: 1794926962774478 usec, L: 0
1117 14:49:35.917085 (+ 150us) write_op.cc:270] Start()
1117 14:49:35.917106 (+ 21us) write_op.cc:276] Timestamp: P: 1794926962782808 usec, L: 0
1117 14:49:35.917275 (+ 169us) write_op.cc:270] Start()
1117 14:49:35.917295 (+ 20us) write_op.cc:276] Timestamp: P: 1794926962799926 usec, L: 0
1117 14:49:35.917456 (+ 161us) write_op.cc:270] Start()
1117 14:49:35.917493 (+ 37us) write_op.cc:276] Timestamp: P: 1794926962801011 usec, L: 0
1117 14:49:35.917668 (+ 175us) write_op.cc:270] Start()
1117 14:49:35.917686 (+ 18us) write_op.cc:276] Timestamp: P: 1794926962834636 usec, L: 0
1117 14:49:35.917846 (+ 160us) write_op.cc:270] Start()
1117 14:49:35.917867 (+ 21us) write_op.cc:276] Timestamp: P: 1794926962835787 usec, L: 0
1117 14:49:35.937028 (+ 19161us) write_op.cc:270] Start()
1117 14:49:35.937053 (+ 25us) write_op.cc:276] Timestamp: P: 1794926962843417 usec, L: 0
1117 14:49:35.937226 (+ 173us) write_op.cc:270] Start()
1117 14:49:35.937245 (+ 19us) write_op.cc:276] Timestamp: P: 1794926962853669 usec, L: 0
1117 14:49:35.937359 (+ 114us) write_op.cc:270] Start()
1117 14:49:35.937375 (+ 16us) write_op.cc:276] Timestamp: P: 1794926962896375 usec, L: 0
1117 14:49:35.937483 (+ 108us) write_op.cc:270] Start()
1117 14:49:35.937510 (+ 27us) write_op.cc:276] Timestamp: P: 1794926962907798 usec, L: 0
1117 14:49:35.937621 (+ 111us) write_op.cc:270] Start()
1117 14:49:35.937636 (+ 15us) write_op.cc:276] Timestamp: P: 1794926962913088 usec, L: 0
1117 14:49:35.937762 (+ 126us) write_op.cc:270] Start()
1117 14:49:35.937781 (+ 19us) write_op.cc:276] Timestamp: P: 1794926962923607 usec, L: 0
1117 14:49:35.937960 (+ 179us) write_op.cc:270] Start()
1117 14:49:35.937983 (+ 23us) write_op.cc:276] Timestamp: P: 1794926962950121 usec, L: 0
1117 14:49:35.938167 (+ 184us) write_op.cc:270] Start()
1117 14:49:35.938188 (+ 21us) write_op.cc:276] Timestamp: P: 1794926962967999 usec, L: 0
1117 14:49:35.938316 (+ 128us) write_op.cc:270] Start()
1117 14:49:35.938332 (+ 16us) write_op.cc:276] Timestamp: P: 1794926962974421 usec, L: 0
1117 14:49:35.938509 (+ 177us) write_op.cc:270] Start()
1117 14:49:35.938526 (+ 17us) write_op.cc:276] Timestamp: P: 1794926962986429 usec, L: 0
1117 14:49:35.938649 (+ 123us) write_op.cc:270] Start()
1117 14:49:35.938665 (+ 16us) write_op.cc:276] Timestamp: P: 1794926962996190 usec, L: 0
1117 14:49:35.942916 (+ 4251us) write_op.cc:270] Start()
1117 14:49:35.942941 (+ 25us) write_op.cc:276] Timestamp: P: 1794926963038458 usec, L: 0
1117 14:49:35.943121 (+ 180us) write_op.cc:270] Start()
1117 14:49:35.943142 (+ 21us) write_op.cc:276] Timestamp: P: 1794926963044192 usec, L: 0
1117 14:49:35.943351 (+ 209us) write_op.cc:270] Start()
1117 14:49:35.943374 (+ 23us) write_op.cc:276] Timestamp: P: 1794926963048022 usec, L: 0
1117 14:49:35.943558 (+ 184us) write_op.cc:270] Start()
1117 14:49:35.943578 (+ 20us) write_op.cc:276] Timestamp: P: 1794926963054709 usec, L: 0
1117 14:49:35.943806 (+ 228us) write_op.cc:270] Start()
1117 14:49:35.943829 (+ 23us) write_op.cc:276] Timestamp: P: 1794926963102054 usec, L: 0
1117 14:49:35.944039 (+ 210us) write_op.cc:270] Start()
1117 14:49:35.953174 (+ 9135us) write_op.cc:276] Timestamp: P: 1794926963103206 usec, L: 0
1117 14:49:35.953340 (+ 166us) write_op.cc:270] Start()
1117 14:49:35.953418 (+ 78us) write_op.cc:276] Timestamp: P: 1794926963124236 usec, L: 0
1117 14:49:35.953920 (+ 502us) write_op.cc:270] Start()
1117 14:49:35.953938 (+ 18us) write_op.cc:276] Timestamp: P: 1794926963125044 usec, L: 0
1117 14:49:35.954073 (+ 135us) write_op.cc:270] Start()
1117 14:49:35.954092 (+ 19us) write_op.cc:276] Timestamp: P: 1794926963151121 usec, L: 0
1117 14:49:35.955121 (+ 1029us) write_op.cc:270] Start()
1117 14:49:35.955144 (+ 23us) write_op.cc:276] Timestamp: P: 1794926963175664 usec, L: 0
1117 14:49:35.955315 (+ 171us) write_op.cc:270] Start()
1117 14:49:35.955337 (+ 22us) write_op.cc:276] Timestamp: P: 1794926963193212 usec, L: 0
1117 14:49:35.957422 (+ 2085us) write_op.cc:270] Start()
1117 14:49:35.957446 (+ 24us) write_op.cc:276] Timestamp: P: 1794926963193956 usec, L: 0
1117 14:49:35.957632 (+ 186us) write_op.cc:270] Start()
1117 14:49:35.957653 (+ 21us) write_op.cc:276] Timestamp: P: 1794926963224539 usec, L: 0
1117 14:49:35.957799 (+ 146us) write_op.cc:270] Start()
1117 14:49:35.957819 (+ 20us) write_op.cc:276] Timestamp: P: 1794926963239801 usec, L: 0
1117 14:49:35.957975 (+ 156us) write_op.cc:270] Start()
1117 14:49:35.957999 (+ 24us) write_op.cc:276] Timestamp: P: 1794926963261874 usec, L: 0
1117 14:49:35.958171 (+ 172us) write_op.cc:270] Start()
1117 14:49:35.958192 (+ 21us) write_op.cc:276] Timestamp: P: 1794926963272434 usec, L: 0
1117 14:49:35.958349 (+ 157us) write_op.cc:270] Start()
1117 14:49:35.958369 (+ 20us) write_op.cc:276] Timestamp: P: 1794926963295174 usec, L: 0
1117 14:49:35.958571 (+ 202us) write_op.cc:270] Start()
1117 14:49:35.958598 (+ 27us) write_op.cc:276] Timestamp: P: 1794926963302791 usec, L: 0
1117 14:49:35.958755 (+ 157us) write_op.cc:270] Start()
1117 14:49:35.958774 (+ 19us) write_op.cc:276] Timestamp: P: 1794926963306773 usec, L: 0
1117 14:49:35.958931 (+ 157us) write_op.cc:270] Start()
1117 14:49:35.958951 (+ 20us) write_op.cc:276] Timestamp: P: 1794926963343443 usec, L: 0
1117 14:49:35.959170 (+ 219us) write_op.cc:270] Start()
1117 14:49:35.959191 (+ 21us) write_op.cc:276] Timestamp: P: 1794926963359067 usec, L: 0
1117 14:49:35.959352 (+ 161us) write_op.cc:270] Start()
1117 14:49:35.959371 (+ 19us) write_op.cc:276] Timestamp: P: 1794926963369715 usec, L: 0
1117 14:49:35.959555 (+ 184us) write_op.cc:270] Start()
1117 14:49:35.959575 (+ 20us) write_op.cc:276] Timestamp: P: 1794926963400624 usec, L: 0
1117 14:49:35.989641 (+ 30066us) write_op.cc:270] Start()
1117 14:49:35.989667 (+ 26us) write_op.cc:276] Timestamp: P: 1794926963407909 usec, L: 0
1117 14:49:36.009249 (+ 19582us) write_op.cc:270] Start()
1117 14:49:36.009272 (+ 23us) write_op.cc:276] Timestamp: P: 1794926963413866 usec, L: 0
1117 14:49:36.009449 (+ 177us) write_op.cc:270] Start()
1117 14:49:36.009469 (+ 20us) write_op.cc:276] Timestamp: P: 1794926963414793 usec, L: 0
1117 14:49:36.009719 (+ 250us) write_op.cc:270] Start()
1117 14:49:36.009741 (+ 22us) write_op.cc:276] Timestamp: P: 1794926963449081 usec, L: 0
1117 14:49:36.009915 (+ 174us) write_op.cc:270] Start()
1117 14:49:36.009936 (+ 21us) write_op.cc:276] Timestamp: P: 1794926963462589 usec, L: 0
1117 14:49:36.010126 (+ 190us) write_op.cc:270] Start()
1117 14:49:36.010147 (+ 21us) write_op.cc:276] Timestamp: P: 1794926963479802 usec, L: 0
1117 14:49:36.010302 (+ 155us) write_op.cc:270] Start()
1117 14:49:36.010343 (+ 41us) write_op.cc:276] Timestamp: P: 1794926963491649 usec, L: 0
1117 14:49:36.010537 (+ 194us) write_op.cc:270] Start()
1117 14:49:36.010560 (+ 23us) write_op.cc:276] Timestamp: P: 1794926963510090 usec, L: 0
1117 14:49:36.010702 (+ 142us) write_op.cc:270] Start()
1117 14:49:36.010721 (+ 19us) write_op.cc:276] Timestamp: P: 1794926963523926 usec, L: 0
1117 14:49:36.011967 (+ 1246us) write_op.cc:270] Start()
1117 14:49:36.011991 (+ 24us) write_op.cc:276] Timestamp: P: 1794926963525828 usec, L: 0
1117 14:49:36.012185 (+ 194us) write_op.cc:270] Start()
1117 14:49:36.012213 (+ 28us) write_op.cc:276] Timestamp: P: 1794926963574001 usec, L: 0
1117 14:49:36.012433 (+ 220us) write_op.cc:270] Start()
1117 14:49:36.012474 (+ 41us) write_op.cc:276] Timestamp: P: 1794926963577494 usec, L: 0
1117 14:49:36.014470 (+ 1996us) write_op.cc:270] Start()
1117 14:49:36.014509 (+ 39us) write_op.cc:276] Timestamp: P: 1794926963597492 usec, L: 0
1117 14:49:36.014714 (+ 205us) write_op.cc:270] Start()
1117 14:49:36.014734 (+ 20us) write_op.cc:276] Timestamp: P: 1794926963621611 usec, L: 0
1117 14:49:36.014890 (+ 156us) write_op.cc:270] Start()
1117 14:49:36.014911 (+ 21us) write_op.cc:276] Timestamp: P: 1794926963633120 usec, L: 0
1117 14:49:36.015096 (+ 185us) write_op.cc:270] Start()
1117 14:49:36.015120 (+ 24us) write_op.cc:276] Timestamp: P: 1794926963655226 usec, L: 0
1117 14:49:36.015264 (+ 144us) write_op.cc:270] Start()
1117 14:49:36.015285 (+ 21us) write_op.cc:276] Timestamp: P: 1794926963657401 usec, L: 0
1117 14:49:36.015447 (+ 162us) write_op.cc:270] Start()
1117 14:49:36.015472 (+ 25us) write_op.cc:276] Timestamp: P: 1794926963666084 usec, L: 0
1117 14:49:36.015646 (+ 174us) write_op.cc:270] Start()
1117 14:49:36.015677 (+ 31us) write_op.cc:276] Timestamp: P: 1794926963685073 usec, L: 0
1117 14:49:36.015879 (+ 202us) write_op.cc:270] Start()
1117 14:49:36.015901 (+ 22us) write_op.cc:276] Timestamp: P: 1794926963703622 usec, L: 0
1117 14:49:36.016067 (+ 166us) write_op.cc:270] Start()
1117 14:49:36.016091 (+ 24us) write_op.cc:276] Timestamp: P: 1794926963713484 usec, L: 0
1117 14:49:36.016233 (+ 142us) write_op.cc:270] Start()
1117 14:49:36.016252 (+ 19us) write_op.cc:276] Timestamp: P: 1794926963720316 usec, L: 0
1117 14:49:36.016421 (+ 169us) write_op.cc:270] Start()
1117 14:49:36.016475 (+ 54us) write_op.cc:276] Timestamp: P: 1794926963746234 usec, L: 0
1117 14:49:36.016673 (+ 198us) write_op.cc:270] Start()
1117 14:49:36.016725 (+ 52us) write_op.cc:276] Timestamp: P: 1794926963767120 usec, L: 0
1117 14:49:36.016904 (+ 179us) write_op.cc:270] Start()
1117 14:49:36.016923 (+ 19us) write_op.cc:276] Timestamp: P: 1794926963767694 usec, L: 0
1117 14:49:36.017061 (+ 138us) write_op.cc:270] Start()
1117 14:49:36.017140 (+ 79us) write_op.cc:276] Timestamp: P: 1794926963769832 usec, L: 0
1117 14:49:36.017318 (+ 178us) write_op.cc:270] Start()
1117 14:49:36.017332 (+ 14us) write_op.cc:276] Timestamp: P: 1794926963803038 usec, L: 0
1117 14:49:36.021738 (+ 4406us) write_op.cc:270] Start()
1117 14:49:36.021757 (+ 19us) write_op.cc:276] Timestamp: P: 1794926963819499 usec, L: 0
1117 14:49:36.023721 (+ 1964us) write_op.cc:270] Start()
1117 14:49:36.023739 (+ 18us) write_op.cc:276] Timestamp: P: 1794926963837782 usec, L: 0
1117 14:49:36.023936 (+ 197us) write_op.cc:270] Start()
1117 14:49:36.023957 (+ 21us) write_op.cc:276] Timestamp: P: 1794926963849876 usec, L: 0
1117 14:49:36.024120 (+ 163us) write_op.cc:270] Start()
1117 14:49:36.024136 (+ 16us) write_op.cc:276] Timestamp: P: 1794926963867793 usec, L: 0
1117 14:49:36.024276 (+ 140us) write_op.cc:270] Start()
1117 14:49:36.024292 (+ 16us) write_op.cc:276] Timestamp: P: 1794926963892874 usec, L: 0
1117 14:49:36.024411 (+ 119us) write_op.cc:270] Start()
1117 14:49:36.024426 (+ 15us) write_op.cc:276] Timestamp: P: 1794926963901910 usec, L: 0
1117 14:49:36.030664 (+ 6238us) write_op.cc:270] Start()
1117 14:49:36.030684 (+ 20us) write_op.cc:276] Timestamp: P: 1794926963913733 usec, L: 0
1117 14:49:36.030868 (+ 184us) write_op.cc:270] Start()
1117 14:49:36.030886 (+ 18us) write_op.cc:276] Timestamp: P: 1794926963928695 usec, L: 0
1117 14:49:36.031004 (+ 118us) write_op.cc:270] Start()
1117 14:49:36.031021 (+ 17us) write_op.cc:276] Timestamp: P: 1794926963944387 usec, L: 0
1117 14:49:36.031173 (+ 152us) write_op.cc:270] Start()
1117 14:49:36.031190 (+ 17us) write_op.cc:276] Timestamp: P: 1794926963960384 usec, L: 0
1117 14:49:36.031314 (+ 124us) write_op.cc:270] Start()
1117 14:49:36.031330 (+ 16us) write_op.cc:276] Timestamp: P: 1794926963986612 usec, L: 0
1117 14:49:36.031438 (+ 108us) write_op.cc:270] Start()
1117 14:49:36.031454 (+ 16us) write_op.cc:276] Timestamp: P: 1794926964002601 usec, L: 0
1117 14:49:36.031587 (+ 133us) write_op.cc:270] Start()
1117 14:49:36.031603 (+ 16us) write_op.cc:276] Timestamp: P: 1794926964003396 usec, L: 0
1117 14:49:36.031711 (+ 108us) write_op.cc:270] Start()
1117 14:49:36.031727 (+ 16us) write_op.cc:276] Timestamp: P: 1794926964038817 usec, L: 0
1117 14:49:36.031854 (+ 127us) write_op.cc:270] Start()
1117 14:49:36.031870 (+ 16us) write_op.cc:276] Timestamp: P: 1794926964048965 usec, L: 0
1117 14:49:36.032031 (+ 161us) write_op.cc:270] Start()
1117 14:49:36.032049 (+ 18us) write_op.cc:276] Timestamp: P: 1794926964055332 usec, L: 0
1117 14:49:36.032162 (+ 113us) write_op.cc:270] Start()
1117 14:49:36.032178 (+ 16us) write_op.cc:276] Timestamp: P: 1794926964063510 usec, L: 0
1117 14:49:36.032295 (+ 117us) write_op.cc:270] Start()
1117 14:49:36.032334 (+ 39us) write_op.cc:276] Timestamp: P: 1794926964077889 usec, L: 0
1117 14:49:36.032505 (+ 171us) write_op.cc:270] Start()
1117 14:49:36.032528 (+ 23us) write_op.cc:276] Timestamp: P: 1794926964117505 usec, L: 0
1117 14:49:36.032697 (+ 169us) write_op.cc:270] Start()
1117 14:49:36.032717 (+ 20us) write_op.cc:276] Timestamp: P: 1794926964121590 usec, L: 0
1117 14:49:36.032861 (+ 144us) write_op.cc:270] Start()
1117 14:49:36.032881 (+ 20us) write_op.cc:276] Timestamp: P: 1794926964141342 usec, L: 0
1117 14:49:36.033067 (+ 186us) write_op.cc:270] Start()
1117 14:49:36.033088 (+ 21us) write_op.cc:276] Timestamp: P: 1794926964160035 usec, L: 0
1117 14:49:36.033237 (+ 149us) write_op.cc:270] Start()
1117 14:49:36.033255 (+ 18us) write_op.cc:276] Timestamp: P: 1794926964166170 usec, L: 0
1117 14:49:36.033397 (+ 142us) write_op.cc:270] Start()
1117 14:49:36.033416 (+ 19us) write_op.cc:276] Timestamp: P: 1794926964170253 usec, L: 0
1117 14:49:36.033576 (+ 160us) write_op.cc:270] Start()
1117 14:49:36.033596 (+ 20us) write_op.cc:276] Timestamp: P: 1794926964195652 usec, L: 0
1117 14:49:36.033736 (+ 140us) write_op.cc:270] Start()
1117 14:49:36.033762 (+ 26us) write_op.cc:276] Timestamp: P: 1794926964230291 usec, L: 0
1117 14:49:36.033920 (+ 158us) write_op.cc:270] Start()
1117 14:49:36.033941 (+ 21us) write_op.cc:276] Timestamp: P: 1794926964248880 usec, L: 0
1117 14:49:36.057414 (+ 23473us) write_op.cc:270] Start()
1117 14:49:36.057452 (+ 38us) write_op.cc:276] Timestamp: P: 1794926964249635 usec, L: 0
1117 14:49:36.057605 (+ 153us) write_op.cc:270] Start()
1117 14:49:36.057624 (+ 19us) write_op.cc:276] Timestamp: P: 1794926964250787 usec, L: 0
1117 14:49:36.057758 (+ 134us) write_op.cc:270] Start()
1117 14:49:36.057776 (+ 18us) write_op.cc:276] Timestamp: P: 1794926964290424 usec, L: 0
1117 14:49:36.057926 (+ 150us) write_op.cc:270] Start()
1117 14:49:36.057947 (+ 21us) write_op.cc:276] Timestamp: P: 1794926964296063 usec, L: 0
1117 14:49:36.058085 (+ 138us) write_op.cc:270] Start()
1117 14:49:36.058110 (+ 25us) write_op.cc:276] Timestamp: P: 1794926964296858 usec, L: 0
1117 14:49:36.058235 (+ 125us) write_op.cc:270] Start()
1117 14:49:36.058252 (+ 17us) write_op.cc:276] Timestamp: P: 1794926964310422 usec, L: 0
1117 14:49:36.058371 (+ 119us) write_op.cc:270] Start()
1117 14:49:36.058390 (+ 19us) write_op.cc:276] Timestamp: P: 1794926964341627 usec, L: 0
1117 14:49:36.058576 (+ 186us) write_op.cc:270] Start()
1117 14:49:36.058600 (+ 24us) write_op.cc:276] Timestamp: P: 1794926964358339 usec, L: 0
1117 14:49:36.058821 (+ 221us) write_op.cc:270] Start()
1117 14:49:36.058845 (+ 24us) write_op.cc:276] Timestamp: P: 1794926964365313 usec, L: 0
1117 14:49:36.059023 (+ 178us) write_op.cc:270] Start()
1117 14:49:36.059047 (+ 24us) write_op.cc:276] Timestamp: P: 1794926964374417 usec, L: 0
1117 14:49:36.059204 (+ 157us) write_op.cc:270] Start()
1117 14:49:36.059227 (+ 23us) write_op.cc:276] Timestamp: P: 1794926964398538 usec, L: 0
1117 14:49:36.059379 (+ 152us) write_op.cc:270] Start()
1117 14:49:36.059401 (+ 22us) write_op.cc:276] Timestamp: P: 1794926964433013 usec, L: 0
1117 14:49:36.059589 (+ 188us) write_op.cc:270] Start()
1117 14:49:36.059609 (+ 20us) write_op.cc:276] Timestamp: P: 1794926964434026 usec, L: 0
1117 14:49:36.059760 (+ 151us) write_op.cc:270] Start()
1117 14:49:36.059781 (+ 21us) write_op.cc:276] Timestamp: P: 1794926964435795 usec, L: 0
1117 14:49:36.059973 (+ 192us) write_op.cc:270] Start()
1117 14:49:36.059997 (+ 24us) write_op.cc:276] Timestamp: P: 1794926964443982 usec, L: 0
1117 14:49:36.060179 (+ 182us) write_op.cc:270] Start()
1117 14:49:36.060202 (+ 23us) write_op.cc:276] Timestamp: P: 1794926964483406 usec, L: 0
1117 14:49:36.060385 (+ 183us) write_op.cc:270] Start()
1117 14:49:36.060406 (+ 21us) write_op.cc:276] Timestamp: P: 1794926964504289 usec, L: 0
1117 14:49:36.092631 (+ 32225us) write_op.cc:270] Start()
1117 14:49:36.092655 (+ 24us) write_op.cc:276] Timestamp: P: 1794926964509332 usec, L: 0
1117 14:49:36.092813 (+ 158us) write_op.cc:270] Start()
1117 14:49:36.092834 (+ 21us) write_op.cc:276] Timestamp: P: 1794926964524358 usec, L: 0
1117 14:49:36.092995 (+ 161us) write_op.cc:270] Start()
1117 14:49:36.093020 (+ 25us) write_op.cc:276] Timestamp: P: 1794926964538507 usec, L: 0
1117 14:49:36.093232 (+ 212us) write_op.cc:270] Start()
1117 14:49:36.093256 (+ 24us) write_op.cc:276] Timestamp: P: 1794926964552802 usec, L: 0
1117 14:49:36.093506 (+ 250us) write_op.cc:270] Start()
1117 14:49:36.093534 (+ 28us) write_op.cc:276] Timestamp: P: 1794926964570377 usec, L: 0
1117 14:49:36.093702 (+ 168us) write_op.cc:270] Start()
1117 14:49:36.093734 (+ 32us) write_op.cc:276] Timestamp: P: 1794926964573600 usec, L: 0
1117 14:49:36.093867 (+ 133us) write_op.cc:270] Start()
1117 14:49:36.093906 (+ 39us) write_op.cc:276] Timestamp: P: 1794926964583505 usec, L: 0
1117 14:49:36.094040 (+ 134us) write_op.cc:270] Start()
1117 14:49:36.094057 (+ 17us) write_op.cc:276] Timestamp: P: 1794926964612880 usec, L: 0
1117 14:49:36.094177 (+ 120us) write_op.cc:270] Start()
1117 14:49:36.094194 (+ 17us) write_op.cc:276] Timestamp: P: 1794926964621317 usec, L: 0
1117 14:49:36.094326 (+ 132us) write_op.cc:270] Start()
1117 14:49:36.094342 (+ 16us) write_op.cc:276] Timestamp: P: 1794926964630070 usec, L: 0
1117 14:49:36.094465 (+ 123us) write_op.cc:270] Start()
1117 14:49:36.094482 (+ 17us) write_op.cc:276] Timestamp: P: 1794926964654609 usec, L: 0
1117 14:49:36.094614 (+ 132us) write_op.cc:270] Start()
1117 14:49:36.094630 (+ 16us) write_op.cc:276] Timestamp: P: 1794926964688046 usec, L: 0
1117 14:49:36.094761 (+ 131us) write_op.cc:270] Start()
1117 14:49:36.094778 (+ 17us) write_op.cc:276] Timestamp: P: 1794926964695593 usec, L: 0
1117 14:49:36.094893 (+ 115us) write_op.cc:270] Start()
1117 14:49:36.094909 (+ 16us) write_op.cc:276] Timestamp: P: 1794926964706997 usec, L: 0
1117 14:49:36.095028 (+ 119us) write_op.cc:270] Start()
1117 14:49:36.095044 (+ 16us) write_op.cc:276] Timestamp: P: 1794926964721494 usec, L: 0
1117 14:49:36.095161 (+ 117us) write_op.cc:270] Start()
1117 14:49:36.095177 (+ 16us) write_op.cc:276] Timestamp: P: 1794926964732799 usec, L: 0
1117 14:49:36.095312 (+ 135us) write_op.cc:270] Start()
1117 14:49:36.095329 (+ 17us) write_op.cc:276] Timestamp: P: 1794926964753499 usec, L: 0
1117 14:49:36.095474 (+ 145us) write_op.cc:270] Start()
1117 14:49:36.095492 (+ 18us) write_op.cc:276] Timestamp: P: 1794926964767591 usec, L: 0
1117 14:49:36.095620 (+ 128us) write_op.cc:270] Start()
1117 14:49:36.095637 (+ 17us) write_op.cc:276] Timestamp: P: 1794926964793637 usec, L: 0
1117 14:49:36.095761 (+ 124us) write_op.cc:270] Start()
1117 14:49:36.095777 (+ 16us) write_op.cc:276] Timestamp: P: 1794926964814607 usec, L: 0
1117 14:49:36.095898 (+ 121us) write_op.cc:270] Start()
1117 14:49:36.095916 (+ 18us) write_op.cc:276] Timestamp: P: 1794926964815266 usec, L: 0
1117 14:49:36.096079 (+ 163us) write_op.cc:270] Start()
1117 14:49:36.096125 (+ 46us) write_op.cc:276] Timestamp: P: 1794926964816706 usec, L: 0
1117 14:49:36.096252 (+ 127us) write_op.cc:270] Start()
1117 14:49:36.096269 (+ 17us) write_op.cc:276] Timestamp: P: 1794926964851597 usec, L: 0
1117 14:49:36.096397 (+ 128us) write_op.cc:270] Start()
1117 14:49:36.096414 (+ 17us) write_op.cc:276] Timestamp: P: 1794926964864098 usec, L: 0
1117 14:49:36.105325 (+ 8911us) write_op.cc:270] Start()
1117 14:49:36.105348 (+ 23us) write_op.cc:276] Timestamp: P: 1794926964869199 usec, L: 0
1117 14:49:36.121491 (+ 16143us) write_op.cc:270] Start()
1117 14:49:36.121521 (+ 30us) write_op.cc:276] Timestamp: P: 1794926964871888 usec, L: 0
1117 14:49:36.130282 (+ 8761us) write_op.cc:270] Start()
1117 14:49:36.130307 (+ 25us) write_op.cc:276] Timestamp: P: 1794926964930260 usec, L: 0
1117 14:49:36.130490 (+ 183us) write_op.cc:270] Start()
1117 14:49:36.130511 (+ 21us) write_op.cc:276] Timestamp: P: 1794926964936066 usec, L: 0
1117 14:49:36.196069 (+ 65558us) write_op.cc:270] Start()
1117 14:49:36.220873 (+ 24804us) write_op.cc:276] Timestamp: P: 1794926964937379 usec, L: 0
1117 14:49:36.221049 (+ 176us) write_op.cc:270] Start()
1117 14:49:36.221068 (+ 19us) write_op.cc:276] Timestamp: P: 1794926964963245 usec, L: 0
1117 14:49:36.247302 (+ 26234us) write_op.cc:270] Start()
1117 14:49:36.247328 (+ 26us) write_op.cc:276] Timestamp: P: 1794926964982783 usec, L: 0
1117 14:49:36.251164 (+ 3836us) write_op.cc:270] Start()
1117 14:49:36.251191 (+ 27us) write_op.cc:276] Timestamp: P: 1794926964988695 usec, L: 0
1117 14:49:36.255593 (+ 4402us) write_op.cc:270] Start()
1117 14:49:36.255624 (+ 31us) write_op.cc:276] Timestamp: P: 1794926964993596 usec, L: 0
1117 14:49:36.256040 (+ 416us) write_op.cc:270] Start()
1117 14:49:36.256067 (+ 27us) write_op.cc:276] Timestamp: P: 1794926965002294 usec, L: 0
1117 14:49:36.270753 (+ 14686us) write_op.cc:270] Start()
1117 14:49:36.270792 (+ 39us) write_op.cc:276] Timestamp: P: 1794926965039483 usec, L: 0
1117 14:49:36.289171 (+ 18379us) write_op.cc:270] Start()
1117 14:49:36.289201 (+ 30us) write_op.cc:276] Timestamp: P: 1794926965065985 usec, L: 0
1117 14:49:36.291786 (+ 2585us) spinlock_profiling.cc:245] Waited 2.36 ms on lock 0x60f00001a288. stack: 00007f9a08fa33a6 00007f9a08fa3160 00007f9a07f9434d 00007f9a1f567704 00007f9a1f5676cd 00007f9a1f56709a 00007f9a121160b8 00007f9a1505c919 00007f9a15003c49 00007f9a15001417 00007f9a18ed38cd 00007f9a1303bae6 00007f9a1303b815 00007f9a100eb8de 00007f9a100ea7be 00007f9a100f09f8
1117 14:49:36.315168 (+ 23382us) write_op.cc:270] Start()
1117 14:49:36.315199 (+ 31us) write_op.cc:276] Timestamp: P: 1794926965082193 usec, L: 0
1117 14:49:36.315395 (+ 196us) write_op.cc:270] Start()
1117 14:49:36.325128 (+ 9733us) write_op.cc:276] Timestamp: P: 1794926965087503 usec, L: 0
1117 14:49:36.332702 (+ 7574us) write_op.cc:270] Start()
1117 14:49:36.332733 (+ 31us) write_op.cc:276] Timestamp: P: 1794926965115293 usec, L: 0
1117 14:49:36.332974 (+ 241us) write_op.cc:270] Start()
1117 14:49:36.333001 (+ 27us) write_op.cc:276] Timestamp: P: 1794926965133819 usec, L: 0
1117 14:49:36.333190 (+ 189us) write_op.cc:270] Start()
1117 14:49:36.333214 (+ 24us) write_op.cc:276] Timestamp: P: 1794926965142643 usec, L: 0
1117 14:49:36.333404 (+ 190us) write_op.cc:270] Start()
1117 14:49:36.333447 (+ 43us) write_op.cc:276] Timestamp: P: 1794926965155416 usec, L: 0
1117 14:49:36.333618 (+ 171us) write_op.cc:270] Start()
1117 14:49:36.336215 (+ 2597us) write_op.cc:276] Timestamp: P: 1794926965164010 usec, L: 0
1117 14:49:36.345843 (+ 9628us) write_op.cc:270] Start()
1117 14:49:36.349045 (+ 3202us) write_op.cc:276] Timestamp: P: 1794926965196579 usec, L: 0
1117 14:49:36.349701 (+ 656us) write_op.cc:270] Start()
1117 14:49:36.349723 (+ 22us) write_op.cc:276] Timestamp: P: 1794926965203801 usec, L: 0
1117 14:49:36.353723 (+ 4000us) write_op.cc:270] Start()
1117 14:49:36.353744 (+ 21us) write_op.cc:276] Timestamp: P: 1794926965214822 usec, L: 0
1117 14:49:36.353911 (+ 167us) write_op.cc:270] Start()
1117 14:49:36.353932 (+ 21us) write_op.cc:276] Timestamp: P: 1794926965246684 usec, L: 0
1117 14:49:36.354084 (+ 152us) write_op.cc:270] Start()
1117 14:49:36.354107 (+ 23us) write_op.cc:276] Timestamp: P: 1794926965256985 usec, L: 0
1117 14:49:36.354290 (+ 183us) write_op.cc:270] Start()
1117 14:49:36.354312 (+ 22us) write_op.cc:276] Timestamp: P: 1794926965257920 usec, L: 0
1117 14:49:36.354499 (+ 187us) write_op.cc:270] Start()
1117 14:49:36.354521 (+ 22us) write_op.cc:276] Timestamp: P: 1794926965274616 usec, L: 0
1117 14:49:36.354688 (+ 167us) write_op.cc:270] Start()
1117 14:49:36.354707 (+ 19us) write_op.cc:276] Timestamp: P: 1794926965300801 usec, L: 0
1117 14:49:36.354832 (+ 125us) write_op.cc:270] Start()
1117 14:49:36.354849 (+ 17us) write_op.cc:276] Timestamp: P: 1794926965311324 usec, L: 0
1117 14:49:36.354969 (+ 120us) write_op.cc:270] Start()
1117 14:49:36.354986 (+ 17us) write_op.cc:276] Timestamp: P: 1794926965312627 usec, L: 0
1117 14:49:36.355108 (+ 122us) write_op.cc:270] Start()
1117 14:49:36.355145 (+ 37us) write_op.cc:276] Timestamp: P: 1794926965346793 usec, L: 0
1117 14:49:36.356332 (+ 1187us) write_op.cc:270] Start()
1117 14:49:36.356358 (+ 26us) write_op.cc:276] Timestamp: P: 1794926965362711 usec, L: 0
1117 14:49:36.356586 (+ 228us) write_op.cc:270] Start()
1117 14:49:36.356611 (+ 25us) write_op.cc:276] Timestamp: P: 1794926965371247 usec, L: 0
1117 14:49:36.365771 (+ 9160us) write_op.cc:270] Start()
1117 14:49:36.365792 (+ 21us) write_op.cc:276] Timestamp: P: 1794926965382973 usec, L: 0
1117 14:49:36.365941 (+ 149us) write_op.cc:270] Start()
1117 14:49:36.365961 (+ 20us) write_op.cc:276] Timestamp: P: 1794926965414917 usec, L: 0
1117 14:49:36.366121 (+ 160us) write_op.cc:270] Start()
1117 14:49:36.366142 (+ 21us) write_op.cc:276] Timestamp: P: 1794926965427786 usec, L: 0
1117 14:49:36.376323 (+ 10181us) write_op.cc:270] Start()
1117 14:49:36.376348 (+ 25us) write_op.cc:276] Timestamp: P: 1794926965445674 usec, L: 0
1117 14:49:36.389332 (+ 12984us) write_op.cc:270] Start()
1117 14:49:36.389361 (+ 29us) write_op.cc:276] Timestamp: P: 1794926965455944 usec, L: 0
1117 14:49:36.389564 (+ 203us) write_op.cc:270] Start()
1117 14:49:36.389590 (+ 26us) write_op.cc:276] Timestamp: P: 1794926965466631 usec, L: 0
1117 14:49:36.389770 (+ 180us) write_op.cc:270] Start()
1117 14:49:36.389794 (+ 24us) write_op.cc:276] Timestamp: P: 1794926965478021 usec, L: 0
1117 14:49:36.389965 (+ 171us) write_op.cc:270] Start()
1117 14:49:36.389988 (+ 23us) write_op.cc:276] Timestamp: P: 1794926965537657 usec, L: 0
1117 14:49:36.390165 (+ 177us) write_op.cc:270] Start()
1117 14:49:36.390190 (+ 25us) write_op.cc:276] Timestamp: P: 1794926965549415 usec, L: 0
1117 14:49:36.390360 (+ 170us) write_op.cc:270] Start()
1117 14:49:36.390385 (+ 25us) write_op.cc:276] Timestamp: P: 1794926965554327 usec, L: 0
1117 14:49:36.390575 (+ 190us) write_op.cc:270] Start()
1117 14:49:36.390600 (+ 25us) write_op.cc:276] Timestamp: P: 1794926965568376 usec, L: 0
1117 14:49:36.390780 (+ 180us) write_op.cc:270] Start()
1117 14:49:36.390803 (+ 23us) write_op.cc:276] Timestamp: P: 1794926965597851 usec, L: 0
1117 14:49:36.390979 (+ 176us) write_op.cc:270] Start()
1117 14:49:36.391005 (+ 26us) write_op.cc:276] Timestamp: P: 1794926965629565 usec, L: 0
1117 14:49:36.391188 (+ 183us) write_op.cc:270] Start()
1117 14:49:36.391225 (+ 37us) write_op.cc:276] Timestamp: P: 1794926965646985 usec, L: 0
1117 14:49:36.391415 (+ 190us) write_op.cc:270] St
I20261117 14:49:38.314863 7347 rpcz_store.cc:276] 1117 14:49:35.107143 (+ 0us) service_pool.cc:167] Inserting onto call queue
1117 14:49:35.108786 (+ 1643us) service_pool.cc:224] Handling call
1117 14:49:35.299095 (+190309us) raft_consensus.cc:1481] Updating replica for 608 ops
1117 14:49:35.657741 (+358646us) raft_consensus.cc:1545] Early marking committed up to index 0
1117 14:49:35.657746 (+ 5us) raft_consensus.cc:1550] Triggering prepare for 608 ops
1117 14:49:35.734415 (+ 76669us) write_op.cc:270] Start()
1117 14:49:35.734428 (+ 13us) write_op.cc:276] Timestamp: P: 1794926962618525 usec, L: 0
1117 14:49:35.811008 (+ 76580us) write_op.cc:270] Start()
1117 14:49:35.811034 (+ 26us) write_op.cc:276] Timestamp: P: 1794926962620139 usec, L: 0
1117 14:49:35.811194 (+ 160us) write_op.cc:270] Start()
1117 14:49:35.811219 (+ 25us) write_op.cc:276] Timestamp: P: 1794926962632571 usec, L: 0
1117 14:49:35.811367 (+ 148us) write_op.cc:270] Start()
1117 14:49:35.811387 (+ 20us) write_op.cc:276] Timestamp: P: 1794926962668518 usec, L: 0
1117 14:49:35.811585 (+ 198us) write_op.cc:270] Start()
1117 14:49:35.811609 (+ 24us) write_op.cc:276] Timestamp: P: 1794926962670791 usec, L: 0
1117 14:49:35.811782 (+ 173us) write_op.cc:270] Start()
1117 14:49:35.811803 (+ 21us) write_op.cc:276] Timestamp: P: 1794926962671899 usec, L: 0
1117 14:49:35.811952 (+ 149us) write_op.cc:270] Start()
1117 14:49:35.811995 (+ 43us) write_op.cc:276] Timestamp: P: 1794926962675129 usec, L: 0
1117 14:49:35.812187 (+ 192us) write_op.cc:270] Start()
1117 14:49:35.812208 (+ 21us) write_op.cc:276] Timestamp: P: 1794926962701570 usec, L: 0
1117 14:49:35.812354 (+ 146us) write_op.cc:270] Start()
1117 14:49:35.812373 (+ 19us) write_op.cc:276] Timestamp: P: 1794926962714433 usec, L: 0
1117 14:49:35.812566 (+ 193us) write_op.cc:270] Start()
1117 14:49:35.812591 (+ 25us) write_op.cc:276] Timestamp: P: 1794926962739991 usec, L: 0
1117 14:49:35.812753 (+ 162us) write_op.cc:270] Start()
1117 14:49:35.812774 (+ 21us) write_op.cc:276] Timestamp: P: 1794926962741101 usec, L: 0
1117 14:49:35.812939 (+ 165us) write_op.cc:270] Start()
1117 14:49:35.812960 (+ 21us) write_op.cc:276] Timestamp: P: 1794926962777148 usec, L: 0
1117 14:49:35.813113 (+ 153us) write_op.cc:270] Start()
1117 14:49:35.813134 (+ 21us) write_op.cc:276] Timestamp: P: 1794926962787259 usec, L: 0
1117 14:49:35.813314 (+ 180us) write_op.cc:270] Start()
1117 14:49:35.813337 (+ 23us) write_op.cc:276] Timestamp: P: 1794926962791483 usec, L: 0
1117 14:49:35.813537 (+ 200us) write_op.cc:270] Start()
1117 14:49:35.815351 (+ 1814us) write_op.cc:276] Timestamp: P: 1794926962793143 usec, L: 0
1117 14:49:35.815549 (+ 198us) write_op.cc:270] Start()
1117 14:49:35.815577 (+ 28us) write_op.cc:276] Timestamp: P: 1794926962838023 usec, L: 0
1117 14:49:35.815742 (+ 165us) write_op.cc:270] Start()
1117 14:49:35.815771 (+ 29us) write_op.cc:276] Timestamp: P: 1794926962842412 usec, L: 0
1117 14:49:35.815951 (+ 180us) write_op.cc:270] Start()
1117 14:49:35.815970 (+ 19us) write_op.cc:276] Timestamp: P: 1794926962844607 usec, L: 0
1117 14:49:35.816148 (+ 178us) write_op.cc:270] Start()
1117 14:49:35.816170 (+ 22us) write_op.cc:276] Timestamp: P: 1794926962863624 usec, L: 0
1117 14:49:35.816317 (+ 147us) write_op.cc:270] Start()
1117 14:49:35.816337 (+ 20us) write_op.cc:276] Timestamp: P: 1794926962887518 usec, L: 0
1117 14:49:35.817605 (+ 1268us) write_op.cc:270] Start()
1117 14:49:35.817631 (+ 26us) write_op.cc:276] Timestamp: P: 1794926962892955 usec, L: 0
1117 14:49:35.817818 (+ 187us) write_op.cc:270] Start()
1117 14:49:35.817840 (+ 22us) write_op.cc:276] Timestamp: P: 1794926962906789 usec, L: 0
1117 14:49:35.818023 (+ 183us) write_op.cc:270] Start()
1117 14:49:35.818045 (+ 22us) write_op.cc:276] Timestamp: P: 1794926962913669 usec, L: 0
1117 14:49:35.819349 (+ 1304us) write_op.cc:270] Start()
1117 14:49:35.819375 (+ 26us) write_op.cc:276] Timestamp: P: 1794926962943631 usec, L: 0
1117 14:49:35.820987 (+ 1612us) write_op.cc:270] Start()
1117 14:49:35.821018 (+ 31us) write_op.cc:276] Timestamp: P: 1794926962975914 usec, L: 0
1117 14:49:35.842211 (+ 21193us) write_op.cc:270] Start()
1117 14:49:35.842236 (+ 25us) write_op.cc:276] Timestamp: P: 1794926962980171 usec, L: 0
1117 14:49:35.869143 (+ 26907us) write_op.cc:270] Start()
1117 14:49:35.869164 (+ 21us) write_op.cc:276] Timestamp: P: 1794926962999561 usec, L: 0
1117 14:49:35.869315 (+ 151us) write_op.cc:270] Start()
1117 14:49:35.869336 (+ 21us) write_op.cc:276] Timestamp: P: 1794926963003960 usec, L: 0
1117 14:49:35.879334 (+ 9998us) write_op.cc:270] Start()
1117 14:49:35.879355 (+ 21us) write_op.cc:276] Timestamp: P: 1794926963029929 usec, L: 0
1117 14:49:35.879511 (+ 156us) write_op.cc:270] Start()
1117 14:49:35.879547 (+ 36us) write_op.cc:276] Timestamp: P: 1794926963034823 usec, L: 0
1117 14:49:35.880375 (+ 828us) write_op.cc:270] Start()
1117 14:49:35.880398 (+ 23us) write_op.cc:276] Timestamp: P: 1794926963037775 usec, L: 0
1117 14:49:35.880597 (+ 199us) write_op.cc:270] Start()
1117 14:49:35.880616 (+ 19us) write_op.cc:276] Timestamp: P: 1794926963050574 usec, L: 0
1117 14:49:35.880775 (+ 159us) write_op.cc:270] Start()
1117 14:49:35.880792 (+ 17us) write_op.cc:276] Timestamp: P: 1794926963098849 usec, L: 0
1117 14:49:35.880916 (+ 124us) write_op.cc:270] Start()
1117 14:49:35.880932 (+ 16us) write_op.cc:276] Timestamp: P: 1794926963111014 usec, L: 0
1117 14:49:35.881096 (+ 164us) write_op.cc:270] Start()
1117 14:49:35.881119 (+ 23us) write_op.cc:276] Timestamp: P: 1794926963112879 usec, L: 0
1117 14:49:35.881286 (+ 167us) write_op.cc:270] Start()
1117 14:49:35.881305 (+ 19us) write_op.cc:276] Timestamp: P: 1794926963117812 usec, L: 0
1117 14:49:35.903775 (+ 22470us) write_op.cc:270] Start()
1117 14:49:35.903813 (+ 38us) write_op.cc:276] Timestamp: P: 1794926963145379 usec, L: 0
1117 14:49:35.904007 (+ 194us) write_op.cc:270] Start()
1117 14:49:35.904032 (+ 25us) write_op.cc:276] Timestamp: P: 1794926963164194 usec, L: 0
1117 14:49:35.904209 (+ 177us) write_op.cc:270] Start()
1117 14:49:35.904229 (+ 20us) write_op.cc:276] Timestamp: P: 1794926963200148 usec, L: 0
1117 14:49:35.904395 (+ 166us) write_op.cc:270] Start()
1117 14:49:35.904415 (+ 20us) write_op.cc:276] Timestamp: P: 1794926963201792 usec, L: 0
1117 14:49:35.911978 (+ 7563us) write_op.cc:270] Start()
1117 14:49:35.912016 (+ 38us) write_op.cc:276] Timestamp: P: 1794926963218170 usec, L: 0
1117 14:49:35.912183 (+ 167us) write_op.cc:270] Start()
1117 14:49:35.912205 (+ 22us) write_op.cc:276] Timestamp: P: 1794926963256231 usec, L: 0
1117 14:49:35.912357 (+ 152us) write_op.cc:270] Start()
1117 14:49:35.912378 (+ 21us) write_op.cc:276] Timestamp: P: 1794926963278126 usec, L: 0
1117 14:49:35.912563 (+ 185us) write_op.cc:270] Start()
1117 14:49:35.912710 (+ 147us) write_op.cc:276] Timestamp: P: 1794926963282155 usec, L: 0
1117 14:49:35.912868 (+ 158us) write_op.cc:270] Start()
1117 14:49:35.912892 (+ 24us) write_op.cc:276] Timestamp: P: 1794926963310588 usec, L: 0
1117 14:49:35.913102 (+ 210us) write_op.cc:270] Start()
1117 14:49:35.913137 (+ 35us) write_op.cc:276] Timestamp: P: 1794926963313814 usec, L: 0
1117 14:49:35.913287 (+ 150us) write_op.cc:270] Start()
1117 14:49:35.913309 (+ 22us) write_op.cc:276] Timestamp: P: 1794926963315785 usec, L: 0
1117 14:49:35.913489 (+ 180us) write_op.cc:270] Start()
1117 14:49:35.913509 (+ 20us) write_op.cc:276] Timestamp: P: 1794926963334567 usec, L: 0
1117 14:49:35.913644 (+ 135us) write_op.cc:270] Start()
1117 14:49:35.913665 (+ 21us) write_op.cc:276] Timestamp: P: 1794926963360117 usec, L: 0
1117 14:49:35.916877 (+ 3212us) write_op.cc:270] Start()
1117 14:49:35.916900 (+ 23us) write_op.cc:276] Timestamp: P: 1794926963372813 usec, L: 0
1117 14:49:35.917093 (+ 193us) write_op.cc:270] Start()
1117 14:49:35.917110 (+ 17us) write_op.cc:276] Timestamp: P: 1794926963404918 usec, L: 0
1117 14:49:35.919311 (+ 2201us) write_op.cc:270] Start()
1117 14:49:35.919334 (+ 23us) write_op.cc:276] Timestamp: P: 1794926963426398 usec, L: 0
1117 14:49:35.919483 (+ 149us) write_op.cc:270] Start()
1117 14:49:35.919515 (+ 32us) write_op.cc:276] Timestamp: P: 1794926963431231 usec, L: 0
1117 14:49:35.919684 (+ 169us) write_op.cc:270] Start()
1117 14:49:35.919704 (+ 20us) write_op.cc:276] Timestamp: P: 1794926963432913 usec, L: 0
1117 14:49:35.919857 (+ 153us) write_op.cc:270] Start()
1117 14:49:35.919877 (+ 20us) write_op.cc:276] Timestamp: P: 1794926963455108 usec, L: 0
1117 14:49:35.920078 (+ 201us) write_op.cc:270] Start()
1117 14:49:35.920100 (+ 22us) write_op.cc:276] Timestamp: P: 1794926963464026 usec, L: 0
1117 14:49:35.920240 (+ 140us) write_op.cc:270] Start()
1117 14:49:35.920259 (+ 19us) write_op.cc:276] Timestamp: P: 1794926963480263 usec, L: 0
1117 14:49:35.920402 (+ 143us) write_op.cc:270] Start()
1117 14:49:35.920421 (+ 19us) write_op.cc:276] Timestamp: P: 1794926963501162 usec, L: 0
1117 14:49:35.920618 (+ 197us) write_op.cc:270] Start()
1117 14:49:35.920637 (+ 19us) write_op.cc:276] Timestamp: P: 1794926963520071 usec, L: 0
1117 14:49:35.920774 (+ 137us) write_op.cc:270] Start()
1117 14:49:35.920829 (+ 55us) write_op.cc:276] Timestamp: P: 1794926963523855 usec, L: 0
1117 14:49:35.920966 (+ 137us) write_op.cc:270] Start()
1117 14:49:35.920984 (+ 18us) write_op.cc:276] Timestamp: P: 1794926963530692 usec, L: 0
1117 14:49:35.921122 (+ 138us) write_op.cc:270] Start()
1117 14:49:35.921158 (+ 36us) write_op.cc:276] Timestamp: P: 1794926963567264 usec, L: 0
1117 14:49:35.921290 (+ 132us) write_op.cc:270] Start()
1117 14:49:35.921309 (+ 19us) write_op.cc:276] Timestamp: P: 1794926963568009 usec, L: 0
1117 14:49:35.921489 (+ 180us) write_op.cc:270] Start()
1117 14:49:35.921519 (+ 30us) write_op.cc:276] Timestamp: P: 1794926963589595 usec, L: 0
1117 14:49:35.921709 (+ 190us) write_op.cc:270] Start()
1117 14:49:35.921728 (+ 19us) write_op.cc:276] Timestamp: P: 1794926963610262 usec, L: 0
1117 14:49:35.921868 (+ 140us) write_op.cc:270] Start()
1117 14:49:35.921886 (+ 18us) write_op.cc:276] Timestamp: P: 1794926963621052 usec, L: 0
1117 14:49:35.922021 (+ 135us) write_op.cc:270] Start()
1117 14:49:35.922040 (+ 19us) write_op.cc:276] Timestamp: P: 1794926963644080 usec, L: 0
1117 14:49:35.944561 (+ 22521us) write_op.cc:270] Start()
1117 14:49:35.944586 (+ 25us) write_op.cc:276] Timestamp: P: 1794926963648777 usec, L: 0
1117 14:49:35.944738 (+ 152us) write_op.cc:270] Start()
1117 14:49:35.944758 (+ 20us) write_op.cc:276] Timestamp: P: 1794926963666472 usec, L: 0
1117 14:49:35.944964 (+ 206us) write_op.cc:270] Start()
1117 14:49:35.944990 (+ 26us) write_op.cc:276] Timestamp: P: 1794926963694522 usec, L: 0
1117 14:49:35.945165 (+ 175us) write_op.cc:270] Start()
1117 14:49:35.945186 (+ 21us) write_op.cc:276] Timestamp: P: 1794926963705942 usec, L: 0
1117 14:49:35.945693 (+ 507us) write_op.cc:270] Start()
1117 14:49:35.945715 (+ 22us) write_op.cc:276] Timestamp: P: 1794926963725146 usec, L: 0
1117 14:49:35.945914 (+ 199us) write_op.cc:270] Start()
1117 14:49:35.945935 (+ 21us) write_op.cc:276] Timestamp: P: 1794926963726762 usec, L: 0
1117 14:49:35.946100 (+ 165us) write_op.cc:270] Start()
1117 14:49:35.946120 (+ 20us) write_op.cc:276] Timestamp: P: 1794926963746393 usec, L: 0
1117 14:49:35.946283 (+ 163us) write_op.cc:270] Start()
1117 14:49:35.946306 (+ 23us) write_op.cc:276] Timestamp: P: 1794926963763491 usec, L: 0
1117 14:49:35.946451 (+ 145us) write_op.cc:270] Start()
1117 14:49:35.946473 (+ 22us) write_op.cc:276] Timestamp: P: 1794926963764191 usec, L: 0
1117 14:49:35.966844 (+ 20371us) write_op.cc:270] Start()
1117 14:49:35.966872 (+ 28us) write_op.cc:276] Timestamp: P: 1794926963765959 usec, L: 0
1117 14:49:35.967082 (+ 210us) write_op.cc:270] Start()
1117 14:49:35.967118 (+ 36us) write_op.cc:276] Timestamp: P: 1794926963811099 usec, L: 0
1117 14:49:35.967283 (+ 165us) write_op.cc:270] Start()
1117 14:49:35.967340 (+ 57us) write_op.cc:276] Timestamp: P: 1794926963813350 usec, L: 0
1117 14:49:35.967524 (+ 184us) write_op.cc:270] Start()
1117 14:49:35.967547 (+ 23us) write_op.cc:276] Timestamp: P: 1794926963841419 usec, L: 0
1117 14:49:35.967722 (+ 175us) write_op.cc:270] Start()
1117 14:49:35.967743 (+ 21us) write_op.cc:276] Timestamp: P: 1794926963852754 usec, L: 0
1117 14:49:35.967903 (+ 160us) write_op.cc:270] Start()
1117 14:49:35.967924 (+ 21us) write_op.cc:276] Timestamp: P: 1794926963862022 usec, L: 0
1117 14:49:35.968134 (+ 210us) write_op.cc:270] Start()
1117 14:49:35.968157 (+ 23us) write_op.cc:276] Timestamp: P: 1794926963877357 usec, L: 0
1117 14:49:35.968319 (+ 162us) write_op.cc:270] Start()
1117 14:49:35.968342 (+ 23us) write_op.cc:276] Timestamp: P: 1794926963886636 usec, L: 0
1117 14:49:35.988574 (+ 20232us) write_op.cc:270] Start()
1117 14:49:35.988600 (+ 26us) write_op.cc:276] Timestamp: P: 1794926963901443 usec, L: 0
1117 14:49:35.999719 (+ 11119us) write_op.cc:270] Start()
1117 14:49:35.999744 (+ 25us) write_op.cc:276] Timestamp: P: 1794926963930311 usec, L: 0
1117 14:49:36.022321 (+ 22577us) spinlock_profiling.cc:245] Waited 1.05 ms on lock 0x60f00001a288. stack: 00007f9a08fa33a6 00007f9a08fa3160 00007f9a07f9434d 00007f9a1f567704 00007f9a1f5676cd 00007f9a1f56709a 00007f9a121160b8 00007f9a1505c919 00007f9a15003c49 00007f9a15001417 00007f9a18ed38cd 00007f9a1303bae6 00007f9a1303b815 00007f9a100eb8de 00007f9a100ea7be 00007f9a100f09f8
1117 14:49:36.022426 (+ 105us) write_op.cc:270] Start()
1117 14:49:36.022459 (+ 33us) write_op.cc:276] Timestamp: P: 1794926963950403 usec, L: 0
1117 14:49:36.022666 (+ 207us) write_op.cc:270] Start()
1117 14:49:36.022695 (+ 29us) write_op.cc:276] Timestamp: P: 1794926963954427 usec, L: 0
1117 14:49:36.022895 (+ 200us) write_op.cc:270] Start()
1117 14:49:36.022916 (+ 21us) write_op.cc:276] Timestamp: P: 1794926963969676 usec, L: 0
1117 14:49:36.023063 (+ 147us) write_op.cc:270] Start()
1117 14:49:36.023082 (+ 19us) write_op.cc:276] Timestamp: P: 1794926963989985 usec, L: 0
1117 14:49:36.050907 (+ 27825us) write_op.cc:270] Start()
1117 14:49:36.050930 (+ 23us) write_op.cc:276] Timestamp: P: 1794926963998446 usec, L: 0
1117 14:49:36.051103 (+ 173us) write_op.cc:270] Start()
1117 14:49:36.051124 (+ 21us) write_op.cc:276] Timestamp: P: 1794926964025339 usec, L: 0
1117 14:49:36.051297 (+ 173us) write_op.cc:270] Start()
1117 14:49:36.051318 (+ 21us) write_op.cc:276] Timestamp: P: 1794926964054104 usec, L: 0
1117 14:49:36.051495 (+ 177us) write_op.cc:270] Start()
1117 14:49:36.051533 (+ 38us) write_op.cc:276] Timestamp: P: 1794926964060330 usec, L: 0
1117 14:49:36.052042 (+ 509us) write_op.cc:270] Start()
1117 14:49:36.052066 (+ 24us) write_op.cc:276] Timestamp: P: 1794926964073782 usec, L: 0
1117 14:49:36.052231 (+ 165us) write_op.cc:270] Start()
1117 14:49:36.052252 (+ 21us) write_op.cc:276] Timestamp: P: 1794926964080859 usec, L: 0
1117 14:49:36.052392 (+ 140us) write_op.cc:270] Start()
1117 14:49:36.052412 (+ 20us) write_op.cc:276] Timestamp: P: 1794926964123471 usec, L: 0
1117 14:49:36.052582 (+ 170us) write_op.cc:270] Start()
1117 14:49:36.052600 (+ 18us) write_op.cc:276] Timestamp: P: 1794926964125608 usec, L: 0
1117 14:49:36.052721 (+ 121us) write_op.cc:270] Start()
1117 14:49:36.052736 (+ 15us) write_op.cc:276] Timestamp: P: 1794926964134623 usec, L: 0
1117 14:49:36.052845 (+ 109us) write_op.cc:270] Start()
1117 14:49:36.052860 (+ 15us) write_op.cc:276] Timestamp: P: 1794926964157675 usec, L: 0
1117 14:49:36.052979 (+ 119us) write_op.cc:270] Start()
1117 14:49:36.052996 (+ 17us) write_op.cc:276] Timestamp: P: 1794926964172532 usec, L: 0
1117 14:49:36.053153 (+ 157us) write_op.cc:270] Start()
1117 14:49:36.053171 (+ 18us) write_op.cc:276] Timestamp: P: 1794926964175363 usec, L: 0
1117 14:49:36.053319 (+ 148us) write_op.cc:270] Start()
1117 14:49:36.053338 (+ 19us) write_op.cc:276] Timestamp: P: 1794926964192748 usec, L: 0
1117 14:49:36.053494 (+ 156us) write_op.cc:270] Start()
1117 14:49:36.053513 (+ 19us) write_op.cc:276] Timestamp: P: 1794926964234464 usec, L: 0
1117 14:49:36.053678 (+ 165us) write_op.cc:270] Start()
1117 14:49:36.053696 (+ 18us) write_op.cc:276] Timestamp: P: 1794926964238436 usec, L: 0
1117 14:49:36.053847 (+ 151us) write_op.cc:270] Start()
1117 14:49:36.053873 (+ 26us) write_op.cc:276] Timestamp: P: 1794926964253553 usec, L: 0
1117 14:49:36.054038 (+ 165us) write_op.cc:270] Start()
1117 14:49:36.054058 (+ 20us) write_op.cc:276] Timestamp: P: 1794926964262098 usec, L: 0
1117 14:49:36.054197 (+ 139us) write_op.cc:270] Start()
1117 14:49:36.054217 (+ 20us) write_op.cc:276] Timestamp: P: 1794926964295274 usec, L: 0
1117 14:49:36.054367 (+ 150us) write_op.cc:270] Start()
1117 14:49:36.054396 (+ 29us) write_op.cc:276] Timestamp: P: 1794926964302844 usec, L: 0
1117 14:49:36.084389 (+ 29993us) write_op.cc:270] Start()
1117 14:49:36.084470 (+ 81us) write_op.cc:276] Timestamp: P: 1794926964303583 usec, L: 0
1117 14:49:36.084637 (+ 167us) write_op.cc:270] Start()
1117 14:49:36.084660 (+ 23us) write_op.cc:276] Timestamp: P: 1794926964307724 usec, L: 0
1117 14:49:36.084849 (+ 189us) write_op.cc:270] Start()
1117 14:49:36.084870 (+ 21us) write_op.cc:276] Timestamp: P: 1794926964345484 usec, L: 0
1117 14:49:36.085002 (+ 132us) write_op.cc:270] Start()
1117 14:49:36.085020 (+ 18us) write_op.cc:276] Timestamp: P: 1794926964362491 usec, L: 0
1117 14:49:36.085145 (+ 125us) write_op.cc:270] Start()
1117 14:49:36.085162 (+ 17us) write_op.cc:276] Timestamp: P: 1794926964364547 usec, L: 0
1117 14:49:36.085282 (+ 120us) write_op.cc:270] Start()
1117 14:49:36.085299 (+ 17us) write_op.cc:276] Timestamp: P: 1794926964388019 usec, L: 0
1117 14:49:36.085446 (+ 147us) write_op.cc:270] Start()
1117 14:49:36.085466 (+ 20us) write_op.cc:276] Timestamp: P: 1794926964391452 usec, L: 0
1117 14:49:36.085606 (+ 140us) write_op.cc:270] Start()
1117 14:49:36.085625 (+ 19us) write_op.cc:276] Timestamp: P: 1794926964421146 usec, L: 0
1117 14:49:36.085754 (+ 129us) write_op.cc:270] Start()
1117 14:49:36.085771 (+ 17us) write_op.cc:276] Timestamp: P: 1794926964422707 usec, L: 0
1117 14:49:36.085896 (+ 125us) write_op.cc:270] Start()
1117 14:49:36.085918 (+ 22us) write_op.cc:276] Timestamp: P: 1794926964438935 usec, L: 0
1117 14:49:36.086093 (+ 175us) write_op.cc:270] Start()
1117 14:49:36.086113 (+ 20us) write_op.cc:276] Timestamp: P: 1794926964449710 usec, L: 0
1117 14:49:36.086278 (+ 165us) write_op.cc:270] Start()
1117 14:49:36.086296 (+ 18us) write_op.cc:276] Timestamp: P: 1794926964485506 usec, L: 0
1117 14:49:36.086414 (+ 118us) write_op.cc:270] Start()
1117 14:49:36.086440 (+ 26us) write_op.cc:276] Timestamp: P: 1794926964496067 usec, L: 0
1117 14:49:36.086595 (+ 155us) write_op.cc:270] Start()
1117 14:49:36.086614 (+ 19us) write_op.cc:276] Timestamp: P: 1794926964519949 usec, L: 0
1117 14:49:36.086769 (+ 155us) write_op.cc:270] Start()
1117 14:49:36.086786 (+ 17us) write_op.cc:276] Timestamp: P: 1794926964525195 usec, L: 0
1117 14:49:36.086927 (+ 141us) write_op.cc:270] Start()
1117 14:49:36.086946 (+ 19us) write_op.cc:276] Timestamp: P: 1794926964543735 usec, L: 0
1117 14:49:36.102365 (+ 15419us) write_op.cc:270] Start()
1117 14:49:36.102438 (+ 73us) write_op.cc:276] Timestamp: P: 1794926964546252 usec, L: 0
1117 14:49:36.102608 (+ 170us) write_op.cc:270] Start()
1117 14:49:36.102632 (+ 24us) write_op.cc:276] Timestamp: P: 1794926964574405 usec, L: 0
1117 14:49:36.104840 (+ 2208us) write_op.cc:270] Start()
1117 14:49:36.104887 (+ 47us) write_op.cc:276] Timestamp: P: 1794926964579467 usec, L: 0
1117 14:49:36.106782 (+ 1895us) write_op.cc:270] Start()
1117 14:49:36.106810 (+ 28us) write_op.cc:276] Timestamp: P: 1794926964588077 usec, L: 0
1117 14:49:36.106989 (+ 179us) write_op.cc:270] Start()
1117 14:49:36.107011 (+ 22us) write_op.cc:276] Timestamp: P: 1794926964622803 usec, L: 0
1117 14:49:36.107214 (+ 203us) write_op.cc:270] Start()
1117 14:49:36.107239 (+ 25us) write_op.cc:276] Timestamp: P: 1794926964628094 usec, L: 0
1117 14:49:36.107452 (+ 213us) write_op.cc:270] Start()
1117 14:49:36.107477 (+ 25us) write_op.cc:276] Timestamp: P: 1794926964628989 usec, L: 0
1117 14:49:36.107646 (+ 169us) write_op.cc:270] Start()
1117 14:49:36.107669 (+ 23us) write_op.cc:276] Timestamp: P: 1794926964669882 usec, L: 0
1117 14:49:36.107868 (+ 199us) write_op.cc:270] Start()
1117 14:49:36.107890 (+ 22us) write_op.cc:276] Timestamp: P: 1794926964685167 usec, L: 0
1117 14:49:36.108054 (+ 164us) write_op.cc:270] Start()
1117 14:49:36.108077 (+ 23us) write_op.cc:276] Timestamp: P: 1794926964687154 usec, L: 0
1117 14:49:36.108244 (+ 167us) write_op.cc:270] Start()
1117 14:49:36.108266 (+ 22us) write_op.cc:276] Timestamp: P: 1794926964718363 usec, L: 0
1117 14:49:36.108500 (+ 234us) write_op.cc:270] Start()
1117 14:49:36.108531 (+ 31us) write_op.cc:276] Timestamp: P: 1794926964725417 usec, L: 0
1117 14:49:36.108699 (+ 168us) write_op.cc:270] Start()
1117 14:49:36.108723 (+ 24us) write_op.cc:276] Timestamp: P: 1794926964733776 usec, L: 0
1117 14:49:36.119529 (+ 10806us) write_op.cc:270] Start()
1117 14:49:36.119554 (+ 25us) write_op.cc:276] Timestamp: P: 1794926964766645 usec, L: 0
1117 14:49:36.122911 (+ 3357us) write_op.cc:270] Start()
1117 14:49:36.122953 (+ 42us) write_op.cc:276] Timestamp: P: 1794926964768307 usec, L: 0
1117 14:49:36.125700 (+ 2747us) write_op.cc:270] Start()
1117 14:49:36.125719 (+ 19us) write_op.cc:276] Timestamp: P: 1794926964809052 usec, L: 0
1117 14:49:36.132180 (+ 6461us) write_op.cc:270] Start()
1117 14:49:36.132201 (+ 21us) write_op.cc:276] Timestamp: P: 1794926964809936 usec, L: 0
1117 14:49:36.132352 (+ 151us) write_op.cc:270] Start()
1117 14:49:36.132370 (+ 18us) write_op.cc:276] Timestamp: P: 1794926964811922 usec, L: 0
1117 14:49:36.132585 (+ 215us) write_op.cc:270] Start()
1117 14:49:36.132609 (+ 24us) write_op.cc:276] Timestamp: P: 1794926964816634 usec, L: 0
1117 14:49:36.132782 (+ 173us) write_op.cc:270] Start()
1117 14:49:36.132805 (+ 23us) write_op.cc:276] Timestamp: P: 1794926964849538 usec, L: 0
1117 14:49:36.133864 (+ 1059us) write_op.cc:270] Start()
1117 14:49:36.133887 (+ 23us) write_op.cc:276] Timestamp: P: 1794926964871033 usec, L: 0
1117 14:49:36.134038 (+ 151us) write_op.cc:270] Start()
1117 14:49:36.134058 (+ 20us) write_op.cc:276] Timestamp: P: 1794926964888666 usec, L: 0
1117 14:49:36.134185 (+ 127us) write_op.cc:270] Start()
1117 14:49:36.134202 (+ 17us) write_op.cc:276] Timestamp: P: 1794926964890877 usec, L: 0
1117 14:49:36.134328 (+ 126us) write_op.cc:270] Start()
1117 14:49:36.134346 (+ 18us) write_op.cc:276] Timestamp: P: 1794926964916589 usec, L: 0
1117 14:49:36.134491 (+ 145us) write_op.cc:270] Start()
1117 14:49:36.134510 (+ 19us) write_op.cc:276] Timestamp: P: 1794926964924542 usec, L: 0
1117 14:49:36.134650 (+ 140us) write_op.cc:270] Start()
1117 14:49:36.134668 (+ 18us) write_op.cc:276] Timestamp: P: 1794926964926829 usec, L: 0
1117 14:49:36.134789 (+ 121us) write_op.cc:270] Start()
1117 14:49:36.134807 (+ 18us) write_op.cc:276] Timestamp: P: 1794926964948765 usec, L: 0
1117 14:49:36.136606 (+ 1799us) write_op.cc:270] Start()
1117 14:49:36.136625 (+ 19us) write_op.cc:276] Timestamp: P: 1794926964980045 usec, L: 0
1117 14:49:36.136799 (+ 174us) write_op.cc:270] Start()
1117 14:49:36.136853 (+ 54us) write_op.cc:276] Timestamp: P: 1794926965005590 usec, L: 0
1117 14:49:36.144414 (+ 7561us) write_op.cc:270] Start()
1117 14:49:36.145418 (+ 1004us) write_op.cc:276] Timestamp: P: 1794926965008208 usec, L: 0
1117 14:49:36.146797 (+ 1379us) write_op.cc:270] Start()
1117 14:49:36.146815 (+ 18us) write_op.cc:276] Timestamp: P: 1794926965027357 usec, L: 0
1117 14:49:36.159384 (+ 12569us) write_op.cc:270] Start()
1117 14:49:36.159410 (+ 26us) write_op.cc:276] Timestamp: P: 1794926965036603 usec, L: 0
1117 14:49:36.159580 (+ 170us) write_op.cc:270] Start()
1117 14:49:36.159750 (+ 170us) write_op.cc:276] Timestamp: P: 1794926965068410 usec, L: 0
1117 14:49:36.159919 (+ 169us) write_op.cc:270] Start()
1117 14:49:36.159953 (+ 34us) write_op.cc:276] Timestamp: P: 1794926965074682 usec, L: 0
1117 14:49:36.160127 (+ 174us) write_op.cc:270] Start()
1117 14:49:36.160148 (+ 21us) write_op.cc:276] Timestamp: P: 1794926965083941 usec, L: 0
1117 14:49:36.160307 (+ 159us) write_op.cc:270] Start()
1117 14:49:36.160328 (+ 21us) write_op.cc:276] Timestamp: P: 1794926965102141 usec, L: 0
1117 14:49:36.160536 (+ 208us) write_op.cc:270] Start()
1117 14:49:36.160560 (+ 24us) write_op.cc:276] Timestamp: P: 1794926965129329 usec, L: 0
1117 14:49:36.160733 (+ 173us) write_op.cc:270] Start()
1117 14:49:36.160755 (+ 22us) write_op.cc:276] Timestamp: P: 1794926965152503 usec, L: 0
1117 14:49:36.160970 (+ 215us) write_op.cc:270] Start()
1117 14:49:36.160994 (+ 24us) write_op.cc:276] Timestamp: P: 1794926965168670 usec, L: 0
1117 14:49:36.161161 (+ 167us) write_op.cc:270] Start()
1117 14:49:36.161180 (+ 19us) write_op.cc:276] Timestamp: P: 1794926965170868 usec, L: 0
1117 14:49:36.161311 (+ 131us) write_op.cc:270] Start()
1117 14:49:36.161328 (+ 17us) write_op.cc:276] Timestamp: P: 1794926965184173 usec, L: 0
1117 14:49:36.161447 (+ 119us) write_op.cc:270] Start()
1117 14:49:36.171097 (+ 9650us) write_op.cc:276] Timestamp: P: 1794926965189410 usec, L: 0
1117 14:49:36.171335 (+ 238us) write_op.cc:270] Start()
1117 14:49:36.171356 (+ 21us) write_op.cc:276] Timestamp: P: 1794926965214669 usec, L: 0
1117 14:49:36.171573 (+ 217us) write_op.cc:270] Start()
1117 14:49:36.171596 (+ 23us) write_op.cc:276] Timestamp: P: 1794926965236350 usec, L: 0
1117 14:49:36.173751 (+ 2155us) write_op.cc:270] Start()
1117 14:49:36.173775 (+ 24us) write_op.cc:276] Timestamp: P: 1794926965252030 usec, L: 0
1117 14:49:36.175647 (+ 1872us) write_op.cc:270] Start()
1117 14:49:36.175672 (+ 25us) write_op.cc:276] Timestamp: P: 1794926965254434 usec, L: 0
1117 14:49:36.175810 (+ 138us) write_op.cc:270] Start()
1117 14:49:36.175830 (+ 20us) write_op.cc:276] Timestamp: P: 1794926965264740 usec, L: 0
1117 14:49:36.176007 (+ 177us) write_op.cc:270] Start()
1117 14:49:36.176030 (+ 23us) write_op.cc:276] Timestamp: P: 1794926965294627 usec, L: 0
1117 14:49:36.176216 (+ 186us) write_op.cc:270] Start()
1117 14:49:36.176237 (+ 21us) write_op.cc:276] Timestamp: P: 1794926965313666 usec, L: 0
1117 14:49:36.176368 (+ 131us) write_op.cc:270] Start()
1117 14:49:36.176386 (+ 18us) write_op.cc:276] Timestamp: P: 1794926965322495 usec, L: 0
1117 14:49:36.176673 (+ 287us) write_op.cc:270] Start()
1117 14:49:36.176696 (+ 23us) write_op.cc:276] Timestamp: P: 1794926965377750 usec, L: 0
1117 14:49:36.176835 (+ 139us) write_op.cc:270] Start()
1117 14:49:36.176853 (+ 18us) write_op.cc:276] Timestamp: P: 1794926965378566 usec, L: 0
1117 14:49:36.176983 (+ 130us) write_op.cc:270] Start()
1117 14:49:36.177003 (+ 20us) write_op.cc:276] Timestamp: P: 1794926965380090 usec, L: 0
1117 14:49:36.177887 (+ 884us) write_op.cc:270] Start()
1117 14:49:36.177910 (+ 23us) write_op.cc:276] Timestamp: P: 1794926965380942 usec, L: 0
1117 14:49:36.178068 (+ 158us) write_op.cc:270] Start()
1117 14:49:36.178087 (+ 19us) write_op.cc:276] Timestamp: P: 1794926965429483 usec, L: 0
1117 14:49:36.196740 (+ 18653us) write_op.cc:270] Start()
1117 14:49:36.196769 (+ 29us) write_op.cc:276] Timestamp: P: 1794926965433786 usec, L: 0
1117 14:49:36.203395 (+ 6626us) write_op.cc:270] Start()
1117 14:49:36.203488 (+ 93us) write_op.cc:276] Timestamp: P: 1794926965455258 usec, L: 0
1117 14:49:36.203678 (+ 190us) write_op.cc:270] Start()
1117 14:49:36.203699 (+ 21us) write_op.cc:276] Timestamp: P: 1794926965462486 usec, L: 0
1117 14:49:36.203845 (+ 146us) write_op.cc:270] Start()
1117 14:49:36.203863 (+ 18us) write_op.cc:276] Timestamp: P: 1794926965482543 usec, L: 0
1117 14:49:36.203991 (+ 128us) write_op.cc:270] Start()
1117 14:49:36.204009 (+ 18us) write_op.cc:276] Timestamp: P: 1794926965484512 usec, L: 0
1117 14:49:36.204129 (+ 120us) write_op.cc:270] Start()
1117 14:49:36.204147 (+ 18us) write_op.cc:276] Timestamp: P: 1794926965526501 usec, L: 0
1117 14:49:36.204292 (+ 145us) write_op.cc:270] Start()
1117 14:49:36.204310 (+ 18us) write_op.cc:276] Timestamp: P: 1794926965555919 usec, L: 0
1117 14:49:36.204494 (+ 184us) write_op.cc:270] Start()
1117 14:49:36.204515 (+ 21us) write_op.cc:276] Timestamp: P: 1794926965557031 usec, L: 0
1117 14:49:36.204665 (+ 150us) write_op.cc:270] Start()
1117 14:49:36.204684 (+ 19us) write_op.cc:276] Timestamp: P: 1794926965563646 usec, L: 0
1117 14:49:36.204832 (+ 148us) write_op.cc:270] Start()
1117 14:49:36.204852 (+ 20us) write_op.cc:276] Timestamp: P: 1794926965618760 usec, L: 0
1117 14:49:36.205004 (+ 152us) write_op.cc:270] Start()
1117 14:49:36.205023 (+ 19us) write_op.cc:276] Timestamp: P: 1794926965651901 usec, L: 0
1117 14:49:36.205174 (+ 151us) write_op.cc:270] Start()
1117 14:49:36.205195 (+ 21us) write_op.cc:276] Timestamp: P: 1794926965657352 usec, L: 0
1117 14:49:36.205360 (+ 165us) write_op.cc:270] Start()
1117 14:49:36.205381 (+ 21us) write_op.cc:276] Timestamp: P: 1794926965663917 usec, L: 0
1117 14:49:36.205561 (+ 180us) write_op.cc:270] Start()
1117 14:49:36.205583 (+ 22us) write_op.cc:276] Timestamp: P: 1794926965666301 usec, L: 0
1117 14:49:36.205747 (+ 164us) write_op.cc:270] St
I20261117 14:49:37.770911 7345 rpcz_store.cc:276] 1117 14:49:35.108324 (+ 0us) service_pool.cc:167] Inserting onto call queue
1117 14:49:35.130485 (+ 22161us) service_pool.cc:224] Handling call
1117 14:49:35.292239 (+161754us) raft_consensus.cc:1481] Updating replica for 608 ops
1117 14:49:35.501194 (+208955us) raft_consensus.cc:1545] Early marking committed up to index 0
1117 14:49:35.501200 (+ 6us) raft_consensus.cc:1550] Triggering prepare for 608 ops
1117 14:49:35.501348 (+ 148us) write_op.cc:270] Start()
1117 14:49:35.501374 (+ 26us) write_op.cc:276] Timestamp: P: 1794926962088022 usec, L: 0
1117 14:49:35.607995 (+106621us) write_op.cc:270] Start()
1117 14:49:35.608028 (+ 33us) write_op.cc:276] Timestamp: P: 1794926962098847 usec, L: 0
1117 14:49:35.608281 (+ 253us) write_op.cc:270] Start()
1117 14:49:35.608308 (+ 27us) write_op.cc:276] Timestamp: P: 1794926962106653 usec, L: 0
1117 14:49:35.608612 (+ 304us) write_op.cc:270] Start()
1117 14:49:35.608632 (+ 20us) write_op.cc:276] Timestamp: P: 1794926962109927 usec, L: 0
1117 14:49:35.608778 (+ 146us) write_op.cc:270] Start()
1117 14:49:35.608804 (+ 26us) write_op.cc:276] Timestamp: P: 1794926962639901 usec, L: 0
1117 14:49:35.641738 (+ 32934us) write_op.cc:270] Start()
1117 14:49:35.641766 (+ 28us) write_op.cc:276] Timestamp: P: 1794926962656067 usec, L: 0
1117 14:49:35.657012 (+ 15246us) write_op.cc:270] Start()
1117 14:49:35.657932 (+ 920us) write_op.cc:276] Timestamp: P: 1794926962683316 usec, L: 0
1117 14:49:35.692229 (+ 34297us) write_op.cc:270] Start()
1117 14:49:35.692252 (+ 23us) write_op.cc:276] Timestamp: P: 1794926962694760 usec, L: 0
1117 14:49:35.695989 (+ 3737us) write_op.cc:270] Start()
1117 14:49:35.696012 (+ 23us) write_op.cc:276] Timestamp: P: 1794926962711415 usec, L: 0
1117 14:49:35.702351 (+ 6339us) write_op.cc:270] Start()
1117 14:49:35.702383 (+ 32us) write_op.cc:276] Timestamp: P: 1794926962740971 usec, L: 0
1117 14:49:35.702578 (+ 195us) write_op.cc:270] Start()
1117 14:49:35.702623 (+ 45us) write_op.cc:276] Timestamp: P: 1794926962745807 usec, L: 0
1117 14:49:35.705311 (+ 2688us) write_op.cc:270] Start()
1117 14:49:35.705337 (+ 26us) write_op.cc:276] Timestamp: P: 1794926962779987 usec, L: 0
1117 14:49:35.707390 (+ 2053us) write_op.cc:270] Start()
1117 14:49:35.707411 (+ 21us) write_op.cc:276] Timestamp: P: 1794926962787932 usec, L: 0
1117 14:49:35.707694 (+ 283us) write_op.cc:270] Start()
1117 14:49:35.707712 (+ 18us) write_op.cc:276] Timestamp: P: 1794926962789967 usec, L: 0
1117 14:49:35.708080 (+ 368us) write_op.cc:270] Start()
1117 14:49:35.708104 (+ 24us) write_op.cc:276] Timestamp: P: 1794926962811482 usec, L: 0
1117 14:49:35.708277 (+ 173us) write_op.cc:270] Start()
1117 14:49:35.708297 (+ 20us) write_op.cc:276] Timestamp: P: 1794926962840785 usec, L: 0
1117 14:49:35.708482 (+ 185us) write_op.cc:270] Start()
1117 14:49:35.708512 (+ 30us) write_op.cc:276] Timestamp: P: 1794926962843275 usec, L: 0
1117 14:49:35.708681 (+ 169us) write_op.cc:270] Start()
1117 14:49:35.708705 (+ 24us) write_op.cc:276] Timestamp: P: 1794926962846105 usec, L: 0
1117 14:49:35.708871 (+ 166us) write_op.cc:270] Start()
1117 14:49:35.708891 (+ 20us) write_op.cc:276] Timestamp: P: 1794926962865043 usec, L: 0
1117 14:49:35.709063 (+ 172us) write_op.cc:270] Start()
1117 14:49:35.709083 (+ 20us) write_op.cc:276] Timestamp: P: 1794926962887835 usec, L: 0
1117 14:49:35.709757 (+ 674us) write_op.cc:270] Start()
1117 14:49:35.709781 (+ 24us) write_op.cc:276] Timestamp: P: 1794926962889444 usec, L: 0
1117 14:49:35.710056 (+ 275us) write_op.cc:270] Start()
1117 14:49:35.710081 (+ 25us) write_op.cc:276] Timestamp: P: 1794926962904297 usec, L: 0
1117 14:49:35.710246 (+ 165us) write_op.cc:270] Start()
1117 14:49:35.710267 (+ 21us) write_op.cc:276] Timestamp: P: 1794926962912342 usec, L: 0
1117 14:49:35.710400 (+ 133us) write_op.cc:270] Start()
1117 14:49:35.710419 (+ 19us) write_op.cc:276] Timestamp: P: 1794926962942366 usec, L: 0
1117 14:49:35.710579 (+ 160us) write_op.cc:270] Start()
1117 14:49:35.710601 (+ 22us) write_op.cc:276] Timestamp: P: 1794926962975464 usec, L: 0
1117 14:49:35.712535 (+ 1934us) write_op.cc:270] Start()
1117 14:49:35.712551 (+ 16us) write_op.cc:276] Timestamp: P: 1794926962979782 usec, L: 0
1117 14:49:35.719413 (+ 6862us) write_op.cc:270] Start()
1117 14:49:35.719429 (+ 16us) write_op.cc:276] Timestamp: P: 1794926962980562 usec, L: 0
1117 14:49:35.721333 (+ 1904us) write_op.cc:270] Start()
1117 14:49:35.721362 (+ 29us) write_op.cc:276] Timestamp: P: 1794926963003872 usec, L: 0
1117 14:49:35.724385 (+ 3023us) write_op.cc:270] Start()
1117 14:49:35.724415 (+ 30us) write_op.cc:276] Timestamp: P: 1794926963029487 usec, L: 0
1117 14:49:35.725323 (+ 908us) write_op.cc:270] Start()
1117 14:49:35.725347 (+ 24us) write_op.cc:276] Timestamp: P: 1794926963032827 usec, L: 0
1117 14:49:35.725868 (+ 521us) write_op.cc:270] Start()
1117 14:49:35.725899 (+ 31us) write_op.cc:276] Timestamp: P: 1794926963038031 usec, L: 0
1117 14:49:35.726229 (+ 330us) write_op.cc:270] Start()
1117 14:49:35.726252 (+ 23us) write_op.cc:276] Timestamp: P: 1794926963052319 usec, L: 0
1117 14:49:35.726498 (+ 246us) write_op.cc:270] Start()
1117 14:49:35.726520 (+ 22us) write_op.cc:276] Timestamp: P: 1794926963095646 usec, L: 0
1117 14:49:35.726687 (+ 167us) write_op.cc:270] Start()
1117 14:49:35.726710 (+ 23us) write_op.cc:276] Timestamp: P: 1794926963109933 usec, L: 0
1117 14:49:35.727229 (+ 519us) write_op.cc:270] Start()
1117 14:49:35.728538 (+ 1309us) write_op.cc:276] Timestamp: P: 1794926963113945 usec, L: 0
1117 14:49:35.728721 (+ 183us) write_op.cc:270] Start()
1117 14:49:35.728747 (+ 26us) write_op.cc:276] Timestamp: P: 1794926963118951 usec, L: 0
1117 14:49:35.728898 (+ 151us) write_op.cc:270] Start()
1117 14:49:35.728973 (+ 75us) write_op.cc:276] Timestamp: P: 1794926963142877 usec, L: 0
1117 14:49:35.729093 (+ 120us) write_op.cc:270] Start()
1117 14:49:35.729109 (+ 16us) write_op.cc:276] Timestamp: P: 1794926963164335 usec, L: 0
1117 14:49:35.729206 (+ 97us) write_op.cc:270] Start()
1117 14:49:35.729218 (+ 12us) write_op.cc:276] Timestamp: P: 1794926963197715 usec, L: 0
1117 14:49:35.729323 (+ 105us) write_op.cc:270] Start()
1117 14:49:35.729335 (+ 12us) write_op.cc:276] Timestamp: P: 1794926963203804 usec, L: 0
1117 14:49:35.729424 (+ 89us) write_op.cc:270] Start()
1117 14:49:35.729439 (+ 15us) write_op.cc:276] Timestamp: P: 1794926963222918 usec, L: 0
1117 14:49:35.729544 (+ 105us) write_op.cc:270] Start()
1117 14:49:35.729557 (+ 13us) write_op.cc:276] Timestamp: P: 1794926963256991 usec, L: 0
1117 14:49:35.729682 (+ 125us) write_op.cc:270] Start()
1117 14:49:35.729699 (+ 17us) write_op.cc:276] Timestamp: P: 1794926963277619 usec, L: 0
1117 14:49:35.729819 (+ 120us) write_op.cc:270] Start()
1117 14:49:35.729835 (+ 16us) write_op.cc:276] Timestamp: P: 1794926963280682 usec, L: 0
1117 14:49:35.729943 (+ 108us) write_op.cc:270] Start()
1117 14:49:35.729964 (+ 21us) write_op.cc:276] Timestamp: P: 1794926963308663 usec, L: 0
1117 14:49:35.730142 (+ 178us) write_op.cc:270] Start()
1117 14:49:35.730168 (+ 26us) write_op.cc:276] Timestamp: P: 1794926963311226 usec, L: 0
1117 14:49:35.730266 (+ 98us) write_op.cc:270] Start()
1117 14:49:35.730281 (+ 15us) write_op.cc:276] Timestamp: P: 1794926963313332 usec, L: 0
1117 14:49:35.730379 (+ 98us) write_op.cc:270] Start()
1117 14:49:35.730391 (+ 12us) write_op.cc:276] Timestamp: P: 1794926963333894 usec, L: 0
1117 14:49:35.730485 (+ 94us) write_op.cc:270] Start()
1117 14:49:35.730498 (+ 13us) write_op.cc:276] Timestamp: P: 1794926963359416 usec, L: 0
1117 14:49:35.730611 (+ 113us) write_op.cc:270] Start()
1117 14:49:35.730623 (+ 12us) write_op.cc:276] Timestamp: P: 1794926963360298 usec, L: 0
1117 14:49:35.730759 (+ 136us) write_op.cc:270] Start()
1117 14:49:35.730772 (+ 13us) write_op.cc:276] Timestamp: P: 1794926963391045 usec, L: 0
1117 14:49:35.730865 (+ 93us) write_op.cc:270] Start()
1117 14:49:35.730877 (+ 12us) write_op.cc:276] Timestamp: P: 1794926963391766 usec, L: 0
1117 14:49:35.731031 (+ 154us) write_op.cc:270] Start()
1117 14:49:35.731051 (+ 20us) write_op.cc:276] Timestamp: P: 1794926963407731 usec, L: 0
1117 14:49:35.731218 (+ 167us) write_op.cc:270] Start()
1117 14:49:35.731233 (+ 15us) write_op.cc:276] Timestamp: P: 1794926963424018 usec, L: 0
1117 14:49:35.731397 (+ 164us) write_op.cc:270] Start()
1117 14:49:35.731416 (+ 19us) write_op.cc:276] Timestamp: P: 1794926963455086 usec, L: 0
1117 14:49:35.731523 (+ 107us) write_op.cc:270] Start()
1117 14:49:35.731536 (+ 13us) write_op.cc:276] Timestamp: P: 1794926963481067 usec, L: 0
1117 14:49:35.731648 (+ 112us) write_op.cc:270] Start()
1117 14:49:35.731660 (+ 12us) write_op.cc:276] Timestamp: P: 1794926963481737 usec, L: 0
1117 14:49:35.731771 (+ 111us) write_op.cc:270] Start()
1117 14:49:35.731783 (+ 12us) write_op.cc:276] Timestamp: P: 1794926963497743 usec, L: 0
1117 14:49:35.731872 (+ 89us) write_op.cc:270] Start()
1117 14:49:35.731885 (+ 13us) write_op.cc:276] Timestamp: P: 1794926963520011 usec, L: 0
1117 14:49:35.731983 (+ 98us) write_op.cc:270] Start()
1117 14:49:35.732010 (+ 27us) write_op.cc:276] Timestamp: P: 1794926963530272 usec, L: 0
1117 14:49:35.732271 (+ 261us) write_op.cc:270] Start()
1117 14:49:35.732290 (+ 19us) write_op.cc:276] Timestamp: P: 1794926963531436 usec, L: 0
1117 14:49:35.732393 (+ 103us) write_op.cc:270] Start()
1117 14:49:35.732405 (+ 12us) write_op.cc:276] Timestamp: P: 1794926963565772 usec, L: 0
1117 14:49:35.732602 (+ 197us) write_op.cc:270] Start()
1117 14:49:35.732620 (+ 18us) write_op.cc:276] Timestamp: P: 1794926963567689 usec, L: 0
1117 14:49:35.732802 (+ 182us) write_op.cc:270] Start()
1117 14:49:35.732823 (+ 21us) write_op.cc:276] Timestamp: P: 1794926963579278 usec, L: 0
1117 14:49:35.776171 (+ 43348us) write_op.cc:270] Start()
1117 14:49:35.776197 (+ 26us) write_op.cc:276] Timestamp: P: 1794926963588168 usec, L: 0
1117 14:49:35.787128 (+ 10931us) write_op.cc:270] Start()
1117 14:49:35.787155 (+ 27us) write_op.cc:276] Timestamp: P: 1794926963625798 usec, L: 0
1117 14:49:35.791876 (+ 4721us) write_op.cc:270] Start()
1117 14:49:35.791907 (+ 31us) write_op.cc:276] Timestamp: P: 1794926963645638 usec, L: 0
1117 14:49:35.797589 (+ 5682us) write_op.cc:270] Start()
1117 14:49:35.797616 (+ 27us) write_op.cc:276] Timestamp: P: 1794926963646448 usec, L: 0
1117 14:49:35.797796 (+ 180us) write_op.cc:270] Start()
1117 14:49:35.797818 (+ 22us) write_op.cc:276] Timestamp: P: 1794926963668038 usec, L: 0
1117 14:49:35.798010 (+ 192us) write_op.cc:270] Start()
1117 14:49:35.798038 (+ 28us) write_op.cc:276] Timestamp: P: 1794926963695292 usec, L: 0
1117 14:49:35.798215 (+ 177us) write_op.cc:270] Start()
1117 14:49:35.798239 (+ 24us) write_op.cc:276] Timestamp: P: 1794926963705246 usec, L: 0
1117 14:49:35.798402 (+ 163us) write_op.cc:270] Start()
1117 14:49:35.798423 (+ 21us) write_op.cc:276] Timestamp: P: 1794926963723540 usec, L: 0
1117 14:49:35.798576 (+ 153us) write_op.cc:270] Start()
1117 14:49:35.798597 (+ 21us) write_op.cc:276] Timestamp: P: 1794926963725837 usec, L: 0
1117 14:49:35.798767 (+ 170us) write_op.cc:270] Start()
1117 14:49:35.798791 (+ 24us) write_op.cc:276] Timestamp: P: 1794926963745878 usec, L: 0
1117 14:49:35.798960 (+ 169us) write_op.cc:270] Start()
1117 14:49:35.798980 (+ 20us) write_op.cc:276] Timestamp: P: 1794926963764708 usec, L: 0
1117 14:49:35.799136 (+ 156us) write_op.cc:270] Start()
1117 14:49:35.799157 (+ 21us) write_op.cc:276] Timestamp: P: 1794926963765340 usec, L: 0
1117 14:49:35.799318 (+ 161us) write_op.cc:270] Start()
1117 14:49:35.799337 (+ 19us) write_op.cc:276] Timestamp: P: 1794926963799408 usec, L: 0
1117 14:49:35.799502 (+ 165us) write_op.cc:270] Start()
1117 14:49:35.799523 (+ 21us) write_op.cc:276] Timestamp: P: 1794926963808985 usec, L: 0
1117 14:49:35.799691 (+ 168us) write_op.cc:270] Start()
1117 14:49:35.799734 (+ 43us) write_op.cc:276] Timestamp: P: 1794926963813113 usec, L: 0
1117 14:49:35.805823 (+ 6089us) write_op.cc:270] Start()
1117 14:49:35.805850 (+ 27us) write_op.cc:276] Timestamp: P: 1794926963840668 usec, L: 0
1117 14:49:35.806061 (+ 211us) write_op.cc:270] Start()
1117 14:49:35.806085 (+ 24us) write_op.cc:276] Timestamp: P: 1794926963851036 usec, L: 0
1117 14:49:35.806325 (+ 240us) write_op.cc:270] Start()
1117 14:49:35.806348 (+ 23us) write_op.cc:276] Timestamp: P: 1794926963862789 usec, L: 0
1117 14:49:35.811530 (+ 5182us) write_op.cc:270] Start()
1117 14:49:35.811555 (+ 25us) write_op.cc:276] Timestamp: P: 1794926963885436 usec, L: 0
1117 14:49:35.811731 (+ 176us) write_op.cc:270] Start()
1117 14:49:35.811752 (+ 21us) write_op.cc:276] Timestamp: P: 1794926963901752 usec, L: 0
1117 14:49:35.811909 (+ 157us) write_op.cc:270] Start()
1117 14:49:35.811932 (+ 23us) write_op.cc:276] Timestamp: P: 1794926963913593 usec, L: 0
1117 14:49:35.812150 (+ 218us) write_op.cc:270] Start()
1117 14:49:35.812176 (+ 26us) write_op.cc:276] Timestamp: P: 1794926963945609 usec, L: 0
1117 14:49:35.812330 (+ 154us) write_op.cc:270] Start()
1117 14:49:35.812377 (+ 47us) write_op.cc:276] Timestamp: P: 1794926963947360 usec, L: 0
1117 14:49:35.814473 (+ 2096us) write_op.cc:270] Start()
1117 14:49:35.814497 (+ 24us) write_op.cc:276] Timestamp: P: 1794926963957943 usec, L: 0
1117 14:49:35.814670 (+ 173us) write_op.cc:270] Start()
1117 14:49:35.814692 (+ 22us) write_op.cc:276] Timestamp: P: 1794926963968993 usec, L: 0
1117 14:49:35.814847 (+ 155us) write_op.cc:270] Start()
1117 14:49:35.814869 (+ 22us) write_op.cc:276] Timestamp: P: 1794926963988509 usec, L: 0
1117 14:49:35.815061 (+ 192us) write_op.cc:270] Start()
1117 14:49:35.815083 (+ 22us) write_op.cc:276] Timestamp: P: 1794926964004170 usec, L: 0
1117 14:49:35.815249 (+ 166us) write_op.cc:270] Start()
1117 14:49:35.815276 (+ 27us) write_op.cc:276] Timestamp: P: 1794926964025119 usec, L: 0
1117 14:49:35.815429 (+ 153us) write_op.cc:270] Start()
1117 14:49:35.815450 (+ 21us) write_op.cc:276] Timestamp: P: 1794926964056621 usec, L: 0
1117 14:49:35.815612 (+ 162us) write_op.cc:270] Start()
1117 14:49:35.815634 (+ 22us) write_op.cc:276] Timestamp: P: 1794926964058771 usec, L: 0
1117 14:49:35.815833 (+ 199us) write_op.cc:270] Start()
1117 14:49:35.815861 (+ 28us) write_op.cc:276] Timestamp: P: 1794926964074094 usec, L: 0
1117 14:49:35.816087 (+ 226us) write_op.cc:270] Start()
1117 14:49:35.816111 (+ 24us) write_op.cc:276] Timestamp: P: 1794926964074734 usec, L: 0
1117 14:49:35.816281 (+ 170us) write_op.cc:270] Start()
1117 14:49:35.816304 (+ 23us) write_op.cc:276] Timestamp: P: 1794926964126006 usec, L: 0
1117 14:49:35.816487 (+ 183us) write_op.cc:270] Start()
1117 14:49:35.816510 (+ 23us) write_op.cc:276] Timestamp: P: 1794926964127308 usec, L: 0
1117 14:49:35.816678 (+ 168us) write_op.cc:270] Start()
1117 14:49:35.816699 (+ 21us) write_op.cc:276] Timestamp: P: 1794926964135299 usec, L: 0
1117 14:49:35.817692 (+ 993us) write_op.cc:270] Start()
1117 14:49:35.817728 (+ 36us) write_op.cc:276] Timestamp: P: 1794926964158593 usec, L: 0
1117 14:49:35.817935 (+ 207us) write_op.cc:270] Start()
1117 14:49:35.834291 (+ 16356us) write_op.cc:276] Timestamp: P: 1794926964173809 usec, L: 0
1117 14:49:35.841404 (+ 7113us) write_op.cc:270] Start()
1117 14:49:35.841712 (+ 308us) write_op.cc:276] Timestamp: P: 1794926964174788 usec, L: 0
1117 14:49:35.868680 (+ 26968us) write_op.cc:270] Start()
1117 14:49:35.868698 (+ 18us) write_op.cc:276] Timestamp: P: 1794926964197166 usec, L: 0
1117 14:49:35.870190 (+ 1492us) write_op.cc:270] Start()
1117 14:49:35.870212 (+ 22us) write_op.cc:276] Timestamp: P: 1794926964227188 usec, L: 0
1117 14:49:35.870372 (+ 160us) write_op.cc:270] Start()
1117 14:49:35.870395 (+ 23us) write_op.cc:276] Timestamp: P: 1794926964245219 usec, L: 0
1117 14:49:35.870553 (+ 158us) write_op.cc:270] Start()
1117 14:49:35.870574 (+ 21us) write_op.cc:276] Timestamp: P: 1794926964246638 usec, L: 0
1117 14:49:35.870715 (+ 141us) write_op.cc:270] Start()
1117 14:49:35.870733 (+ 18us) write_op.cc:276] Timestamp: P: 1794926964256292 usec, L: 0
1117 14:49:35.870921 (+ 188us) write_op.cc:270] Start()
1117 14:49:35.870942 (+ 21us) write_op.cc:276] Timestamp: P: 1794926964294549 usec, L: 0
1117 14:49:35.871124 (+ 182us) write_op.cc:270] Start()
1117 14:49:35.871145 (+ 21us) write_op.cc:276] Timestamp: P: 1794926964302183 usec, L: 0
1117 14:49:35.871297 (+ 152us) write_op.cc:270] Start()
1117 14:49:35.871316 (+ 19us) write_op.cc:276] Timestamp: P: 1794926964303877 usec, L: 0
1117 14:49:35.871453 (+ 137us) write_op.cc:270] Start()
1117 14:49:35.871474 (+ 21us) write_op.cc:276] Timestamp: P: 1794926964319878 usec, L: 0
1117 14:49:35.871647 (+ 173us) write_op.cc:270] Start()
1117 14:49:35.871668 (+ 21us) write_op.cc:276] Timestamp: P: 1794926964346029 usec, L: 0
1117 14:49:35.871823 (+ 155us) write_op.cc:270] Start()
1117 14:49:35.871844 (+ 21us) write_op.cc:276] Timestamp: P: 1794926964361954 usec, L: 0
1117 14:49:35.872065 (+ 221us) write_op.cc:270] Start()
1117 14:49:35.872086 (+ 21us) write_op.cc:276] Timestamp: P: 1794926964369181 usec, L: 0
1117 14:49:35.872234 (+ 148us) write_op.cc:270] Start()
1117 14:49:35.872253 (+ 19us) write_op.cc:276] Timestamp: P: 1794926964381481 usec, L: 0
1117 14:49:35.872432 (+ 179us) write_op.cc:270] Start()
1117 14:49:35.872478 (+ 46us) write_op.cc:276] Timestamp: P: 1794926964392153 usec, L: 0
1117 14:49:35.872663 (+ 185us) write_op.cc:270] Start()
1117 14:49:35.872704 (+ 41us) write_op.cc:276] Timestamp: P: 1794926964419536 usec, L: 0
1117 14:49:35.872854 (+ 150us) write_op.cc:270] Start()
1117 14:49:35.872874 (+ 20us) write_op.cc:276] Timestamp: P: 1794926964421335 usec, L: 0
1117 14:49:35.873698 (+ 824us) write_op.cc:270] Start()
1117 14:49:35.873720 (+ 22us) write_op.cc:276] Timestamp: P: 1794926964439716 usec, L: 0
1117 14:49:35.873881 (+ 161us) write_op.cc:270] Start()
1117 14:49:35.873903 (+ 22us) write_op.cc:276] Timestamp: P: 1794926964449057 usec, L: 0
1117 14:49:35.874079 (+ 176us) write_op.cc:270] Start()
1117 14:49:35.874109 (+ 30us) write_op.cc:276] Timestamp: P: 1794926964484857 usec, L: 0
1117 14:49:35.874258 (+ 149us) write_op.cc:270] Start()
1117 14:49:35.874279 (+ 21us) write_op.cc:276] Timestamp: P: 1794926964519304 usec, L: 0
1117 14:49:35.874440 (+ 161us) write_op.cc:270] Start()
1117 14:49:35.874460 (+ 20us) write_op.cc:276] Timestamp: P: 1794926964520073 usec, L: 0
1117 14:49:35.874634 (+ 174us) write_op.cc:270] Start()
1117 14:49:35.874655 (+ 21us) write_op.cc:276] Timestamp: P: 1794926964526571 usec, L: 0
1117 14:49:35.874798 (+ 143us) write_op.cc:270] Start()
1117 14:49:35.874818 (+ 20us) write_op.cc:276] Timestamp: P: 1794926964545268 usec, L: 0
1117 14:49:35.874960 (+ 142us) write_op.cc:270] Start()
1117 14:49:35.874978 (+ 18us) write_op.cc:276] Timestamp: P: 1794926964558365 usec, L: 0
1117 14:49:35.877489 (+ 2511us) write_op.cc:270] Start()
1117 14:49:35.877526 (+ 37us) write_op.cc:276] Timestamp: P: 1794926964575307 usec, L: 0
1117 14:49:35.877717 (+ 191us) write_op.cc:270] Start()
1117 14:49:35.877738 (+ 21us) write_op.cc:276] Timestamp: P: 1794926964577174 usec, L: 0
1117 14:49:35.877912 (+ 174us) write_op.cc:270] Start()
1117 14:49:35.877936 (+ 24us) write_op.cc:276] Timestamp: P: 1794926964589513 usec, L: 0
1117 14:49:35.878101 (+ 165us) write_op.cc:270] Start()
1117 14:49:35.878120 (+ 19us) write_op.cc:276] Timestamp: P: 1794926964622776 usec, L: 0
1117 14:49:35.878285 (+ 165us) write_op.cc:270] Start()
1117 14:49:35.878342 (+ 57us) write_op.cc:276] Timestamp: P: 1794926964623406 usec, L: 0
1117 14:49:35.878482 (+ 140us) write_op.cc:270] Start()
1117 14:49:35.878510 (+ 28us) write_op.cc:276] Timestamp: P: 1794926964630457 usec, L: 0
1117 14:49:35.878628 (+ 118us) write_op.cc:270] Start()
1117 14:49:35.878650 (+ 22us) write_op.cc:276] Timestamp: P: 1794926964664656 usec, L: 0
1117 14:49:35.878818 (+ 168us) write_op.cc:270] Start()
1117 14:49:35.878836 (+ 18us) write_op.cc:276] Timestamp: P: 1794926964687593 usec, L: 0
1117 14:49:35.878967 (+ 131us) write_op.cc:270] Start()
1117 14:49:35.878982 (+ 15us) write_op.cc:276] Timestamp: P: 1794926964689426 usec, L: 0
1117 14:49:35.879824 (+ 842us) write_op.cc:270] Start()
1117 14:49:35.879845 (+ 21us) write_op.cc:276] Timestamp: P: 1794926964717461 usec, L: 0
1117 14:49:35.879972 (+ 127us) write_op.cc:270] Start()
1117 14:49:35.879989 (+ 17us) write_op.cc:276] Timestamp: P: 1794926964730700 usec, L: 0
1117 14:49:35.880125 (+ 136us) write_op.cc:270] Start()
1117 14:49:35.880142 (+ 17us) write_op.cc:276] Timestamp: P: 1794926964737901 usec, L: 0
1117 14:49:35.881751 (+ 1609us) write_op.cc:270] Start()
1117 14:49:35.881781 (+ 30us) write_op.cc:276] Timestamp: P: 1794926964765955 usec, L: 0
1117 14:49:35.883412 (+ 1631us) write_op.cc:270] Start()
1117 14:49:35.883433 (+ 21us) write_op.cc:276] Timestamp: P: 1794926964769699 usec, L: 0
1117 14:49:35.883581 (+ 148us) write_op.cc:270] Start()
1117 14:49:35.883599 (+ 18us) write_op.cc:276] Timestamp: P: 1794926964797410 usec, L: 0
1117 14:49:35.883718 (+ 119us) write_op.cc:270] Start()
1117 14:49:35.883734 (+ 16us) write_op.cc:276] Timestamp: P: 1794926964808400 usec, L: 0
1117 14:49:35.883849 (+ 115us) write_op.cc:270] Start()
1117 14:49:35.883865 (+ 16us) write_op.cc:276] Timestamp: P: 1794926964811148 usec, L: 0
1117 14:49:35.883989 (+ 124us) write_op.cc:270] Start()
1117 14:49:35.884007 (+ 18us) write_op.cc:276] Timestamp: P: 1794926964811839 usec, L: 0
1117 14:49:35.884134 (+ 127us) write_op.cc:270] Start()
1117 14:49:35.884149 (+ 15us) write_op.cc:276] Timestamp: P: 1794926964848267 usec, L: 0
1117 14:49:35.884303 (+ 154us) write_op.cc:270] Start()
1117 14:49:35.884319 (+ 16us) write_op.cc:276] Timestamp: P: 1794926964886268 usec, L: 0
1117 14:49:35.884477 (+ 158us) write_op.cc:270] Start()
1117 14:49:35.884505 (+ 28us) write_op.cc:276] Timestamp: P: 1794926964889219 usec, L: 0
1117 14:49:35.884625 (+ 120us) write_op.cc:270] Start()
1117 14:49:35.884641 (+ 16us) write_op.cc:276] Timestamp: P: 1794926964893957 usec, L: 0
1117 14:49:35.884769 (+ 128us) write_op.cc:270] Start()
1117 14:49:35.884791 (+ 22us) write_op.cc:276] Timestamp: P: 1794926964916103 usec, L: 0
1117 14:49:35.884918 (+ 127us) write_op.cc:270] Start()
1117 14:49:35.884934 (+ 16us) write_op.cc:276] Timestamp: P: 1794926964919548 usec, L: 0
1117 14:49:35.885061 (+ 127us) write_op.cc:270] Start()
1117 14:49:35.885077 (+ 16us) write_op.cc:276] Timestamp: P: 1794926964921321 usec, L: 0
1117 14:49:35.885192 (+ 115us) write_op.cc:270] Start()
1117 14:49:35.885208 (+ 16us) write_op.cc:276] Timestamp: P: 1794926964947990 usec, L: 0
1117 14:49:35.885344 (+ 136us) write_op.cc:270] Start()
1117 14:49:35.885360 (+ 16us) write_op.cc:276] Timestamp: P: 1794926964981095 usec, L: 0
1117 14:49:35.885477 (+ 117us) write_op.cc:270] Start()
1117 14:49:35.885493 (+ 16us) write_op.cc:276] Timestamp: P: 1794926965007496 usec, L: 0
1117 14:49:35.885637 (+ 144us) write_op.cc:270] Start()
1117 14:49:35.885665 (+ 28us) write_op.cc:276] Timestamp: P: 1794926965008217 usec, L: 0
1117 14:49:35.885795 (+ 130us) write_op.cc:270] Start()
1117 14:49:35.885812 (+ 17us) write_op.cc:276] Timestamp: P: 1794926965011372 usec, L: 0
1117 14:49:35.885926 (+ 114us) write_op.cc:270] Start()
1117 14:49:35.885942 (+ 16us) write_op.cc:276] Timestamp: P: 1794926965039418 usec, L: 0
1117 14:49:35.886064 (+ 122us) write_op.cc:270] Start()
1117 14:49:35.886080 (+ 16us) write_op.cc:276] Timestamp: P: 1794926965062547 usec, L: 0
1117 14:49:35.886231 (+ 151us) write_op.cc:270] Start()
1117 14:49:35.886250 (+ 19us) write_op.cc:276] Timestamp: P: 1794926965075139 usec, L: 0
1117 14:49:35.886446 (+ 196us) write_op.cc:270] Start()
1117 14:49:35.886468 (+ 22us) write_op.cc:276] Timestamp: P: 1794926965075883 usec, L: 0
1117 14:49:35.886653 (+ 185us) write_op.cc:270] Start()
1117 14:49:35.886675 (+ 22us) write_op.cc:276] Timestamp: P: 1794926965102817 usec, L: 0
1117 14:49:35.922936 (+ 36261us) write_op.cc:270] Start()
1117 14:49:35.922952 (+ 16us) write_op.cc:276] Timestamp: P: 1794926965129905 usec, L: 0
1117 14:49:35.924052 (+ 1100us) write_op.cc:270] Start()
1117 14:49:35.924073 (+ 21us) write_op.cc:276] Timestamp: P: 1794926965147042 usec, L: 0
1117 14:49:35.924234 (+ 161us) write_op.cc:270] Start()
1117 14:49:35.924253 (+ 19us) write_op.cc:276] Timestamp: P: 1794926965170396 usec, L: 0
1117 14:49:35.924378 (+ 125us) write_op.cc:270] Start()
1117 14:49:35.924416 (+ 38us) write_op.cc:276] Timestamp: P: 1794926965174893 usec, L: 0
1117 14:49:35.928563 (+ 4147us) write_op.cc:270] Start()
1117 14:49:35.928588 (+ 25us) write_op.cc:276] Timestamp: P: 1794926965183480 usec, L: 0
1117 14:49:35.928798 (+ 210us) write_op.cc:270] Start()
1117 14:49:35.928893 (+ 95us) write_op.cc:276] Timestamp: P: 1794926965190046 usec, L: 0
1117 14:49:35.929085 (+ 192us) write_op.cc:270] Start()
1117 14:49:35.929106 (+ 21us) write_op.cc:276] Timestamp: P: 1794926965215610 usec, L: 0
1117 14:49:35.929274 (+ 168us) write_op.cc:270] Start()
1117 14:49:35.929295 (+ 21us) write_op.cc:276] Timestamp: P: 1794926965251234 usec, L: 0
1117 14:49:35.929438 (+ 143us) write_op.cc:270] Start()
1117 14:49:35.929462 (+ 24us) write_op.cc:276] Timestamp: P: 1794926965254771 usec, L: 0
1117 14:49:35.929620 (+ 158us) write_op.cc:270] Start()
1117 14:49:35.929640 (+ 20us) write_op.cc:276] Timestamp: P: 1794926965258660 usec, L: 0
1117 14:49:35.929790 (+ 150us) write_op.cc:270] Start()
1117 14:49:35.929810 (+ 20us) write_op.cc:276] Timestamp: P: 1794926965267683 usec, L: 0
1117 14:49:35.929952 (+ 142us) write_op.cc:270] Start()
1117 14:49:35.929971 (+ 19us) write_op.cc:276] Timestamp: P: 1794926965292833 usec, L: 0
1117 14:49:35.930128 (+ 157us) write_op.cc:270] Start()
1117 14:49:35.930151 (+ 23us) write_op.cc:276] Timestamp: P: 1794926965314382 usec, L: 0
1117 14:49:35.930308 (+ 157us) write_op.cc:270] Start()
1117 14:49:35.930327 (+ 19us) write_op.cc:276] Timestamp: P: 1794926965316039 usec, L: 0
1117 14:49:35.930492 (+ 165us) write_op.cc:270] Start()
1117 14:49:35.930524 (+ 32us) write_op.cc:276] Timestamp: P: 1794926965328244 usec, L: 0
1117 14:49:35.944738 (+ 14214us) write_op.cc:270] Start()
1117 14:49:35.944758 (+ 20us) write_op.cc:276] Timestamp: P: 1794926965376323 usec, L: 0
1117 14:49:35.945441 (+ 683us) write_op.cc:270] Start()
1117 14:49:35.945464 (+ 23us) write_op.cc:276] Timestamp: P: 1794926965377502 usec, L: 0
1117 14:49:35.945693 (+ 229us) write_op.cc:270] Start()
1117 14:49:35.945715 (+ 22us) write_op.cc:276] Timestamp: P: 1794926965379604 usec, L: 0
1117 14:49:35.949999 (+ 4284us) write_op.cc:270] Start()
1117 14:49:35.950031 (+ 32us) write_op.cc:276] Timestamp: P: 1794926965431106 usec, L: 0
1117 14:49:35.950207 (+ 176us) write_op.cc:270] Start()
1117 14:49:35.950250 (+ 43us) write_op.cc:276] Timestamp: P: 1794926965434451 usec, L: 0
1117 14:49:35.950404 (+ 154us) write_op.cc:270] Start()
1117 14:49:35.950425 (+ 21us) write_op.cc:276] Timestamp: P: 1794926965461219 usec, L: 0
1117 14:49:35.950613 (+ 188us) write_op.cc:270] Start()
1117 14:49:35.950634 (+ 21us) write_op.cc:276] Timestamp: P: 1794926965463021 usec, L: 0
1117 14:49:35.954549 (+ 3915us) write_op.cc:270] Start()
1117 14:49:35.954575 (+ 26us) write_op.cc:276] Timestamp: P: 1794926965483830 usec, L: 0
1117 14:49:35.954731 (+ 156us) write_op.cc:270] Start()
1117 14:49:35.954752 (+ 21us) write_op.cc:276] Timestamp: P: 1794926965499360 usec, L: 0
1117 14:49:35.956510 (+ 1758us) write_op.cc:270] Start()
1117 14:49:35.956542 (+ 32us) write_op.cc:276] Timestamp: P: 1794926965528555 usec, L: 0
1117 14:49:35.956755 (+ 213us) write_op.cc:270] Start()
1117 14:49:35.956778 (+ 23us) write_op.cc:276] Timestamp: P: 1794926965553434 usec, L: 0
1117 14:49:35.956931 (+ 153us) write_op.cc:270] Start()
1117 14:49:35.956952 (+ 21us) write_op.cc:276] Timestamp: P: 1794926965554562 usec, L: 0
1117 14:49:35.978114 (+ 21162us) write_op.cc:270] Start()
1117 14:49:35.978148 (+ 34us) write_op.cc:276] Timestamp: P: 1794926965561313 usec, L: 0
1117 14:49:35.978327 (+ 179us) write_op.cc:270] Start()
1117 14:49:35.978344 (+ 17us) write_op.cc:276] Timestamp: P: 1794926965612727 usec, L: 0
1117 14:49:35.978458 (+ 114us) write_op.cc:270] Start()
1117 14:49:35.978473 (+ 15us) write_op.cc:276] Timestamp: P: 1794926965636764 usec, L: 0
1117 14:49:35.978614 (+ 141us) write_op.cc:270] Start()
1117 14:49:35.978630 (+ 16us) write_op.cc:276] Timestamp: P: 1794926965660262 usec, L: 0
1117 14:49:35.978774 (+ 144us) write_op.cc:270] Start()
1117 14:49:35.978791 (+ 17us) write_op.cc:276] Timestamp: P: 1794926965662825 usec, L: 0
1117 14:49:35.978913 (+ 122us) write_op.cc:270] Start()
1117 14:49:35.978930 (+ 17us) write_op.cc:276] Timestamp: P: 1794926965664596 usec, L: 0
1117 14:49:35.979047 (+ 117us) write_op.cc:270] Start()
1117 14:49:35.979064 (+ 17us) write_op.cc:276] Timestamp: P: 1794926965708955 usec, L: 0
1117 14:49:35.988701 (+ 9637us) write_op.cc:270] Start()
1117 14:49:35.988717 (+ 16us) write_op.cc:276] Timestamp: P: 1794926965730542 usec, L: 0
1117 14:49:36.004933 (+ 16216us) write_op.cc:270] Start()
1117 14:49:36.004957 (+ 24us) write_op.cc:276] Timestamp: P: 17949269
I20261117 14:49:39.770696 7421 raft_consensus.cc:499] T 57984748adc7482a9a2d999a447a81af P ec41d6947a4a4eadadf90c3756899704 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader def6b23bccc94a78a47118da331f2798)
I20261117 14:49:39.781426 7421 raft_consensus.cc:521] T 57984748adc7482a9a2d999a447a81af P ec41d6947a4a4eadadf90c3756899704 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:39.784888 6788 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "57984748adc7482a9a2d999a447a81af" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 3 candidate_status { last_received { term: 2 index: 784 } } ignore_live_leader: false dest_uuid: "def6b23bccc94a78a47118da331f2798" is_pre_election: true
I20261117 14:49:39.785781 7421 leader_election.cc:290] T 57984748adc7482a9a2d999a447a81af P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271), def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611)
I20261117 14:49:38.304401 7341 rpcz_store.cc:276] 1117 14:49:35.265765 (+ 0us) service_pool.cc:167] Inserting onto call queue
1117 14:49:35.272495 (+ 6730us) service_pool.cc:224] Handling call
1117 14:49:35.389728 (+117233us) raft_consensus.cc:1481] Updating replica for 609 ops
1117 14:49:35.841720 (+451992us) raft_consensus.cc:1545] Early marking committed up to index 0
1117 14:49:35.841725 (+ 5us) raft_consensus.cc:1550] Triggering prepare for 609 ops
1117 14:49:35.841878 (+ 153us) write_op.cc:270] Start()
1117 14:49:35.841900 (+ 22us) write_op.cc:276] Timestamp: P: 1794926962440706 usec, L: 0
1117 14:49:35.894057 (+ 52157us) write_op.cc:270] Start()
1117 14:49:35.894083 (+ 26us) write_op.cc:276] Timestamp: P: 1794926962441657 usec, L: 0
1117 14:49:35.894261 (+ 178us) write_op.cc:270] Start()
1117 14:49:35.894288 (+ 27us) write_op.cc:276] Timestamp: P: 1794926962460353 usec, L: 0
1117 14:49:35.894489 (+ 201us) write_op.cc:270] Start()
1117 14:49:35.894513 (+ 24us) write_op.cc:276] Timestamp: P: 1794926962462933 usec, L: 0
1117 14:49:35.894689 (+ 176us) write_op.cc:270] Start()
1117 14:49:35.894710 (+ 21us) write_op.cc:276] Timestamp: P: 1794926962644017 usec, L: 0
1117 14:49:35.894876 (+ 166us) write_op.cc:270] Start()
1117 14:49:35.894897 (+ 21us) write_op.cc:276] Timestamp: P: 1794926962653135 usec, L: 0
1117 14:49:35.895101 (+ 204us) write_op.cc:270] Start()
1117 14:49:35.895154 (+ 53us) write_op.cc:276] Timestamp: P: 1794926962678386 usec, L: 0
1117 14:49:35.895330 (+ 176us) write_op.cc:270] Start()
1117 14:49:35.895351 (+ 21us) write_op.cc:276] Timestamp: P: 1794926962702216 usec, L: 0
1117 14:49:35.895523 (+ 172us) write_op.cc:270] Start()
1117 14:49:35.895546 (+ 23us) write_op.cc:276] Timestamp: P: 1794926962703776 usec, L: 0
1117 14:49:35.895700 (+ 154us) write_op.cc:270] Start()
1117 14:49:35.895720 (+ 20us) write_op.cc:276] Timestamp: P: 1794926962727894 usec, L: 0
1117 14:49:35.895874 (+ 154us) write_op.cc:270] Start()
1117 14:49:35.895895 (+ 21us) write_op.cc:276] Timestamp: P: 1794926962730374 usec, L: 0
1117 14:49:35.896079 (+ 184us) write_op.cc:270] Start()
1117 14:49:35.896119 (+ 40us) write_op.cc:276] Timestamp: P: 1794926962782702 usec, L: 0
1117 14:49:35.920548 (+ 24429us) write_op.cc:270] Start()
1117 14:49:35.920569 (+ 21us) write_op.cc:276] Timestamp: P: 1794926962788225 usec, L: 0
1117 14:49:35.920719 (+ 150us) write_op.cc:270] Start()
1117 14:49:35.920737 (+ 18us) write_op.cc:276] Timestamp: P: 1794926962797809 usec, L: 0
1117 14:49:35.920873 (+ 136us) write_op.cc:270] Start()
1117 14:49:35.920892 (+ 19us) write_op.cc:276] Timestamp: P: 1794926962799171 usec, L: 0
1117 14:49:35.921032 (+ 140us) write_op.cc:270] Start()
1117 14:49:35.921050 (+ 18us) write_op.cc:276] Timestamp: P: 1794926962836569 usec, L: 0
1117 14:49:35.921195 (+ 145us) write_op.cc:270] Start()
1117 14:49:35.921221 (+ 26us) write_op.cc:276] Timestamp: P: 1794926962838705 usec, L: 0
1117 14:49:35.921420 (+ 199us) write_op.cc:270] Start()
1117 14:49:35.921439 (+ 19us) write_op.cc:276] Timestamp: P: 1794926962846887 usec, L: 0
1117 14:49:35.921574 (+ 135us) write_op.cc:270] Start()
1117 14:49:35.921592 (+ 18us) write_op.cc:276] Timestamp: P: 1794926962855078 usec, L: 0
1117 14:49:35.921746 (+ 154us) write_op.cc:270] Start()
1117 14:49:35.921763 (+ 17us) write_op.cc:276] Timestamp: P: 1794926962896050 usec, L: 0
1117 14:49:35.921890 (+ 127us) write_op.cc:270] Start()
1117 14:49:35.921906 (+ 16us) write_op.cc:276] Timestamp: P: 1794926962896784 usec, L: 0
1117 14:49:35.922023 (+ 117us) write_op.cc:270] Start()
1117 14:49:35.922040 (+ 17us) write_op.cc:276] Timestamp: P: 1794926962914839 usec, L: 0
1117 14:49:35.922201 (+ 161us) write_op.cc:270] Start()
1117 14:49:35.922220 (+ 19us) write_op.cc:276] Timestamp: P: 1794926962926049 usec, L: 0
1117 14:49:35.922353 (+ 133us) write_op.cc:270] Start()
1117 14:49:35.922374 (+ 21us) write_op.cc:276] Timestamp: P: 1794926962947423 usec, L: 0
1117 14:49:35.922544 (+ 170us) write_op.cc:270] Start()
1117 14:49:35.922566 (+ 22us) write_op.cc:276] Timestamp: P: 1794926962975098 usec, L: 0
1117 14:49:35.922749 (+ 183us) write_op.cc:270] Start()
1117 14:49:35.922770 (+ 21us) write_op.cc:276] Timestamp: P: 1794926962985858 usec, L: 0
1117 14:49:35.922926 (+ 156us) write_op.cc:270] Start()
1117 14:49:35.922946 (+ 20us) write_op.cc:276] Timestamp: P: 1794926962989396 usec, L: 0
1117 14:49:35.923153 (+ 207us) write_op.cc:270] Start()
1117 14:49:35.923184 (+ 31us) write_op.cc:276] Timestamp: P: 1794926962995303 usec, L: 0
1117 14:49:35.923352 (+ 168us) write_op.cc:270] Start()
1117 14:49:35.923373 (+ 21us) write_op.cc:276] Timestamp: P: 1794926963040604 usec, L: 0
1117 14:49:35.923541 (+ 168us) write_op.cc:270] Start()
1117 14:49:35.923563 (+ 22us) write_op.cc:276] Timestamp: P: 1794926963046046 usec, L: 0
1117 14:49:35.923726 (+ 163us) write_op.cc:270] Start()
1117 14:49:35.923749 (+ 23us) write_op.cc:276] Timestamp: P: 1794926963053981 usec, L: 0
1117 14:49:35.923917 (+ 168us) write_op.cc:270] Start()
1117 14:49:35.923939 (+ 22us) write_op.cc:276] Timestamp: P: 1794926963055705 usec, L: 0
1117 14:49:35.924126 (+ 187us) write_op.cc:270] Start()
1117 14:49:35.924145 (+ 19us) write_op.cc:276] Timestamp: P: 1794926963089879 usec, L: 0
1117 14:49:35.924279 (+ 134us) write_op.cc:270] Start()
1117 14:49:35.924297 (+ 18us) write_op.cc:276] Timestamp: P: 1794926963102894 usec, L: 0
1117 14:49:35.924428 (+ 131us) write_op.cc:270] Start()
1117 14:49:35.952485 (+ 28057us) write_op.cc:276] Timestamp: P: 1794926963124449 usec, L: 0
1117 14:49:35.952717 (+ 232us) write_op.cc:270] Start()
1117 14:49:35.952740 (+ 23us) write_op.cc:276] Timestamp: P: 1794926963125191 usec, L: 0
1117 14:49:35.952914 (+ 174us) write_op.cc:270] Start()
1117 14:49:35.952980 (+ 66us) write_op.cc:276] Timestamp: P: 1794926963149441 usec, L: 0
1117 14:49:35.953340 (+ 360us) write_op.cc:270] Start()
1117 14:49:35.953364 (+ 24us) write_op.cc:276] Timestamp: P: 1794926963155244 usec, L: 0
1117 14:49:35.953578 (+ 214us) write_op.cc:270] Start()
1117 14:49:35.953598 (+ 20us) write_op.cc:276] Timestamp: P: 1794926963192970 usec, L: 0
1117 14:49:35.953741 (+ 143us) write_op.cc:270] Start()
1117 14:49:35.953762 (+ 21us) write_op.cc:276] Timestamp: P: 1794926963193674 usec, L: 0
1117 14:49:35.953902 (+ 140us) write_op.cc:270] Start()
1117 14:49:35.953923 (+ 21us) write_op.cc:276] Timestamp: P: 1794926963226806 usec, L: 0
1117 14:49:35.954073 (+ 150us) write_op.cc:270] Start()
1117 14:49:35.954092 (+ 19us) write_op.cc:276] Timestamp: P: 1794926963239843 usec, L: 0
1117 14:49:35.954247 (+ 155us) write_op.cc:270] Start()
1117 14:49:35.954267 (+ 20us) write_op.cc:276] Timestamp: P: 1794926963262081 usec, L: 0
1117 14:49:35.954403 (+ 136us) write_op.cc:270] Start()
1117 14:49:35.954443 (+ 40us) write_op.cc:276] Timestamp: P: 1794926963271573 usec, L: 0
1117 14:49:35.954595 (+ 152us) write_op.cc:270] Start()
1117 14:49:35.954612 (+ 17us) write_op.cc:276] Timestamp: P: 1794926963300799 usec, L: 0
1117 14:49:35.954742 (+ 130us) write_op.cc:270] Start()
1117 14:49:35.954757 (+ 15us) write_op.cc:276] Timestamp: P: 1794926963307443 usec, L: 0
1117 14:49:35.988629 (+ 33872us) write_op.cc:270] Start()
1117 14:49:35.988653 (+ 24us) write_op.cc:276] Timestamp: P: 1794926963309969 usec, L: 0
1117 14:49:35.999719 (+ 11066us) write_op.cc:270] Start()
1117 14:49:35.999744 (+ 25us) write_op.cc:276] Timestamp: P: 1794926963343224 usec, L: 0
1117 14:49:35.999931 (+ 187us) write_op.cc:270] Start()
1117 14:49:35.999953 (+ 22us) write_op.cc:276] Timestamp: P: 1794926963362315 usec, L: 0
1117 14:49:36.000127 (+ 174us) write_op.cc:270] Start()
1117 14:49:36.000147 (+ 20us) write_op.cc:276] Timestamp: P: 1794926963368556 usec, L: 0
1117 14:49:36.000336 (+ 189us) write_op.cc:270] Start()
1117 14:49:36.000363 (+ 27us) write_op.cc:276] Timestamp: P: 1794926963380766 usec, L: 0
1117 14:49:36.000549 (+ 186us) write_op.cc:270] Start()
1117 14:49:36.000570 (+ 21us) write_op.cc:276] Timestamp: P: 1794926963391222 usec, L: 0
1117 14:49:36.000715 (+ 145us) write_op.cc:270] Start()
1117 14:49:36.000734 (+ 19us) write_op.cc:276] Timestamp: P: 1794926963403556 usec, L: 0
1117 14:49:36.000880 (+ 146us) write_op.cc:270] Start()
1117 14:49:36.000901 (+ 21us) write_op.cc:276] Timestamp: P: 1794926963414631 usec, L: 0
1117 14:49:36.001050 (+ 149us) write_op.cc:270] Start()
1117 14:49:36.001070 (+ 20us) write_op.cc:276] Timestamp: P: 1794926963448416 usec, L: 0
1117 14:49:36.001275 (+ 205us) write_op.cc:270] Start()
1117 14:49:36.001300 (+ 25us) write_op.cc:276] Timestamp: P: 1794926963473510 usec, L: 0
1117 14:49:36.001448 (+ 148us) write_op.cc:270] Start()
1117 14:49:36.001471 (+ 23us) write_op.cc:276] Timestamp: P: 1794926963477520 usec, L: 0
1117 14:49:36.001675 (+ 204us) write_op.cc:270] Start()
1117 14:49:36.001696 (+ 21us) write_op.cc:276] Timestamp: P: 1794926963478654 usec, L: 0
1117 14:49:36.001862 (+ 166us) write_op.cc:270] Start()
1117 14:49:36.001884 (+ 22us) write_op.cc:276] Timestamp: P: 1794926963504813 usec, L: 0
1117 14:49:36.002055 (+ 171us) write_op.cc:270] Start()
1117 14:49:36.002114 (+ 59us) write_op.cc:276] Timestamp: P: 1794926963523913 usec, L: 0
1117 14:49:36.002272 (+ 158us) write_op.cc:270] Start()
1117 14:49:36.002293 (+ 21us) write_op.cc:276] Timestamp: P: 1794926963526317 usec, L: 0
1117 14:49:36.002445 (+ 152us) write_op.cc:270] Start()
1117 14:49:36.002465 (+ 20us) write_op.cc:276] Timestamp: P: 1794926963570039 usec, L: 0
1117 14:49:36.002615 (+ 150us) write_op.cc:270] Start()
1117 14:49:36.003153 (+ 538us) write_op.cc:276] Timestamp: P: 1794926963571556 usec, L: 0
1117 14:49:36.003336 (+ 183us) write_op.cc:270] Start()
1117 14:49:36.003357 (+ 21us) write_op.cc:276] Timestamp: P: 1794926963596665 usec, L: 0
1117 14:49:36.003563 (+ 206us) write_op.cc:270] Start()
1117 14:49:36.003585 (+ 22us) write_op.cc:276] Timestamp: P: 1794926963622344 usec, L: 0
1117 14:49:36.003747 (+ 162us) write_op.cc:270] Start()
1117 14:49:36.003768 (+ 21us) write_op.cc:276] Timestamp: P: 1794926963637682 usec, L: 0
1117 14:49:36.003925 (+ 157us) write_op.cc:270] Start()
1117 14:49:36.003945 (+ 20us) write_op.cc:276] Timestamp: P: 1794926963645596 usec, L: 0
1117 14:49:36.004079 (+ 134us) write_op.cc:270] Start()
1117 14:49:36.004098 (+ 19us) write_op.cc:276] Timestamp: P: 1794926963655174 usec, L: 0
1117 14:49:36.004234 (+ 136us) write_op.cc:270] Start()
1117 14:49:36.004254 (+ 20us) write_op.cc:276] Timestamp: P: 1794926963665130 usec, L: 0
1117 14:49:36.004397 (+ 143us) write_op.cc:270] Start()
1117 14:49:36.004416 (+ 19us) write_op.cc:276] Timestamp: P: 1794926963690191 usec, L: 0
1117 14:49:36.004642 (+ 226us) write_op.cc:270] Start()
1117 14:49:36.004662 (+ 20us) write_op.cc:276] Timestamp: P: 1794926963704525 usec, L: 0
1117 14:49:36.020547 (+ 15885us) write_op.cc:270] Start()
1117 14:49:36.020570 (+ 23us) write_op.cc:276] Timestamp: P: 1794926963713867 usec, L: 0
1117 14:49:36.021218 (+ 648us) write_op.cc:270] Start()
1117 14:49:36.021246 (+ 28us) write_op.cc:276] Timestamp: P: 1794926963714580 usec, L: 0
1117 14:49:36.021414 (+ 168us) write_op.cc:270] Start()
1117 14:49:36.021431 (+ 17us) write_op.cc:276] Timestamp: P: 1794926963743291 usec, L: 0
1117 14:49:36.021562 (+ 131us) write_op.cc:270] Start()
1117 14:49:36.021581 (+ 19us) write_op.cc:276] Timestamp: P: 1794926963762819 usec, L: 0
1117 14:49:36.022720 (+ 1139us) write_op.cc:270] Start()
1117 14:49:36.022738 (+ 18us) write_op.cc:276] Timestamp: P: 1794926963767712 usec, L: 0
1117 14:49:36.022926 (+ 188us) write_op.cc:270] Start()
1117 14:49:36.022943 (+ 17us) write_op.cc:276] Timestamp: P: 1794926963769273 usec, L: 0
1117 14:49:36.023076 (+ 133us) write_op.cc:270] Start()
1117 14:49:36.023092 (+ 16us) write_op.cc:276] Timestamp: P: 1794926963803248 usec, L: 0
1117 14:49:36.023246 (+ 154us) write_op.cc:270] Start()
1117 14:49:36.023311 (+ 65us) write_op.cc:276] Timestamp: P: 1794926963821703 usec, L: 0
1117 14:49:36.023528 (+ 217us) write_op.cc:270] Start()
1117 14:49:36.023550 (+ 22us) write_op.cc:276] Timestamp: P: 1794926963836781 usec, L: 0
1117 14:49:36.024988 (+ 1438us) write_op.cc:270] Start()
1117 14:49:36.025010 (+ 22us) write_op.cc:276] Timestamp: P: 1794926963841715 usec, L: 0
1117 14:49:36.028622 (+ 3612us) write_op.cc:270] Start()
1117 14:49:36.028646 (+ 24us) write_op.cc:276] Timestamp: P: 1794926963861363 usec, L: 0
1117 14:49:36.028809 (+ 163us) write_op.cc:270] Start()
1117 14:49:36.028832 (+ 23us) write_op.cc:276] Timestamp: P: 1794926963892084 usec, L: 0
1117 14:49:36.028966 (+ 134us) write_op.cc:270] Start()
1117 14:49:36.028986 (+ 20us) write_op.cc:276] Timestamp: P: 1794926963901234 usec, L: 0
1117 14:49:36.029125 (+ 139us) write_op.cc:270] Start()
1117 14:49:36.029144 (+ 19us) write_op.cc:276] Timestamp: P: 1794926963911992 usec, L: 0
1117 14:49:36.029291 (+ 147us) write_op.cc:270] Start()
1117 14:49:36.029309 (+ 18us) write_op.cc:276] Timestamp: P: 1794926963927955 usec, L: 0
1117 14:49:36.029464 (+ 155us) write_op.cc:270] Start()
1117 14:49:36.029483 (+ 19us) write_op.cc:276] Timestamp: P: 1794926963942175 usec, L: 0
1117 14:49:36.029646 (+ 163us) write_op.cc:270] Start()
1117 14:49:36.029666 (+ 20us) write_op.cc:276] Timestamp: P: 1794926963962966 usec, L: 0
1117 14:49:36.029790 (+ 124us) write_op.cc:270] Start()
1117 14:49:36.029805 (+ 15us) write_op.cc:276] Timestamp: P: 1794926963986575 usec, L: 0
1117 14:49:36.029909 (+ 104us) write_op.cc:270] Start()
1117 14:49:36.029923 (+ 14us) write_op.cc:276] Timestamp: P: 1794926964002236 usec, L: 0
1117 14:49:36.030069 (+ 146us) write_op.cc:270] Start()
1117 14:49:36.030086 (+ 17us) write_op.cc:276] Timestamp: P: 1794926964006806 usec, L: 0
1117 14:49:36.030230 (+ 144us) write_op.cc:270] Start()
1117 14:49:36.030248 (+ 18us) write_op.cc:276] Timestamp: P: 1794926964037979 usec, L: 0
1117 14:49:36.030375 (+ 127us) write_op.cc:270] Start()
1117 14:49:36.030391 (+ 16us) write_op.cc:276] Timestamp: P: 1794926964049559 usec, L: 0
1117 14:49:36.041304 (+ 10913us) write_op.cc:270] Start()
1117 14:49:36.041326 (+ 22us) write_op.cc:276] Timestamp: P: 1794926964050913 usec, L: 0
1117 14:49:36.041508 (+ 182us) write_op.cc:270] Start()
1117 14:49:36.041532 (+ 24us) write_op.cc:276] Timestamp: P: 1794926964064216 usec, L: 0
1117 14:49:36.041746 (+ 214us) write_op.cc:270] Start()
1117 14:49:36.041768 (+ 22us) write_op.cc:276] Timestamp: P: 1794926964078363 usec, L: 0
1117 14:49:36.047332 (+ 5564us) write_op.cc:270] Start()
1117 14:49:36.047358 (+ 26us) write_op.cc:276] Timestamp: P: 1794926964118162 usec, L: 0
1117 14:49:36.047530 (+ 172us) write_op.cc:270] Start()
1117 14:49:36.047549 (+ 19us) write_op.cc:276] Timestamp: P: 1794926964127417 usec, L: 0
1117 14:49:36.047714 (+ 165us) write_op.cc:270] Start()
1117 14:49:36.047732 (+ 18us) write_op.cc:276] Timestamp: P: 1794926964140425 usec, L: 0
1117 14:49:36.047860 (+ 128us) write_op.cc:270] Start()
1117 14:49:36.047876 (+ 16us) write_op.cc:276] Timestamp: P: 1794926964162552 usec, L: 0
1117 14:49:36.048000 (+ 124us) write_op.cc:270] Start()
1117 14:49:36.048017 (+ 17us) write_op.cc:276] Timestamp: P: 1794926964172120 usec, L: 0
1117 14:49:36.048192 (+ 175us) write_op.cc:270] Start()
1117 14:49:36.048209 (+ 17us) write_op.cc:276] Timestamp: P: 1794926964179873 usec, L: 0
1117 14:49:36.048336 (+ 127us) write_op.cc:270] Start()
1117 14:49:36.048351 (+ 15us) write_op.cc:276] Timestamp: P: 1794926964194151 usec, L: 0
1117 14:49:36.048497 (+ 146us) write_op.cc:270] Start()
1117 14:49:36.048514 (+ 17us) write_op.cc:276] Timestamp: P: 1794926964224728 usec, L: 0
1117 14:49:36.048639 (+ 125us) write_op.cc:270] Start()
1117 14:49:36.048655 (+ 16us) write_op.cc:276] Timestamp: P: 1794926964248117 usec, L: 0
1117 14:49:36.048764 (+ 109us) write_op.cc:270] Start()
1117 14:49:36.048779 (+ 15us) write_op.cc:276] Timestamp: P: 1794926964250324 usec, L: 0
1117 14:49:36.048907 (+ 128us) write_op.cc:270] Start()
1117 14:49:36.048923 (+ 16us) write_op.cc:276] Timestamp: P: 1794926964253778 usec, L: 0
1117 14:49:36.049075 (+ 152us) write_op.cc:270] Start()
1117 14:49:36.049092 (+ 17us) write_op.cc:276] Timestamp: P: 1794926964287985 usec, L: 0
1117 14:49:36.049218 (+ 126us) write_op.cc:270] Start()
1117 14:49:36.049234 (+ 16us) write_op.cc:276] Timestamp: P: 1794926964294433 usec, L: 0
1117 14:49:36.049372 (+ 138us) write_op.cc:270] Start()
1117 14:49:36.049389 (+ 17us) write_op.cc:276] Timestamp: P: 1794926964305658 usec, L: 0
1117 14:49:36.049531 (+ 142us) write_op.cc:270] Start()
1117 14:49:36.049549 (+ 18us) write_op.cc:276] Timestamp: P: 1794926964311420 usec, L: 0
1117 14:49:36.049714 (+ 165us) write_op.cc:270] Start()
1117 14:49:36.049733 (+ 19us) write_op.cc:276] Timestamp: P: 1794926964341362 usec, L: 0
1117 14:49:36.049851 (+ 118us) write_op.cc:270] Start()
1117 14:49:36.049867 (+ 16us) write_op.cc:276] Timestamp: P: 1794926964359871 usec, L: 0
1117 14:49:36.049994 (+ 127us) write_op.cc:270] Start()
1117 14:49:36.050016 (+ 22us) write_op.cc:276] Timestamp: P: 1794926964365744 usec, L: 0
1117 14:49:36.050182 (+ 166us) write_op.cc:270] Start()
1117 14:49:36.050205 (+ 23us) write_op.cc:276] Timestamp: P: 1794926964387010 usec, L: 0
1117 14:49:36.050379 (+ 174us) write_op.cc:270] Start()
1117 14:49:36.050399 (+ 20us) write_op.cc:276] Timestamp: P: 1794926964399290 usec, L: 0
1117 14:49:36.050559 (+ 160us) write_op.cc:270] Start()
1117 14:49:36.050579 (+ 20us) write_op.cc:276] Timestamp: P: 1794926964432254 usec, L: 0
1117 14:49:36.068162 (+ 17583us) write_op.cc:270] Start()
1117 14:49:36.068183 (+ 21us) write_op.cc:276] Timestamp: P: 1794926964433027 usec, L: 0
1117 14:49:36.068350 (+ 167us) write_op.cc:270] Start()
1117 14:49:36.068379 (+ 29us) write_op.cc:276] Timestamp: P: 1794926964435182 usec, L: 0
1117 14:49:36.069465 (+ 1086us) write_op.cc:270] Start()
1117 14:49:36.069490 (+ 25us) write_op.cc:276] Timestamp: P: 1794926964436709 usec, L: 0
1117 14:49:36.069668 (+ 178us) write_op.cc:270] Start()
1117 14:49:36.069691 (+ 23us) write_op.cc:276] Timestamp: P: 1794926964487403 usec, L: 0
1117 14:49:36.069850 (+ 159us) write_op.cc:270] Start()
1117 14:49:36.069873 (+ 23us) write_op.cc:276] Timestamp: P: 1794926964501765 usec, L: 0
1117 14:49:36.070073 (+ 200us) write_op.cc:270] Start()
1117 14:49:36.070095 (+ 22us) write_op.cc:276] Timestamp: P: 1794926964504379 usec, L: 0
1117 14:49:36.070279 (+ 184us) write_op.cc:270] Start()
1117 14:49:36.070300 (+ 21us) write_op.cc:276] Timestamp: P: 1794926964511731 usec, L: 0
1117 14:49:36.070464 (+ 164us) write_op.cc:270] Start()
1117 14:49:36.070486 (+ 22us) write_op.cc:276] Timestamp: P: 1794926964537753 usec, L: 0
1117 14:49:36.070657 (+ 171us) write_op.cc:270] Start()
1117 14:49:36.070679 (+ 22us) write_op.cc:276] Timestamp: P: 1794926964551033 usec, L: 0
1117 14:49:36.070854 (+ 175us) write_op.cc:270] Start()
1117 14:49:36.070876 (+ 22us) write_op.cc:276] Timestamp: P: 1794926964571215 usec, L: 0
1117 14:49:36.071110 (+ 234us) write_op.cc:270] Start()
1117 14:49:36.071133 (+ 23us) write_op.cc:276] Timestamp: P: 1794926964573591 usec, L: 0
1117 14:49:36.071344 (+ 211us) write_op.cc:270] Start()
1117 14:49:36.071367 (+ 23us) write_op.cc:276] Timestamp: P: 1794926964581245 usec, L: 0
1117 14:49:36.071536 (+ 169us) write_op.cc:270] Start()
1117 14:49:36.071557 (+ 21us) write_op.cc:276] Timestamp: P: 1794926964622712 usec, L: 0
1117 14:49:36.099971 (+ 28414us) write_op.cc:270] Start()
1117 14:49:36.100021 (+ 50us) write_op.cc:276] Timestamp: P: 1794926964623389 usec, L: 0
1117 14:49:36.100225 (+ 204us) write_op.cc:270] Start()
1117 14:49:36.100248 (+ 23us) write_op.cc:276] Timestamp: P: 1794926964628542 usec, L: 0
1117 14:49:36.100495 (+ 247us) write_op.cc:270] Start()
1117 14:49:36.100520 (+ 25us) write_op.cc:276] Timestamp: P: 1794926964669740 usec, L: 0
1117 14:49:36.100692 (+ 172us) write_op.cc:270] Start()
1117 14:49:36.100713 (+ 21us) write_op.cc:276] Timestamp: P: 1794926964690560 usec, L: 0
1117 14:49:36.100861 (+ 148us) write_op.cc:270] Start()
1117 14:49:36.100883 (+ 22us) write_op.cc:276] Timestamp: P: 1794926964693146 usec, L: 0
1117 14:49:36.101048 (+ 165us) write_op.cc:270] Start()
1117 14:49:36.101070 (+ 22us) write_op.cc:276] Timestamp: P: 1794926964726193 usec, L: 0
1117 14:49:36.101260 (+ 190us) write_op.cc:270] Start()
1117 14:49:36.101284 (+ 24us) write_op.cc:276] Timestamp: P: 1794926964730428 usec, L: 0
1117 14:49:36.101471 (+ 187us) write_op.cc:270] Start()
1117 14:49:36.101495 (+ 24us) write_op.cc:276] Timestamp: P: 1794926964734237 usec, L: 0
1117 14:49:36.101689 (+ 194us) write_op.cc:270] Start()
1117 14:49:36.101712 (+ 23us) write_op.cc:276] Timestamp: P: 1794926964753906 usec, L: 0
1117 14:49:36.101888 (+ 176us) write_op.cc:270] Start()
1117 14:49:36.101911 (+ 23us) write_op.cc:276] Timestamp: P: 1794926964771928 usec, L: 0
1117 14:49:36.102086 (+ 175us) write_op.cc:270] Start()
1117 14:49:36.102108 (+ 22us) write_op.cc:276] Timestamp: P: 1794926964794350 usec, L: 0
1117 14:49:36.103162 (+ 1054us) write_op.cc:270] Start()
1117 14:49:36.103975 (+ 813us) write_op.cc:276] Timestamp: P: 1794926964814412 usec, L: 0
1117 14:49:36.104136 (+ 161us) write_op.cc:270] Start()
1117 14:49:36.104160 (+ 24us) write_op.cc:276] Timestamp: P: 1794926964815065 usec, L: 0
1117 14:49:36.119309 (+ 15149us) write_op.cc:270] Start()
1117 14:49:36.119335 (+ 26us) write_op.cc:276] Timestamp: P: 1794926964816458 usec, L: 0
1117 14:49:36.124414 (+ 5079us) write_op.cc:270] Start()
1117 14:49:36.124579 (+ 165us) write_op.cc:276] Timestamp: P: 1794926964850826 usec, L: 0
1117 14:49:36.131667 (+ 7088us) write_op.cc:270] Start()
1117 14:49:36.131690 (+ 23us) write_op.cc:276] Timestamp: P: 1794926964862090 usec, L: 0
1117 14:49:36.131842 (+ 152us) write_op.cc:270] Start()
1117 14:49:36.131861 (+ 19us) write_op.cc:276] Timestamp: P: 1794926964868444 usec, L: 0
1117 14:49:36.131988 (+ 127us) write_op.cc:270] Start()
1117 14:49:36.132005 (+ 17us) write_op.cc:276] Timestamp: P: 1794926964878177 usec, L: 0
1117 14:49:36.136584 (+ 4579us) write_op.cc:270] Start()
1117 14:49:36.136611 (+ 27us) write_op.cc:276] Timestamp: P: 1794926964930954 usec, L: 0
1117 14:49:36.137271 (+ 660us) write_op.cc:270] Start()
1117 14:49:36.137298 (+ 27us) write_op.cc:276] Timestamp: P: 1794926964936172 usec, L: 0
1117 14:49:36.137494 (+ 196us) write_op.cc:270] Start()
1117 14:49:36.137517 (+ 23us) write_op.cc:276] Timestamp: P: 1794926964936952 usec, L: 0
1117 14:49:36.137699 (+ 182us) write_op.cc:270] Start()
1117 14:49:36.137722 (+ 23us) write_op.cc:276] Timestamp: P: 1794926964937613 usec, L: 0
1117 14:49:36.159159 (+ 21437us) write_op.cc:270] Start()
1117 14:49:36.159185 (+ 26us) write_op.cc:276] Timestamp: P: 1794926964980424 usec, L: 0
1117 14:49:36.159348 (+ 163us) write_op.cc:270] Start()
1117 14:49:36.159369 (+ 21us) write_op.cc:276] Timestamp: P: 1794926964987689 usec, L: 0
1117 14:49:36.159580 (+ 211us) write_op.cc:270] Start()
1117 14:49:36.159602 (+ 22us) write_op.cc:276] Timestamp: P: 1794926964994275 usec, L: 0
1117 14:49:36.159791 (+ 189us) write_op.cc:270] Start()
1117 14:49:36.159813 (+ 22us) write_op.cc:276] Timestamp: P: 1794926965004781 usec, L: 0
1117 14:49:36.159971 (+ 158us) write_op.cc:270] Start()
1117 14:49:36.159990 (+ 19us) write_op.cc:276] Timestamp: P: 1794926965031372 usec, L: 0
1117 14:49:36.160156 (+ 166us) write_op.cc:270] Start()
1117 14:49:36.160175 (+ 19us) write_op.cc:276] Timestamp: P: 1794926965057367 usec, L: 0
1117 14:49:36.160322 (+ 147us) write_op.cc:270] Start()
1117 14:49:36.160340 (+ 18us) write_op.cc:276] Timestamp: P: 1794926965065134 usec, L: 0
1117 14:49:36.171743 (+ 11403us) write_op.cc:270] Start()
1117 14:49:36.171766 (+ 23us) write_op.cc:276] Timestamp: P: 1794926965081572 usec, L: 0
1117 14:49:36.171966 (+ 200us) write_op.cc:270] Start()
1117 14:49:36.171988 (+ 22us) write_op.cc:276] Timestamp: P: 1794926965114274 usec, L: 0
1117 14:49:36.172177 (+ 189us) write_op.cc:270] Start()
1117 14:49:36.172199 (+ 22us) write_op.cc:276] Timestamp: P: 1794926965133063 usec, L: 0
1117 14:49:36.172387 (+ 188us) write_op.cc:270] Start()
1117 14:49:36.172411 (+ 24us) write_op.cc:276] Timestamp: P: 1794926965147711 usec, L: 0
1117 14:49:36.172640 (+ 229us) write_op.cc:270] Start()
1117 14:49:36.172667 (+ 27us) write_op.cc:276] Timestamp: P: 1794926965165406 usec, L: 0
1117 14:49:36.172868 (+ 201us) write_op.cc:270] Start()
1117 14:49:36.172890 (+ 22us) write_op.cc:276] Timestamp: P: 1794926965172593 usec, L: 0
1117 14:49:36.173049 (+ 159us) write_op.cc:270] Start()
1117 14:49:36.173072 (+ 23us) write_op.cc:276] Timestamp: P: 1794926965195880 usec, L: 0
1117 14:49:36.177128 (+ 4056us) write_op.cc:270] Start()
1117 14:49:36.178266 (+ 1138us) write_op.cc:276] Timestamp: P: 1794926965206630 usec, L: 0
1117 14:49:36.178503 (+ 237us) write_op.cc:270] Start()
1117 14:49:36.178526 (+ 23us) write_op.cc:276] Timestamp: P: 1794926965227366 usec, L: 0
1117 14:49:36.178702 (+ 176us) write_op.cc:270] Start()
1117 14:49:36.178725 (+ 23us) write_op.cc:276] Timestamp: P: 1794926965246916 usec, L: 0
1117 14:49:36.178881 (+ 156us) write_op.cc:270] Start()
1117 14:49:36.178902 (+ 21us) write_op.cc:276] Timestamp: P: 1794926965257136 usec, L: 0
1117 14:49:36.179069 (+ 167us) write_op.cc:270] Start()
1117 14:49:36.179092 (+ 23us) write_op.cc:276] Timestamp: P: 1794926965257975 usec, L: 0
1117 14:49:36.179280 (+ 188us) write_op.cc:270] Start()
1117 14:49:36.179303 (+ 23us) write_op.cc:276] Timestamp: P: 1794926965276662 usec, L: 0
1117 14:49:36.179452 (+ 149us) write_op.cc:270] Start()
1117 14:49:36.179471 (+ 19us) write_op.cc:276] Timestamp: P: 1794926965300532 usec, L: 0
1117 14:49:36.179615 (+ 144us) write_op.cc:270] Start()
1117 14:49:36.179632 (+ 17us) write_op.cc:276] Timestamp: P: 1794926965310570 usec, L: 0
1117 14:49:36.179756 (+ 124us) write_op.cc:270] Start()
1117 14:49:36.179774 (+ 18us) write_op.cc:276] Timestamp: P: 1794926965311738 usec, L: 0
1117 14:49:36.179925 (+ 151us) write_op.cc:270] Start()
1117 14:49:36.179945 (+ 20us) write_op.cc:276] Timestamp: P: 1794926965330743 usec, L: 0
1117 14:49:36.180082 (+ 137us) write_op.cc:270] Start()
1117 14:49:36.180099 (+ 17us) write_op.cc:276] Timestamp: P: 1794926965372681 usec, L: 0
1117 14:49:36.180241 (+ 142us) write_op.cc:270] Start()
1117 14:49:36.180258 (+ 17us) write_op.cc:276] Timestamp: P: 1794926965385059 usec, L: 0
1117 14:49:36.186587 (+ 6329us) write_op.cc:270] Start()
1117 14:49:36.186616 (+ 29us) write_op.cc:276] Timestamp: P: 1794926965387110 usec, L: 0
1117 14:49:36.195461 (+ 8845us) write_op.cc:270] Start()
1117 14:49:36.195482 (+ 21us) write_op.cc:276] Timestamp: P: 1794926965414151 usec, L: 0
1117 14:49:36.195647 (+ 165us) write_op.cc:270] Start()
1117 14:49:36.195667 (+ 20us) write_op.cc:276] Timestamp: P: 1794926965426040 usec, L: 0
1117 14:49:36.197005 (+ 1338us) write_op.cc:270] Start()
1117 14:49:36.197030 (+ 25us) write_op.cc:276] Timestamp: P: 1794926965430877 usec, L: 0
1117 14:49:36.200626 (+ 3596us) write_op.cc:270] Start()
1117 14:49:36.200659 (+ 33us) write_op.cc:276] Timestamp: P: 1794926965455955 usec, L: 0
1117 14:49:36.216423 (+ 15764us) write_op.cc:270] Start()
1117 14:49:36.216478 (+ 55us) write_op.cc:276] Timestamp: P: 1794926965465986 usec, L: 0
1117 14:49:36.216634 (+ 156us) write_op.cc:270] Start()
1117 14:49:36.216653 (+ 19us) write_op.cc:276] Timestamp: P: 1794926965477629 usec, L: 0
1117 14:49:36.216795 (+ 142us) write_op.cc:270] Start()
1117 14:49:36.216812 (+ 17us) write_op.cc:276] Timestamp: P: 1794926965526562 usec, L: 0
1117 14:49:36.217314 (+ 502us) write_op.cc:270] Start()
1117 14:49:36.217342 (+ 28us) write_op.cc:276] Timestamp: P: 1794926965550486 usec, L: 0
1117 14:49:36.217525 (+ 183us) write_op.cc:270] Start()
1117 14:49:36.217545 (+ 20us) write_op.cc:276] Timestamp: P: 1794926965552296 usec, L: 0
1117 14:49:36.217690 (+ 145us) write_op.cc:270] Start()
1117 14:49:36.217709 (+ 19us) write_op.cc:276] Timestamp: P: 1794926965586580 usec, L: 0
1117 14:49:36.217837 (+ 128us) write_op.cc:270] Start()
1117 14:49:36.217854 (+ 17us) write_op.cc:276] Timestamp: P: 1794926965596212 usec, L: 0
1117 14:49:36.217979 (+ 125us) write_op.cc:270] Start()
1117 14:49:36.217997 (+ 18us) write_op.cc:276] Timestamp: P: 1794926965637500 usec, L: 0
1117 14:49:36.218140 (+ 143us) write_op.cc:270] Start()
1117 14:49:36.218158 (+ 18us) write_op.cc:276] Timestamp: P: 1794926965646071 usec, L: 0
1117 14:49:36.218283 (+ 125us) write_op.cc:270] Start()
1117 14:49:36.218305 (+ 22us) write_op.cc:276] Timestamp: P: 1794926965647473 usec, L: 0
1117 14:49:36.218443 (+ 138us) write_op.cc:270] Start()
1117 14:49:36.218460 (+ 17us) write_op.cc:276] Timestamp: P: 1794926965655642 usec, L: 0
1117 14:49:36.218588 (+ 128us) write_op.cc:270] Start()
1117 14:49:36.218605 (+ 17us) write_op.cc:276] Timestamp: P: 1794926965715680 usec, L: 0
1117 14:49:36.218722 (+ 117us) write_op.cc:270] Start()
1117 14:49:36.218739 (+ 17us) write_op.cc:276] Timestamp: P: 1794926965722500 usec, L: 0
1117 14:49:36.218886 (+ 147us) write_op.cc:270] Start()
1117 14:49:36.218906 (+ 20us) write_op.cc:276] Timestamp: P: 17949269
I20261117 14:49:39.823613 6655 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "57984748adc7482a9a2d999a447a81af" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 3 candidate_status { last_received { term: 2 index: 784 } } ignore_live_leader: false dest_uuid: "c7900e455dd64c68bccfc499bda413f7" is_pre_election: true
I20261117 14:49:39.841312 7421 raft_consensus.cc:499] T b74e748e97c84edeabc1c0cb41ddae99 P ec41d6947a4a4eadadf90c3756899704 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c7900e455dd64c68bccfc499bda413f7)
I20261117 14:49:39.841527 7421 raft_consensus.cc:521] T b74e748e97c84edeabc1c0cb41ddae99 P ec41d6947a4a4eadadf90c3756899704 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:39.842327 7421 leader_election.cc:290] T b74e748e97c84edeabc1c0cb41ddae99 P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271), def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611)
I20261117 14:49:39.844700 6787 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "b74e748e97c84edeabc1c0cb41ddae99" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 3 candidate_status { last_received { term: 2 index: 785 } } ignore_live_leader: false dest_uuid: "def6b23bccc94a78a47118da331f2798" is_pre_election: true
I20261117 14:49:39.885733 7266 leader_election.cc:304] T 57984748adc7482a9a2d999a447a81af P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec41d6947a4a4eadadf90c3756899704; no voters: c7900e455dd64c68bccfc499bda413f7, def6b23bccc94a78a47118da331f2798
W20261117 14:49:40.144215 7266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.50.130:36271, user_credentials={real_user=slave}} blocked reactor thread for 319264us
I20261117 14:49:40.146003 6655 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "b74e748e97c84edeabc1c0cb41ddae99" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 3 candidate_status { last_received { term: 2 index: 785 } } ignore_live_leader: false dest_uuid: "c7900e455dd64c68bccfc499bda413f7" is_pre_election: true
I20261117 14:49:40.193851 7266 leader_election.cc:304] T b74e748e97c84edeabc1c0cb41ddae99 P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec41d6947a4a4eadadf90c3756899704; no voters: c7900e455dd64c68bccfc499bda413f7, def6b23bccc94a78a47118da331f2798
W20261117 14:49:40.209110 7266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.50.130:36271, user_credentials={real_user=slave}} blocked reactor thread for 60484.4us
W20261117 14:49:40.268711 7443 log.cc:927] Time spent T 5c849aa2a21a4c13b2e31d2ca3f692cc P ec41d6947a4a4eadadf90c3756899704: Append to log took a long time: real 0.120s user 0.001s sys 0.001s
I20261117 14:49:40.305491 7425 raft_consensus.cc:2771] T 5c849aa2a21a4c13b2e31d2ca3f692cc P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20261117 14:49:40.352290 7420 mvcc.cc:204] Tried to move back new op lower bound from 7352020889393897472 to 7352020838775255040. Current Snapshot: MvccSnapshot[applied={T|T < 7352020867963396096 or (T in {7352020868131188736,7352020868209025024})}]
I20261117 14:49:40.353925 7343 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.6.50.130:39451 (request call id 5) took 4157 ms. Trace:
I20261117 14:49:40.679543 7425 raft_consensus.cc:499] T 5c849aa2a21a4c13b2e31d2ca3f692cc P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7900e455dd64c68bccfc499bda413f7)
I20261117 14:49:40.679747 7425 raft_consensus.cc:521] T 5c849aa2a21a4c13b2e31d2ca3f692cc P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:40.681982 6654 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5c849aa2a21a4c13b2e31d2ca3f692cc" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 2 candidate_status { last_received { term: 1 index: 839 } } ignore_live_leader: false dest_uuid: "c7900e455dd64c68bccfc499bda413f7" is_pre_election: true
I20261117 14:49:40.683118 6788 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5c849aa2a21a4c13b2e31d2ca3f692cc" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 2 candidate_status { last_received { term: 1 index: 839 } } ignore_live_leader: false dest_uuid: "def6b23bccc94a78a47118da331f2798" is_pre_election: true
I20261117 14:49:40.698982 7425 leader_election.cc:290] T 5c849aa2a21a4c13b2e31d2ca3f692cc P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271), def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611)
I20261117 14:49:40.706084 7266 leader_election.cc:304] T 5c849aa2a21a4c13b2e31d2ca3f692cc P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec41d6947a4a4eadadf90c3756899704; no voters: c7900e455dd64c68bccfc499bda413f7, def6b23bccc94a78a47118da331f2798
I20261117 14:49:40.706786 7425 raft_consensus.cc:2771] T 5c849aa2a21a4c13b2e31d2ca3f692cc P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20261117 14:49:41.060930 7421 raft_consensus.cc:499] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader def6b23bccc94a78a47118da331f2798)
I20261117 14:49:41.061107 7346 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.6.50.131:58395 (request call id 3) took 1863 ms. Trace:
I20261117 14:49:41.062745 7421 raft_consensus.cc:521] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:41.065964 6654 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "3cea00abcccd4b1284393ef8b406cab1" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 3 candidate_status { last_received { term: 2 index: 992 } } ignore_live_leader: false dest_uuid: "c7900e455dd64c68bccfc499bda413f7" is_pre_election: true
I20261117 14:49:41.069185 7293 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:35168 (request call id 6) took 3091 ms. Trace:
I20261117 14:49:41.070375 6786 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "3cea00abcccd4b1284393ef8b406cab1" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 3 candidate_status { last_received { term: 2 index: 992 } } ignore_live_leader: false dest_uuid: "def6b23bccc94a78a47118da331f2798" is_pre_election: true
I20261117 14:49:41.071944 7267 leader_election.cc:304] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec41d6947a4a4eadadf90c3756899704; no voters: c7900e455dd64c68bccfc499bda413f7, def6b23bccc94a78a47118da331f2798
I20261117 14:49:41.098795 7421 leader_election.cc:290] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271), def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611)
I20261117 14:49:41.069314 7293 rpcz_store.cc:276] 1117 14:49:37.972428 (+ 0us) service_pool.cc:167] Inserting onto call queue
1117 14:49:37.972551 (+ 123us) service_pool.cc:224] Handling call
1117 14:49:38.343965 (+371414us) spinlock_profiling.cc:245] Waited 371 ms on lock 0x61600001d854. stack: 00007f9a08fa33a6 00007f9a08fa3160 00007f9a07f9434d 00007f9a1f567704 00007f9a1f5676cd 00007f9a1f56709a 00007f9a14feefd0 00007f9a18ef839f 00007f9a132ebbd6 00007f9a132eb905 00007f9a100eb8de 00007f9a100ea7be 00007f9a100f09f8 00007f9a100f135f 00007f9a100f1188 0000000000372c7c
1117 14:49:38.357038 (+ 13073us) spinlock_profiling.cc:245] Waited 5.97 ms on lock 0x61600001c054. stack: 00007f9a08fa33a6 00007f9a08fa3160 00007f9a07f9434d 00007f9a1f567704 00007f9a1f5676cd 00007f9a1f56709a 00007f9a14feefd0 00007f9a18ef839f 00007f9a132ebbd6 00007f9a132eb905 00007f9a100eb8de 00007f9a100ea7be 00007f9a100f09f8 00007f9a100f135f 00007f9a100f1188 0000000000372c7c
1117 14:49:40.305146 (+1948108us) spinlock_profiling.cc:245] Waited 1.92 s on lock 0x61600001de54. stack: 00007f9a08fa33a6 00007f9a08fa3160 00007f9a07f9434d 00007f9a1f567704 00007f9a1f5676cd 00007f9a1f56709a 00007f9a14feefd0 00007f9a18ef839f 00007f9a132ebbd6 00007f9a132eb905 00007f9a100eb8de 00007f9a100ea7be 00007f9a100f09f8 00007f9a100f135f 00007f9a100f1188 0000000000372c7c
1117 14:49:41.063179 (+758033us) spinlock_profiling.cc:245] Waited 758 ms on lock 0x61600001c654. stack: 00007f9a08fa33a6 00007f9a08fa3160 00007f9a07f9434d 00007f9a1f567704 00007f9a1f5676cd 00007f9a1f56709a 00007f9a14feefd0 00007f9a18ef839f 00007f9a132ebbd6 00007f9a132eb905 00007f9a100eb8de 00007f9a100ea7be 00007f9a100f09f8 00007f9a100f135f 00007f9a100f1188 0000000000372c7c
1117 14:49:41.063368 (+ 189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7031288064}
I20261117 14:49:41.101213 7425 raft_consensus.cc:2771] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20261117 14:49:41.133456 7178 ts_manager.cc:210] Registered new tserver with Master: ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937)
I20261117 14:49:41.136997 7178 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.6.50.129:49603
I20261117 14:49:41.183769 7425 raft_consensus.cc:499] T 5c849aa2a21a4c13b2e31d2ca3f692cc P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7900e455dd64c68bccfc499bda413f7)
I20261117 14:49:41.186172 7425 raft_consensus.cc:521] T 5c849aa2a21a4c13b2e31d2ca3f692cc P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:41.187108 7425 leader_election.cc:290] T 5c849aa2a21a4c13b2e31d2ca3f692cc P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271), def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611)
I20261117 14:49:41.187805 6788 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5c849aa2a21a4c13b2e31d2ca3f692cc" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 2 candidate_status { last_received { term: 1 index: 839 } } ignore_live_leader: false dest_uuid: "def6b23bccc94a78a47118da331f2798" is_pre_election: true
I20261117 14:49:41.187829 6658 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5c849aa2a21a4c13b2e31d2ca3f692cc" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 2 candidate_status { last_received { term: 1 index: 839 } } ignore_live_leader: false dest_uuid: "c7900e455dd64c68bccfc499bda413f7" is_pre_election: true
I20261117 14:49:41.188938 7267 leader_election.cc:304] T 5c849aa2a21a4c13b2e31d2ca3f692cc P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec41d6947a4a4eadadf90c3756899704; no voters: c7900e455dd64c68bccfc499bda413f7, def6b23bccc94a78a47118da331f2798
I20261117 14:49:41.189231 7425 raft_consensus.cc:2771] T 5c849aa2a21a4c13b2e31d2ca3f692cc P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20261117 14:49:41.372205 6922 meta_cache.cc:1261] Time spent looking up entry by key: real 0.075s user 0.001s sys 0.000s
I20261117 14:49:41.434973 7425 raft_consensus.cc:499] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader def6b23bccc94a78a47118da331f2798)
I20261117 14:49:41.435199 7425 raft_consensus.cc:521] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:41.439090 7425 leader_election.cc:290] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271), def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611)
I20261117 14:49:41.439894 6788 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "3cea00abcccd4b1284393ef8b406cab1" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 3 candidate_status { last_received { term: 2 index: 992 } } ignore_live_leader: false dest_uuid: "def6b23bccc94a78a47118da331f2798" is_pre_election: true
I20261117 14:49:41.440376 6658 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "3cea00abcccd4b1284393ef8b406cab1" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 3 candidate_status { last_received { term: 2 index: 992 } } ignore_live_leader: false dest_uuid: "c7900e455dd64c68bccfc499bda413f7" is_pre_election: true
I20261117 14:49:41.449823 7266 leader_election.cc:304] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec41d6947a4a4eadadf90c3756899704; no voters: c7900e455dd64c68bccfc499bda413f7, def6b23bccc94a78a47118da331f2798
I20261117 14:49:41.453826 7425 raft_consensus.cc:2771] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20261117 14:49:41.071723 7346 rpcz_store.cc:276] 1117 14:49:39.180090 (+ 0us) service_pool.cc:167] Inserting onto call queue
1117 14:49:39.180181 (+ 91us) service_pool.cc:224] Handling call
1117 14:49:39.340416 (+160235us) raft_consensus.cc:1481] Updating replica for 207 ops
1117 14:49:39.534828 (+194412us) raft_consensus.cc:1545] Early marking committed up to index 785
1117 14:49:39.534946 (+ 118us) raft_consensus.cc:1550] Triggering prepare for 207 ops
1117 14:49:39.538422 (+ 3476us) write_op.cc:270] Start()
1117 14:49:39.538451 (+ 29us) write_op.cc:276] Timestamp: P: 1794926975007389 usec, L: 0
1117 14:49:39.545836 (+ 7385us) write_op.cc:270] Start()
1117 14:49:39.545874 (+ 38us) write_op.cc:276] Timestamp: P: 1794926975017849 usec, L: 0
1117 14:49:39.546132 (+ 258us) write_op.cc:270] Start()
1117 14:49:39.546158 (+ 26us) write_op.cc:276] Timestamp: P: 1794926975020608 usec, L: 0
1117 14:49:39.546370 (+ 212us) write_op.cc:270] Start()
1117 14:49:39.546393 (+ 23us) write_op.cc:276] Timestamp: P: 1794926975100026 usec, L: 0
1117 14:49:39.546574 (+ 181us) write_op.cc:270] Start()
1117 14:49:39.546596 (+ 22us) write_op.cc:276] Timestamp: P: 1794926975100662 usec, L: 0
1117 14:49:39.546758 (+ 162us) write_op.cc:270] Start()
1117 14:49:39.546779 (+ 21us) write_op.cc:276] Timestamp: P: 1794926975103427 usec, L: 0
1117 14:49:39.546940 (+ 161us) write_op.cc:270] Start()
1117 14:49:39.546986 (+ 46us) write_op.cc:276] Timestamp: P: 1794926975106601 usec, L: 0
1117 14:49:39.547137 (+ 151us) write_op.cc:270] Start()
1117 14:49:39.547162 (+ 25us) write_op.cc:276] Timestamp: P: 1794926975141310 usec, L: 0
1117 14:49:39.547319 (+ 157us) write_op.cc:270] Start()
1117 14:49:39.547340 (+ 21us) write_op.cc:276] Timestamp: P: 1794926975169893 usec, L: 0
1117 14:49:39.572062 (+ 24722us) write_op.cc:270] Start()
1117 14:49:39.572097 (+ 35us) write_op.cc:276] Timestamp: P: 1794926975171914 usec, L: 0
1117 14:49:39.572305 (+ 208us) write_op.cc:270] Start()
1117 14:49:39.572329 (+ 24us) write_op.cc:276] Timestamp: P: 1794926975173812 usec, L: 0
1117 14:49:39.581166 (+ 8837us) write_op.cc:270] Start()
1117 14:49:39.581196 (+ 30us) write_op.cc:276] Timestamp: P: 1794926975199947 usec, L: 0
1117 14:49:39.621159 (+ 39963us) write_op.cc:270] Start()
1117 14:49:39.621194 (+ 35us) write_op.cc:276] Timestamp: P: 1794926975260106 usec, L: 0
1117 14:49:39.621398 (+ 204us) write_op.cc:270] Start()
1117 14:49:39.621421 (+ 23us) write_op.cc:276] Timestamp: P: 1794926975264520 usec, L: 0
1117 14:49:39.624963 (+ 3542us) write_op.cc:270] Start()
1117 14:49:39.624991 (+ 28us) write_op.cc:276] Timestamp: P: 1794926975299587 usec, L: 0
1117 14:49:39.631343 (+ 6352us) write_op.cc:270] Start()
1117 14:49:39.631390 (+ 47us) write_op.cc:276] Timestamp: P: 1794926975331428 usec, L: 0
1117 14:49:39.637161 (+ 5771us) write_op.cc:270] Start()
1117 14:49:39.637190 (+ 29us) write_op.cc:276] Timestamp: P: 1794926975339047 usec, L: 0
1117 14:49:39.637373 (+ 183us) write_op.cc:270] Start()
1117 14:49:39.637408 (+ 35us) write_op.cc:276] Timestamp: P: 1794926975362727 usec, L: 0
1117 14:49:39.637587 (+ 179us) write_op.cc:270] Start()
1117 14:49:39.637610 (+ 23us) write_op.cc:276] Timestamp: P: 1794926975380038 usec, L: 0
1117 14:49:39.637764 (+ 154us) write_op.cc:270] Start()
1117 14:49:39.637785 (+ 21us) write_op.cc:276] Timestamp: P: 1794926975390467 usec, L: 0
1117 14:49:39.637939 (+ 154us) write_op.cc:270] Start()
1117 14:49:39.637960 (+ 21us) write_op.cc:276] Timestamp: P: 1794926975426772 usec, L: 0
1117 14:49:39.638102 (+ 142us) write_op.cc:270] Start()
1117 14:49:39.638123 (+ 21us) write_op.cc:276] Timestamp: P: 1794926975433441 usec, L: 0
1117 14:49:39.638273 (+ 150us) write_op.cc:270] Start()
1117 14:49:39.638293 (+ 20us) write_op.cc:276] Timestamp: P: 1794926975434052 usec, L: 0
1117 14:49:39.638456 (+ 163us) write_op.cc:270] Start()
1117 14:49:39.638490 (+ 34us) write_op.cc:276] Timestamp: P: 1794926975455669 usec, L: 0
1117 14:49:39.638684 (+ 194us) write_op.cc:270] Start()
1117 14:49:39.638706 (+ 22us) write_op.cc:276] Timestamp: P: 1794926975471499 usec, L: 0
1117 14:49:39.638832 (+ 126us) write_op.cc:270] Start()
1117 14:49:39.638849 (+ 17us) write_op.cc:276] Timestamp: P: 1794926975513493 usec, L: 0
1117 14:49:39.638968 (+ 119us) write_op.cc:270] Start()
1117 14:49:39.638985 (+ 17us) write_op.cc:276] Timestamp: P: 1794926975519702 usec, L: 0
1117 14:49:39.686353 (+ 47368us) write_op.cc:270] Start()
1117 14:49:39.686389 (+ 36us) write_op.cc:276] Timestamp: P: 1794926975521889 usec, L: 0
1117 14:49:39.686617 (+ 228us) write_op.cc:270] Start()
1117 14:49:39.686641 (+ 24us) write_op.cc:276] Timestamp: P: 1794926975584713 usec, L: 0
1117 14:49:39.686828 (+ 187us) write_op.cc:270] Start()
1117 14:49:39.686853 (+ 25us) write_op.cc:276] Timestamp: P: 1794926975586812 usec, L: 0
1117 14:49:39.687020 (+ 167us) write_op.cc:270] Start()
1117 14:49:39.687042 (+ 22us) write_op.cc:276] Timestamp: P: 1794926975606734 usec, L: 0
1117 14:49:39.687209 (+ 167us) write_op.cc:270] Start()
1117 14:49:39.687232 (+ 23us) write_op.cc:276] Timestamp: P: 1794926975618699 usec, L: 0
1117 14:49:39.687398 (+ 166us) write_op.cc:270] Start()
1117 14:49:39.687419 (+ 21us) write_op.cc:276] Timestamp: P: 1794926975640337 usec, L: 0
1117 14:49:39.687595 (+ 176us) write_op.cc:270] Start()
1117 14:49:39.689750 (+ 2155us) write_op.cc:276] Timestamp: P: 1794926975664972 usec, L: 0
1117 14:49:39.689930 (+ 180us) write_op.cc:270] Start()
1117 14:49:39.689949 (+ 19us) write_op.cc:276] Timestamp: P: 1794926975666310 usec, L: 0
1117 14:49:39.690171 (+ 222us) write_op.cc:270] Start()
1117 14:49:39.690194 (+ 23us) write_op.cc:276] Timestamp: P: 1794926975673647 usec, L: 0
1117 14:49:39.690367 (+ 173us) write_op.cc:270] Start()
1117 14:49:39.690387 (+ 20us) write_op.cc:276] Timestamp: P: 1794926975685020 usec, L: 0
1117 14:49:39.690569 (+ 182us) write_op.cc:270] Start()
1117 14:49:39.690591 (+ 22us) write_op.cc:276] Timestamp: P: 1794926975711558 usec, L: 0
1117 14:49:39.690750 (+ 159us) write_op.cc:270] Start()
1117 14:49:39.690770 (+ 20us) write_op.cc:276] Timestamp: P: 1794926975749108 usec, L: 0
1117 14:49:39.690916 (+ 146us) write_op.cc:270] Start()
1117 14:49:39.690936 (+ 20us) write_op.cc:276] Timestamp: P: 1794926975766137 usec, L: 0
1117 14:49:39.691081 (+ 145us) write_op.cc:270] Start()
1117 14:49:39.691101 (+ 20us) write_op.cc:276] Timestamp: P: 1794926975781013 usec, L: 0
1117 14:49:39.691279 (+ 178us) write_op.cc:270] Start()
1117 14:49:39.691299 (+ 20us) write_op.cc:276] Timestamp: P: 1794926975801771 usec, L: 0
1117 14:49:39.718389 (+ 27090us) write_op.cc:270] Start()
1117 14:49:39.718422 (+ 33us) write_op.cc:276] Timestamp: P: 1794926975811760 usec, L: 0
1117 14:49:39.726077 (+ 7655us) write_op.cc:270] Start()
1117 14:49:39.726110 (+ 33us) write_op.cc:276] Timestamp: P: 1794926975852043 usec, L: 0
1117 14:49:39.737777 (+ 11667us) write_op.cc:270] Start()
1117 14:49:39.737808 (+ 31us) write_op.cc:276] Timestamp: P: 1794926975854547 usec, L: 0
1117 14:49:39.738011 (+ 203us) write_op.cc:270] Start()
1117 14:49:39.738037 (+ 26us) write_op.cc:276] Timestamp: P: 1794926975858449 usec, L: 0
1117 14:49:39.770975 (+ 32938us) write_op.cc:270] Start()
1117 14:49:39.771008 (+ 33us) write_op.cc:276] Timestamp: P: 1794926975890900 usec, L: 0
1117 14:49:39.786711 (+ 15703us) write_op.cc:270] Start()
1117 14:49:39.786742 (+ 31us) write_op.cc:276] Timestamp: P: 1794926975913558 usec, L: 0
1117 14:49:39.792130 (+ 5388us) write_op.cc:270] Start()
1117 14:49:39.792161 (+ 31us) write_op.cc:276] Timestamp: P: 1794926975961100 usec, L: 0
1117 14:49:39.794243 (+ 2082us) write_op.cc:270] Start()
1117 14:49:39.810486 (+ 16243us) write_op.cc:276] Timestamp: P: 1794926975961801 usec, L: 0
1117 14:49:39.810722 (+ 236us) write_op.cc:270] Start()
1117 14:49:39.810756 (+ 34us) write_op.cc:276] Timestamp: P: 1794926975977828 usec, L: 0
1117 14:49:39.810908 (+ 152us) write_op.cc:270] Start()
1117 14:49:39.810925 (+ 17us) write_op.cc:276] Timestamp: P: 1794926976006564 usec, L: 0
1117 14:49:39.821031 (+ 10106us) write_op.cc:270] Start()
1117 14:49:39.821060 (+ 29us) write_op.cc:276] Timestamp: P: 1794926976013736 usec, L: 0
1117 14:49:39.821243 (+ 183us) write_op.cc:270] Start()
1117 14:49:39.821262 (+ 19us) write_op.cc:276] Timestamp: P: 1794926976014261 usec, L: 0
1117 14:49:39.821387 (+ 125us) write_op.cc:270] Start()
1117 14:49:39.821404 (+ 17us) write_op.cc:276] Timestamp: P: 1794926976044020 usec, L: 0
1117 14:49:39.821524 (+ 120us) write_op.cc:270] Start()
1117 14:49:39.821540 (+ 16us) write_op.cc:276] Timestamp: P: 1794926976075962 usec, L: 0
1117 14:49:39.821704 (+ 164us) write_op.cc:270] Start()
1117 14:49:39.821722 (+ 18us) write_op.cc:276] Timestamp: P: 1794926976083905 usec, L: 0
1117 14:49:39.837386 (+ 15664us) write_op.cc:270] Start()
1117 14:49:39.837428 (+ 42us) write_op.cc:276] Timestamp: P: 1794926976120487 usec, L: 0
1117 14:49:39.880156 (+ 42728us) write_op.cc:270] Start()
1117 14:49:39.880207 (+ 51us) write_op.cc:276] Timestamp: P: 1794926976153847 usec, L: 0
1117 14:49:39.882369 (+ 2162us) write_op.cc:270] Start()
1117 14:49:39.885981 (+ 3612us) write_op.cc:276] Timestamp: P: 1794926976183806 usec, L: 0
1117 14:49:39.936182 (+ 50201us) write_op.cc:270] Start()
1117 14:49:39.936232 (+ 50us) write_op.cc:276] Timestamp: P: 1794926976216129 usec, L: 0
1117 14:49:39.936550 (+ 318us) write_op.cc:270] Start()
1117 14:49:39.936605 (+ 55us) write_op.cc:276] Timestamp: P: 1794926976226501 usec, L: 0
1117 14:49:39.940083 (+ 3478us) write_op.cc:270] Start()
1117 14:49:39.940114 (+ 31us) write_op.cc:276] Timestamp: P: 1794926976229558 usec, L: 0
1117 14:49:39.966767 (+ 26653us) write_op.cc:270] Start()
1117 14:49:39.966843 (+ 76us) write_op.cc:276] Timestamp: P: 1794926976263492 usec, L: 0
1117 14:49:40.028286 (+ 61443us) write_op.cc:270] Start()
1117 14:49:40.028340 (+ 54us) write_op.cc:276] Timestamp: P: 1794926976264914 usec, L: 0
1117 14:49:40.053258 (+ 24918us) write_op.cc:270] Start()
1117 14:49:40.053296 (+ 38us) write_op.cc:276] Timestamp: P: 1794926976296872 usec, L: 0
1117 14:49:40.053543 (+ 247us) write_op.cc:270] Start()
1117 14:49:40.053582 (+ 39us) write_op.cc:276] Timestamp: P: 1794926976313405 usec, L: 0
1117 14:49:40.058536 (+ 4954us) write_op.cc:270] Start()
1117 14:49:40.058584 (+ 48us) write_op.cc:276] Timestamp: P: 1794926976315329 usec, L: 0
1117 14:49:40.068763 (+ 10179us) write_op.cc:270] Start()
1117 14:49:40.068818 (+ 55us) write_op.cc:276] Timestamp: P: 1794926976343849 usec, L: 0
1117 14:49:40.079973 (+ 11155us) write_op.cc:270] Start()
1117 14:49:40.080024 (+ 51us) write_op.cc:276] Timestamp: P: 1794926976344587 usec, L: 0
1117 14:49:40.080248 (+ 224us) write_op.cc:270] Start()
1117 14:49:40.080272 (+ 24us) write_op.cc:276] Timestamp: P: 1794926976366270 usec, L: 0
1117 14:49:40.080496 (+ 224us) write_op.cc:270] Start()
1117 14:49:40.080524 (+ 28us) write_op.cc:276] Timestamp: P: 1794926976403942 usec, L: 0
1117 14:49:40.080726 (+ 202us) write_op.cc:270] Start()
1117 14:49:40.080751 (+ 25us) write_op.cc:276] Timestamp: P: 1794926976416110 usec, L: 0
1117 14:49:40.081015 (+ 264us) write_op.cc:270] Start()
1117 14:49:40.081042 (+ 27us) write_op.cc:276] Timestamp: P: 1794926976418264 usec, L: 0
1117 14:49:40.081222 (+ 180us) write_op.cc:270] Start()
1117 14:49:40.081249 (+ 27us) write_op.cc:276] Timestamp: P: 1794926976467480 usec, L: 0
1117 14:49:40.081427 (+ 178us) write_op.cc:270] Start()
1117 14:49:40.081450 (+ 23us) write_op.cc:276] Timestamp: P: 1794926976488762 usec, L: 0
1117 14:49:40.081649 (+ 199us) write_op.cc:270] Start()
1117 14:49:40.081676 (+ 27us) write_op.cc:276] Timestamp: P: 1794926976509284 usec, L: 0
1117 14:49:40.081844 (+ 168us) write_op.cc:270] Start()
1117 14:49:40.081869 (+ 25us) write_op.cc:276] Timestamp: P: 1794926976518214 usec, L: 0
1117 14:49:40.106760 (+ 24891us) write_op.cc:270] Start()
1117 14:49:40.107092 (+ 332us) write_op.cc:276] Timestamp: P: 1794926976530397 usec, L: 0
1117 14:49:40.126769 (+ 19677us) write_op.cc:270] Start()
1117 14:49:40.126800 (+ 31us) write_op.cc:276] Timestamp: P: 1794926976552294 usec, L: 0
1117 14:49:40.127010 (+ 210us) write_op.cc:270] Start()
1117 14:49:40.127037 (+ 27us) write_op.cc:276] Timestamp: P: 1794926976574114 usec, L: 0
1117 14:49:40.128500 (+ 1463us) write_op.cc:270] Start()
1117 14:49:40.128545 (+ 45us) write_op.cc:276] Timestamp: P: 1794926976583954 usec, L: 0
1117 14:49:40.128760 (+ 215us) write_op.cc:270] Start()
1117 14:49:40.128786 (+ 26us) write_op.cc:276] Timestamp: P: 1794926976605368 usec, L: 0
1117 14:49:40.128985 (+ 199us) write_op.cc:270] Start()
1117 14:49:40.129011 (+ 26us) write_op.cc:276] Timestamp: P: 1794926976622988 usec, L: 0
1117 14:49:40.130349 (+ 1338us) write_op.cc:270] Start()
1117 14:49:40.130367 (+ 18us) write_op.cc:276] Timestamp: P: 1794926976648008 usec, L: 0
1117 14:49:40.131690 (+ 1323us) write_op.cc:270] Start()
1117 14:49:40.131723 (+ 33us) write_op.cc:276] Timestamp: P: 1794926976669184 usec, L: 0
1117 14:49:40.140989 (+ 9266us) write_op.cc:270] Start()
1117 14:49:40.141028 (+ 39us) write_op.cc:276] Timestamp: P: 1794926976686193 usec, L: 0
1117 14:49:40.181124 (+ 40096us) write_op.cc:270] Start()
1117 14:49:40.181162 (+ 38us) write_op.cc:276] Timestamp: P: 1794926976728962 usec, L: 0
1117 14:49:40.185126 (+ 3964us) write_op.cc:270] Start()
1117 14:49:40.185158 (+ 32us) write_op.cc:276] Timestamp: P: 1794926976732383 usec, L: 0
1117 14:49:40.193157 (+ 7999us) write_op.cc:270] Start()
1117 14:49:40.193189 (+ 32us) write_op.cc:276] Timestamp: P: 1794926976737934 usec, L: 0
1117 14:49:40.195628 (+ 2439us) write_op.cc:270] Start()
1117 14:49:40.195657 (+ 29us) write_op.cc:276] Timestamp: P: 1794926976739544 usec, L: 0
1117 14:49:40.218978 (+ 23321us) write_op.cc:270] Start()
1117 14:49:40.219009 (+ 31us) write_op.cc:276] Timestamp: P: 1794926976783142 usec, L: 0
1117 14:49:40.250398 (+ 31389us) write_op.cc:270] Start()
1117 14:49:40.250433 (+ 35us) write_op.cc:276] Timestamp: P: 1794926976802403 usec, L: 0
1117 14:49:40.250664 (+ 231us) write_op.cc:270] Start()
1117 14:49:40.250694 (+ 30us) write_op.cc:276] Timestamp: P: 1794926976819721 usec, L: 0
1117 14:49:40.253670 (+ 2976us) write_op.cc:270] Start()
1117 14:49:40.253701 (+ 31us) write_op.cc:276] Timestamp: P: 1794926976837138 usec, L: 0
1117 14:49:40.258349 (+ 4648us) write_op.cc:270] Start()
1117 14:49:40.258391 (+ 42us) write_op.cc:276] Timestamp: P: 1794926976837814 usec, L: 0
1117 14:49:40.258573 (+ 182us) write_op.cc:270] Start()
1117 14:49:40.258597 (+ 24us) write_op.cc:276] Timestamp: P: 1794926976893172 usec, L: 0
1117 14:49:40.258785 (+ 188us) write_op.cc:270] Start()
1117 14:49:40.258808 (+ 23us) write_op.cc:276] Timestamp: P: 1794926976906011 usec, L: 0
1117 14:49:40.258958 (+ 150us) write_op.cc:270] Start()
1117 14:49:40.258978 (+ 20us) write_op.cc:276] Timestamp: P: 1794926976908503 usec, L: 0
1117 14:49:40.259136 (+ 158us) write_op.cc:270] Start()
1117 14:49:40.259456 (+ 320us) write_op.cc:276] Timestamp: P: 1794926976931124 usec, L: 0
1117 14:49:40.259643 (+ 187us) write_op.cc:270] Start()
1117 14:49:40.259665 (+ 22us) write_op.cc:276] Timestamp: P: 1794926976973068 usec, L: 0
1117 14:49:40.260119 (+ 454us) write_op.cc:270] Start()
1117 14:49:40.260144 (+ 25us) write_op.cc:276] Timestamp: P: 1794926976982173 usec, L: 0
1117 14:49:40.260305 (+ 161us) write_op.cc:270] Start()
1117 14:49:40.260324 (+ 19us) write_op.cc:276] Timestamp: P: 1794926976987079 usec, L: 0
1117 14:49:40.286659 (+ 26335us) write_op.cc:270] Start()
1117 14:49:40.286683 (+ 24us) write_op.cc:276] Timestamp: P: 1794926976990034 usec, L: 0
1117 14:49:40.288719 (+ 2036us) write_op.cc:270] Start()
1117 14:49:40.288745 (+ 26us) write_op.cc:276] Timestamp: P: 1794926977030787 usec, L: 0
1117 14:49:40.309178 (+ 20433us) write_op.cc:270] Start()
1117 14:49:40.309202 (+ 24us) write_op.cc:276] Timestamp: P: 1794926977041093 usec, L: 0
1117 14:49:40.319801 (+ 10599us) write_op.cc:270] Start()
1117 14:49:40.319824 (+ 23us) write_op.cc:276] Timestamp: P: 1794926977049786 usec, L: 0
1117 14:49:40.319985 (+ 161us) write_op.cc:270] Start()
1117 14:49:40.320004 (+ 19us) write_op.cc:276] Timestamp: P: 1794926977067623 usec, L: 0
1117 14:49:40.322011 (+ 2007us) write_op.cc:270] Start()
1117 14:49:40.322037 (+ 26us) write_op.cc:276] Timestamp: P: 1794926977121280 usec, L: 0
1117 14:49:40.322193 (+ 156us) write_op.cc:270] Start()
1117 14:49:40.322212 (+ 19us) write_op.cc:276] Timestamp: P: 1794926977121986 usec, L: 0
1117 14:49:40.330171 (+ 7959us) write_op.cc:270] Start()
1117 14:49:40.330197 (+ 26us) write_op.cc:276] Timestamp: P: 1794926977139130 usec, L: 0
1117 14:49:40.330425 (+ 228us) write_op.cc:270] Start()
1117 14:49:40.330450 (+ 25us) write_op.cc:276] Timestamp: P: 1794926977148553 usec, L: 0
1117 14:49:40.330632 (+ 182us) write_op.cc:270] Start()
1117 14:49:40.330671 (+ 39us) write_op.cc:276] Timestamp: P: 1794926977177626 usec, L: 0
1117 14:49:40.330848 (+ 177us) write_op.cc:270] Start()
1117 14:49:40.330868 (+ 20us) write_op.cc:276] Timestamp: P: 1794926977194157 usec, L: 0
1117 14:49:40.331030 (+ 162us) write_op.cc:270] Start()
1117 14:49:40.331050 (+ 20us) write_op.cc:276] Timestamp: P: 1794926977234712 usec, L: 0
1117 14:49:40.331188 (+ 138us) write_op.cc:270] Start()
1117 14:49:40.331208 (+ 20us) write_op.cc:276] Timestamp: P: 1794926977240737 usec, L: 0
1117 14:49:40.331389 (+ 181us) write_op.cc:270] Start()
1117 14:49:40.331419 (+ 30us) write_op.cc:276] Timestamp: P: 1794926977245528 usec, L: 0
1117 14:49:40.331565 (+ 146us) write_op.cc:270] Start()
1117 14:49:40.331588 (+ 23us) write_op.cc:276] Timestamp: P: 1794926977282642 usec, L: 0
1117 14:49:40.331741 (+ 153us) write_op.cc:270] Start()
1117 14:49:40.331762 (+ 21us) write_op.cc:276] Timestamp: P: 1794926977298754 usec, L: 0
1117 14:49:40.331916 (+ 154us) write_op.cc:270] Start()
1117 14:49:40.331936 (+ 20us) write_op.cc:276] Timestamp: P: 1794926977319314 usec, L: 0
1117 14:49:40.353041 (+ 21105us) spinlock_profiling.cc:245] Waited 10.9 ms on lock 0x61600001c430. stack: 00007f9a08fa33a6 00007f9a08fa3160 00007f9a07f9434d 00007f9a1f567704 00007f9a1f5676cd 00007f9a1f56709a 00007f9a18e0c62b 00007f9a16413a27 00007f9a163bfd7f 00007f9a163bee3e 00007f9a14fe4241 00007f9a15003b67 00007f9a15001417 00007f9a18ed38cd 00007f9a1303bae6 00007f9a1303b815
1117 14:49:40.353058 (+ 17us) write_op.cc:270] Start()
1117 14:49:40.353087 (+ 29us) write_op.cc:276] Timestamp: P: 1794926977339671 usec, L: 0
1117 14:49:40.354597 (+ 1510us) write_op.cc:270] Start()
1117 14:49:40.354618 (+ 21us) write_op.cc:276] Timestamp: P: 1794926977358105 usec, L: 0
1117 14:49:40.404768 (+ 50150us) write_op.cc:270] Start()
1117 14:49:40.404801 (+ 33us) write_op.cc:276] Timestamp: P: 1794926977392023 usec, L: 0
1117 14:49:40.405011 (+ 210us) write_op.cc:270] Start()
1117 14:49:40.405033 (+ 22us) write_op.cc:276] Timestamp: P: 1794926977434892 usec, L: 0
1117 14:49:40.419651 (+ 14618us) write_op.cc:270] Start()
1117 14:49:40.419679 (+ 28us) write_op.cc:276] Timestamp: P: 1794926977435588 usec, L: 0
1117 14:49:40.419853 (+ 174us) write_op.cc:270] Start()
1117 14:49:40.419872 (+ 19us) write_op.cc:276] Timestamp: P: 1794926977438130 usec, L: 0
1117 14:49:40.430974 (+ 11102us) write_op.cc:270] Start()
1117 14:49:40.431002 (+ 28us) write_op.cc:276] Timestamp: P: 1794926977473358 usec, L: 0
1117 14:49:40.444601 (+ 13599us) write_op.cc:270] Start()
1117 14:49:40.444649 (+ 48us) write_op.cc:276] Timestamp: P: 1794926977491601 usec, L: 0
1117 14:49:40.445334 (+ 685us) write_op.cc:270] Start()
1117 14:49:40.445359 (+ 25us) write_op.cc:276] Timestamp: P: 1794926977516378 usec, L: 0
1117 14:49:40.449316 (+ 3957us) write_op.cc:270] Start()
1117 14:49:40.449343 (+ 27us) write_op.cc:276] Timestamp: P: 1794926977531426 usec, L: 0
1117 14:49:40.449516 (+ 173us) write_op.cc:270] Start()
1117 14:49:40.449538 (+ 22us) write_op.cc:276] Timestamp: P: 1794926977560765 usec, L: 0
1117 14:49:40.449680 (+ 142us) write_op.cc:270] Start()
1117 14:49:40.449699 (+ 19us) write_op.cc:276] Timestamp: P: 1794926977592719 usec, L: 0
1117 14:49:40.449841 (+ 142us) write_op.cc:270] Start()
1117 14:49:40.449859 (+ 18us) write_op.cc:276] Timestamp: P: 1794926977594899 usec, L: 0
1117 14:49:40.450069 (+ 210us) write_op.cc:270] Start()
1117 14:49:40.450093 (+ 24us) write_op.cc:276] Timestamp: P: 1794926977662745 usec, L: 0
1117 14:49:40.450286 (+ 193us) write_op.cc:270] Start()
1117 14:49:40.450315 (+ 29us) write_op.cc:276] Timestamp: P: 1794926977666523 usec, L: 0
1117 14:49:40.450485 (+ 170us) write_op.cc:270] Start()
1117 14:49:40.450506 (+ 21us) write_op.cc:276] Timestamp: P: 1794926977691154 usec, L: 0
1117 14:49:40.450642 (+ 136us) write_op.cc:270] Start()
1117 14:49:40.450659 (+ 17us) write_op.cc:276] Timestamp: P: 1794926977706988 usec, L: 0
1117 14:49:40.450813 (+ 154us) write_op.cc:270] Start()
1117 14:49:40.450833 (+ 20us) write_op.cc:276] Timestamp: P: 1794926977723842 usec, L: 0
1117 14:49:40.451005 (+ 172us) write_op.cc:270] Start()
1117 14:49:40.451026 (+ 21us) write_op.cc:276] Timestamp: P: 1794926977756862 usec, L: 0
1117 14:49:40.451163 (+ 137us) write_op.cc:270] Start()
1117 14:49:40.451182 (+ 19us) write_op.cc:276] Timestamp: P: 1794926977780245 usec, L: 0
1117 14:49:40.451326 (+ 144us) write_op.cc:270] Start()
1117 14:49:40.451352 (+ 26us) write_op.cc:276] Timestamp: P: 1794926977798223 usec, L: 0
1117 14:49:40.451502 (+ 150us) write_op.cc:270] Start()
1117 14:49:40.451522 (+ 20us) write_op.cc:276] Timestamp: P: 1794926977828604 usec, L: 0
1117 14:49:40.451680 (+ 158us) write_op.cc:270] Start()
1117 14:49:40.451704 (+ 24us) write_op.cc:276] Timestamp: P: 1794926977829200 usec, L: 0
1117 14:49:40.451905 (+ 201us) write_op.cc:270] Start()
1117 14:49:40.451925 (+ 20us) write_op.cc:276] Timestamp: P: 1794926977860607 usec, L: 0
1117 14:49:40.452089 (+ 164us) write_op.cc:270] Start()
1117 14:49:40.452109 (+ 20us) write_op.cc:276] Timestamp: P: 1794926977886325 usec, L: 0
1117 14:49:40.452287 (+ 178us) write_op.cc:270] Start()
1117 14:49:40.452311 (+ 24us) write_op.cc:276] Timestamp: P: 1794926977910968 usec, L: 0
1117 14:49:40.459466 (+ 7155us) write_op.cc:270] Start()
1117 14:49:40.459508 (+ 42us) write_op.cc:276] Timestamp: P: 1794926977929389 usec, L: 0
1117 14:49:40.465579 (+ 6071us) write_op.cc:270] Start()
1117 14:49:40.465610 (+ 31us) write_op.cc:276] Timestamp: P: 1794926977935900 usec, L: 0
1117 14:49:40.476532 (+ 10922us) write_op.cc:270] Start()
1117 14:49:40.476558 (+ 26us) write_op.cc:276] Timestamp: P: 1794926977985677 usec, L: 0
1117 14:49:40.476731 (+ 173us) write_op.cc:270] Start()
1117 14:49:40.476758 (+ 27us) write_op.cc:276] Timestamp: P: 1794926977986442 usec, L: 0
1117 14:49:40.504411 (+ 27653us) write_op.cc:270] Start()
1117 14:49:40.504435 (+ 24us) write_op.cc:276] Timestamp: P: 1794926977990713 usec, L: 0
1117 14:49:40.510738 (+ 6303us) write_op.cc:270] Start()
1117 14:49:40.510760 (+ 22us) write_op.cc:276] Timestamp: P: 1794926978031090 usec, L: 0
1117 14:49:40.514425 (+ 3665us) write_op.cc:270] Start()
1117 14:49:40.514451 (+ 26us) write_op.cc:276] Timestamp: P: 1794926978041937 usec, L: 0
1117 14:49:40.520713 (+ 6262us) write_op.cc:270] Start()
1117 14:49:40.520749 (+ 36us) write_op.cc:276] Timestamp: P: 1794926978046668 usec, L: 0
1117 14:49:40.564043 (+ 43294us) write_op.cc:270] Start()
1117 14:49:40.564073 (+ 30us) write_op.cc:276] Timestamp: P: 1794926978073245 usec, L: 0
1117 14:49:40.568006 (+ 3933us) write_op.cc:270] Start()
1117 14:49:40.568032 (+ 26us) write_op.cc:276] Timestamp: P: 1794926978097319 usec, L: 0
1117 14:49:40.574448 (+ 6416us) write_op.cc:270] Start()
1117 14:49:40.574476 (+ 28us) write_op.cc:276] Timestamp: P: 1794926978111143 usec, L: 0
1117 14:49:40.627752 (+ 53276us) spinlock_profiling.cc:245] Waited 22 ms on lock 0x60f00001a288. stack: 00007f9a08fa33a6 00007f9a08fa3160 00007f9a07f9434d 00007f9a1f567704 00007f9a1f5676cd 00007f9a1f56709a 00007f9a121160b8 00007f9a1505c919 00007f9a15003c49 00007f9a15001417 00007f9a18ed38cd 00007f9a1303bae6 00007f9a1303b815 00007f9a100eb8de 00007f9a100ea7be 00007f9a100f09f8
1117 14:49:40.642491 (+ 14739us) write_op.cc:270] Start()
1117 14:49:40.642530 (+ 39us) write_op.cc:276] Timestamp: P: 1794926978143676 usec, L: 0
1117 14:49:40.642753 (+ 223us) write_op.cc:270] Start()
1117 14:49:40.642777 (+ 24us) write_op.cc:276] Timestamp: P: 1794926978171651 usec, L: 0
1117 14:49:40.642928 (+ 151us) write_op.cc:270] Start()
1117 14:49:40.642960 (+ 32us) write_op.cc:276] Timestamp: P: 1794926978205070 usec, L: 0
1117 14:49:40.643141 (+ 181us) write_op.cc:270] Start()
1117 14:49:40.643163 (+ 22us) write_op.cc:276] Timestamp: P: 1794926978206784 usec, L: 0
1117 14:49:40.645427 (+ 2264us) write_op.cc:270] Start()
1117 14:49:40.645453 (+ 26us) write_op.cc:276] Timestamp: P: 1794926978236010 usec, L: 0
1117 14:49:40.645622 (+ 169us) write_op.cc:270] Start()
1117 14:49:40.645649 (+ 27us) write_op.cc:276] Timestamp: P: 1794926978237818 usec, L: 0
1117 14:49:40.650493 (+ 4844us) write_op.cc:270] Start()
1117 14:49:40.650518 (+ 25us) write_op.cc:276] Timestamp: P: 1794926978258018 usec, L: 0
1117 14:49:40.650701 (+ 183us) write_op.cc:270] Start()
1117 14:49:40.650719 (+ 18us) write_op.cc:276] Timestamp: P: 1794926978264046 usec, L: 0
1117 14:49:40.655083 (+ 4364us) write_op.cc:270] Start()
1117 14:49:40.655109 (+ 26us) write_op.cc:276] Timestamp: P: 1794926978310036 usec, L: 0
1117 14:49:40.655307 (+ 198us) write_op.cc:270] Start()
1117 14:49:40.655330 (+ 23us) write_op.cc:276] Timestamp: P: 1794926978313085 usec, L: 0
1117 14:49:40.655492 (+ 162us) write_op.cc:270] Start()
1117 14:49:40.655514 (+ 22us) write_op.cc:276] Timestamp: P: 1794926978361672 usec, L: 0
1117 14:49:40.655662 (+ 148us) write_op.cc:270] Start()
1117 14:49:40.655686 (+ 24us) write_op.cc:276] Timestamp: P: 1794926978382666 usec, L: 0
1117 14:49:40.655858 (+ 172us) write_op.cc:270] Start()
1117 14:49:40.655879 (+ 21us) write_op.cc:276] Timestamp: P: 1794926978391807 usec, L: 0
1117 14:49:40.656053 (+ 174us) write_op.cc:270] Start()
1117 14:49:40.656077 (+ 24us) write_op.cc:276] Timestamp: P: 1794926978398094 usec, L: 0
1117 14:49:40.656230 (+ 153us) write_op.cc:270] Start()
1117 14:49:40.656270 (+ 40us) write_op.cc:276] Timestamp: P: 1794926978443863 usec, L: 0
1117 14:49:40.656435 (+ 165us) write_op.cc:270] Start()
1117 14:49:40.656485 (+ 50us) write_op.cc:276] Timestamp: P: 1794926978445341 usec, L: 0
1117 14:49:40.656658 (+ 173us) write_op.cc:270] Start()
1117 14:49:40.656679 (+ 21us) write_op.cc:276] Timestamp: P: 1794926978468184 usec, L: 0
1117 14:49:40.656866 (+ 187us) write_op.cc:270] Start()
1117 14:49:40.656886 (+ 20us) write_op.cc:276] Timestamp: P: 1794926978469236 usec, L: 0
1117 14:49:40.657070 (+ 184us) write_op.cc:270] Start()
1117 14:49:40.657090 (+ 20us) write_op.cc:276] Timestamp: P: 1794926978497584 usec, L: 0
1117 14:49:40.657225 (+ 135us) write_op.cc:270] Start()
1117 14:49:40.657244 (+ 19us) write_op.cc:276] Timestamp: P: 1794926978498857 usec, L: 0
1117 14:49:40.657400 (+ 156us) write_op.cc:270] Start()
1117 14:49:40.657419 (+ 19us) write_op.cc:276] Timestamp: P: 1794926978537891 usec, L: 0
1117 14:49:40.657570 (+ 151us) write_op.cc:270] Start()
1117 14:49:40.657589 (+ 19us) write_op.cc:276] Timestamp: P: 1794926978579152 usec, L: 0
1117 14:49:40.657730 (+ 141us) write_op.cc:270] Start()
1117 14:49:40.657749 (+ 19us) write_op.cc:276] Timestamp: P: 1794926978595848 usec, L: 0
1117 14:49:40.705938 (+ 48189us) write_op.cc:270] Start()
1117 14:49:40.705963 (+ 25us) write_op.cc:276] Timestamp: P: 1794926978601897 usec, L: 0
1117 14:49:40.710102 (+ 4139us) write_op.cc:270] Start()
1117 14:49:40.710128 (+ 26us) write_op.cc:276] Timestamp: P: 1794926978654778 usec, L: 0
1117 14:49:40.710310 (+ 182us) write_op.cc:270] Start()
1117 14:49:40.710329 (+ 19us) write_op.cc:276] Timestamp: P: 1794926978658204 usec, L: 0
1117 14:49:40.710466 (+ 137us) write_op.cc:270] Start()
1117 14:49:40.710484 (+ 18us) write_op.cc:276] Timestamp: P: 1794926978660099 usec, L: 0
1117 14:49:40.725725 (+ 15241us) write_op.cc:270] Start()
1117 14:49:40.725752 (+ 27us) write_op.cc:276] Timestamp: P: 1794926978696474 usec, L: 0
1117 14:49:40.761558 (+ 35806us) write_op.cc:270] Start()
1117 14:49:40.761583 (+ 25us) write_op.cc:276] Timestamp: P: 1794926978765637 usec, L: 0
1117 14:49:40.771160 (+ 9577us) write_op.cc:270] Start()
1117 14:49:40.772152 (+ 992us) write_op.cc:276] Timestamp: P: 1794926978770458 usec, L: 0
1117 14:49:40.774593 (+ 2441us) write_op.cc:270] Start()
1117 14:49:40.774620 (+ 27us) write_op.cc:276] Timestamp: P: 1794926978775525 usec, L: 0
1117 14:49:40.780591 (+ 5971us) write_op.cc:270] Start()
1117 14:49:40.780617 (+ 26us) write_op.cc:276] Timestamp: P: 1794926978781879 usec, L: 0
1117 14:49:40.780801 (+ 184us) write_op.cc:270] Start()
1117 14:49:40.780824 (+ 23us) write_op.cc:276] Timestamp: P: 1794926978824930 usec, L: 0
1117 14:49:40.780975 (+ 151us) write_op.cc:270] Start()
1117 14:49:40.780990 (+ 15us) write_op.cc:276] Timestamp: P: 1794926978857274 usec, L: 0
1117 14:49:40.781182 (+ 192us) write_op.cc:270] Start()
1117 14:49:40.781203 (+ 21us) write_op.cc:276] Timestamp: P: 17
I20261117 14:49:41.566180 7425 raft_consensus.cc:499] T 5c849aa2a21a4c13b2e31d2ca3f692cc P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7900e455dd64c68bccfc499bda413f7)
I20261117 14:49:41.570231 7425 raft_consensus.cc:521] T 5c849aa2a21a4c13b2e31d2ca3f692cc P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:41.571034 7425 leader_election.cc:290] T 5c849aa2a21a4c13b2e31d2ca3f692cc P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271), def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611)
I20261117 14:49:41.571504 6786 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5c849aa2a21a4c13b2e31d2ca3f692cc" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 2 candidate_status { last_received { term: 1 index: 839 } } ignore_live_leader: false dest_uuid: "def6b23bccc94a78a47118da331f2798" is_pre_election: true
I20261117 14:49:41.571947 6658 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5c849aa2a21a4c13b2e31d2ca3f692cc" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 2 candidate_status { last_received { term: 1 index: 839 } } ignore_live_leader: false dest_uuid: "c7900e455dd64c68bccfc499bda413f7" is_pre_election: true
I20261117 14:49:41.579952 7266 leader_election.cc:304] T 5c849aa2a21a4c13b2e31d2ca3f692cc P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec41d6947a4a4eadadf90c3756899704; no voters: c7900e455dd64c68bccfc499bda413f7, def6b23bccc94a78a47118da331f2798
I20261117 14:49:41.588367 7425 raft_consensus.cc:2771] T 5c849aa2a21a4c13b2e31d2ca3f692cc P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20261117 14:49:41.711865 7445 raft_consensus.cc:499] T d1732d75bf044feb8884fc3135373072 P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7900e455dd64c68bccfc499bda413f7)
I20261117 14:49:41.712136 7445 raft_consensus.cc:521] T d1732d75bf044feb8884fc3135373072 P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:41.713174 7445 leader_election.cc:290] T d1732d75bf044feb8884fc3135373072 P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271), def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611)
I20261117 14:49:41.714017 6655 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "d1732d75bf044feb8884fc3135373072" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 2 candidate_status { last_received { term: 1 index: 1018 } } ignore_live_leader: false dest_uuid: "c7900e455dd64c68bccfc499bda413f7" is_pre_election: true
I20261117 14:49:41.714468 6786 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "d1732d75bf044feb8884fc3135373072" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 2 candidate_status { last_received { term: 1 index: 1018 } } ignore_live_leader: false dest_uuid: "def6b23bccc94a78a47118da331f2798" is_pre_election: true
I20261117 14:49:41.715123 7267 leader_election.cc:304] T d1732d75bf044feb8884fc3135373072 P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec41d6947a4a4eadadf90c3756899704; no voters: c7900e455dd64c68bccfc499bda413f7, def6b23bccc94a78a47118da331f2798
I20261117 14:49:41.715603 7445 raft_consensus.cc:2771] T d1732d75bf044feb8884fc3135373072 P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20261117 14:49:41.725277 7342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.6.50.130:39451 (request call id 6) took 2045 ms. Trace:
I20261117 14:49:41.767675 7447 raft_consensus.cc:2771] T b74e748e97c84edeabc1c0cb41ddae99 P ec41d6947a4a4eadadf90c3756899704 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20261117 14:49:41.779950 7347 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.6.50.131:58395 (request call id 4) took 2051 ms. Trace:
I20261117 14:49:41.806942 7345 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.6.50.130:39451 (request call id 7) took 1921 ms. Trace:
I20261117 14:49:41.807825 7444 raft_consensus.cc:2771] T 57984748adc7482a9a2d999a447a81af P ec41d6947a4a4eadadf90c3756899704 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20261117 14:49:41.725445 7342 rpcz_store.cc:276] 1117 14:49:39.679456 (+ 0us) service_pool.cc:167] Inserting onto call queue
1117 14:49:39.680505 (+ 1049us) service_pool.cc:224] Handling call
1117 14:49:39.881324 (+200819us) raft_consensus.cc:1481] Updating replica for 234 ops
1117 14:49:40.198343 (+317019us) raft_consensus.cc:1545] Early marking committed up to index 784
1117 14:49:40.198403 (+ 60us) raft_consensus.cc:1550] Triggering prepare for 234 ops
1117 14:49:40.198612 (+ 209us) write_op.cc:270] Start()
1117 14:49:40.198643 (+ 31us) write_op.cc:276] Timestamp: P: 1794926975008354 usec, L: 0
1117 14:49:40.198845 (+ 202us) write_op.cc:270] Start()
1117 14:49:40.198871 (+ 26us) write_op.cc:276] Timestamp: P: 1794926975011142 usec, L: 0
1117 14:49:40.199066 (+ 195us) write_op.cc:270] Start()
1117 14:49:40.199088 (+ 22us) write_op.cc:276] Timestamp: P: 1794926975017793 usec, L: 0
1117 14:49:40.199284 (+ 196us) write_op.cc:270] Start()
1117 14:49:40.199307 (+ 23us) write_op.cc:276] Timestamp: P: 1794926975072517 usec, L: 0
1117 14:49:40.199452 (+ 145us) write_op.cc:270] Start()
1117 14:49:40.199477 (+ 25us) write_op.cc:276] Timestamp: P: 1794926975081945 usec, L: 0
1117 14:49:40.199688 (+ 211us) write_op.cc:270] Start()
1117 14:49:40.199712 (+ 24us) write_op.cc:276] Timestamp: P: 1794926975087349 usec, L: 0
1117 14:49:40.199863 (+ 151us) write_op.cc:270] Start()
1117 14:49:40.199902 (+ 39us) write_op.cc:276] Timestamp: P: 1794926975093556 usec, L: 0
1117 14:49:40.202455 (+ 2553us) write_op.cc:270] Start()
1117 14:49:40.202481 (+ 26us) write_op.cc:276] Timestamp: P: 1794926975135320 usec, L: 0
1117 14:49:40.218761 (+ 16280us) write_op.cc:270] Start()
1117 14:49:40.218795 (+ 34us) write_op.cc:276] Timestamp: P: 1794926975175729 usec, L: 0
1117 14:49:40.269565 (+ 50770us) write_op.cc:270] Start()
1117 14:49:40.269602 (+ 37us) write_op.cc:276] Timestamp: P: 1794926975177926 usec, L: 0
1117 14:49:40.269814 (+ 212us) write_op.cc:270] Start()
1117 14:49:40.269840 (+ 26us) write_op.cc:276] Timestamp: P: 1794926975181931 usec, L: 0
1117 14:49:40.270028 (+ 188us) write_op.cc:270] Start()
1117 14:49:40.270050 (+ 22us) write_op.cc:276] Timestamp: P: 1794926975203744 usec, L: 0
1117 14:49:40.270200 (+ 150us) write_op.cc:270] Start()
1117 14:49:40.270220 (+ 20us) write_op.cc:276] Timestamp: P: 1794926975246830 usec, L: 0
1117 14:49:40.270465 (+ 245us) write_op.cc:270] Start()
1117 14:49:40.270490 (+ 25us) write_op.cc:276] Timestamp: P: 1794926975253353 usec, L: 0
1117 14:49:40.270665 (+ 175us) write_op.cc:270] Start()
1117 14:49:40.270688 (+ 23us) write_op.cc:276] Timestamp: P: 1794926975285539 usec, L: 0
1117 14:49:40.270851 (+ 163us) write_op.cc:270] Start()
1117 14:49:40.270875 (+ 24us) write_op.cc:276] Timestamp: P: 1794926975303920 usec, L: 0
1117 14:49:40.271085 (+ 210us) write_op.cc:270] Start()
1117 14:49:40.271111 (+ 26us) write_op.cc:276] Timestamp: P: 1794926975315837 usec, L: 0
1117 14:49:40.271274 (+ 163us) write_op.cc:270] Start()
1117 14:49:40.271291 (+ 17us) write_op.cc:276] Timestamp: P: 1794926975347804 usec, L: 0
1117 14:49:40.271388 (+ 97us) write_op.cc:270] Start()
1117 14:49:40.271401 (+ 13us) write_op.cc:276] Timestamp: P: 1794926975358459 usec, L: 0
1117 14:49:40.286372 (+ 14971us) write_op.cc:270] Start()
1117 14:49:40.286402 (+ 30us) write_op.cc:276] Timestamp: P: 1794926975384287 usec, L: 0
1117 14:49:40.287792 (+ 1390us) write_op.cc:270] Start()
1117 14:49:40.287819 (+ 27us) write_op.cc:276] Timestamp: P: 1794926975414722 usec, L: 0
1117 14:49:40.288131 (+ 312us) write_op.cc:270] Start()
1117 14:49:40.288156 (+ 25us) write_op.cc:276] Timestamp: P: 1794926975420208 usec, L: 0
1117 14:49:40.316222 (+ 28066us) write_op.cc:270] Start()
1117 14:49:40.316250 (+ 28us) write_op.cc:276] Timestamp: P: 1794926975442505 usec, L: 0
1117 14:49:40.325745 (+ 9495us) write_op.cc:270] Start()
1117 14:49:40.325773 (+ 28us) write_op.cc:276] Timestamp: P: 1794926975453463 usec, L: 0
1117 14:49:40.333770 (+ 7997us) write_op.cc:270] Start()
1117 14:49:40.333797 (+ 27us) write_op.cc:276] Timestamp: P: 1794926975479505 usec, L: 0
1117 14:49:40.336222 (+ 2425us) write_op.cc:270] Start()
1117 14:49:40.336250 (+ 28us) write_op.cc:276] Timestamp: P: 1794926975514650 usec, L: 0
1117 14:49:40.336430 (+ 180us) write_op.cc:270] Start()
1117 14:49:40.336483 (+ 53us) write_op.cc:276] Timestamp: P: 1794926975517879 usec, L: 0
1117 14:49:40.336650 (+ 167us) write_op.cc:270] Start()
1117 14:49:40.336671 (+ 21us) write_op.cc:276] Timestamp: P: 1794926975526915 usec, L: 0
1117 14:49:40.336819 (+ 148us) write_op.cc:270] Start()
1117 14:49:40.336840 (+ 21us) write_op.cc:276] Timestamp: P: 1794926975571016 usec, L: 0
1117 14:49:40.337007 (+ 167us) write_op.cc:270] Start()
1117 14:49:40.337029 (+ 22us) write_op.cc:276] Timestamp: P: 1794926975590191 usec, L: 0
1117 14:49:40.337179 (+ 150us) write_op.cc:270] Start()
1117 14:49:40.337199 (+ 20us) write_op.cc:276] Timestamp: P: 1794926975610507 usec, L: 0
1117 14:49:40.337348 (+ 149us) write_op.cc:270] Start()
1117 14:49:40.337369 (+ 21us) write_op.cc:276] Timestamp: P: 1794926975624193 usec, L: 0
1117 14:49:40.337569 (+ 200us) write_op.cc:270] Start()
1117 14:49:40.337593 (+ 24us) write_op.cc:276] Timestamp: P: 1794926975642237 usec, L: 0
1117 14:49:40.337745 (+ 152us) write_op.cc:270] Start()
1117 14:49:40.337765 (+ 20us) write_op.cc:276] Timestamp: P: 1794926975660914 usec, L: 0
1117 14:49:40.337913 (+ 148us) write_op.cc:270] Start()
1117 14:49:40.337936 (+ 23us) write_op.cc:276] Timestamp: P: 1794926975682880 usec, L: 0
1117 14:49:40.338092 (+ 156us) write_op.cc:270] Start()
1117 14:49:40.338112 (+ 20us) write_op.cc:276] Timestamp: P: 1794926975685488 usec, L: 0
1117 14:49:40.338308 (+ 196us) write_op.cc:270] Start()
1117 14:49:40.338330 (+ 22us) write_op.cc:276] Timestamp: P: 1794926975691057 usec, L: 0
1117 14:49:40.338537 (+ 207us) write_op.cc:270] Start()
1117 14:49:40.338561 (+ 24us) write_op.cc:276] Timestamp: P: 1794926975728229 usec, L: 0
1117 14:49:40.338736 (+ 175us) write_op.cc:270] Start()
1117 14:49:40.338758 (+ 22us) write_op.cc:276] Timestamp: P: 1794926975767655 usec, L: 0
1117 14:49:40.342884 (+ 4126us) write_op.cc:270] Start()
1117 14:49:40.342916 (+ 32us) write_op.cc:276] Timestamp: P: 1794926975769520 usec, L: 0
1117 14:49:40.344145 (+ 1229us) write_op.cc:270] Start()
1117 14:49:40.344170 (+ 25us) write_op.cc:276] Timestamp: P: 1794926975784333 usec, L: 0
1117 14:49:40.344335 (+ 165us) write_op.cc:270] Start()
1117 14:49:40.344360 (+ 25us) write_op.cc:276] Timestamp: P: 1794926975796016 usec, L: 0
1117 14:49:40.344548 (+ 188us) write_op.cc:270] Start()
1117 14:49:40.344573 (+ 25us) write_op.cc:276] Timestamp: P: 1794926975823275 usec, L: 0
1117 14:49:40.352682 (+ 8109us) write_op.cc:270] Start()
1117 14:49:40.352709 (+ 27us) write_op.cc:276] Timestamp: P: 1794926975842978 usec, L: 0
1117 14:49:40.352896 (+ 187us) write_op.cc:270] Start()
1117 14:49:40.353104 (+ 208us) write_op.cc:276] Timestamp: P: 1794926975847280 usec, L: 0
1117 14:49:40.416762 (+ 63658us) write_op.cc:270] Start()
1117 14:49:40.416805 (+ 43us) write_op.cc:276] Timestamp: P: 1794926975853283 usec, L: 0
1117 14:49:40.417074 (+ 269us) write_op.cc:270] Start()
1117 14:49:40.417103 (+ 29us) write_op.cc:276] Timestamp: P: 1794926975895428 usec, L: 0
1117 14:49:40.417300 (+ 197us) write_op.cc:270] Start()
1117 14:49:40.417326 (+ 26us) write_op.cc:276] Timestamp: P: 1794926975903346 usec, L: 0
1117 14:49:40.417546 (+ 220us) write_op.cc:270] Start()
1117 14:49:40.417573 (+ 27us) write_op.cc:276] Timestamp: P: 1794926975938925 usec, L: 0
1117 14:49:40.417791 (+ 218us) write_op.cc:270] Start()
1117 14:49:40.417815 (+ 24us) write_op.cc:276] Timestamp: P: 1794926975946100 usec, L: 0
1117 14:49:40.418000 (+ 185us) write_op.cc:270] Start()
1117 14:49:40.418026 (+ 26us) write_op.cc:276] Timestamp: P: 1794926975978464 usec, L: 0
1117 14:49:40.444926 (+ 26900us) write_op.cc:270] Start()
1117 14:49:40.444998 (+ 72us) write_op.cc:276] Timestamp: P: 1794926975993513 usec, L: 0
1117 14:49:40.456128 (+ 11130us) write_op.cc:270] Start()
1117 14:49:40.456155 (+ 27us) write_op.cc:276] Timestamp: P: 1794926975998524 usec, L: 0
1117 14:49:40.456320 (+ 165us) write_op.cc:270] Start()
1117 14:49:40.456340 (+ 20us) write_op.cc:276] Timestamp: P: 1794926976037921 usec, L: 0
1117 14:49:40.464593 (+ 8253us) write_op.cc:270] Start()
1117 14:49:40.464622 (+ 29us) write_op.cc:276] Timestamp: P: 1794926976047615 usec, L: 0
1117 14:49:40.469579 (+ 4957us) write_op.cc:270] Start()
1117 14:49:40.469610 (+ 31us) write_op.cc:276] Timestamp: P: 1794926976101128 usec, L: 0
1117 14:49:40.469787 (+ 177us) write_op.cc:270] Start()
1117 14:49:40.469812 (+ 25us) write_op.cc:276] Timestamp: P: 1794926976105568 usec, L: 0
1117 14:49:40.472886 (+ 3074us) write_op.cc:270] Start()
1117 14:49:40.472913 (+ 27us) write_op.cc:276] Timestamp: P: 1794926976112199 usec, L: 0
1117 14:49:40.477715 (+ 4802us) write_op.cc:270] Start()
1117 14:49:40.477739 (+ 24us) write_op.cc:276] Timestamp: P: 1794926976152169 usec, L: 0
1117 14:49:40.503419 (+ 25680us) write_op.cc:270] Start()
1117 14:49:40.503461 (+ 42us) write_op.cc:276] Timestamp: P: 1794926976179063 usec, L: 0
1117 14:49:40.506411 (+ 2950us) write_op.cc:270] Start()
1117 14:49:40.506438 (+ 27us) write_op.cc:276] Timestamp: P: 1794926976195301 usec, L: 0
1117 14:49:40.510528 (+ 4090us) write_op.cc:270] Start()
1117 14:49:40.510554 (+ 26us) write_op.cc:276] Timestamp: P: 1794926976233030 usec, L: 0
1117 14:49:40.517678 (+ 7124us) write_op.cc:270] Start()
1117 14:49:40.517702 (+ 24us) write_op.cc:276] Timestamp: P: 1794926976256276 usec, L: 0
1117 14:49:40.525848 (+ 8146us) write_op.cc:270] Start()
1117 14:49:40.525886 (+ 38us) write_op.cc:276] Timestamp: P: 1794926976257020 usec, L: 0
1117 14:49:40.564535 (+ 38649us) write_op.cc:270] Start()
1117 14:49:40.564563 (+ 28us) write_op.cc:276] Timestamp: P: 1794926976268500 usec, L: 0
1117 14:49:40.564739 (+ 176us) write_op.cc:270] Start()
1117 14:49:40.564762 (+ 23us) write_op.cc:276] Timestamp: P: 1794926976297192 usec, L: 0
1117 14:49:40.564903 (+ 141us) write_op.cc:270] Start()
1117 14:49:40.564926 (+ 23us) write_op.cc:276] Timestamp: P: 1794926976310303 usec, L: 0
1117 14:49:40.565114 (+ 188us) write_op.cc:270] Start()
1117 14:49:40.565137 (+ 23us) write_op.cc:276] Timestamp: P: 1794926976318068 usec, L: 0
1117 14:49:40.565321 (+ 184us) write_op.cc:270] Start()
1117 14:49:40.565344 (+ 23us) write_op.cc:276] Timestamp: P: 1794926976321479 usec, L: 0
1117 14:49:40.565493 (+ 149us) write_op.cc:270] Start()
1117 14:49:40.565515 (+ 22us) write_op.cc:276] Timestamp: P: 1794926976346591 usec, L: 0
1117 14:49:40.565694 (+ 179us) write_op.cc:270] Start()
1117 14:49:40.565718 (+ 24us) write_op.cc:276] Timestamp: P: 1794926976368644 usec, L: 0
1117 14:49:40.565868 (+ 150us) write_op.cc:270] Start()
1117 14:49:40.565890 (+ 22us) write_op.cc:276] Timestamp: P: 1794926976395957 usec, L: 0
1117 14:49:40.566049 (+ 159us) write_op.cc:270] Start()
1117 14:49:40.566069 (+ 20us) write_op.cc:276] Timestamp: P: 1794926976417982 usec, L: 0
1117 14:49:40.566244 (+ 175us) write_op.cc:270] Start()
1117 14:49:40.566265 (+ 21us) write_op.cc:276] Timestamp: P: 1794926976423340 usec, L: 0
1117 14:49:40.566422 (+ 157us) write_op.cc:270] Start()
1117 14:49:40.566444 (+ 22us) write_op.cc:276] Timestamp: P: 1794926976473316 usec, L: 0
1117 14:49:40.566602 (+ 158us) write_op.cc:270] Start()
1117 14:49:40.566623 (+ 21us) write_op.cc:276] Timestamp: P: 1794926976494845 usec, L: 0
1117 14:49:40.568243 (+ 1620us) write_op.cc:270] Start()
1117 14:49:40.568266 (+ 23us) write_op.cc:276] Timestamp: P: 1794926976511374 usec, L: 0
1117 14:49:40.568427 (+ 161us) write_op.cc:270] Start()
1117 14:49:40.568478 (+ 51us) write_op.cc:276] Timestamp: P: 1794926976514055 usec, L: 0
1117 14:49:40.568653 (+ 175us) write_op.cc:270] Start()
1117 14:49:40.568674 (+ 21us) write_op.cc:276] Timestamp: P: 1794926976525696 usec, L: 0
1117 14:49:40.568862 (+ 188us) write_op.cc:270] Start()
1117 14:49:40.568884 (+ 22us) write_op.cc:276] Timestamp: P: 1794926976554714 usec, L: 0
1117 14:49:40.572639 (+ 3755us) write_op.cc:270] Start()
1117 14:49:40.572662 (+ 23us) write_op.cc:276] Timestamp: P: 1794926976580968 usec, L: 0
1117 14:49:40.592642 (+ 19980us) write_op.cc:270] Start()
1117 14:49:40.592663 (+ 21us) write_op.cc:276] Timestamp: P: 1794926976584349 usec, L: 0
1117 14:49:40.592781 (+ 118us) write_op.cc:270] Start()
1117 14:49:40.592797 (+ 16us) write_op.cc:276] Timestamp: P: 1794926976618711 usec, L: 0
1117 14:49:40.592922 (+ 125us) write_op.cc:270] Start()
1117 14:49:40.592938 (+ 16us) write_op.cc:276] Timestamp: P: 1794926976639287 usec, L: 0
1117 14:49:40.593063 (+ 125us) write_op.cc:270] Start()
1117 14:49:40.593080 (+ 17us) write_op.cc:276] Timestamp: P: 1794926976650268 usec, L: 0
1117 14:49:40.593202 (+ 122us) write_op.cc:270] Start()
1117 14:49:40.593218 (+ 16us) write_op.cc:276] Timestamp: P: 1794926976666916 usec, L: 0
1117 14:49:40.593337 (+ 119us) write_op.cc:270] Start()
1117 14:49:40.593356 (+ 19us) write_op.cc:276] Timestamp: P: 1794926976702562 usec, L: 0
1117 14:49:40.593481 (+ 125us) write_op.cc:270] Start()
1117 14:49:40.593498 (+ 17us) write_op.cc:276] Timestamp: P: 1794926976719280 usec, L: 0
1117 14:49:40.593612 (+ 114us) write_op.cc:270] Start()
1117 14:49:40.593628 (+ 16us) write_op.cc:276] Timestamp: P: 1794926976741953 usec, L: 0
1117 14:49:40.593756 (+ 128us) write_op.cc:270] Start()
1117 14:49:40.593772 (+ 16us) write_op.cc:276] Timestamp: P: 1794926976743015 usec, L: 0
1117 14:49:40.593894 (+ 122us) write_op.cc:270] Start()
1117 14:49:40.593910 (+ 16us) write_op.cc:276] Timestamp: P: 1794926976743551 usec, L: 0
1117 14:49:40.594056 (+ 146us) write_op.cc:270] Start()
1117 14:49:40.594074 (+ 18us) write_op.cc:276] Timestamp: P: 1794926976776366 usec, L: 0
1117 14:49:40.594204 (+ 130us) write_op.cc:270] Start()
1117 14:49:40.594221 (+ 17us) write_op.cc:276] Timestamp: P: 1794926976808133 usec, L: 0
1117 14:49:40.594346 (+ 125us) write_op.cc:270] Start()
1117 14:49:40.594363 (+ 17us) write_op.cc:276] Timestamp: P: 1794926976828967 usec, L: 0
1117 14:49:40.594482 (+ 119us) write_op.cc:270] Start()
1117 14:49:40.594497 (+ 15us) write_op.cc:276] Timestamp: P: 1794926976841840 usec, L: 0
1117 14:49:40.594668 (+ 171us) write_op.cc:270] Start()
1117 14:49:40.594687 (+ 19us) write_op.cc:276] Timestamp: P: 1794926976843107 usec, L: 0
1117 14:49:40.594796 (+ 109us) write_op.cc:270] Start()
1117 14:49:40.594811 (+ 15us) write_op.cc:276] Timestamp: P: 1794926976899504 usec, L: 0
1117 14:49:40.594922 (+ 111us) write_op.cc:270] Start()
1117 14:49:40.594937 (+ 15us) write_op.cc:276] Timestamp: P: 1794926976900793 usec, L: 0
1117 14:49:40.595057 (+ 120us) write_op.cc:270] Start()
1117 14:49:40.595273 (+ 216us) write_op.cc:276] Timestamp: P: 1794926976903028 usec, L: 0
1117 14:49:40.595669 (+ 396us) write_op.cc:270] Start()
1117 14:49:40.595697 (+ 28us) write_op.cc:276] Timestamp: P: 1794926976926562 usec, L: 0
1117 14:49:40.595902 (+ 205us) write_op.cc:270] Start()
1117 14:49:40.595925 (+ 23us) write_op.cc:276] Timestamp: P: 1794926976966241 usec, L: 0
1117 14:49:40.596116 (+ 191us) write_op.cc:270] Start()
1117 14:49:40.596141 (+ 25us) write_op.cc:276] Timestamp: P: 1794926976979506 usec, L: 0
1117 14:49:40.596339 (+ 198us) write_op.cc:270] Start()
1117 14:49:40.596363 (+ 24us) write_op.cc:276] Timestamp: P: 1794926976986728 usec, L: 0
1117 14:49:40.644392 (+ 48029us) write_op.cc:270] Start()
1117 14:49:40.644419 (+ 27us) write_op.cc:276] Timestamp: P: 1794926976994774 usec, L: 0
1117 14:49:40.673723 (+ 29304us) write_op.cc:270] Start()
1117 14:49:40.673758 (+ 35us) write_op.cc:276] Timestamp: P: 1794926977049743 usec, L: 0
1117 14:49:40.677078 (+ 3320us) write_op.cc:270] Start()
1117 14:49:40.677105 (+ 27us) write_op.cc:276] Timestamp: P: 1794926977052109 usec, L: 0
1117 14:49:40.691267 (+ 14162us) write_op.cc:270] Start()
1117 14:49:40.691289 (+ 22us) write_op.cc:276] Timestamp: P: 1794926977058626 usec, L: 0
1117 14:49:40.691432 (+ 143us) write_op.cc:270] Start()
1117 14:49:40.691450 (+ 18us) write_op.cc:276] Timestamp: P: 1794926977060880 usec, L: 0
1117 14:49:40.702414 (+ 10964us) write_op.cc:270] Start()
1117 14:49:40.702443 (+ 29us) write_op.cc:276] Timestamp: P: 1794926977105182 usec, L: 0
1117 14:49:40.705638 (+ 3195us) write_op.cc:270] Start()
1117 14:49:40.705660 (+ 22us) write_op.cc:276] Timestamp: P: 1794926977141700 usec, L: 0
1117 14:49:40.725390 (+ 19730us) write_op.cc:270] Start()
1117 14:49:40.725429 (+ 39us) write_op.cc:276] Timestamp: P: 1794926977147216 usec, L: 0
1117 14:49:40.761807 (+ 36378us) write_op.cc:270] Start()
1117 14:49:40.763797 (+ 1990us) write_op.cc:276] Timestamp: P: 1794926977202704 usec, L: 0
1117 14:49:40.781620 (+ 17823us) write_op.cc:270] Start()
1117 14:49:40.781642 (+ 22us) write_op.cc:276] Timestamp: P: 1794926977204822 usec, L: 0
1117 14:49:40.782841 (+ 1199us) write_op.cc:270] Start()
1117 14:49:40.782863 (+ 22us) write_op.cc:276] Timestamp: P: 1794926977207462 usec, L: 0
1117 14:49:40.783046 (+ 183us) write_op.cc:270] Start()
1117 14:49:40.783068 (+ 22us) write_op.cc:276] Timestamp: P: 1794926977244532 usec, L: 0
1117 14:49:40.783234 (+ 166us) write_op.cc:270] Start()
1117 14:49:40.783255 (+ 21us) write_op.cc:276] Timestamp: P: 1794926977250217 usec, L: 0
1117 14:49:40.807193 (+ 23938us) write_op.cc:270] Start()
1117 14:49:40.807218 (+ 25us) write_op.cc:276] Timestamp: P: 1794926977256068 usec, L: 0
1117 14:49:40.807389 (+ 171us) write_op.cc:270] Start()
1117 14:49:40.807411 (+ 22us) write_op.cc:276] Timestamp: P: 1794926977281406 usec, L: 0
1117 14:49:40.833399 (+ 25988us) write_op.cc:270] Start()
1117 14:49:40.833426 (+ 27us) write_op.cc:276] Timestamp: P: 1794926977321488 usec, L: 0
1117 14:49:40.833631 (+ 205us) write_op.cc:270] Start()
1117 14:49:40.833654 (+ 23us) write_op.cc:276] Timestamp: P: 1794926977323212 usec, L: 0
1117 14:49:40.833812 (+ 158us) write_op.cc:270] Start()
1117 14:49:40.833833 (+ 21us) write_op.cc:276] Timestamp: P: 1794926977326617 usec, L: 0
1117 14:49:40.834000 (+ 167us) write_op.cc:270] Start()
1117 14:49:40.834021 (+ 21us) write_op.cc:276] Timestamp: P: 1794926977361764 usec, L: 0
1117 14:49:40.834180 (+ 159us) write_op.cc:270] Start()
1117 14:49:40.834200 (+ 20us) write_op.cc:276] Timestamp: P: 1794926977397704 usec, L: 0
1117 14:49:40.834356 (+ 156us) write_op.cc:270] Start()
1117 14:49:40.834377 (+ 21us) write_op.cc:276] Timestamp: P: 1794926977401994 usec, L: 0
1117 14:49:40.834543 (+ 166us) write_op.cc:270] Start()
1117 14:49:40.834566 (+ 23us) write_op.cc:276] Timestamp: P: 1794926977446498 usec, L: 0
1117 14:49:40.834748 (+ 182us) write_op.cc:270] Start()
1117 14:49:40.834771 (+ 23us) write_op.cc:276] Timestamp: P: 1794926977447102 usec, L: 0
1117 14:49:40.834926 (+ 155us) write_op.cc:270] Start()
1117 14:49:40.834948 (+ 22us) write_op.cc:276] Timestamp: P: 1794926977497503 usec, L: 0
1117 14:49:40.836613 (+ 1665us) write_op.cc:270] Start()
1117 14:49:40.836656 (+ 43us) write_op.cc:276] Timestamp: P: 1794926977498186 usec, L: 0
1117 14:49:40.836867 (+ 211us) write_op.cc:270] Start()
1117 14:49:40.836889 (+ 22us) write_op.cc:276] Timestamp: P: 1794926977520544 usec, L: 0
1117 14:49:40.837064 (+ 175us) write_op.cc:270] Start()
1117 14:49:40.837085 (+ 21us) write_op.cc:276] Timestamp: P: 1794926977536568 usec, L: 0
1117 14:49:40.837247 (+ 162us) write_op.cc:270] Start()
1117 14:49:40.837303 (+ 56us) write_op.cc:276] Timestamp: P: 1794926977578985 usec, L: 0
1117 14:49:40.837474 (+ 171us) write_op.cc:270] Start()
1117 14:49:40.837495 (+ 21us) write_op.cc:276] Timestamp: P: 1794926977609391 usec, L: 0
1117 14:49:40.837668 (+ 173us) write_op.cc:270] Start()
1117 14:49:40.837689 (+ 21us) write_op.cc:276] Timestamp: P: 1794926977609943 usec, L: 0
1117 14:49:40.837837 (+ 148us) write_op.cc:270] Start()
1117 14:49:40.837858 (+ 21us) write_op.cc:276] Timestamp: P: 1794926977644495 usec, L: 0
1117 14:49:40.838005 (+ 147us) write_op.cc:270] Start()
1117 14:49:40.838025 (+ 20us) write_op.cc:276] Timestamp: P: 1794926977679706 usec, L: 0
1117 14:49:40.838185 (+ 160us) write_op.cc:270] Start()
1117 14:49:40.838212 (+ 27us) write_op.cc:276] Timestamp: P: 1794926977701376 usec, L: 0
1117 14:49:40.838368 (+ 156us) write_op.cc:270] Start()
1117 14:49:40.838390 (+ 22us) write_op.cc:276] Timestamp: P: 1794926977723219 usec, L: 0
1117 14:49:40.891053 (+ 52663us) write_op.cc:270] Start()
1117 14:49:40.891075 (+ 22us) write_op.cc:276] Timestamp: P: 1794926977729433 usec, L: 0
1117 14:49:40.894031 (+ 2956us) write_op.cc:270] Start()
1117 14:49:40.894079 (+ 48us) write_op.cc:276] Timestamp: P: 1794926977750577 usec, L: 0
1117 14:49:40.897291 (+ 3212us) write_op.cc:270] Start()
1117 14:49:40.897319 (+ 28us) write_op.cc:276] Timestamp: P: 1794926977788493 usec, L: 0
1117 14:49:40.915183 (+ 17864us) write_op.cc:270] Start()
1117 14:49:40.915212 (+ 29us) write_op.cc:276] Timestamp: P: 1794926977808703 usec, L: 0
1117 14:49:40.933709 (+ 18497us) write_op.cc:270] Start()
1117 14:49:40.933735 (+ 26us) write_op.cc:276] Timestamp: P: 1794926977824939 usec, L: 0
1117 14:49:40.933947 (+ 212us) write_op.cc:270] Start()
1117 14:49:40.933972 (+ 25us) write_op.cc:276] Timestamp: P: 1794926977827282 usec, L: 0
1117 14:49:40.934157 (+ 185us) write_op.cc:270] Start()
1117 14:49:40.934192 (+ 35us) write_op.cc:276] Timestamp: P: 1794926977875949 usec, L: 0
1117 14:49:40.934353 (+ 161us) write_op.cc:270] Start()
1117 14:49:40.934395 (+ 42us) write_op.cc:276] Timestamp: P: 1794926977897395 usec, L: 0
1117 14:49:40.934580 (+ 185us) write_op.cc:270] Start()
1117 14:49:40.934602 (+ 22us) write_op.cc:276] Timestamp: P: 1794926977922507 usec, L: 0
1117 14:49:40.934902 (+ 300us) write_op.cc:270] Start()
1117 14:49:40.934927 (+ 25us) write_op.cc:276] Timestamp: P: 1794926977939407 usec, L: 0
1117 14:49:40.935144 (+ 217us) write_op.cc:270] Start()
1117 14:49:40.935172 (+ 28us) write_op.cc:276] Timestamp: P: 1794926977940195 usec, L: 0
1117 14:49:40.935353 (+ 181us) write_op.cc:270] Start()
1117 14:49:40.935376 (+ 23us) write_op.cc:276] Timestamp: P: 1794926977974920 usec, L: 0
1117 14:49:40.935546 (+ 170us) write_op.cc:270] Start()
1117 14:49:40.935570 (+ 24us) write_op.cc:276] Timestamp: P: 1794926977988514 usec, L: 0
1117 14:49:40.935743 (+ 173us) write_op.cc:270] Start()
1117 14:49:40.935765 (+ 22us) write_op.cc:276] Timestamp: P: 1794926978017085 usec, L: 0
1117 14:49:40.935922 (+ 157us) write_op.cc:270] Start()
1117 14:49:40.935960 (+ 38us) write_op.cc:276] Timestamp: P: 1794926978027024 usec, L: 0
1117 14:49:40.936127 (+ 167us) write_op.cc:270] Start()
1117 14:49:40.936152 (+ 25us) write_op.cc:276] Timestamp: P: 1794926978029721 usec, L: 0
1117 14:49:40.965874 (+ 29722us) write_op.cc:270] Start()
1117 14:49:40.965904 (+ 30us) write_op.cc:276] Timestamp: P: 1794926978036944 usec, L: 0
1117 14:49:40.966114 (+ 210us) write_op.cc:270] Start()
1117 14:49:40.966139 (+ 25us) write_op.cc:276] Timestamp: P: 1794926978108330 usec, L: 0
1117 14:49:40.966342 (+ 203us) write_op.cc:270] Start()
1117 14:49:40.966365 (+ 23us) write_op.cc:276] Timestamp: P: 1794926978112875 usec, L: 0
1117 14:49:40.966541 (+ 176us) write_op.cc:270] Start()
1117 14:49:40.966564 (+ 23us) write_op.cc:276] Timestamp: P: 1794926978117038 usec, L: 0
1117 14:49:40.966754 (+ 190us) write_op.cc:270] Start()
1117 14:49:40.966776 (+ 22us) write_op.cc:276] Timestamp: P: 1794926978151828 usec, L: 0
1117 14:49:40.966939 (+ 163us) write_op.cc:270] Start()
1117 14:49:40.966963 (+ 24us) write_op.cc:276] Timestamp: P: 1794926978183807 usec, L: 0
1117 14:49:40.967118 (+ 155us) write_op.cc:270] Start()
1117 14:49:40.997053 (+ 29935us) write_op.cc:276] Timestamp: P: 1794926978188230 usec, L: 0
1117 14:49:41.051760 (+ 54707us) write_op.cc:270] Start()
1117 14:49:41.051789 (+ 29us) write_op.cc:276] Timestamp: P: 1794926978209216 usec, L: 0
1117 14:49:41.051996 (+ 207us) write_op.cc:270] Start()
1117 14:49:41.052020 (+ 24us) write_op.cc:276] Timestamp: P: 1794926978252579 usec, L: 0
1117 14:49:41.052176 (+ 156us) write_op.cc:270] Start()
1117 14:49:41.052197 (+ 21us) write_op.cc:276] Timestamp: P: 1794926978255709 usec, L: 0
1117 14:49:41.061305 (+ 9108us) write_op.cc:270] Start()
1117 14:49:41.061331 (+ 26us) write_op.cc:276] Timestamp: P: 1794926978274235 usec, L: 0
1117 14:49:41.068611 (+ 7280us) write_op.cc:270] Start()
1117 14:49:41.068641 (+ 30us) write_op.cc:276] Timestamp: P: 1794926978317318 usec, L: 0
1117 14:49:41.068811 (+ 170us) write_op.cc:270] Start()
1117 14:49:41.068836 (+ 25us) write_op.cc:276] Timestamp: P: 1794926978331007 usec, L: 0
1117 14:49:41.069063 (+ 227us) write_op.cc:270] Start()
1117 14:49:41.069085 (+ 22us) write_op.cc:276] Timestamp: P: 1794926978332663 usec, L: 0
1117 14:49:41.069784 (+ 699us) write_op.cc:270] Start()
1117 14:49:41.069807 (+ 23us) write_op.cc:276] Timestamp: P: 1794926978354807 usec, L: 0
1117 14:49:41.099138 (+ 29331us) write_op.cc:270] Start()
1117 14:49:41.099175 (+ 37us) write_op.cc:276] Timestamp: P: 1794926978376959 usec, L: 0
1117 14:49:41.101506 (+ 2331us) write_op.cc:270] Start()
1117 14:49:41.101530 (+ 24us) write_op.cc:276] Timestamp: P: 1794926978392103 usec, L: 0
1117 14:49:41.101789 (+ 259us) write_op.cc:270] Start()
1117 14:49:41.101810 (+ 21us) write_op.cc:276] Timestamp: P: 1794926978419888 usec, L: 0
1117 14:49:41.101959 (+ 149us) write_op.cc:270] Start()
1117 14:49:41.101982 (+ 23us) write_op.cc:276] Timestamp: P: 1794926978421305 usec, L: 0
1117 14:49:41.102135 (+ 153us) write_op.cc:270] Start()
1117 14:49:41.102156 (+ 21us) write_op.cc:276] Timestamp: P: 1794926978451045 usec, L: 0
1117 14:49:41.116283 (+ 14127us) write_op.cc:270] Start()
1117 14:49:41.116319 (+ 36us) write_op.cc:276] Timestamp: P: 1794926978470956 usec, L: 0
1117 14:49:41.119305 (+ 2986us) write_op.cc:270] Start()
1117 14:49:41.119324 (+ 19us) write_op.cc:276] Timestamp: P: 1794926978481770 usec, L: 0
1117 14:49:41.120419 (+ 1095us) write_op.cc:270] Start()
1117 14:49:41.120478 (+ 59us) write_op.cc:276] Timestamp: P: 1794926978505247 usec, L: 0
1117 14:49:41.120656 (+ 178us) write_op.cc:270] Start()
1117 14:49:41.120677 (+ 21us) write_op.cc:276] Timestamp: P: 1794926978517734 usec, L: 0
1117 14:49:41.120819 (+ 142us) write_op.cc:270] Start()
1117 14:49:41.120840 (+ 21us) write_op.cc:276] Timestamp: P: 1794926978530462 usec, L: 0
1117 14:49:41.170735 (+ 49895us) write_op.cc:270] Start()
1117 14:49:41.170771 (+ 36us) write_op.cc:276] Timestamp: P: 1794926978565971 usec, L: 0
1117 14:49:41.170992 (+ 221us) write_op.cc:270] Start()
1117 14:49:41.171015 (+ 23us) write_op.cc:276] Timestamp: P: 1794926978595417 usec, L: 0
1117 14:49:41.171218 (+ 203us) write_op.cc:270] Start()
1117 14:49:41.171239 (+ 21us) write_op.cc:276] Timestamp: P: 1794926978607129 usec, L: 0
1117 14:49:41.171370 (+ 131us) write_op.cc:270] Start()
1117 14:49:41.171388 (+ 18us) write_op.cc:276] Timestamp: P: 1794926978640206 usec, L: 0
1117 14:49:41.171541 (+ 153us) write_op.cc:270] Start()
1117 14:49:41.171559 (+ 18us) write_op.cc:276] Timestamp: P: 1794926978662487 usec, L: 0
1117 14:49:41.171682 (+ 123us) write_op.cc:270] Start()
1117 14:49:41.171700 (+ 18us) write_op.cc:276] Timestamp: P: 1794926978664657 usec, L: 0
1117 14:49:41.171870 (+ 170us) write_op.cc:270] Start()
1117 14:49:41.171890 (+ 20us) write_op.cc:276] Timestamp: P: 1794926978693414 usec, L: 0
1117 14:49:41.172037 (+ 147us) write_op.cc:270] Start()
1117 14:49:41.172055 (+ 18us) write_op.cc:276] Timestamp: P: 1794926978731168 usec, L: 0
1117 14:49:41.172203 (+ 148us) write_op.cc:270] Start()
1117 14:49:41.172221 (+ 18us) write_op.cc:276] Timestamp: P: 1794926978749001 usec, L: 0
1117 14:49:41.172359 (+ 138us) write_op.cc:270] Start()
1117 14:49:41.172378 (+ 19us) write_op.cc:276] Timestamp: P: 1794926978753695 usec, L: 0
1117 14:49:41.172564 (+ 186us) write_op.cc:270] Start()
1117 14:49:41.172584 (+ 20us) write_op.cc:276] Timestamp: P: 1794926978764893 usec, L: 0
1117 14:49:41.172758 (+ 174us) write_op.cc:270] Start()
1117 14:49:41.172779 (+ 21us) write_op.cc:276] Timestamp: P: 1794926978836192 usec, L: 0
1117 14:49:41.172922 (+ 143us) write_op.cc:270] Start()
1117 14:49:41.172945 (+ 23us) write_op.cc:276] Timestamp: P: 1794926978838421 usec, L: 0
1117 14:49:41.177583 (+ 4638us) write_op.cc:270] Start()
1117 14:49:41.177636 (+ 53us) write_op.cc:276] Timestamp: P: 1794926978840146 usec, L: 0
1117 14:49:41.177867 (+ 231us) write_op.cc:270] Start()
1117 14:49:41.177893 (+ 26us) write_op.cc:276] Timestamp: P: 1794926978855284 usec, L: 0
1117 14:49:41.178063 (+ 170us) write_op.cc:270] Start()
1117 14:49:41.178089 (+ 26us) write_op.cc:276] Timestamp: P: 1794926978907207 usec, L: 0
1117 14:49:41.178286 (+ 197us) write_op.cc:270] Start()
1117 14:49:41.178312 (+ 26us) write_op.cc:276] Timestamp: P: 1794926978917422 usec, L: 0
1117 14:49:41.178468 (+ 156us) write_op.cc:270] Start()
1117 14:49:41.178502 (+ 34us) write_op.cc:276] Timestamp: P: 1794926978922794 usec, L: 0
1117 14:49:41.178705 (+ 203us) write_op.cc:270] Start()
1117 14:49:41.178730 (+ 25us) write_op.cc:276] Timestamp: P: 179492
I20261117 14:49:40.354118 7343 rpcz_store.cc:276] 1117 14:49:36.194411 (+ 0us) service_pool.cc:167] Inserting onto call queue
1117 14:49:36.194473 (+ 62us) service_pool.cc:224] Handling call
1117 14:49:36.389192 (+194719us) raft_consensus.cc:1481] Updating replica for 664 ops
1117 14:49:36.594295 (+205103us) raft_consensus.cc:1545] Early marking committed up to index 0
1117 14:49:36.594301 (+ 6us) raft_consensus.cc:1550] Triggering prepare for 664 ops
1117 14:49:36.594475 (+ 174us) write_op.cc:270] Start()
1117 14:49:36.594503 (+ 28us) write_op.cc:276] Timestamp: P: 1794926962050242 usec, L: 0
1117 14:49:36.595072 (+ 569us) write_op.cc:270] Start()
1117 14:49:36.595098 (+ 26us) write_op.cc:276] Timestamp: P: 1794926962083781 usec, L: 0
1117 14:49:36.595292 (+ 194us) write_op.cc:270] Start()
1117 14:49:36.595319 (+ 27us) write_op.cc:276] Timestamp: P: 1794926962118517 usec, L: 0
1117 14:49:36.595565 (+ 246us) write_op.cc:270] Start()
1117 14:49:36.595588 (+ 23us) write_op.cc:276] Timestamp: P: 1794926962125911 usec, L: 0
1117 14:49:36.595759 (+ 171us) write_op.cc:270] Start()
1117 14:49:36.595782 (+ 23us) write_op.cc:276] Timestamp: P: 1794926962127385 usec, L: 0
1117 14:49:36.595986 (+ 204us) write_op.cc:270] Start()
1117 14:49:36.596014 (+ 28us) write_op.cc:276] Timestamp: P: 1794926962634392 usec, L: 0
1117 14:49:36.599412 (+ 3398us) write_op.cc:270] Start()
1117 14:49:36.599466 (+ 54us) write_op.cc:276] Timestamp: P: 1794926962644284 usec, L: 0
1117 14:49:36.599618 (+ 152us) write_op.cc:270] Start()
1117 14:49:36.599637 (+ 19us) write_op.cc:276] Timestamp: P: 1794926962677847 usec, L: 0
1117 14:49:36.599801 (+ 164us) write_op.cc:270] Start()
1117 14:49:36.599822 (+ 21us) write_op.cc:276] Timestamp: P: 1794926962703040 usec, L: 0
1117 14:49:36.600003 (+ 181us) write_op.cc:270] Start()
1117 14:49:36.600047 (+ 44us) write_op.cc:276] Timestamp: P: 1794926962705707 usec, L: 0
1117 14:49:36.600246 (+ 199us) write_op.cc:270] Start()
1117 14:49:36.600268 (+ 22us) write_op.cc:276] Timestamp: P: 1794926962728493 usec, L: 0
1117 14:49:36.600415 (+ 147us) write_op.cc:270] Start()
1117 14:49:36.600470 (+ 55us) write_op.cc:276] Timestamp: P: 1794926962729483 usec, L: 0
1117 14:49:36.634750 (+ 34280us) write_op.cc:270] Start()
1117 14:49:36.634774 (+ 24us) write_op.cc:276] Timestamp: P: 1794926962786066 usec, L: 0
1117 14:49:36.640417 (+ 5643us) write_op.cc:270] Start()
1117 14:49:36.640489 (+ 72us) write_op.cc:276] Timestamp: P: 1794926962787171 usec, L: 0
1117 14:49:36.640828 (+ 339us) write_op.cc:270] Start()
1117 14:49:36.640855 (+ 27us) write_op.cc:276] Timestamp: P: 1794926962798325 usec, L: 0
1117 14:49:36.641072 (+ 217us) write_op.cc:270] Start()
1117 14:49:36.641102 (+ 30us) write_op.cc:276] Timestamp: P: 1794926962798943 usec, L: 0
1117 14:49:36.641306 (+ 204us) write_op.cc:270] Start()
1117 14:49:36.641337 (+ 31us) write_op.cc:276] Timestamp: P: 1794926962839616 usec, L: 0
1117 14:49:36.641499 (+ 162us) write_op.cc:270] Start()
1117 14:49:36.641522 (+ 23us) write_op.cc:276] Timestamp: P: 1794926962844928 usec, L: 0
1117 14:49:36.641674 (+ 152us) write_op.cc:270] Start()
1117 14:49:36.641694 (+ 20us) write_op.cc:276] Timestamp: P: 1794926962847352 usec, L: 0
1117 14:49:36.641889 (+ 195us) write_op.cc:270] Start()
1117 14:49:36.641909 (+ 20us) write_op.cc:276] Timestamp: P: 1794926962854420 usec, L: 0
1117 14:49:36.645996 (+ 4087us) write_op.cc:270] Start()
1117 14:49:36.646016 (+ 20us) write_op.cc:276] Timestamp: P: 1794926962895690 usec, L: 0
1117 14:49:36.646192 (+ 176us) write_op.cc:270] Start()
1117 14:49:36.646235 (+ 43us) write_op.cc:276] Timestamp: P: 1794926962906139 usec, L: 0
1117 14:49:36.646403 (+ 168us) write_op.cc:270] Start()
1117 14:49:36.646421 (+ 18us) write_op.cc:276] Timestamp: P: 1794926962916602 usec, L: 0
1117 14:49:36.647574 (+ 1153us) write_op.cc:270] Start()
1117 14:49:36.647601 (+ 27us) write_op.cc:276] Timestamp: P: 1794926962925411 usec, L: 0
1117 14:49:36.654973 (+ 7372us) write_op.cc:270] Start()
1117 14:49:36.654995 (+ 22us) write_op.cc:276] Timestamp: P: 1794926962948137 usec, L: 0
1117 14:49:36.664026 (+ 9031us) write_op.cc:270] Start()
1117 14:49:36.664057 (+ 31us) write_op.cc:276] Timestamp: P: 1794926962975089 usec, L: 0
1117 14:49:36.678360 (+ 14303us) write_op.cc:270] Start()
1117 14:49:36.678383 (+ 23us) write_op.cc:276] Timestamp: P: 1794926962987540 usec, L: 0
1117 14:49:36.679067 (+ 684us) write_op.cc:270] Start()
1117 14:49:36.679090 (+ 23us) write_op.cc:276] Timestamp: P: 1794926962988180 usec, L: 0
1117 14:49:36.688497 (+ 9407us) write_op.cc:270] Start()
1117 14:49:36.688520 (+ 23us) write_op.cc:276] Timestamp: P: 1794926962995120 usec, L: 0
1117 14:49:36.688680 (+ 160us) write_op.cc:270] Start()
1117 14:49:36.688700 (+ 20us) write_op.cc:276] Timestamp: P: 1794926963037750 usec, L: 0
1117 14:49:36.689363 (+ 663us) write_op.cc:270] Start()
1117 14:49:36.689387 (+ 24us) write_op.cc:276] Timestamp: P: 1794926963042539 usec, L: 0
1117 14:49:36.690480 (+ 1093us) write_op.cc:270] Start()
1117 14:49:36.690504 (+ 24us) write_op.cc:276] Timestamp: P: 1794926963051302 usec, L: 0
1117 14:49:36.694190 (+ 3686us) write_op.cc:270] Start()
1117 14:49:36.694217 (+ 27us) write_op.cc:276] Timestamp: P: 1794926963065157 usec, L: 0
1117 14:49:36.694400 (+ 183us) write_op.cc:270] Start()
1117 14:49:36.694422 (+ 22us) write_op.cc:276] Timestamp: P: 1794926963102482 usec, L: 0
1117 14:49:36.694577 (+ 155us) write_op.cc:270] Start()
1117 14:49:36.694599 (+ 22us) write_op.cc:276] Timestamp: P: 1794926963104316 usec, L: 0
1117 14:49:36.694757 (+ 158us) write_op.cc:270] Start()
1117 14:49:36.694778 (+ 21us) write_op.cc:276] Timestamp: P: 1794926963124221 usec, L: 0
1117 14:49:36.694935 (+ 157us) write_op.cc:270] Start()
1117 14:49:36.694980 (+ 45us) write_op.cc:276] Timestamp: P: 1794926963125054 usec, L: 0
1117 14:49:36.695155 (+ 175us) write_op.cc:270] Start()
1117 14:49:36.695177 (+ 22us) write_op.cc:276] Timestamp: P: 1794926963150862 usec, L: 0
1117 14:49:36.695345 (+ 168us) write_op.cc:270] Start()
1117 14:49:36.695368 (+ 23us) write_op.cc:276] Timestamp: P: 1794926963174843 usec, L: 0
1117 14:49:36.695524 (+ 156us) write_op.cc:270] Start()
1117 14:49:36.695546 (+ 22us) write_op.cc:276] Timestamp: P: 1794926963192494 usec, L: 0
1117 14:49:36.695701 (+ 155us) write_op.cc:270] Start()
1117 14:49:36.695723 (+ 22us) write_op.cc:276] Timestamp: P: 1794926963193599 usec, L: 0
1117 14:49:36.695906 (+ 183us) write_op.cc:270] Start()
1117 14:49:36.695927 (+ 21us) write_op.cc:276] Timestamp: P: 1794926963225597 usec, L: 0
1117 14:49:36.696107 (+ 180us) write_op.cc:270] Start()
1117 14:49:36.696129 (+ 22us) write_op.cc:276] Timestamp: P: 1794926963242332 usec, L: 0
1117 14:49:36.696286 (+ 157us) write_op.cc:270] Start()
1117 14:49:36.696307 (+ 21us) write_op.cc:276] Timestamp: P: 1794926963262095 usec, L: 0
1117 14:49:36.700802 (+ 4495us) write_op.cc:270] Start()
1117 14:49:36.700825 (+ 23us) write_op.cc:276] Timestamp: P: 1794926963271213 usec, L: 0
1117 14:49:36.707357 (+ 6532us) write_op.cc:270] Start()
1117 14:49:36.707381 (+ 24us) write_op.cc:276] Timestamp: P: 1794926963293594 usec, L: 0
1117 14:49:36.707536 (+ 155us) write_op.cc:270] Start()
1117 14:49:36.716001 (+ 8465us) write_op.cc:276] Timestamp: P: 1794926963299043 usec, L: 0
1117 14:49:36.729418 (+ 13417us) write_op.cc:270] Start()
1117 14:49:36.729447 (+ 29us) write_op.cc:276] Timestamp: P: 1794926963308058 usec, L: 0
1117 14:49:36.753159 (+ 23712us) write_op.cc:270] Start()
1117 14:49:36.753202 (+ 43us) write_op.cc:276] Timestamp: P: 1794926963345690 usec, L: 0
1117 14:49:36.755259 (+ 2057us) write_op.cc:270] Start()
1117 14:49:36.755290 (+ 31us) write_op.cc:276] Timestamp: P: 1794926963359720 usec, L: 0
1117 14:49:36.772138 (+ 16848us) write_op.cc:270] Start()
1117 14:49:36.772165 (+ 27us) write_op.cc:276] Timestamp: P: 1794926963361798 usec, L: 0
1117 14:49:36.775551 (+ 3386us) write_op.cc:270] Start()
1117 14:49:36.775581 (+ 30us) write_op.cc:276] Timestamp: P: 1794926963394025 usec, L: 0
1117 14:49:36.775775 (+ 194us) write_op.cc:270] Start()
1117 14:49:36.775798 (+ 23us) write_op.cc:276] Timestamp: P: 1794926963423499 usec, L: 0
1117 14:49:36.775985 (+ 187us) write_op.cc:270] Start()
1117 14:49:36.776011 (+ 26us) write_op.cc:276] Timestamp: P: 1794926963427385 usec, L: 0
1117 14:49:36.776188 (+ 177us) write_op.cc:270] Start()
1117 14:49:36.776212 (+ 24us) write_op.cc:276] Timestamp: P: 1794926963428126 usec, L: 0
1117 14:49:36.776370 (+ 158us) write_op.cc:270] Start()
1117 14:49:36.776392 (+ 22us) write_op.cc:276] Timestamp: P: 1794926963445090 usec, L: 0
1117 14:49:36.776587 (+ 195us) write_op.cc:270] Start()
1117 14:49:36.776609 (+ 22us) write_op.cc:276] Timestamp: P: 1794926963456960 usec, L: 0
1117 14:49:36.776805 (+ 196us) write_op.cc:270] Start()
1117 14:49:36.776828 (+ 23us) write_op.cc:276] Timestamp: P: 1794926963476582 usec, L: 0
1117 14:49:36.777018 (+ 190us) write_op.cc:270] Start()
1117 14:49:36.777041 (+ 23us) write_op.cc:276] Timestamp: P: 1794926963488498 usec, L: 0
1117 14:49:36.777193 (+ 152us) write_op.cc:270] Start()
1117 14:49:36.777229 (+ 36us) write_op.cc:276] Timestamp: P: 1794926963514174 usec, L: 0
1117 14:49:36.777414 (+ 185us) write_op.cc:270] Start()
1117 14:49:36.777441 (+ 27us) write_op.cc:276] Timestamp: P: 1794926963528526 usec, L: 0
1117 14:49:36.777625 (+ 184us) write_op.cc:270] Start()
1117 14:49:36.777652 (+ 27us) write_op.cc:276] Timestamp: P: 1794926963530169 usec, L: 0
1117 14:49:36.777817 (+ 165us) write_op.cc:270] Start()
1117 14:49:36.777847 (+ 30us) write_op.cc:276] Timestamp: P: 1794926963569137 usec, L: 0
1117 14:49:36.778025 (+ 178us) write_op.cc:270] Start()
1117 14:49:36.778047 (+ 22us) write_op.cc:276] Timestamp: P: 1794926963570291 usec, L: 0
1117 14:49:36.803246 (+ 25199us) write_op.cc:270] Start()
1117 14:49:36.803277 (+ 31us) write_op.cc:276] Timestamp: P: 1794926963596876 usec, L: 0
1117 14:49:36.804121 (+ 844us) write_op.cc:270] Start()
1117 14:49:36.804146 (+ 25us) write_op.cc:276] Timestamp: P: 1794926963623618 usec, L: 0
1117 14:49:36.804292 (+ 146us) write_op.cc:270] Start()
1117 14:49:36.804311 (+ 19us) write_op.cc:276] Timestamp: P: 1794926963637427 usec, L: 0
1117 14:49:36.804477 (+ 166us) write_op.cc:270] Start()
1117 14:49:36.804500 (+ 23us) write_op.cc:276] Timestamp: P: 1794926963641999 usec, L: 0
1117 14:49:36.804654 (+ 154us) write_op.cc:270] Start()
1117 14:49:36.804673 (+ 19us) write_op.cc:276] Timestamp: P: 1794926963655909 usec, L: 0
1117 14:49:36.804815 (+ 142us) write_op.cc:270] Start()
1117 14:49:36.804831 (+ 16us) write_op.cc:276] Timestamp: P: 1794926963674321 usec, L: 0
1117 14:49:36.804963 (+ 132us) write_op.cc:270] Start()
1117 14:49:36.804981 (+ 18us) write_op.cc:276] Timestamp: P: 1794926963689297 usec, L: 0
1117 14:49:36.805120 (+ 139us) write_op.cc:270] Start()
1117 14:49:36.805137 (+ 17us) write_op.cc:276] Timestamp: P: 1794926963700799 usec, L: 0
1117 14:49:36.806581 (+ 1444us) write_op.cc:270] Start()
1117 14:49:36.806602 (+ 21us) write_op.cc:276] Timestamp: P: 1794926963713901 usec, L: 0
1117 14:49:36.806755 (+ 153us) write_op.cc:270] Start()
1117 14:49:36.806775 (+ 20us) write_op.cc:276] Timestamp: P: 1794926963714803 usec, L: 0
1117 14:49:36.806923 (+ 148us) write_op.cc:270] Start()
1117 14:49:36.806953 (+ 30us) write_op.cc:276] Timestamp: P: 1794926963744581 usec, L: 0
1117 14:49:36.807089 (+ 136us) write_op.cc:270] Start()
1117 14:49:36.807107 (+ 18us) write_op.cc:276] Timestamp: P: 1794926963767576 usec, L: 0
1117 14:49:36.824130 (+ 17023us) write_op.cc:270] Start()
1117 14:49:36.824151 (+ 21us) write_op.cc:276] Timestamp: P: 1794926963768305 usec, L: 0
1117 14:49:36.826390 (+ 2239us) write_op.cc:270] Start()
1117 14:49:36.826414 (+ 24us) write_op.cc:276] Timestamp: P: 1794926963780669 usec, L: 0
1117 14:49:36.826590 (+ 176us) write_op.cc:270] Start()
1117 14:49:36.826650 (+ 60us) write_op.cc:276] Timestamp: P: 1794926963803933 usec, L: 0
1117 14:49:36.826831 (+ 181us) write_op.cc:270] Start()
1117 14:49:36.826853 (+ 22us) write_op.cc:276] Timestamp: P: 1794926963821487 usec, L: 0
1117 14:49:36.827037 (+ 184us) write_op.cc:270] Start()
1117 14:49:36.827059 (+ 22us) write_op.cc:276] Timestamp: P: 1794926963837616 usec, L: 0
1117 14:49:36.827225 (+ 166us) write_op.cc:270] Start()
1117 14:49:36.827246 (+ 21us) write_op.cc:276] Timestamp: P: 1794926963839824 usec, L: 0
1117 14:49:36.827402 (+ 156us) write_op.cc:270] Start()
1117 14:49:36.827426 (+ 24us) write_op.cc:276] Timestamp: P: 1794926963862094 usec, L: 0
1117 14:49:36.827595 (+ 169us) write_op.cc:270] Start()
1117 14:49:36.827617 (+ 22us) write_op.cc:276] Timestamp: P: 1794926963892019 usec, L: 0
1117 14:49:36.827797 (+ 180us) write_op.cc:270] Start()
1117 14:49:36.827820 (+ 23us) write_op.cc:276] Timestamp: P: 1794926963895176 usec, L: 0
1117 14:49:36.827997 (+ 177us) write_op.cc:270] Start()
1117 14:49:36.828020 (+ 23us) write_op.cc:276] Timestamp: P: 1794926963905260 usec, L: 0
1117 14:49:36.828228 (+ 208us) write_op.cc:270] Start()
1117 14:49:36.828251 (+ 23us) write_op.cc:276] Timestamp: P: 1794926963927967 usec, L: 0
1117 14:49:36.828411 (+ 160us) write_op.cc:270] Start()
1117 14:49:36.828432 (+ 21us) write_op.cc:276] Timestamp: P: 1794926963941649 usec, L: 0
1117 14:49:36.883910 (+ 55478us) write_op.cc:270] Start()
1117 14:49:36.883932 (+ 22us) write_op.cc:276] Timestamp: P: 1794926963958582 usec, L: 0
1117 14:49:36.901635 (+ 17703us) write_op.cc:270] Start()
1117 14:49:36.901657 (+ 22us) write_op.cc:276] Timestamp: P: 1794926963987381 usec, L: 0
1117 14:49:36.901837 (+ 180us) write_op.cc:270] Start()
1117 14:49:36.901858 (+ 21us) write_op.cc:276] Timestamp: P: 1794926964002979 usec, L: 0
1117 14:49:36.902040 (+ 182us) write_op.cc:270] Start()
1117 14:49:36.902063 (+ 23us) write_op.cc:276] Timestamp: P: 1794926964006650 usec, L: 0
1117 14:49:36.902255 (+ 192us) write_op.cc:270] Start()
1117 14:49:36.902281 (+ 26us) write_op.cc:276] Timestamp: P: 1794926964039633 usec, L: 0
1117 14:49:36.902462 (+ 181us) write_op.cc:270] Start()
1117 14:49:36.902488 (+ 26us) write_op.cc:276] Timestamp: P: 1794926964049332 usec, L: 0
1117 14:49:36.902649 (+ 161us) write_op.cc:270] Start()
1117 14:49:36.902670 (+ 21us) write_op.cc:276] Timestamp: P: 1794926964051419 usec, L: 0
1117 14:49:36.902864 (+ 194us) write_op.cc:270] Start()
1117 14:49:36.902885 (+ 21us) write_op.cc:276] Timestamp: P: 1794926964064189 usec, L: 0
1117 14:49:36.903049 (+ 164us) write_op.cc:270] Start()
1117 14:49:36.903070 (+ 21us) write_op.cc:276] Timestamp: P: 1794926964078722 usec, L: 0
1117 14:49:36.903242 (+ 172us) write_op.cc:270] Start()
1117 14:49:36.904632 (+ 1390us) write_op.cc:276] Timestamp: P: 1794926964116699 usec, L: 0
1117 14:49:36.914679 (+ 10047us) write_op.cc:270] Start()
1117 14:49:36.914704 (+ 25us) write_op.cc:276] Timestamp: P: 1794926964122286 usec, L: 0
1117 14:49:36.919326 (+ 4622us) write_op.cc:270] Start()
1117 14:49:36.919356 (+ 30us) write_op.cc:276] Timestamp: P: 1794926964152528 usec, L: 0
1117 14:49:36.921101 (+ 1745us) write_op.cc:270] Start()
1117 14:49:36.921125 (+ 24us) write_op.cc:276] Timestamp: P: 1794926964163540 usec, L: 0
1117 14:49:36.943619 (+ 22494us) write_op.cc:270] Start()
1117 14:49:36.943655 (+ 36us) write_op.cc:276] Timestamp: P: 1794926964168502 usec, L: 0
1117 14:49:36.945435 (+ 1780us) write_op.cc:270] Start()
1117 14:49:36.945459 (+ 24us) write_op.cc:276] Timestamp: P: 1794926964171645 usec, L: 0
1117 14:49:36.979627 (+ 34168us) write_op.cc:270] Start()
1117 14:49:36.979660 (+ 33us) write_op.cc:276] Timestamp: P: 1794926964194899 usec, L: 0
1117 14:49:36.983743 (+ 4083us) write_op.cc:270] Start()
1117 14:49:36.983766 (+ 23us) write_op.cc:276] Timestamp: P: 1794926964230280 usec, L: 0
1117 14:49:36.997829 (+ 14063us) write_op.cc:270] Start()
1117 14:49:36.997853 (+ 24us) write_op.cc:276] Timestamp: P: 1794926964247998 usec, L: 0
1117 14:49:36.998011 (+ 158us) write_op.cc:270] Start()
1117 14:49:36.998031 (+ 20us) write_op.cc:276] Timestamp: P: 1794926964252599 usec, L: 0
1117 14:49:37.000122 (+ 2091us) write_op.cc:270] Start()
1117 14:49:37.000146 (+ 24us) write_op.cc:276] Timestamp: P: 1794926964253303 usec, L: 0
1117 14:49:37.006984 (+ 6838us) write_op.cc:270] Start()
1117 14:49:37.007009 (+ 25us) write_op.cc:276] Timestamp: P: 1794926964291049 usec, L: 0
1117 14:49:37.009186 (+ 2177us) write_op.cc:270] Start()
1117 14:49:37.009211 (+ 25us) write_op.cc:276] Timestamp: P: 1794926964291771 usec, L: 0
1117 14:49:37.010082 (+ 871us) write_op.cc:270] Start()
1117 14:49:37.010103 (+ 21us) write_op.cc:276] Timestamp: P: 1794926964292606 usec, L: 0
1117 14:49:37.028980 (+ 18877us) write_op.cc:270] Start()
1117 14:49:37.029007 (+ 27us) write_op.cc:276] Timestamp: P: 1794926964308789 usec, L: 0
1117 14:49:37.029181 (+ 174us) write_op.cc:270] Start()
1117 14:49:37.029208 (+ 27us) write_op.cc:276] Timestamp: P: 1794926964340780 usec, L: 0
1117 14:49:37.029378 (+ 170us) write_op.cc:270] Start()
1117 14:49:37.029400 (+ 22us) write_op.cc:276] Timestamp: P: 1794926964358591 usec, L: 0
1117 14:49:37.029565 (+ 165us) write_op.cc:270] Start()
1117 14:49:37.029585 (+ 20us) write_op.cc:276] Timestamp: P: 1794926964364120 usec, L: 0
1117 14:49:37.029715 (+ 130us) write_op.cc:270] Start()
1117 14:49:37.029734 (+ 19us) write_op.cc:276] Timestamp: P: 1794926964387373 usec, L: 0
1117 14:49:37.029881 (+ 147us) write_op.cc:270] Start()
1117 14:49:37.029904 (+ 23us) write_op.cc:276] Timestamp: P: 1794926964398902 usec, L: 0
1117 14:49:37.030087 (+ 183us) write_op.cc:270] Start()
1117 14:49:37.030109 (+ 22us) write_op.cc:276] Timestamp: P: 1794926964432895 usec, L: 0
1117 14:49:37.030263 (+ 154us) write_op.cc:270] Start()
1117 14:49:37.030283 (+ 20us) write_op.cc:276] Timestamp: P: 1794926964433716 usec, L: 0
1117 14:49:37.030436 (+ 153us) write_op.cc:270] Start()
1117 14:49:37.030469 (+ 33us) write_op.cc:276] Timestamp: P: 1794926964435191 usec, L: 0
1117 14:49:37.030622 (+ 153us) write_op.cc:270] Start()
1117 14:49:37.030643 (+ 21us) write_op.cc:276] Timestamp: P: 1794926964442487 usec, L: 0
1117 14:49:37.030804 (+ 161us) write_op.cc:270] Start()
1117 14:49:37.030825 (+ 21us) write_op.cc:276] Timestamp: P: 1794926964489621 usec, L: 0
1117 14:49:37.030984 (+ 159us) write_op.cc:270] Start()
1117 14:49:37.031006 (+ 22us) write_op.cc:276] Timestamp: P: 1794926964508287 usec, L: 0
1117 14:49:37.031186 (+ 180us) write_op.cc:270] Start()
1117 14:49:37.031209 (+ 23us) write_op.cc:276] Timestamp: P: 1794926964514546 usec, L: 0
1117 14:49:37.031373 (+ 164us) write_op.cc:270] Start()
1117 14:49:37.031395 (+ 22us) write_op.cc:276] Timestamp: P: 1794926964515449 usec, L: 0
1117 14:49:37.031662 (+ 267us) write_op.cc:270] Start()
1117 14:49:37.031685 (+ 23us) write_op.cc:276] Timestamp: P: 1794926964537275 usec, L: 0
1117 14:49:37.051961 (+ 20276us) write_op.cc:270] Start()
1117 14:49:37.051985 (+ 24us) write_op.cc:276] Timestamp: P: 1794926964556813 usec, L: 0
1117 14:49:37.064569 (+ 12584us) write_op.cc:270] Start()
1117 14:49:37.064593 (+ 24us) write_op.cc:276] Timestamp: P: 1794926964570861 usec, L: 0
1117 14:49:37.084715 (+ 20122us) write_op.cc:270] Start()
1117 14:49:37.084739 (+ 24us) write_op.cc:276] Timestamp: P: 1794926964571464 usec, L: 0
1117 14:49:37.084895 (+ 156us) write_op.cc:270] Start()
1117 14:49:37.084914 (+ 19us) write_op.cc:276] Timestamp: P: 1794926964584829 usec, L: 0
1117 14:49:37.085053 (+ 139us) write_op.cc:270] Start()
1117 14:49:37.085094 (+ 41us) write_op.cc:276] Timestamp: P: 1794926964612709 usec, L: 0
1117 14:49:37.085224 (+ 130us) write_op.cc:270] Start()
1117 14:49:37.085241 (+ 17us) write_op.cc:276] Timestamp: P: 1794926964622029 usec, L: 0
1117 14:49:37.085379 (+ 138us) write_op.cc:270] Start()
1117 14:49:37.085397 (+ 18us) write_op.cc:276] Timestamp: P: 1794926964629150 usec, L: 0
1117 14:49:37.085537 (+ 140us) write_op.cc:270] Start()
1117 14:49:37.085555 (+ 18us) write_op.cc:276] Timestamp: P: 1794926964655439 usec, L: 0
1117 14:49:37.085690 (+ 135us) write_op.cc:270] Start()
1117 14:49:37.085710 (+ 20us) write_op.cc:276] Timestamp: P: 1794926964687266 usec, L: 0
1117 14:49:37.085837 (+ 127us) write_op.cc:270] Start()
1117 14:49:37.085854 (+ 17us) write_op.cc:276] Timestamp: P: 1794926964695752 usec, L: 0
1117 14:49:37.085983 (+ 129us) write_op.cc:270] Start()
1117 14:49:37.086001 (+ 18us) write_op.cc:276] Timestamp: P: 1794926964706967 usec, L: 0
1117 14:49:37.090357 (+ 4356us) write_op.cc:270] Start()
1117 14:49:37.090381 (+ 24us) write_op.cc:276] Timestamp: P: 1794926964730837 usec, L: 0
1117 14:49:37.090582 (+ 201us) write_op.cc:270] Start()
1117 14:49:37.090601 (+ 19us) write_op.cc:276] Timestamp: P: 1794926964731511 usec, L: 0
1117 14:49:37.090741 (+ 140us) write_op.cc:270] Start()
1117 14:49:37.090761 (+ 20us) write_op.cc:276] Timestamp: P: 1794926964754333 usec, L: 0
1117 14:49:37.090947 (+ 186us) write_op.cc:270] Start()
1117 14:49:37.090968 (+ 21us) write_op.cc:276] Timestamp: P: 1794926964766904 usec, L: 0
1117 14:49:37.091292 (+ 324us) write_op.cc:270] Start()
1117 14:49:37.091326 (+ 34us) write_op.cc:276] Timestamp: P: 1794926964804887 usec, L: 0
1117 14:49:37.091546 (+ 220us) write_op.cc:270] Start()
1117 14:49:37.091576 (+ 30us) write_op.cc:276] Timestamp: P: 1794926964813859 usec, L: 0
1117 14:49:37.091769 (+ 193us) write_op.cc:270] Start()
1117 14:49:37.091791 (+ 22us) write_op.cc:276] Timestamp: P: 1794926964814833 usec, L: 0
1117 14:49:37.091951 (+ 160us) write_op.cc:270] Start()
1117 14:49:37.091973 (+ 22us) write_op.cc:276] Timestamp: P: 1794926964815557 usec, L: 0
1117 14:49:37.092220 (+ 247us) write_op.cc:270] Start()
1117 14:49:37.092244 (+ 24us) write_op.cc:276] Timestamp: P: 1794926964850836 usec, L: 0
1117 14:49:37.092871 (+ 627us) write_op.cc:270] Start()
1117 14:49:37.092899 (+ 28us) write_op.cc:276] Timestamp: P: 1794926964863033 usec, L: 0
1117 14:49:37.093090 (+ 191us) write_op.cc:270] Start()
1117 14:49:37.093116 (+ 26us) write_op.cc:276] Timestamp: P: 1794926964869164 usec, L: 0
1117 14:49:37.093291 (+ 175us) write_op.cc:270] Start()
1117 14:49:37.093312 (+ 21us) write_op.cc:276] Timestamp: P: 1794926964871599 usec, L: 0
1117 14:49:37.093507 (+ 195us) write_op.cc:270] Start()
1117 14:49:37.093528 (+ 21us) write_op.cc:276] Timestamp: P: 1794926964930462 usec, L: 0
1117 14:49:37.093692 (+ 164us) write_op.cc:270] Start()
1117 14:49:37.093713 (+ 21us) write_op.cc:276] Timestamp: P: 1794926964931155 usec, L: 0
1117 14:49:37.093864 (+ 151us) write_op.cc:270] Start()
1117 14:49:37.093886 (+ 22us) write_op.cc:276] Timestamp: P: 1794926964932257 usec, L: 0
1117 14:49:37.094132 (+ 246us) write_op.cc:270] Start()
1117 14:49:37.094156 (+ 24us) write_op.cc:276] Timestamp: P: 1794926964963726 usec, L: 0
1117 14:49:37.094312 (+ 156us) write_op.cc:270] Start()
1117 14:49:37.094333 (+ 21us) write_op.cc:276] Timestamp: P: 1794926964981586 usec, L: 0
1117 14:49:37.094536 (+ 203us) write_op.cc:270] Start()
1117 14:49:37.094558 (+ 22us) write_op.cc:276] Timestamp: P: 1794926964993095 usec, L: 0
1117 14:49:37.094709 (+ 151us) write_op.cc:270] Start()
1117 14:49:37.094733 (+ 24us) write_op.cc:276] Timestamp: P: 1794926964996988 usec, L: 0
1117 14:49:37.094913 (+ 180us) write_op.cc:270] Start()
1117 14:49:37.094936 (+ 23us) write_op.cc:276] Timestamp: P: 1794926965003226 usec, L: 0
1117 14:49:37.095223 (+ 287us) write_op.cc:270] Start()
1117 14:49:37.095246 (+ 23us) write_op.cc:276] Timestamp: P: 1794926965055478 usec, L: 0
1117 14:49:37.095418 (+ 172us) write_op.cc:270] Start()
1117 14:49:37.095443 (+ 25us) write_op.cc:276] Timestamp: P: 1794926965066830 usec, L: 0
1117 14:49:37.095632 (+ 189us) write_op.cc:270] Start()
1117 14:49:37.095655 (+ 23us) write_op.cc:276] Timestamp: P: 1794926965094536 usec, L: 0
1117 14:49:37.095814 (+ 159us) write_op.cc:270] Start()
1117 14:49:37.095833 (+ 19us) write_op.cc:276] Timestamp: P: 1794926965096596 usec, L: 0
1117 14:49:37.095975 (+ 142us) write_op.cc:270] Start()
1117 14:49:37.095995 (+ 20us) write_op.cc:276] Timestamp: P: 1794926965115328 usec, L: 0
1117 14:49:37.096179 (+ 184us) write_op.cc:270] Start()
1117 14:49:37.096311 (+ 132us) write_op.cc:276] Timestamp: P: 1794926965133131 usec, L: 0
1117 14:49:37.096561 (+ 250us) write_op.cc:270] Start()
1117 14:49:37.096606 (+ 45us) write_op.cc:276] Timestamp: P: 1794926965154844 usec, L: 0
1117 14:49:37.096809 (+ 203us) write_op.cc:270] Start()
1117 14:49:37.096832 (+ 23us) write_op.cc:276] Timestamp: P: 1794926965160591 usec, L: 0
1117 14:49:37.097008 (+ 176us) write_op.cc:270] Start()
1117 14:49:37.097029 (+ 21us) write_op.cc:276] Timestamp: P: 1794926965167046 usec, L: 0
1117 14:49:37.097264 (+ 235us) write_op.cc:270] Start()
1117 14:49:37.097326 (+ 62us) write_op.cc:276] Timestamp: P: 1794926965206696 usec, L: 0
1117 14:49:37.097554 (+ 228us) write_op.cc:270] Start()
1117 14:49:37.097579 (+ 25us) write_op.cc:276] Timestamp: P: 1794926965207382 usec, L: 0
1117 14:49:37.097774 (+ 195us) write_op.cc:270] Start()
1117 14:49:37.097797 (+ 23us) write_op.cc:276] Timestamp: P: 1794926965215987 usec, L: 0
1117 14:49:37.098037 (+ 240us) write_op.cc:270] Start()
1117 14:49:37.098070 (+ 33us) write_op.cc:276] Timestamp: P: 1794926965248687 usec, L: 0
1117 14:49:37.098283 (+ 213us) write_op.cc:270] Start()
1117 14:49:37.098307 (+ 24us) write_op.cc:276] Timestamp: P: 1794926965249380 usec, L: 0
1117 14:49:37.098463 (+ 156us) write_op.cc:270] Start()
1117 14:49:37.098484 (+ 21us) write_op.cc:276] Timestamp: P: 1794926965257658 usec, L: 0
1117 14:49:37.098667 (+ 183us) write_op.cc:270] Start()
1117 14:49:37.098690 (+ 23us) write_op.cc:276] Timestamp: P: 1794926965271716 usec, L: 0
1117 14:49:37.098850 (+ 160us) write_op.cc:270] Start()
1117 14:49:37.098877 (+ 27us) write_op.cc:276] Timestamp: P: 1794926965300027 usec, L: 0
1117 14:49:37.099026 (+ 149us) write_op.cc:270] Start()
1117 14:49:37.099060 (+ 34us) write_op.cc:276] Timestamp: P: 1794926965309403 usec, L: 0
1117 14:49:37.099237 (+ 177us) write_op.cc:270] Start()
1117 14:49:37.099264 (+ 27us) write_op.cc:276] Timestamp: P: 1794926965310242 usec, L: 0
1117 14:49:37.099424 (+ 160us) write_op.cc:270] Start()
1117 14:49:37.099446 (+ 22us) write_op.cc:276] Timestamp: P: 1794926965325281 usec, L: 0
1117 14:49:37.099606 (+ 160us) write_op.cc:270] Start()
1117 14:49:37.099628 (+ 22us) write_op.cc:276] Timestamp: P: 1794926965362833 usec, L: 0
1117 14:49:37.099839 (+ 211us) write_op.cc:270] Start()
1117 14:49:37.099861 (+ 22us) write_op.cc:276] Timestamp: P: 1794926965371962 usec, L: 0
1117 14:49:37.100070 (+ 209us) write_op.cc:270] Start()
1117 14:49:37.100093 (+ 23us) write_op.cc:276] Timestamp: P: 1794926965382959 usec, L: 0
1117 14:49:37.100336 (+ 243us) write_op.cc:270] Start()
1117 14:49:37.100360 (+ 24us) write_op.cc:276] Timestamp: P: 1794926965415908 usec, L: 0
1117 14:49:37.166826 (+ 66466us) write_op.cc:270] Start()
1117 14:49:37.166866 (+ 40us) write_op.cc:276] Timestamp: P: 1794926965426919 usec, L: 0
1117 14:49:37.169765 (+ 2899us) write_op.cc:270] Start()
1117 14:49:37.169794 (+ 29us) write_op.cc:276] Timestamp: P: 1794926965430163 usec, L: 0
1117 14:49:37.170000 (+ 206us) write_op.cc:270] Start()
1117 14:49:37.170033 (+ 33us) write_op.cc:276] Timestamp: P: 1794926965455103 usec, L: 0
1117 14:49:37.170220 (+ 187us) write_op.cc:270] Start()
1117 14:49:37.170243 (+ 23us) write_op.cc:276] Timestamp: P: 1794926965465813 usec, L: 0
1117 14:49:37.170407 (+ 164us) write_op.cc:270] Start()
1117 14:49:37.170431 (+ 24us) write_op.cc:276] Timestamp: P: 1794926965479190 usec, L: 0
1117 14:49:37.170617 (+ 186us) write_op.cc:270] Start()
1117 14:49:37.170639 (+ 22us) write_op.cc:276] Timestamp: P: 1794926965528286 usec, L: 0
1117 14:49:37.170820 (+ 181us) write_op.cc:270] Start()
1117 14:49:37.170841 (+ 21us) write_op.cc:276] Timestamp: P: 1794926965538099 usec, L: 0
1117 14:49:37.171008 (+ 167us) write_op.cc:270] Start()
1117 14:49:37.171029 (+ 21us) write_op.cc:276] Timestamp: P: 1794926965551368 usec, L: 0
1117 14:49:37.171196 (+ 167us) write_op.cc:270] Start()
1117 14:49:37.171221 (+ 25us) write_op.cc:276] Timestamp: P: 1794926965558274 usec, L: 0
1117 14:49:37.171392 (+ 171us) write_op.cc:270] Start()
1117 14:49:37.171421 (+ 29us) write_op.cc:276] Timestamp: P: 1794926965594613 usec, L: 0
1117 14:49:37.171615 (+ 194us) write_op.cc:270] Start()
1117 14:49:37.171637 (+ 22us) write_op.cc:276] Timestamp: P: 1794926965627079 usec, L: 0
1117 14:49:37.171876 (+ 239us) write_op.cc:270] Start()
1117 14:49:37.171900 (+ 24us) write_op.cc:276] Timestamp: P: 1794926965646792 usec, L: 0
1117 14:49:37.172079 (+ 179us) write_op.cc:270] Start()
1117 14:49:37.172100 (+ 21us) write_op.cc:276] Timestamp: P: 1794926965650347 usec, L: 0
1117 14:49:37.172295 (+ 195us) write_op.cc:270] Start()
1117 14:49:37.172318 (+ 23us) write_op.cc:276] Timestamp: P: 1794926965655048 usec, L: 0
1117 14:49:37.172519 (+ 201us) write_op.cc:270] Start()
1117 14:49:37.172542 (+ 23us) write_op.cc:276] Timestamp: P: 1794926965719892 usec, L: 0
1117 14:49:37.176241 (+ 3699us) write_op.cc:270] Start()
1117 14:49:37.176270 (+ 29us) write_op.cc:276] Timestamp: P: 17949269
I20261117 14:49:42.008232 7444 raft_consensus.cc:499] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader def6b23bccc94a78a47118da331f2798)
I20261117 14:49:42.034684 7444 raft_consensus.cc:521] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:41.832563 7347 rpcz_store.cc:276] 1117 14:49:39.728712 (+ 0us) service_pool.cc:167] Inserting onto call queue
1117 14:49:39.737704 (+ 8992us) service_pool.cc:224] Handling call
1117 14:49:39.908000 (+170296us) raft_consensus.cc:1481] Updating replica for 238 ops
1117 14:49:40.271652 (+363652us) raft_consensus.cc:1545] Early marking committed up to index 784
1117 14:49:40.271710 (+ 58us) raft_consensus.cc:1550] Triggering prepare for 238 ops
1117 14:49:40.271812 (+ 102us) write_op.cc:270] Start()
1117 14:49:40.271840 (+ 28us) write_op.cc:276] Timestamp: P: 1794926974965174 usec, L: 0
1117 14:49:40.271995 (+ 155us) write_op.cc:270] Start()
1117 14:49:40.272017 (+ 22us) write_op.cc:276] Timestamp: P: 1794926975007558 usec, L: 0
1117 14:49:40.272192 (+ 175us) write_op.cc:270] Start()
1117 14:49:40.272217 (+ 25us) write_op.cc:276] Timestamp: P: 1794926975018448 usec, L: 0
1117 14:49:40.282143 (+ 9926us) write_op.cc:270] Start()
1117 14:49:40.282175 (+ 32us) write_op.cc:276] Timestamp: P: 1794926975020594 usec, L: 0
1117 14:49:40.282374 (+ 199us) write_op.cc:270] Start()
1117 14:49:40.282398 (+ 24us) write_op.cc:276] Timestamp: P: 1794926975072906 usec, L: 0
1117 14:49:40.282586 (+ 188us) write_op.cc:270] Start()
1117 14:49:40.282612 (+ 26us) write_op.cc:276] Timestamp: P: 1794926975100045 usec, L: 0
1117 14:49:40.282772 (+ 160us) write_op.cc:270] Start()
1117 14:49:40.282818 (+ 46us) write_op.cc:276] Timestamp: P: 1794926975101964 usec, L: 0
1117 14:49:40.283040 (+ 222us) write_op.cc:270] Start()
1117 14:49:40.283065 (+ 25us) write_op.cc:276] Timestamp: P: 1794926975102702 usec, L: 0
1117 14:49:40.283249 (+ 184us) write_op.cc:270] Start()
1117 14:49:40.283271 (+ 22us) write_op.cc:276] Timestamp: P: 1794926975142177 usec, L: 0
1117 14:49:40.283433 (+ 162us) write_op.cc:270] Start()
1117 14:49:40.283469 (+ 36us) write_op.cc:276] Timestamp: P: 1794926975168401 usec, L: 0
1117 14:49:40.288345 (+ 4876us) write_op.cc:270] Start()
1117 14:49:40.288370 (+ 25us) write_op.cc:276] Timestamp: P: 1794926975169781 usec, L: 0
1117 14:49:40.308894 (+ 20524us) write_op.cc:270] Start()
1117 14:49:40.308924 (+ 30us) write_op.cc:276] Timestamp: P: 1794926975171252 usec, L: 0
1117 14:49:40.319631 (+ 10707us) write_op.cc:270] Start()
1117 14:49:40.319660 (+ 29us) write_op.cc:276] Timestamp: P: 1794926975200738 usec, L: 0
1117 14:49:40.322916 (+ 3256us) write_op.cc:270] Start()
1117 14:49:40.322938 (+ 22us) write_op.cc:276] Timestamp: P: 1794926975261328 usec, L: 0
1117 14:49:40.326430 (+ 3492us) write_op.cc:270] Start()
1117 14:49:40.326456 (+ 26us) write_op.cc:276] Timestamp: P: 1794926975265961 usec, L: 0
1117 14:49:40.326897 (+ 441us) write_op.cc:270] Start()
1117 14:49:40.326919 (+ 22us) write_op.cc:276] Timestamp: P: 1794926975292847 usec, L: 0
1117 14:49:40.340658 (+ 13739us) write_op.cc:270] Start()
1117 14:49:40.340683 (+ 25us) write_op.cc:276] Timestamp: P: 1794926975312393 usec, L: 0
1117 14:49:40.341422 (+ 739us) write_op.cc:270] Start()
1117 14:49:40.341459 (+ 37us) write_op.cc:276] Timestamp: P: 1794926975331808 usec, L: 0
1117 14:49:40.341628 (+ 169us) write_op.cc:270] Start()
1117 14:49:40.341648 (+ 20us) write_op.cc:276] Timestamp: P: 1794926975350324 usec, L: 0
1117 14:49:40.354358 (+ 12710us) write_op.cc:270] Start()
1117 14:49:40.354385 (+ 27us) write_op.cc:276] Timestamp: P: 1794926975363552 usec, L: 0
1117 14:49:40.427588 (+ 73203us) write_op.cc:270] Start()
1117 14:49:40.427627 (+ 39us) write_op.cc:276] Timestamp: P: 1794926975390867 usec, L: 0
1117 14:49:40.427861 (+ 234us) write_op.cc:270] Start()
1117 14:49:40.427908 (+ 47us) write_op.cc:276] Timestamp: P: 1794926975426189 usec, L: 0
1117 14:49:40.428099 (+ 191us) write_op.cc:270] Start()
1117 14:49:40.428124 (+ 25us) write_op.cc:276] Timestamp: P: 1794926975434475 usec, L: 0
1117 14:49:40.428278 (+ 154us) write_op.cc:270] Start()
1117 14:49:40.428300 (+ 22us) write_op.cc:276] Timestamp: P: 1794926975435083 usec, L: 0
1117 14:49:40.428525 (+ 225us) write_op.cc:270] Start()
1117 14:49:40.428557 (+ 32us) write_op.cc:276] Timestamp: P: 1794926975456370 usec, L: 0
1117 14:49:40.431973 (+ 3416us) write_op.cc:270] Start()
1117 14:49:40.432004 (+ 31us) write_op.cc:276] Timestamp: P: 1794926975471793 usec, L: 0
1117 14:49:40.432220 (+ 216us) write_op.cc:270] Start()
1117 14:49:40.432243 (+ 23us) write_op.cc:276] Timestamp: P: 1794926975514803 usec, L: 0
1117 14:49:40.432397 (+ 154us) write_op.cc:270] Start()
1117 14:49:40.432419 (+ 22us) write_op.cc:276] Timestamp: P: 1794926975520461 usec, L: 0
1117 14:49:40.440494 (+ 8075us) write_op.cc:270] Start()
1117 14:49:40.440526 (+ 32us) write_op.cc:276] Timestamp: P: 1794926975525420 usec, L: 0
1117 14:49:40.440719 (+ 193us) write_op.cc:270] Start()
1117 14:49:40.440743 (+ 24us) write_op.cc:276] Timestamp: P: 1794926975572890 usec, L: 0
1117 14:49:40.440917 (+ 174us) write_op.cc:270] Start()
1117 14:49:40.440939 (+ 22us) write_op.cc:276] Timestamp: P: 1794926975587388 usec, L: 0
1117 14:49:40.441111 (+ 172us) write_op.cc:270] Start()
1117 14:49:40.441132 (+ 21us) write_op.cc:276] Timestamp: P: 1794926975605564 usec, L: 0
1117 14:49:40.441296 (+ 164us) write_op.cc:270] Start()
1117 14:49:40.441321 (+ 25us) write_op.cc:276] Timestamp: P: 1794926975625041 usec, L: 0
1117 14:49:40.441473 (+ 152us) write_op.cc:270] Start()
1117 14:49:40.441497 (+ 24us) write_op.cc:276] Timestamp: P: 1794926975639862 usec, L: 0
1117 14:49:40.441638 (+ 141us) write_op.cc:270] Start()
1117 14:49:40.441659 (+ 21us) write_op.cc:276] Timestamp: P: 1794926975665891 usec, L: 0
1117 14:49:40.441809 (+ 150us) write_op.cc:270] Start()
1117 14:49:40.441828 (+ 19us) write_op.cc:276] Timestamp: P: 1794926975677978 usec, L: 0
1117 14:49:40.441990 (+ 162us) write_op.cc:270] Start()
1117 14:49:40.442013 (+ 23us) write_op.cc:276] Timestamp: P: 1794926975679465 usec, L: 0
1117 14:49:40.442184 (+ 171us) write_op.cc:270] Start()
1117 14:49:40.442208 (+ 24us) write_op.cc:276] Timestamp: P: 1794926975681674 usec, L: 0
1117 14:49:40.442357 (+ 149us) write_op.cc:270] Start()
1117 14:49:40.442377 (+ 20us) write_op.cc:276] Timestamp: P: 1794926975710384 usec, L: 0
1117 14:49:40.442553 (+ 176us) write_op.cc:270] Start()
1117 14:49:40.442575 (+ 22us) write_op.cc:276] Timestamp: P: 1794926975749985 usec, L: 0
1117 14:49:40.442727 (+ 152us) write_op.cc:270] Start()
1117 14:49:40.442748 (+ 21us) write_op.cc:276] Timestamp: P: 1794926975764008 usec, L: 0
1117 14:49:40.442898 (+ 150us) write_op.cc:270] Start()
1117 14:49:40.442918 (+ 20us) write_op.cc:276] Timestamp: P: 1794926975781462 usec, L: 0
1117 14:49:40.465310 (+ 22392us) write_op.cc:270] Start()
1117 14:49:40.465334 (+ 24us) write_op.cc:276] Timestamp: P: 1794926975798614 usec, L: 0
1117 14:49:40.472000 (+ 6666us) write_op.cc:270] Start()
1117 14:49:40.472024 (+ 24us) write_op.cc:276] Timestamp: P: 1794926975827587 usec, L: 0
1117 14:49:40.500417 (+ 28393us) write_op.cc:270] Start()
1117 14:49:40.500478 (+ 61us) write_op.cc:276] Timestamp: P: 1794926975847346 usec, L: 0
1117 14:49:40.500693 (+ 215us) write_op.cc:270] Start()
1117 14:49:40.500718 (+ 25us) write_op.cc:276] Timestamp: P: 1794926975850824 usec, L: 0
1117 14:49:40.500922 (+ 204us) write_op.cc:270] Start()
1117 14:49:40.500961 (+ 39us) write_op.cc:276] Timestamp: P: 1794926975856082 usec, L: 0
1117 14:49:40.501182 (+ 221us) write_op.cc:270] Start()
1117 14:49:40.501210 (+ 28us) write_op.cc:276] Timestamp: P: 1794926975901089 usec, L: 0
1117 14:49:40.508703 (+ 7493us) write_op.cc:270] Start()
1117 14:49:40.508734 (+ 31us) write_op.cc:276] Timestamp: P: 1794926975902062 usec, L: 0
1117 14:49:40.515880 (+ 7146us) write_op.cc:270] Start()
1117 14:49:40.515906 (+ 26us) write_op.cc:276] Timestamp: P: 1794926975962827 usec, L: 0
1117 14:49:40.521041 (+ 5135us) write_op.cc:270] Start()
1117 14:49:40.521072 (+ 31us) write_op.cc:276] Timestamp: P: 1794926975963443 usec, L: 0
1117 14:49:40.529570 (+ 8498us) write_op.cc:270] Start()
1117 14:49:40.529599 (+ 29us) write_op.cc:276] Timestamp: P: 1794926975976441 usec, L: 0
1117 14:49:40.529780 (+ 181us) write_op.cc:270] Start()
1117 14:49:40.529801 (+ 21us) write_op.cc:276] Timestamp: P: 1794926976013444 usec, L: 0
1117 14:49:40.543118 (+ 13317us) write_op.cc:270] Start()
1117 14:49:40.543144 (+ 26us) write_op.cc:276] Timestamp: P: 1794926976014112 usec, L: 0
1117 14:49:40.570736 (+ 27592us) write_op.cc:270] Start()
1117 14:49:40.570763 (+ 27us) write_op.cc:276] Timestamp: P: 1794926976014750 usec, L: 0
1117 14:49:40.570950 (+ 187us) write_op.cc:270] Start()
1117 14:49:40.570977 (+ 27us) write_op.cc:276] Timestamp: P: 1794926976042782 usec, L: 0
1117 14:49:40.571158 (+ 181us) write_op.cc:270] Start()
1117 14:49:40.571183 (+ 25us) write_op.cc:276] Timestamp: P: 1794926976076894 usec, L: 0
1117 14:49:40.571360 (+ 177us) write_op.cc:270] Start()
1117 14:49:40.571384 (+ 24us) write_op.cc:276] Timestamp: P: 1794926976082302 usec, L: 0
1117 14:49:40.571562 (+ 178us) write_op.cc:270] Start()
1117 14:49:40.571583 (+ 21us) write_op.cc:276] Timestamp: P: 1794926976119287 usec, L: 0
1117 14:49:40.571735 (+ 152us) write_op.cc:270] Start()
1117 14:49:40.571809 (+ 74us) write_op.cc:276] Timestamp: P: 1794926976153871 usec, L: 0
1117 14:49:40.572377 (+ 568us) write_op.cc:270] Start()
1117 14:49:40.572400 (+ 23us) write_op.cc:276] Timestamp: P: 1794926976181707 usec, L: 0
1117 14:49:40.588645 (+ 16245us) write_op.cc:270] Start()
1117 14:49:40.588673 (+ 28us) write_op.cc:276] Timestamp: P: 1794926976192818 usec, L: 0
1117 14:49:40.588862 (+ 189us) write_op.cc:270] Start()
1117 14:49:40.588885 (+ 23us) write_op.cc:276] Timestamp: P: 1794926976227154 usec, L: 0
1117 14:49:40.589055 (+ 170us) write_op.cc:270] Start()
1117 14:49:40.589077 (+ 22us) write_op.cc:276] Timestamp: P: 1794926976245188 usec, L: 0
1117 14:49:40.589255 (+ 178us) write_op.cc:270] Start()
1117 14:49:40.589283 (+ 28us) write_op.cc:276] Timestamp: P: 1794926976263825 usec, L: 0
1117 14:49:40.589447 (+ 164us) write_op.cc:270] Start()
1117 14:49:40.589469 (+ 22us) write_op.cc:276] Timestamp: P: 1794926976266054 usec, L: 0
1117 14:49:40.589644 (+ 175us) write_op.cc:270] Start()
1117 14:49:40.589668 (+ 24us) write_op.cc:276] Timestamp: P: 1794926976294760 usec, L: 0
1117 14:49:40.589839 (+ 171us) write_op.cc:270] Start()
1117 14:49:40.589860 (+ 21us) write_op.cc:276] Timestamp: P: 1794926976312518 usec, L: 0
1117 14:49:40.590008 (+ 148us) write_op.cc:270] Start()
1117 14:49:40.590025 (+ 17us) write_op.cc:276] Timestamp: P: 1794926976314299 usec, L: 0
1117 14:49:40.590149 (+ 124us) write_op.cc:270] Start()
1117 14:49:40.590164 (+ 15us) write_op.cc:276] Timestamp: P: 1794926976343552 usec, L: 0
1117 14:49:40.590278 (+ 114us) write_op.cc:270] Start()
1117 14:49:40.590293 (+ 15us) write_op.cc:276] Timestamp: P: 1794926976344256 usec, L: 0
1117 14:49:40.590424 (+ 131us) write_op.cc:270] Start()
1117 14:49:40.590440 (+ 16us) write_op.cc:276] Timestamp: P: 1794926976374677 usec, L: 0
1117 14:49:40.590561 (+ 121us) write_op.cc:270] Start()
1117 14:49:40.590578 (+ 17us) write_op.cc:276] Timestamp: P: 1794926976408312 usec, L: 0
1117 14:49:40.590687 (+ 109us) write_op.cc:270] Start()
1117 14:49:40.590703 (+ 16us) write_op.cc:276] Timestamp: P: 1794926976410891 usec, L: 0
1117 14:49:40.590827 (+ 124us) write_op.cc:270] Start()
1117 14:49:40.590842 (+ 15us) write_op.cc:276] Timestamp: P: 1794926976416522 usec, L: 0
1117 14:49:40.590974 (+ 132us) write_op.cc:270] Start()
1117 14:49:40.590992 (+ 18us) write_op.cc:276] Timestamp: P: 1794926976466351 usec, L: 0
1117 14:49:40.591117 (+ 125us) write_op.cc:270] Start()
1117 14:49:40.591133 (+ 16us) write_op.cc:276] Timestamp: P: 1794926976489493 usec, L: 0
1117 14:49:40.591237 (+ 104us) write_op.cc:270] Start()
1117 14:49:40.591252 (+ 15us) write_op.cc:276] Timestamp: P: 1794926976512230 usec, L: 0
1117 14:49:40.591383 (+ 131us) write_op.cc:270] Start()
1117 14:49:40.591401 (+ 18us) write_op.cc:276] Timestamp: P: 1794926976512958 usec, L: 0
1117 14:49:40.591554 (+ 153us) write_op.cc:270] Start()
1117 14:49:40.591572 (+ 18us) write_op.cc:276] Timestamp: P: 1794926976523510 usec, L: 0
1117 14:49:40.591694 (+ 122us) write_op.cc:270] Start()
1117 14:49:40.591710 (+ 16us) write_op.cc:276] Timestamp: P: 1794926976549665 usec, L: 0
1117 14:49:40.591838 (+ 128us) write_op.cc:270] Start()
1117 14:49:40.591853 (+ 15us) write_op.cc:276] Timestamp: P: 1794926976572894 usec, L: 0
1117 14:49:40.592007 (+ 154us) write_op.cc:270] Start()
1117 14:49:40.592027 (+ 20us) write_op.cc:276] Timestamp: P: 1794926976584766 usec, L: 0
1117 14:49:40.592177 (+ 150us) write_op.cc:270] Start()
1117 14:49:40.592194 (+ 17us) write_op.cc:276] Timestamp: P: 1794926976602687 usec, L: 0
1117 14:49:40.592347 (+ 153us) write_op.cc:270] Start()
1117 14:49:40.592369 (+ 22us) write_op.cc:276] Timestamp: P: 1794926976623574 usec, L: 0
1117 14:49:40.644581 (+ 52212us) write_op.cc:270] Start()
1117 14:49:40.644604 (+ 23us) write_op.cc:276] Timestamp: P: 1794926976641037 usec, L: 0
1117 14:49:40.649586 (+ 4982us) write_op.cc:270] Start()
1117 14:49:40.649614 (+ 28us) write_op.cc:276] Timestamp: P: 1794926976664785 usec, L: 0
1117 14:49:40.653220 (+ 3606us) write_op.cc:270] Start()
1117 14:49:40.653247 (+ 27us) write_op.cc:276] Timestamp: P: 1794926976694633 usec, L: 0
1117 14:49:40.653413 (+ 166us) write_op.cc:270] Start()
1117 14:49:40.653435 (+ 22us) write_op.cc:276] Timestamp: P: 1794926976712096 usec, L: 0
1117 14:49:40.716593 (+ 63158us) write_op.cc:270] Start()
1117 14:49:40.716616 (+ 23us) write_op.cc:276] Timestamp: P: 1794926976735060 usec, L: 0
1117 14:49:40.761259 (+ 44643us) write_op.cc:270] Start()
1117 14:49:40.761285 (+ 26us) write_op.cc:276] Timestamp: P: 1794926976736707 usec, L: 0
1117 14:49:40.773665 (+ 12380us) write_op.cc:270] Start()
1117 14:49:40.773691 (+ 26us) write_op.cc:276] Timestamp: P: 1794926976738967 usec, L: 0
1117 14:49:40.780957 (+ 7266us) write_op.cc:270] Start()
1117 14:49:40.780982 (+ 25us) write_op.cc:276] Timestamp: P: 1794926976783210 usec, L: 0
1117 14:49:40.781688 (+ 706us) write_op.cc:270] Start()
1117 14:49:40.781707 (+ 19us) write_op.cc:276] Timestamp: P: 1794926976819646 usec, L: 0
1117 14:49:40.783828 (+ 2121us) write_op.cc:270] Start()
1117 14:49:40.783855 (+ 27us) write_op.cc:276] Timestamp: P: 1794926976837148 usec, L: 0
1117 14:49:40.784061 (+ 206us) write_op.cc:270] Start()
1117 14:49:40.784090 (+ 29us) write_op.cc:276] Timestamp: P: 1794926976838849 usec, L: 0
1117 14:49:40.784253 (+ 163us) write_op.cc:270] Start()
1117 14:49:40.784308 (+ 55us) write_op.cc:276] Timestamp: P: 1794926976839454 usec, L: 0
1117 14:49:40.820434 (+ 36126us) write_op.cc:270] Start()
1117 14:49:40.820486 (+ 52us) write_op.cc:276] Timestamp: P: 1794926976883711 usec, L: 0
1117 14:49:40.835438 (+ 14952us) write_op.cc:270] Start()
1117 14:49:40.835462 (+ 24us) write_op.cc:276] Timestamp: P: 1794926976912556 usec, L: 0
1117 14:49:40.864908 (+ 29446us) write_op.cc:270] Start()
1117 14:49:40.864934 (+ 26us) write_op.cc:276] Timestamp: P: 1794926976915880 usec, L: 0
1117 14:49:40.871611 (+ 6677us) write_op.cc:270] Start()
1117 14:49:40.872203 (+ 592us) write_op.cc:276] Timestamp: P: 1794926976921996 usec, L: 0
1117 14:49:40.875426 (+ 3223us) write_op.cc:270] Start()
1117 14:49:40.875454 (+ 28us) write_op.cc:276] Timestamp: P: 1794926976968194 usec, L: 0
1117 14:49:40.883613 (+ 8159us) write_op.cc:270] Start()
1117 14:49:40.883640 (+ 27us) write_op.cc:276] Timestamp: P: 1794926976973812 usec, L: 0
1117 14:49:40.896285 (+ 12645us) write_op.cc:270] Start()
1117 14:49:40.896319 (+ 34us) write_op.cc:276] Timestamp: P: 1794926976984910 usec, L: 0
1117 14:49:40.896544 (+ 225us) write_op.cc:270] Start()
1117 14:49:40.896570 (+ 26us) write_op.cc:276] Timestamp: P: 1794926976989053 usec, L: 0
1117 14:49:40.898768 (+ 2198us) write_op.cc:270] Start()
1117 14:49:40.898802 (+ 34us) write_op.cc:276] Timestamp: P: 1794926977025482 usec, L: 0
1117 14:49:40.907135 (+ 8333us) write_op.cc:270] Start()
1117 14:49:40.907171 (+ 36us) write_op.cc:276] Timestamp: P: 1794926977043933 usec, L: 0
1117 14:49:40.907560 (+ 389us) write_op.cc:270] Start()
1117 14:49:40.907593 (+ 33us) write_op.cc:276] Timestamp: P: 1794926977058645 usec, L: 0
1117 14:49:40.908045 (+ 452us) write_op.cc:270] Start()
1117 14:49:40.908104 (+ 59us) write_op.cc:276] Timestamp: P: 1794926977062822 usec, L: 0
1117 14:49:40.908538 (+ 434us) write_op.cc:270] Start()
1117 14:49:40.908572 (+ 34us) write_op.cc:276] Timestamp: P: 1794926977120159 usec, L: 0
1117 14:49:40.910643 (+ 2071us) write_op.cc:270] Start()
1117 14:49:40.910969 (+ 326us) write_op.cc:276] Timestamp: P: 1794926977139816 usec, L: 0
1117 14:49:40.912754 (+ 1785us) write_op.cc:270] Start()
1117 14:49:40.912781 (+ 27us) write_op.cc:276] Timestamp: P: 1794926977146489 usec, L: 0
1117 14:49:40.913180 (+ 399us) write_op.cc:270] Start()
1117 14:49:40.913209 (+ 29us) write_op.cc:276] Timestamp: P: 1794926977151349 usec, L: 0
1117 14:49:40.913398 (+ 189us) write_op.cc:270] Start()
1117 14:49:40.913423 (+ 25us) write_op.cc:276] Timestamp: P: 1794926977180564 usec, L: 0
1117 14:49:40.913596 (+ 173us) write_op.cc:270] Start()
1117 14:49:40.913619 (+ 23us) write_op.cc:276] Timestamp: P: 1794926977193620 usec, L: 0
1117 14:49:40.913785 (+ 166us) write_op.cc:270] Start()
1117 14:49:40.913811 (+ 26us) write_op.cc:276] Timestamp: P: 1794926977231349 usec, L: 0
1117 14:49:40.914001 (+ 190us) write_op.cc:270] Start()
1117 14:49:40.914045 (+ 44us) write_op.cc:276] Timestamp: P: 1794926977234935 usec, L: 0
1117 14:49:40.914226 (+ 181us) write_op.cc:270] Start()
1117 14:49:40.914252 (+ 26us) write_op.cc:276] Timestamp: P: 1794926977244218 usec, L: 0
1117 14:49:40.914435 (+ 183us) write_op.cc:270] Start()
1117 14:49:40.914462 (+ 27us) write_op.cc:276] Timestamp: P: 1794926977284251 usec, L: 0
1117 14:49:40.914676 (+ 214us) write_op.cc:270] Start()
1117 14:49:40.914702 (+ 26us) write_op.cc:276] Timestamp: P: 1794926977300340 usec, L: 0
1117 14:49:40.914863 (+ 161us) write_op.cc:270] Start()
1117 14:49:40.914889 (+ 26us) write_op.cc:276] Timestamp: P: 1794926977324973 usec, L: 0
1117 14:49:40.980182 (+ 65293us) write_op.cc:270] Start()
1117 14:49:40.992495 (+ 12313us) write_op.cc:276] Timestamp: P: 1794926977339120 usec, L: 0
1117 14:49:41.037813 (+ 45318us) write_op.cc:270] Start()
1117 14:49:41.037841 (+ 28us) write_op.cc:276] Timestamp: P: 1794926977356341 usec, L: 0
1117 14:49:41.038197 (+ 356us) write_op.cc:270] Start()
1117 14:49:41.038223 (+ 26us) write_op.cc:276] Timestamp: P: 1794926977381859 usec, L: 0
1117 14:49:41.038409 (+ 186us) write_op.cc:270] Start()
1117 14:49:41.038431 (+ 22us) write_op.cc:276] Timestamp: P: 1794926977392645 usec, L: 0
1117 14:49:41.038605 (+ 174us) write_op.cc:270] Start()
1117 14:49:41.038630 (+ 25us) write_op.cc:276] Timestamp: P: 1794926977440531 usec, L: 0
1117 14:49:41.040536 (+ 1906us) write_op.cc:270] Start()
1117 14:49:41.040564 (+ 28us) write_op.cc:276] Timestamp: P: 1794926977464123 usec, L: 0
1117 14:49:41.040750 (+ 186us) write_op.cc:270] Start()
1117 14:49:41.040772 (+ 22us) write_op.cc:276] Timestamp: P: 1794926977472700 usec, L: 0
1117 14:49:41.040948 (+ 176us) write_op.cc:270] Start()
1117 14:49:41.040971 (+ 23us) write_op.cc:276] Timestamp: P: 1794926977490167 usec, L: 0
1117 14:49:41.041290 (+ 319us) write_op.cc:270] Start()
1117 14:49:41.041315 (+ 25us) write_op.cc:276] Timestamp: P: 1794926977523881 usec, L: 0
1117 14:49:41.042196 (+ 881us) write_op.cc:270] Start()
1117 14:49:41.042263 (+ 67us) write_op.cc:276] Timestamp: P: 1794926977527704 usec, L: 0
1117 14:49:41.042462 (+ 199us) write_op.cc:270] Start()
1117 14:49:41.042489 (+ 27us) write_op.cc:276] Timestamp: P: 1794926977561528 usec, L: 0
1117 14:49:41.052367 (+ 9878us) write_op.cc:270] Start()
1117 14:49:41.052388 (+ 21us) write_op.cc:276] Timestamp: P: 1794926977580154 usec, L: 0
1117 14:49:41.055476 (+ 3088us) write_op.cc:270] Start()
1117 14:49:41.055507 (+ 31us) write_op.cc:276] Timestamp: P: 1794926977592020 usec, L: 0
1117 14:49:41.060950 (+ 5443us) write_op.cc:270] Start()
1117 14:49:41.060986 (+ 36us) write_op.cc:276] Timestamp: P: 1794926977638636 usec, L: 0
1117 14:49:41.061853 (+ 867us) write_op.cc:270] Start()
1117 14:49:41.061881 (+ 28us) write_op.cc:276] Timestamp: P: 1794926977662974 usec, L: 0
1117 14:49:41.068859 (+ 6978us) write_op.cc:270] Start()
1117 14:49:41.068887 (+ 28us) write_op.cc:276] Timestamp: P: 1794926977695351 usec, L: 0
1117 14:49:41.069069 (+ 182us) write_op.cc:270] Start()
1117 14:49:41.069112 (+ 43us) write_op.cc:276] Timestamp: P: 1794926977723188 usec, L: 0
1117 14:49:41.069264 (+ 152us) write_op.cc:270] Start()
1117 14:49:41.069281 (+ 17us) write_op.cc:276] Timestamp: P: 1794926977738437 usec, L: 0
1117 14:49:41.069406 (+ 125us) write_op.cc:270] Start()
1117 14:49:41.069422 (+ 16us) write_op.cc:276] Timestamp: P: 1794926977756933 usec, L: 0
1117 14:49:41.087480 (+ 18058us) write_op.cc:270] Start()
1117 14:49:41.087514 (+ 34us) write_op.cc:276] Timestamp: P: 1794926977779579 usec, L: 0
1117 14:49:41.089123 (+ 1609us) write_op.cc:270] Start()
1117 14:49:41.089151 (+ 28us) write_op.cc:276] Timestamp: P: 1794926977797611 usec, L: 0
1117 14:49:41.108114 (+ 18963us) write_op.cc:270] Start()
1117 14:49:41.108138 (+ 24us) write_op.cc:276] Timestamp: P: 1794926977828800 usec, L: 0
1117 14:49:41.108610 (+ 472us) write_op.cc:270] Start()
1117 14:49:41.108634 (+ 24us) write_op.cc:276] Timestamp: P: 1794926977829565 usec, L: 0
1117 14:49:41.118298 (+ 9664us) write_op.cc:270] Start()
1117 14:49:41.118325 (+ 27us) write_op.cc:276] Timestamp: P: 1794926977859861 usec, L: 0
1117 14:49:41.118504 (+ 179us) write_op.cc:270] Start()
1117 14:49:41.118527 (+ 23us) write_op.cc:276] Timestamp: P: 1794926977885624 usec, L: 0
1117 14:49:41.125352 (+ 6825us) write_op.cc:270] Start()
1117 14:49:41.125380 (+ 28us) write_op.cc:276] Timestamp: P: 1794926977910838 usec, L: 0
1117 14:49:41.125595 (+ 215us) write_op.cc:270] Start()
1117 14:49:41.125615 (+ 20us) write_op.cc:276] Timestamp: P: 1794926977935260 usec, L: 0
1117 14:49:41.138739 (+ 13124us) write_op.cc:270] Start()
1117 14:49:41.138770 (+ 31us) write_op.cc:276] Timestamp: P: 1794926977936538 usec, L: 0
1117 14:49:41.141827 (+ 3057us) write_op.cc:270] Start()
1117 14:49:41.141855 (+ 28us) write_op.cc:276] Timestamp: P: 1794926977986187 usec, L: 0
1117 14:49:41.142039 (+ 184us) write_op.cc:270] Start()
1117 14:49:41.143323 (+ 1284us) write_op.cc:276] Timestamp: P: 1794926977990075 usec, L: 0
1117 14:49:41.156106 (+ 12783us) write_op.cc:270] Start()
1117 14:49:41.156142 (+ 36us) write_op.cc:276] Timestamp: P: 1794926977992851 usec, L: 0
1117 14:49:41.156998 (+ 856us) write_op.cc:270] Start()
1117 14:49:41.157027 (+ 29us) write_op.cc:276] Timestamp: P: 1794926978034465 usec, L: 0
1117 14:49:41.191895 (+ 34868us) write_op.cc:270] Start()
1117 14:49:41.203559 (+ 11664us) write_op.cc:276] Timestamp: P: 1794926978040194 usec, L: 0
1117 14:49:41.203737 (+ 178us) write_op.cc:270] Start()
1117 14:49:41.203759 (+ 22us) write_op.cc:276] Timestamp: P: 1794926978043088 usec, L: 0
1117 14:49:41.203898 (+ 139us) write_op.cc:270] Start()
1117 14:49:41.203918 (+ 20us) write_op.cc:276] Timestamp: P: 1794926978076287 usec, L: 0
1117 14:49:41.243698 (+ 39780us) write_op.cc:270] Start()
1117 14:49:41.243726 (+ 28us) write_op.cc:276] Timestamp: P: 1794926978101527 usec, L: 0
1117 14:49:41.258431 (+ 14705us) write_op.cc:270] Start()
1117 14:49:41.258462 (+ 31us) write_op.cc:276] Timestamp: P: 1794926978110652 usec, L: 0
1117 14:49:41.271572 (+ 13110us) write_op.cc:270] Start()
1117 14:49:41.271607 (+ 35us) write_op.cc:276] Timestamp: P: 1794926978145245 usec, L: 0
1117 14:49:41.277529 (+ 5922us) write_op.cc:270] Start()
1117 14:49:41.277554 (+ 25us) write_op.cc:276] Timestamp: P: 1794926978180329 usec, L: 0
1117 14:49:41.280042 (+ 2488us) write_op.cc:270] Start()
1117 14:49:41.280070 (+ 28us) write_op.cc:276] Timestamp: P: 1794926978204757 usec, L: 0
1117 14:49:41.283368 (+ 3298us) write_op.cc:270] Start()
1117 14:49:41.283395 (+ 27us) write_op.cc:276] Timestamp: P: 1794926978205330 usec, L: 0
1117 14:49:41.299191 (+ 15796us) write_op.cc:270] Start()
1117 14:49:41.299226 (+ 35us) write_op.cc:276] Timestamp: P: 1794926978237240 usec, L: 0
1117 14:49:41.304504 (+ 5278us) write_op.cc:270] Start()
1117 14:49:41.304536 (+ 32us) write_op.cc:276] Timestamp: P: 1794926978237880 usec, L: 0
1117 14:49:41.308937 (+ 4401us) write_op.cc:270] Start()
1117 14:49:41.308962 (+ 25us) write_op.cc:276] Timestamp: P: 1794926978261709 usec, L: 0
1117 14:49:41.319519 (+ 10557us) write_op.cc:270] Start()
1117 14:49:41.319551 (+ 32us) write_op.cc:276] Timestamp: P: 1794926978282166 usec, L: 0
1117 14:49:41.319771 (+ 220us) write_op.cc:270] Start()
1117 14:49:41.319798 (+ 27us) write_op.cc:276] Timestamp: P: 1794926978308327 usec, L: 0
1117 14:49:41.320007 (+ 209us) write_op.cc:270] Start()
1117 14:49:41.320034 (+ 27us) write_op.cc:276] Timestamp: P: 1794926978313389 usec, L: 0
1117 14:49:41.320207 (+ 173us) write_op.cc:270] Start()
1117 14:49:41.320230 (+ 23us) write_op.cc:276] Timestamp: P: 1794926978361205 usec, L: 0
1117 14:49:41.320411 (+ 181us) write_op.cc:270] Start()
1117 14:49:41.320488 (+ 77us) write_op.cc:276] Timestamp: P: 1794926978379985 usec, L: 0
1117 14:49:41.320668 (+ 180us) write_op.cc:270] Start()
1117 14:49:41.320694 (+ 26us) write_op.cc:276] Timestamp: P: 1794926978392660 usec, L: 0
1117 14:49:41.320917 (+ 223us) write_op.cc:270] Start()
1117 14:49:41.320944 (+ 27us) write_op.cc:276] Timestamp: P: 1794926978416779 usec, L: 0
1117 14:49:41.321166 (+ 222us) write_op.cc:270] Start()
1117 14:49:41.321191 (+ 25us) write_op.cc:276] Timestamp: P: 1794926978418323 usec, L: 0
1117 14:49:41.329561 (+ 8370us) write_op.cc:270] Start()
1117 14:49:41.329589 (+ 28us) write_op.cc:276] Timestamp: P: 1794926978444616 usec, L: 0
1117 14:49:41.348015 (+ 18426us) write_op.cc:270] Start()
1117 14:49:41.348043 (+ 28us) write_op.cc:276] Timestamp: P: 1794926978465612 usec, L: 0
1117 14:49:41.355870 (+ 7827us) write_op.cc:270] Start()
1117 14:49:41.355897 (+ 27us) write_op.cc:276] Timestamp: P: 1794926978478530 usec, L: 0
1117 14:49:41.362067 (+ 6170us) write_op.cc:270] Start()
1117 14:49:41.362096 (+ 29us) write_op.cc:276] Timestamp: P: 1794926978495973 usec, L: 0
1117 14:49:41.363494 (+ 1398us) write_op.cc:270] Start()
1117 14:49:41.363524 (+ 30us) write_op.cc:276] Timestamp: P: 1794926978500037 usec, L: 0
1117 14:49:41.368860 (+ 5336us) write_op.cc:270] Start()
1117 14:49:41.368887 (+ 27us) write_op.cc:276] Timestamp: P: 1794926978525444 usec, L: 0
1117 14:49:41.369058 (+ 171us) write_op.cc:270] Start()
1117 14:49:41.369079 (+ 21us) write_op.cc:276] Timestamp: P: 1794926978579204 usec, L: 0
1117 14:49:41.369989 (+ 910us) write_op.cc:270] Start()
1117 14:49:41.370014 (+ 25us) write_op.cc:276] Timestamp: P: 1794926978604359 usec, L: 0
1117 14:49:41.387330 (+ 17316us) write_op.cc:270] Start()
1117 14:49:41.387354 (+ 24us) write_op.cc:276] Timestamp: P: 1794926978618732 usec, L: 0
1117 14:49:41.404663 (+ 17309us) write_op.cc:270] Start()
1117 14:49:41.404692 (+ 29us) write_op.cc:276] Timestamp: P: 1794926978649559 usec, L: 0
1117 14:49:41.404883 (+ 191us) write_op.cc:270] Start()
1117 14:49:41.404907 (+ 24us) write_op.cc:276] Timestamp: P: 1794926978657272 usec, L: 0
1117 14:49:41.405086 (+ 179us) write_op.cc:270] Start()
1117 14:49:41.405109 (+ 23us) write_op.cc:276] Timestamp: P: 1794926978659774 usec, L: 0
1117 14:49:41.405279 (+ 170us) write_op.cc:270] Start()
1117 14:49:41.405312 (+ 33us) write_op.cc:276] Timestamp: P: 1794926978692449 usec, L: 0
1117 14:49:41.405504 (+ 192us) write_op.cc:270] Start()
1117 14:49:41.405527 (+ 23us) write_op.cc:276] Timestamp: P: 1794926978738436 usec, L: 0
1117 14:49:41.405684 (+ 157us) write_op.cc:270] Start()
1117 14:49:41.405705 (+ 21us) write_op.cc:276] Timestamp: P: 1794926978770384 usec, L: 0
1117 14:49:41.405863 (+ 158us) write_op.cc:270] Start()
1117 14:49:41.405883 (+ 20us) write_op.cc:276] Timestamp: P: 1794926978773143 usec, L: 0
1117 14:49:41.406036 (+ 153us) write_op.cc:270] Start()
1117 14:49:41.406060 (+ 24us) write_op.cc:276] Timestamp: P: 1794926978778402 usec, L: 0
1117 14:49:41.406237 (+ 177us) write_op.cc:270] Start()
1117 14:49:41.406267 (+ 30us) write_op.cc:276] Timestamp: P: 1794926978819946 usec, L: 0
1117 14:49:41.406419 (+ 152us) write_op.cc:270] Start()
1117 14:49:41.406439 (+ 20us) write_op.cc:276] Timestamp: P: 1794926978850610 usec, L: 0
1117 14:49:41.406586 (+ 147us) write_op.cc:270] Start()
1117 14:49:41.406605 (+ 19us) write_op.cc:276] Timestamp: P: 1794926978851809 usec, L: 0
1117 14:49:41.406756 (+ 151us) write_op.cc:270] Start()
1117 14:49:41.406777 (+ 21us) write_op.cc:276] Timestamp: P: 1794926978871226 usec, L: 0
1117 14:49:41.421391 (+ 14614us) write_op.cc:270] Start()
1117 14:49:41.421424 (+ 33us) write_op.cc:276] Timestamp: P: 1794926978913741 usec, L: 0
1117 14:49:41.434557 (+ 13133us) write_op.cc:270] Start()
1117 14:49:41.434584 (+ 27us) write_op.cc:276] Timestamp: P: 1794926978932679 usec, L: 0
1117 14:49:41.434793 (+ 209us) write_op.cc:270] Start()
1117 14:49:41.434818 (+ 25us) write_op.cc:276] Timestamp: P: 179492
I20261117 14:49:42.102726 7449 raft_consensus.cc:499] T 47d9af37b05545f0b5b0c033f4ec953f P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader def6b23bccc94a78a47118da331f2798)
I20261117 14:49:42.102946 7449 raft_consensus.cc:521] T 47d9af37b05545f0b5b0c033f4ec953f P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:42.128906 6787 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "3cea00abcccd4b1284393ef8b406cab1" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 3 candidate_status { last_received { term: 2 index: 1107 } } ignore_live_leader: false dest_uuid: "def6b23bccc94a78a47118da331f2798" is_pre_election: true
I20261117 14:49:42.130429 7341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.6.50.131:58395 (request call id 5) took 2282 ms. Trace:
I20261117 14:49:42.134471 6787 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "47d9af37b05545f0b5b0c033f4ec953f" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 2 candidate_status { last_received { term: 1 index: 1021 } } ignore_live_leader: false dest_uuid: "def6b23bccc94a78a47118da331f2798" is_pre_election: true
I20261117 14:49:42.136955 7449 leader_election.cc:290] T 47d9af37b05545f0b5b0c033f4ec953f P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271), def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611)
I20261117 14:49:42.138957 6658 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "47d9af37b05545f0b5b0c033f4ec953f" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 2 candidate_status { last_received { term: 1 index: 1021 } } ignore_live_leader: false dest_uuid: "c7900e455dd64c68bccfc499bda413f7" is_pre_election: true
I20261117 14:49:41.807178 7345 rpcz_store.cc:276] 1117 14:49:39.843373 (+ 0us) service_pool.cc:167] Inserting onto call queue
1117 14:49:39.844211 (+ 838us) service_pool.cc:224] Handling call
1117 14:49:40.239729 (+395518us) raft_consensus.cc:1481] Updating replica for 239 ops
1117 14:49:40.573128 (+333399us) raft_consensus.cc:1545] Early marking committed up to index 0
1117 14:49:40.573134 (+ 6us) raft_consensus.cc:1550] Triggering prepare for 239 ops
1117 14:49:40.573229 (+ 95us) write_op.cc:270] Start()
1117 14:49:40.573253 (+ 24us) write_op.cc:276] Timestamp: P: 1794926975006395 usec, L: 0
1117 14:49:40.627955 (+ 54702us) spinlock_profiling.cc:245] Waited 31.3 ms on lock 0x60f00001a288. stack: 00007f9a08fa33a6 00007f9a08fa3160 00007f9a07f9434d 00007f9a1f567704 00007f9a1f5676cd 00007f9a1f56709a 00007f9a121160b8 00007f9a1505c919 00007f9a15003c49 00007f9a15001417 00007f9a18ed38cd 00007f9a1303bae6 00007f9a1303b815 00007f9a100eb8de 00007f9a100ea7be 00007f9a100f09f8
1117 14:49:40.628048 (+ 93us) write_op.cc:270] Start()
1117 14:49:40.628075 (+ 27us) write_op.cc:276] Timestamp: P: 1794926975012215 usec, L: 0
1117 14:49:40.675703 (+ 47628us) write_op.cc:270] Start()
1117 14:49:40.675728 (+ 25us) write_op.cc:276] Timestamp: P: 1794926975012775 usec, L: 0
1117 14:49:40.680928 (+ 5200us) write_op.cc:270] Start()
1117 14:49:40.680969 (+ 41us) write_op.cc:276] Timestamp: P: 1794926975078625 usec, L: 0
1117 14:49:40.681147 (+ 178us) write_op.cc:270] Start()
1117 14:49:40.681172 (+ 25us) write_op.cc:276] Timestamp: P: 1794926975085580 usec, L: 0
1117 14:49:40.699554 (+ 18382us) write_op.cc:270] Start()
1117 14:49:40.699587 (+ 33us) write_op.cc:276] Timestamp: P: 1794926975091175 usec, L: 0
1117 14:49:40.699808 (+ 221us) write_op.cc:270] Start()
1117 14:49:40.699832 (+ 24us) write_op.cc:276] Timestamp: P: 1794926975091825 usec, L: 0
1117 14:49:40.704787 (+ 4955us) write_op.cc:270] Start()
1117 14:49:40.704811 (+ 24us) write_op.cc:276] Timestamp: P: 1794926975136125 usec, L: 0
1117 14:49:40.710580 (+ 5769us) write_op.cc:270] Start()
1117 14:49:40.710602 (+ 22us) write_op.cc:276] Timestamp: P: 1794926975173047 usec, L: 0
1117 14:49:40.710744 (+ 142us) write_op.cc:270] Start()
1117 14:49:40.710765 (+ 21us) write_op.cc:276] Timestamp: P: 1794926975180478 usec, L: 0
1117 14:49:40.710909 (+ 144us) write_op.cc:270] Start()
1117 14:49:40.710929 (+ 20us) write_op.cc:276] Timestamp: P: 1794926975183163 usec, L: 0
1117 14:49:40.736978 (+ 26049us) write_op.cc:270] Start()
1117 14:49:40.737011 (+ 33us) write_op.cc:276] Timestamp: P: 1794926975205933 usec, L: 0
1117 14:49:40.737220 (+ 209us) write_op.cc:270] Start()
1117 14:49:40.737245 (+ 25us) write_op.cc:276] Timestamp: P: 1794926975247504 usec, L: 0
1117 14:49:40.737434 (+ 189us) write_op.cc:270] Start()
1117 14:49:40.737455 (+ 21us) write_op.cc:276] Timestamp: P: 1794926975254061 usec, L: 0
1117 14:49:40.737617 (+ 162us) write_op.cc:270] Start()
1117 14:49:40.737638 (+ 21us) write_op.cc:276] Timestamp: P: 1794926975288126 usec, L: 0
1117 14:49:40.737785 (+ 147us) write_op.cc:270] Start()
1117 14:49:40.737806 (+ 21us) write_op.cc:276] Timestamp: P: 1794926975304886 usec, L: 0
1117 14:49:40.737973 (+ 167us) write_op.cc:270] Start()
1117 14:49:40.737996 (+ 23us) write_op.cc:276] Timestamp: P: 1794926975318325 usec, L: 0
1117 14:49:40.738157 (+ 161us) write_op.cc:270] Start()
1117 14:49:40.738182 (+ 25us) write_op.cc:276] Timestamp: P: 1794926975335036 usec, L: 0
1117 14:49:40.738341 (+ 159us) write_op.cc:270] Start()
1117 14:49:40.738363 (+ 22us) write_op.cc:276] Timestamp: P: 1794926975366050 usec, L: 0
1117 14:49:40.738515 (+ 152us) write_op.cc:270] Start()
1117 14:49:40.738548 (+ 33us) write_op.cc:276] Timestamp: P: 1794926975387928 usec, L: 0
1117 14:49:40.738737 (+ 189us) write_op.cc:270] Start()
1117 14:49:40.738780 (+ 43us) write_op.cc:276] Timestamp: P: 1794926975417594 usec, L: 0
1117 14:49:40.738955 (+ 175us) write_op.cc:270] Start()
1117 14:49:40.738979 (+ 24us) write_op.cc:276] Timestamp: P: 1794926975422260 usec, L: 0
1117 14:49:40.739152 (+ 173us) write_op.cc:270] Start()
1117 14:49:40.739173 (+ 21us) write_op.cc:276] Timestamp: P: 1794926975442268 usec, L: 0
1117 14:49:40.739353 (+ 180us) write_op.cc:270] Start()
1117 14:49:40.739378 (+ 25us) write_op.cc:276] Timestamp: P: 1794926975453189 usec, L: 0
1117 14:49:40.739566 (+ 188us) write_op.cc:270] Start()
1117 14:49:40.739588 (+ 22us) write_op.cc:276] Timestamp: P: 1794926975478637 usec, L: 0
1117 14:49:40.739728 (+ 140us) write_op.cc:270] Start()
1117 14:49:40.739749 (+ 21us) write_op.cc:276] Timestamp: P: 1794926975510856 usec, L: 0
1117 14:49:40.739877 (+ 128us) write_op.cc:270] Start()
1117 14:49:40.739924 (+ 47us) write_op.cc:276] Timestamp: P: 1794926975515055 usec, L: 0
1117 14:49:40.759090 (+ 19166us) write_op.cc:270] Start()
1117 14:49:40.759120 (+ 30us) write_op.cc:276] Timestamp: P: 1794926975530737 usec, L: 0
1117 14:49:40.761709 (+ 2589us) write_op.cc:270] Start()
1117 14:49:40.761731 (+ 22us) write_op.cc:276] Timestamp: P: 1794926975570008 usec, L: 0
1117 14:49:40.780365 (+ 18634us) write_op.cc:270] Start()
1117 14:49:40.780395 (+ 30us) write_op.cc:276] Timestamp: P: 1794926975591656 usec, L: 0
1117 14:49:40.782352 (+ 1957us) write_op.cc:270] Start()
1117 14:49:40.782382 (+ 30us) write_op.cc:276] Timestamp: P: 1794926975610776 usec, L: 0
1117 14:49:40.782561 (+ 179us) write_op.cc:270] Start()
1117 14:49:40.782583 (+ 22us) write_op.cc:276] Timestamp: P: 1794926975634021 usec, L: 0
1117 14:49:40.783234 (+ 651us) write_op.cc:270] Start()
1117 14:49:40.783255 (+ 21us) write_op.cc:276] Timestamp: P: 1794926975644898 usec, L: 0
1117 14:49:40.783432 (+ 177us) write_op.cc:270] Start()
1117 14:49:40.783462 (+ 30us) write_op.cc:276] Timestamp: P: 1794926975661522 usec, L: 0
1117 14:49:40.783637 (+ 175us) write_op.cc:270] Start()
1117 14:49:40.783654 (+ 17us) write_op.cc:276] Timestamp: P: 1794926975662185 usec, L: 0
1117 14:49:40.783773 (+ 119us) write_op.cc:270] Start()
1117 14:49:40.783788 (+ 15us) write_op.cc:276] Timestamp: P: 1794926975683589 usec, L: 0
1117 14:49:40.783890 (+ 102us) write_op.cc:270] Start()
1117 14:49:40.783906 (+ 16us) write_op.cc:276] Timestamp: P: 1794926975685471 usec, L: 0
1117 14:49:40.784038 (+ 132us) write_op.cc:270] Start()
1117 14:49:40.784054 (+ 16us) write_op.cc:276] Timestamp: P: 1794926975727602 usec, L: 0
1117 14:49:40.792853 (+ 8799us) write_op.cc:270] Start()
1117 14:49:40.792885 (+ 32us) write_op.cc:276] Timestamp: P: 1794926975757652 usec, L: 0
1117 14:49:40.793088 (+ 203us) write_op.cc:270] Start()
1117 14:49:40.793110 (+ 22us) write_op.cc:276] Timestamp: P: 1794926975768280 usec, L: 0
1117 14:49:40.793287 (+ 177us) write_op.cc:270] Start()
1117 14:49:40.793309 (+ 22us) write_op.cc:276] Timestamp: P: 1794926975783694 usec, L: 0
1117 14:49:40.793468 (+ 159us) write_op.cc:270] Start()
1117 14:49:40.793487 (+ 19us) write_op.cc:276] Timestamp: P: 1794926975796658 usec, L: 0
1117 14:49:40.793689 (+ 202us) write_op.cc:270] Start()
1117 14:49:40.805867 (+ 12178us) write_op.cc:276] Timestamp: P: 1794926975822488 usec, L: 0
1117 14:49:40.806147 (+ 280us) write_op.cc:270] Start()
1117 14:49:40.806179 (+ 32us) write_op.cc:276] Timestamp: P: 1794926975841498 usec, L: 0
1117 14:49:40.806398 (+ 219us) write_op.cc:270] Start()
1117 14:49:40.806424 (+ 26us) write_op.cc:276] Timestamp: P: 1794926975848582 usec, L: 0
1117 14:49:40.806603 (+ 179us) write_op.cc:270] Start()
1117 14:49:40.806627 (+ 24us) write_op.cc:276] Timestamp: P: 1794926975863545 usec, L: 0
1117 14:49:40.806815 (+ 188us) write_op.cc:270] Start()
1117 14:49:40.806838 (+ 23us) write_op.cc:276] Timestamp: P: 1794926975894780 usec, L: 0
1117 14:49:40.814136 (+ 7298us) write_op.cc:270] Start()
1117 14:49:40.814166 (+ 30us) write_op.cc:276] Timestamp: P: 1794926975904839 usec, L: 0
1117 14:49:40.814353 (+ 187us) write_op.cc:270] Start()
1117 14:49:40.814374 (+ 21us) write_op.cc:276] Timestamp: P: 1794926975943324 usec, L: 0
1117 14:49:40.814648 (+ 274us) write_op.cc:270] Start()
1117 14:49:40.814670 (+ 22us) write_op.cc:276] Timestamp: P: 1794926975947142 usec, L: 0
1117 14:49:40.864701 (+ 50031us) write_op.cc:270] Start()
1117 14:49:40.864724 (+ 23us) write_op.cc:276] Timestamp: P: 1794926975973608 usec, L: 0
1117 14:49:40.866129 (+ 1405us) write_op.cc:270] Start()
1117 14:49:40.866153 (+ 24us) write_op.cc:276] Timestamp: P: 1794926975999827 usec, L: 0
1117 14:49:40.867020 (+ 867us) write_op.cc:270] Start()
1117 14:49:40.867045 (+ 25us) write_op.cc:276] Timestamp: P: 1794926976004557 usec, L: 0
1117 14:49:40.876526 (+ 9481us) write_op.cc:270] Start()
1117 14:49:40.876562 (+ 36us) write_op.cc:276] Timestamp: P: 1794926976039446 usec, L: 0
1117 14:49:40.876733 (+ 171us) write_op.cc:270] Start()
1117 14:49:40.876755 (+ 22us) write_op.cc:276] Timestamp: P: 1794926976051138 usec, L: 0
1117 14:49:40.876954 (+ 199us) write_op.cc:270] Start()
1117 14:49:40.876981 (+ 27us) write_op.cc:276] Timestamp: P: 1794926976078042 usec, L: 0
1117 14:49:40.878445 (+ 1464us) write_op.cc:270] Start()
1117 14:49:40.878469 (+ 24us) write_op.cc:276] Timestamp: P: 1794926976106332 usec, L: 0
1117 14:49:40.878648 (+ 179us) write_op.cc:270] Start()
1117 14:49:40.878669 (+ 21us) write_op.cc:276] Timestamp: P: 1794926976108694 usec, L: 0
1117 14:49:40.878828 (+ 159us) write_op.cc:270] Start()
1117 14:49:40.878863 (+ 35us) write_op.cc:276] Timestamp: P: 1794926976165742 usec, L: 0
1117 14:49:40.879119 (+ 256us) write_op.cc:270] Start()
1117 14:49:40.879146 (+ 27us) write_op.cc:276] Timestamp: P: 1794926976176853 usec, L: 0
1117 14:49:40.879299 (+ 153us) write_op.cc:270] Start()
1117 14:49:40.879319 (+ 20us) write_op.cc:276] Timestamp: P: 1794926976185827 usec, L: 0
1117 14:49:40.879482 (+ 163us) write_op.cc:270] Start()
1117 14:49:40.879503 (+ 21us) write_op.cc:276] Timestamp: P: 1794926976219715 usec, L: 0
1117 14:49:40.879673 (+ 170us) write_op.cc:270] Start()
1117 14:49:40.879696 (+ 23us) write_op.cc:276] Timestamp: P: 1794926976232209 usec, L: 0
1117 14:49:40.879853 (+ 157us) write_op.cc:270] Start()
1117 14:49:40.879873 (+ 20us) write_op.cc:276] Timestamp: P: 1794926976233021 usec, L: 0
1117 14:49:40.880040 (+ 167us) write_op.cc:270] Start()
1117 14:49:40.880060 (+ 20us) write_op.cc:276] Timestamp: P: 1794926976267742 usec, L: 0
1117 14:49:40.880213 (+ 153us) write_op.cc:270] Start()
1117 14:49:40.880233 (+ 20us) write_op.cc:276] Timestamp: P: 1794926976301887 usec, L: 0
1117 14:49:40.880673 (+ 440us) write_op.cc:270] Start()
1117 14:49:40.880697 (+ 24us) write_op.cc:276] Timestamp: P: 1794926976310635 usec, L: 0
1117 14:49:40.880861 (+ 164us) write_op.cc:270] Start()
1117 14:49:40.880881 (+ 20us) write_op.cc:276] Timestamp: P: 1794926976317442 usec, L: 0
1117 14:49:40.881025 (+ 144us) write_op.cc:270] Start()
1117 14:49:40.881046 (+ 21us) write_op.cc:276] Timestamp: P: 1794926976321513 usec, L: 0
1117 14:49:40.881208 (+ 162us) write_op.cc:270] Start()
1117 14:49:40.881230 (+ 22us) write_op.cc:276] Timestamp: P: 1794926976348517 usec, L: 0
1117 14:49:40.881388 (+ 158us) write_op.cc:270] Start()
1117 14:49:40.881409 (+ 21us) write_op.cc:276] Timestamp: P: 1794926976367822 usec, L: 0
1117 14:49:40.881582 (+ 173us) write_op.cc:270] Start()
1117 14:49:40.881600 (+ 18us) write_op.cc:276] Timestamp: P: 1794926976396220 usec, L: 0
1117 14:49:40.881738 (+ 138us) write_op.cc:270] Start()
1117 14:49:40.881756 (+ 18us) write_op.cc:276] Timestamp: P: 1794926976416257 usec, L: 0
1117 14:49:40.881888 (+ 132us) write_op.cc:270] Start()
1117 14:49:40.881906 (+ 18us) write_op.cc:276] Timestamp: P: 1794926976419896 usec, L: 0
1117 14:49:40.882039 (+ 133us) write_op.cc:270] Start()
1117 14:49:40.882065 (+ 26us) write_op.cc:276] Timestamp: P: 1794926976474020 usec, L: 0
1117 14:49:40.882260 (+ 195us) write_op.cc:270] Start()
1117 14:49:40.882280 (+ 20us) write_op.cc:276] Timestamp: P: 1794926976495255 usec, L: 0
1117 14:49:40.882438 (+ 158us) write_op.cc:270] Start()
1117 14:49:40.882459 (+ 21us) write_op.cc:276] Timestamp: P: 1794926976509687 usec, L: 0
1117 14:49:40.882618 (+ 159us) write_op.cc:270] Start()
1117 14:49:40.882639 (+ 21us) write_op.cc:276] Timestamp: P: 1794926976512336 usec, L: 0
1117 14:49:40.893316 (+ 10677us) write_op.cc:270] Start()
1117 14:49:40.893349 (+ 33us) write_op.cc:276] Timestamp: P: 1794926976524314 usec, L: 0
1117 14:49:40.895531 (+ 2182us) write_op.cc:270] Start()
1117 14:49:40.895557 (+ 26us) write_op.cc:276] Timestamp: P: 1794926976554206 usec, L: 0
1117 14:49:40.898521 (+ 2964us) write_op.cc:270] Start()
1117 14:49:40.898553 (+ 32us) write_op.cc:276] Timestamp: P: 1794926976577053 usec, L: 0
1117 14:49:40.924317 (+ 25764us) write_op.cc:270] Start()
1117 14:49:40.924348 (+ 31us) write_op.cc:276] Timestamp: P: 1794926976585711 usec, L: 0
1117 14:49:40.929039 (+ 4691us) write_op.cc:270] Start()
1117 14:49:40.929067 (+ 28us) write_op.cc:276] Timestamp: P: 1794926976622265 usec, L: 0
1117 14:49:40.940498 (+ 11431us) write_op.cc:270] Start()
1117 14:49:40.940530 (+ 32us) write_op.cc:276] Timestamp: P: 1794926976645628 usec, L: 0
1117 14:49:40.969335 (+ 28805us) write_op.cc:270] Start()
1117 14:49:40.969366 (+ 31us) write_op.cc:276] Timestamp: P: 1794926976648480 usec, L: 0
1117 14:49:41.028416 (+ 59050us) write_op.cc:270] Start()
1117 14:49:41.028474 (+ 58us) write_op.cc:276] Timestamp: P: 1794926976673059 usec, L: 0
1117 14:49:41.030875 (+ 2401us) write_op.cc:270] Start()
1117 14:49:41.030909 (+ 34us) write_op.cc:276] Timestamp: P: 1794926976702123 usec, L: 0
1117 14:49:41.051770 (+ 20861us) write_op.cc:270] Start()
1117 14:49:41.051800 (+ 30us) write_op.cc:276] Timestamp: P: 1794926976719472 usec, L: 0
1117 14:49:41.052007 (+ 207us) write_op.cc:270] Start()
1117 14:49:41.052031 (+ 24us) write_op.cc:276] Timestamp: P: 1794926976725911 usec, L: 0
1117 14:49:41.060492 (+ 8461us) write_op.cc:270] Start()
1117 14:49:41.060527 (+ 35us) write_op.cc:276] Timestamp: P: 1794926976742938 usec, L: 0
1117 14:49:41.060744 (+ 217us) write_op.cc:270] Start()
1117 14:49:41.060792 (+ 48us) write_op.cc:276] Timestamp: P: 1794926976745861 usec, L: 0
1117 14:49:41.072059 (+ 11267us) write_op.cc:270] Start()
1117 14:49:41.072112 (+ 53us) write_op.cc:276] Timestamp: P: 1794926976777127 usec, L: 0
1117 14:49:41.086733 (+ 14621us) write_op.cc:270] Start()
1117 14:49:41.086771 (+ 38us) write_op.cc:276] Timestamp: P: 1794926976807988 usec, L: 0
1117 14:49:41.099294 (+ 12523us) write_op.cc:270] Start()
1117 14:49:41.099320 (+ 26us) write_op.cc:276] Timestamp: P: 1794926976840340 usec, L: 0
1117 14:49:41.106529 (+ 7209us) write_op.cc:270] Start()
1117 14:49:41.106558 (+ 29us) write_op.cc:276] Timestamp: P: 1794926976843756 usec, L: 0
1117 14:49:41.106720 (+ 162us) write_op.cc:270] Start()
1117 14:49:41.108670 (+ 1950us) write_op.cc:276] Timestamp: P: 1794926976844521 usec, L: 0
1117 14:49:41.118912 (+ 10242us) write_op.cc:270] Start()
1117 14:49:41.118938 (+ 26us) write_op.cc:276] Timestamp: P: 1794926976892890 usec, L: 0
1117 14:49:41.119118 (+ 180us) write_op.cc:270] Start()
1117 14:49:41.119138 (+ 20us) write_op.cc:276] Timestamp: P: 1794926976906239 usec, L: 0
1117 14:49:41.119305 (+ 167us) write_op.cc:270] Start()
1117 14:49:41.119324 (+ 19us) write_op.cc:276] Timestamp: P: 1794926976906849 usec, L: 0
1117 14:49:41.119482 (+ 158us) write_op.cc:270] Start()
1117 14:49:41.119502 (+ 20us) write_op.cc:276] Timestamp: P: 1794926976926468 usec, L: 0
1117 14:49:41.119664 (+ 162us) write_op.cc:270] Start()
1117 14:49:41.119684 (+ 20us) write_op.cc:276] Timestamp: P: 1794926976961314 usec, L: 0
1117 14:49:41.119835 (+ 151us) write_op.cc:270] Start()
1117 14:49:41.119853 (+ 18us) write_op.cc:276] Timestamp: P: 1794926976964969 usec, L: 0
1117 14:49:41.120001 (+ 148us) write_op.cc:270] Start()
1117 14:49:41.120021 (+ 20us) write_op.cc:276] Timestamp: P: 1794926976977983 usec, L: 0
1117 14:49:41.120182 (+ 161us) write_op.cc:270] Start()
1117 14:49:41.120211 (+ 29us) write_op.cc:276] Timestamp: P: 1794926976993970 usec, L: 0
1117 14:49:41.157987 (+ 37776us) write_op.cc:270] Start()
1117 14:49:41.158017 (+ 30us) write_op.cc:276] Timestamp: P: 1794926977027671 usec, L: 0
1117 14:49:41.158215 (+ 198us) write_op.cc:270] Start()
1117 14:49:41.158236 (+ 21us) write_op.cc:276] Timestamp: P: 1794926977050858 usec, L: 0
1117 14:49:41.158387 (+ 151us) write_op.cc:270] Start()
1117 14:49:41.174132 (+ 15745us) write_op.cc:276] Timestamp: P: 1794926977053550 usec, L: 0
1117 14:49:41.186210 (+ 12078us) write_op.cc:270] Start()
1117 14:49:41.186239 (+ 29us) write_op.cc:276] Timestamp: P: 1794926977059325 usec, L: 0
1117 14:49:41.186434 (+ 195us) write_op.cc:270] Start()
1117 14:49:41.186458 (+ 24us) write_op.cc:276] Timestamp: P: 1794926977105961 usec, L: 0
1117 14:49:41.186617 (+ 159us) write_op.cc:270] Start()
1117 14:49:41.186637 (+ 20us) write_op.cc:276] Timestamp: P: 1794926977122765 usec, L: 0
1117 14:49:41.187218 (+ 581us) write_op.cc:270] Start()
1117 14:49:41.187240 (+ 22us) write_op.cc:276] Timestamp: P: 1794926977149525 usec, L: 0
1117 14:49:41.187402 (+ 162us) write_op.cc:270] Start()
1117 14:49:41.187421 (+ 19us) write_op.cc:276] Timestamp: P: 1794926977202125 usec, L: 0
1117 14:49:41.187610 (+ 189us) write_op.cc:270] Start()
1117 14:49:41.187631 (+ 21us) write_op.cc:276] Timestamp: P: 1794926977202715 usec, L: 0
1117 14:49:41.190271 (+ 2640us) write_op.cc:270] Start()
1117 14:49:41.190299 (+ 28us) write_op.cc:276] Timestamp: P: 1794926977206786 usec, L: 0
1117 14:49:41.190463 (+ 164us) write_op.cc:270] Start()
1117 14:49:41.190497 (+ 34us) write_op.cc:276] Timestamp: P: 1794926977241267 usec, L: 0
1117 14:49:41.190697 (+ 200us) write_op.cc:270] Start()
1117 14:49:41.190728 (+ 31us) write_op.cc:276] Timestamp: P: 1794926977247552 usec, L: 0
1117 14:49:41.194582 (+ 3854us) write_op.cc:270] Start()
1117 14:49:41.194608 (+ 26us) write_op.cc:276] Timestamp: P: 1794926977251332 usec, L: 0
1117 14:49:41.194767 (+ 159us) write_op.cc:270] Start()
1117 14:49:41.194788 (+ 21us) write_op.cc:276] Timestamp: P: 1794926977280797 usec, L: 0
1117 14:49:41.194961 (+ 173us) write_op.cc:270] Start()
1117 14:49:41.194993 (+ 32us) write_op.cc:276] Timestamp: P: 1794926977322123 usec, L: 0
1117 14:49:41.195133 (+ 140us) write_op.cc:270] Start()
1117 14:49:41.195153 (+ 20us) write_op.cc:276] Timestamp: P: 1794926977327027 usec, L: 0
1117 14:49:41.206307 (+ 11154us) write_op.cc:270] Start()
1117 14:49:41.206333 (+ 26us) write_op.cc:276] Timestamp: P: 1794926977340942 usec, L: 0
1117 14:49:41.206521 (+ 188us) write_op.cc:270] Start()
1117 14:49:41.206540 (+ 19us) write_op.cc:276] Timestamp: P: 1794926977360473 usec, L: 0
1117 14:49:41.206662 (+ 122us) write_op.cc:270] Start()
1117 14:49:41.206704 (+ 42us) write_op.cc:276] Timestamp: P: 1794926977399082 usec, L: 0
1117 14:49:41.206835 (+ 131us) write_op.cc:270] Start()
1117 14:49:41.206851 (+ 16us) write_op.cc:276] Timestamp: P: 1794926977400703 usec, L: 0
1117 14:49:41.206965 (+ 114us) write_op.cc:270] Start()
1117 14:49:41.206991 (+ 26us) write_op.cc:276] Timestamp: P: 1794926977445124 usec, L: 0
1117 14:49:41.207115 (+ 124us) write_op.cc:270] Start()
1117 14:49:41.207131 (+ 16us) write_op.cc:276] Timestamp: P: 1794926977449266 usec, L: 0
1117 14:49:41.207249 (+ 118us) write_op.cc:270] Start()
1117 14:49:41.207265 (+ 16us) write_op.cc:276] Timestamp: P: 1794926977497609 usec, L: 0
1117 14:49:41.207433 (+ 168us) write_op.cc:270] Start()
1117 14:49:41.217547 (+ 10114us) write_op.cc:276] Timestamp: P: 1794926977499312 usec, L: 0
1117 14:49:41.235255 (+ 17708us) write_op.cc:270] Start()
1117 14:49:41.235290 (+ 35us) write_op.cc:276] Timestamp: P: 1794926977521171 usec, L: 0
1117 14:49:41.236203 (+ 913us) write_op.cc:270] Start()
1117 14:49:41.236232 (+ 29us) write_op.cc:276] Timestamp: P: 1794926977521776 usec, L: 0
1117 14:49:41.236403 (+ 171us) write_op.cc:270] Start()
1117 14:49:41.236423 (+ 20us) write_op.cc:276] Timestamp: P: 1794926977579609 usec, L: 0
1117 14:49:41.236608 (+ 185us) write_op.cc:270] Start()
1117 14:49:41.236634 (+ 26us) write_op.cc:276] Timestamp: P: 1794926977609220 usec, L: 0
1117 14:49:41.236770 (+ 136us) write_op.cc:270] Start()
1117 14:49:41.236788 (+ 18us) write_op.cc:276] Timestamp: P: 1794926977609815 usec, L: 0
1117 14:49:41.236925 (+ 137us) write_op.cc:270] Start()
1117 14:49:41.236943 (+ 18us) write_op.cc:276] Timestamp: P: 1794926977679097 usec, L: 0
1117 14:49:41.237105 (+ 162us) write_op.cc:270] Start()
1117 14:49:41.237124 (+ 19us) write_op.cc:276] Timestamp: P: 1794926977680322 usec, L: 0
1117 14:49:41.237251 (+ 127us) write_op.cc:270] Start()
1117 14:49:41.237269 (+ 18us) write_op.cc:276] Timestamp: P: 1794926977699112 usec, L: 0
1117 14:49:41.238122 (+ 853us) write_op.cc:270] Start()
1117 14:49:41.238149 (+ 27us) write_op.cc:276] Timestamp: P: 1794926977726023 usec, L: 0
1117 14:49:41.238312 (+ 163us) write_op.cc:270] Start()
1117 14:49:41.238332 (+ 20us) write_op.cc:276] Timestamp: P: 1794926977737100 usec, L: 0
1117 14:49:41.238535 (+ 203us) write_op.cc:270] Start()
1117 14:49:41.238556 (+ 21us) write_op.cc:276] Timestamp: P: 1794926977751873 usec, L: 0
1117 14:49:41.238743 (+ 187us) write_op.cc:270] Start()
1117 14:49:41.238790 (+ 47us) write_op.cc:276] Timestamp: P: 1794926977784157 usec, L: 0
1117 14:49:41.238919 (+ 129us) write_op.cc:270] Start()
1117 14:49:41.238938 (+ 19us) write_op.cc:276] Timestamp: P: 1794926977807763 usec, L: 0
1117 14:49:41.239127 (+ 189us) write_op.cc:270] Start()
1117 14:49:41.239148 (+ 21us) write_op.cc:276] Timestamp: P: 1794926977824219 usec, L: 0
1117 14:49:41.239290 (+ 142us) write_op.cc:270] Start()
1117 14:49:41.239309 (+ 19us) write_op.cc:276] Timestamp: P: 1794926977825186 usec, L: 0
1117 14:49:41.239447 (+ 138us) write_op.cc:270] Start()
1117 14:49:41.239485 (+ 38us) write_op.cc:276] Timestamp: P: 1794926977875284 usec, L: 0
1117 14:49:41.239636 (+ 151us) write_op.cc:270] Start()
1117 14:49:41.239657 (+ 21us) write_op.cc:276] Timestamp: P: 1794926977898742 usec, L: 0
1117 14:49:41.239807 (+ 150us) write_op.cc:270] Start()
1117 14:49:41.239828 (+ 21us) write_op.cc:276] Timestamp: P: 1794926977921222 usec, L: 0
1117 14:49:41.239963 (+ 135us) write_op.cc:270] Start()
1117 14:49:41.239994 (+ 31us) write_op.cc:276] Timestamp: P: 1794926977935745 usec, L: 0
1117 14:49:41.240142 (+ 148us) write_op.cc:270] Start()
1117 14:49:41.240159 (+ 17us) write_op.cc:276] Timestamp: P: 1794926977940616 usec, L: 0
1117 14:49:41.283235 (+ 43076us) write_op.cc:270] Start()
1117 14:49:41.283265 (+ 30us) write_op.cc:276] Timestamp: P: 1794926977988386 usec, L: 0
1117 14:49:41.308357 (+ 25092us) write_op.cc:270] Start()
1117 14:49:41.308384 (+ 27us) write_op.cc:276] Timestamp: P: 1794926977991259 usec, L: 0
1117 14:49:41.321994 (+ 13610us) write_op.cc:270] Start()
1117 14:49:41.322020 (+ 26us) write_op.cc:276] Timestamp: P: 1794926977991749 usec, L: 0
1117 14:49:41.329041 (+ 7021us) write_op.cc:270] Start()
1117 14:49:41.329067 (+ 26us) write_op.cc:276] Timestamp: P: 1794926978023223 usec, L: 0
1117 14:49:41.351850 (+ 22783us) write_op.cc:270] Start()
1117 14:49:41.351879 (+ 29us) write_op.cc:276] Timestamp: P: 1794926978036305 usec, L: 0
1117 14:49:41.357478 (+ 5599us) write_op.cc:270] Start()
1117 14:49:41.357517 (+ 39us) write_op.cc:276] Timestamp: P: 1794926978037544 usec, L: 0
1117 14:49:41.357684 (+ 167us) write_op.cc:270] Start()
1117 14:49:41.357704 (+ 20us) write_op.cc:276] Timestamp: P: 1794926978064643 usec, L: 0
1117 14:49:41.370704 (+ 13000us) write_op.cc:270] Start()
1117 14:49:41.370728 (+ 24us) write_op.cc:276] Timestamp: P: 1794926978112395 usec, L: 0
1117 14:49:41.372719 (+ 1991us) write_op.cc:270] Start()
1117 14:49:41.372738 (+ 19us) write_op.cc:276] Timestamp: P: 1794926978114954 usec, L: 0
1117 14:49:41.372893 (+ 155us) write_op.cc:270] Start()
1117 14:49:41.372911 (+ 18us) write_op.cc:276] Timestamp: P: 1794926978149751 usec, L: 0
1117 14:49:41.373059 (+ 148us) write_op.cc:270] Start()
1117 14:49:41.373083 (+ 24us) write_op.cc:276] Timestamp: P: 1794926978183053 usec, L: 0
1117 14:49:41.373207 (+ 124us) write_op.cc:270] Start()
1117 14:49:41.373225 (+ 18us) write_op.cc:276] Timestamp: P: 1794926978185596 usec, L: 0
1117 14:49:41.373398 (+ 173us) write_op.cc:270] Start()
1117 14:49:41.373416 (+ 18us) write_op.cc:276] Timestamp: P: 1794926978194111 usec, L: 0
1117 14:49:41.380468 (+ 7052us) write_op.cc:270] Start()
1117 14:49:41.380500 (+ 32us) write_op.cc:276] Timestamp: P: 1794926978227803 usec, L: 0
1117 14:49:41.384207 (+ 3707us) write_op.cc:270] Start()
1117 14:49:41.384253 (+ 46us) write_op.cc:276] Timestamp: P: 1794926978255089 usec, L: 0
1117 14:49:41.384417 (+ 164us) write_op.cc:270] Start()
1117 14:49:41.384460 (+ 43us) write_op.cc:276] Timestamp: P: 1794926978274810 usec, L: 0
1117 14:49:41.384617 (+ 157us) write_op.cc:270] Start()
1117 14:49:41.384637 (+ 20us) write_op.cc:276] Timestamp: P: 1794926978276676 usec, L: 0
1117 14:49:41.384770 (+ 133us) write_op.cc:270] Start()
1117 14:49:41.384792 (+ 22us) write_op.cc:276] Timestamp: P: 1794926978321467 usec, L: 0
1117 14:49:41.384966 (+ 174us) write_op.cc:270] Start()
1117 14:49:41.384997 (+ 31us) write_op.cc:276] Timestamp: P: 1794926978333907 usec, L: 0
1117 14:49:41.385180 (+ 183us) write_op.cc:270] Start()
1117 14:49:41.385203 (+ 23us) write_op.cc:276] Timestamp: P: 1794926978356105 usec, L: 0
1117 14:49:41.385377 (+ 174us) write_op.cc:270] Start()
1117 14:49:41.385403 (+ 26us) write_op.cc:276] Timestamp: P: 1794926978393952 usec, L: 0
1117 14:49:41.385565 (+ 162us) write_op.cc:270] Start()
1117 14:49:41.385587 (+ 22us) write_op.cc:276] Timestamp: P: 1794926978420574 usec, L: 0
1117 14:49:41.385746 (+ 159us) write_op.cc:270] Start()
1117 14:49:41.385771 (+ 25us) write_op.cc:276] Timestamp: P: 1794926978421650 usec, L: 0
1117 14:49:41.385946 (+ 175us) write_op.cc:270] Start()
1117 14:49:41.385968 (+ 22us) write_op.cc:276] Timestamp: P: 1794926978422254 usec, L: 0
1117 14:49:41.386147 (+ 179us) write_op.cc:270] Start()
1117 14:49:41.386163 (+ 16us) write_op.cc:276] Timestamp: P: 1794926978451035 usec, L: 0
1117 14:49:41.410170 (+ 24007us) write_op.cc:270] Start()
1117 14:49:41.410196 (+ 26us) write_op.cc:276] Timestamp: P: 1794926978470888 usec, L: 0
1117 14:49:41.410890 (+ 694us) write_op.cc:270] Start()
1117 14:49:41.410921 (+ 31us) write_op.cc:276] Timestamp: P: 1794926978472001 usec, L: 0
1117 14:49:41.424951 (+ 14030us) write_op.cc:270] Start()
1117 14:49:41.424995 (+ 44us) write_op.cc:276] Timestamp: P: 1794926978519709 usec, L: 0
1117 14:49:41.445350 (+ 20355us) write_op.cc:270] Start()
1117 14:49:41.445371 (+ 21us) write_op.cc:276] Timestamp: P: 1794926978522958 usec, L: 0
1117 14:49:41.447706 (+ 2335us) write_op.cc:270] Start()
1117 14:49:41.447734 (+ 28us) write_op.cc:276] Timestamp: P: 1794926978540025 usec, L: 0
1117 14:49:41.447896 (+ 162us) write_op.cc:270] Start()
1117 14:49:41.447920 (+ 24us) write_op.cc:276] Timestamp: P: 1794926978568093 usec, L: 0
1117 14:49:41.451122 (+ 3202us) write_op.cc:270] Start()
1117 14:49:41.451149 (+ 27us) write_op.cc:276] Timestamp: P: 1794926978573964 usec, L: 0
1117 14:49:41.458556 (+ 7407us) write_op.cc:270] Start()
1117 14:49:41.460728 (+ 2172us) write_op.cc:276] Timestamp: P: 1794926978599886 usec, L: 0
1117 14:49:41.470715 (+ 9987us) write_op.cc:270] Start()
1117 14:49:41.470742 (+ 27us) write_op.cc:276] Timestamp: P: 1794926978661915 usec, L: 0
1117 14:49:41.479772 (+ 9030us) write_op.cc:270] Start()
1117 14:49:41.479795 (+ 23us) write_op.cc:276] Timestamp: P: 1794926978662712 usec, L: 0
1117 14:49:41.479954 (+ 159us) write_op.cc:270] Start()
1117 14:49:41.479979 (+ 25us) write_op.cc:276] Timestamp: P: 1794926978665488 usec, L: 0
1117 14:49:41.483104 (+ 3125us) write_op.cc:270] Start()
1117 14:49:41.483129 (+ 25us) write_op.cc:276] Timestamp: P: 1794926978710967 usec, L: 0
1117 14:49:41.483298 (+ 169us) write_op.cc:270] Start()
1117 14:49:41.483321 (+ 23us) write_op.cc:276] Timestamp: P: 1794926978735185 usec, L: 0
1117 14:49:41.483469 (+ 148us) write_op.cc:270] Start()
1117 14:49:41.483503 (+ 34us) write_op.cc:276] Timestamp: P: 1794926978750504 usec, L: 0
1117 14:49:41.483664 (+ 161us) write_op.cc:270] Start()
1117 14:49:41.483686 (+ 22us) write_op.cc:276] Timestamp: P: 1794926978752490 usec, L: 0
1117 14:49:41.483843 (+ 157us) write_op.cc:270] Start()
1117 14:49:41.483867 (+ 24us) write_op.cc:276] Timestamp: P: 1794926978764191 usec, L: 0
1117 14:49:41.484013 (+ 146us) write_op.cc:270] Start()
1117 14:49:41.484029 (+ 16us) write_op.cc:276] Timestamp: P: 1794926978830848 usec, L: 0
1117 14:49:41.484127 (+ 98us) write_op.cc:270] Start()
1117 14:49:41.484139 (+ 12us) write_op.cc:276] Timestamp: P: 1794926978831804 usec, L: 0
1117 14:49:41.484227 (+ 88us) write_op.cc:270] Start()
1117 14:49:41.484246 (+ 19us) write_op.cc:276] Timestamp: P: 1794926978854561 usec, L: 0
1117 14:49:41.484348 (+ 102us) write_op.cc:270] Start()
1117 14:49:41.484360 (+ 12us) write_op.cc:276] Timestamp: P: 1794926978858879 usec, L: 0
1117 14:49:41.505196 (+ 20836us) write_op.cc:270] Start()
1117 14:49:41.505228 (+ 32us) write_op.cc:276] Timestamp: P: 1794926978907419 usec, L: 0
1117 14:49:41.512632 (+ 7404us) write_op.cc:270] St
I20261117 14:49:42.156797 6654 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "3cea00abcccd4b1284393ef8b406cab1" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 3 candidate_status { last_received { term: 2 index: 1107 } } ignore_live_leader: false dest_uuid: "c7900e455dd64c68bccfc499bda413f7" is_pre_election: true
I20261117 14:49:42.137179 7444 leader_election.cc:290] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271), def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611)
I20261117 14:49:42.184259 7266 leader_election.cc:304] T 47d9af37b05545f0b5b0c033f4ec953f P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec41d6947a4a4eadadf90c3756899704; no voters: c7900e455dd64c68bccfc499bda413f7, def6b23bccc94a78a47118da331f2798
I20261117 14:49:42.194204 7449 raft_consensus.cc:499] T b74e748e97c84edeabc1c0cb41ddae99 P ec41d6947a4a4eadadf90c3756899704 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c7900e455dd64c68bccfc499bda413f7)
I20261117 14:49:42.196310 7444 raft_consensus.cc:2771] T 47d9af37b05545f0b5b0c033f4ec953f P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20261117 14:49:42.196667 7449 raft_consensus.cc:521] T b74e748e97c84edeabc1c0cb41ddae99 P ec41d6947a4a4eadadf90c3756899704 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:42.197350 7449 leader_election.cc:290] T b74e748e97c84edeabc1c0cb41ddae99 P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271), def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611)
I20261117 14:49:42.199694 6788 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "b74e748e97c84edeabc1c0cb41ddae99" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 3 candidate_status { last_received { term: 2 index: 1024 } } ignore_live_leader: false dest_uuid: "def6b23bccc94a78a47118da331f2798" is_pre_election: true
I20261117 14:49:42.204949 7266 leader_election.cc:304] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec41d6947a4a4eadadf90c3756899704; no voters: c7900e455dd64c68bccfc499bda413f7, def6b23bccc94a78a47118da331f2798
I20261117 14:49:42.224017 6654 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "b74e748e97c84edeabc1c0cb41ddae99" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 3 candidate_status { last_received { term: 2 index: 1024 } } ignore_live_leader: false dest_uuid: "c7900e455dd64c68bccfc499bda413f7" is_pre_election: true
I20261117 14:49:42.232893 7444 raft_consensus.cc:499] T 57984748adc7482a9a2d999a447a81af P ec41d6947a4a4eadadf90c3756899704 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader def6b23bccc94a78a47118da331f2798)
I20261117 14:49:42.234344 7444 raft_consensus.cc:521] T 57984748adc7482a9a2d999a447a81af P ec41d6947a4a4eadadf90c3756899704 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:42.235028 7444 leader_election.cc:290] T 57984748adc7482a9a2d999a447a81af P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271), def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611)
I20261117 14:49:42.235816 6787 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "57984748adc7482a9a2d999a447a81af" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 3 candidate_status { last_received { term: 2 index: 1022 } } ignore_live_leader: false dest_uuid: "def6b23bccc94a78a47118da331f2798" is_pre_election: true
I20261117 14:49:42.233203 7266 leader_election.cc:304] T b74e748e97c84edeabc1c0cb41ddae99 P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec41d6947a4a4eadadf90c3756899704; no voters: c7900e455dd64c68bccfc499bda413f7, def6b23bccc94a78a47118da331f2798
I20261117 14:49:42.247812 6655 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "57984748adc7482a9a2d999a447a81af" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 3 candidate_status { last_received { term: 2 index: 1022 } } ignore_live_leader: false dest_uuid: "c7900e455dd64c68bccfc499bda413f7" is_pre_election: true
I20261117 14:49:42.255322 7266 leader_election.cc:304] T 57984748adc7482a9a2d999a447a81af P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec41d6947a4a4eadadf90c3756899704; no voters: c7900e455dd64c68bccfc499bda413f7, def6b23bccc94a78a47118da331f2798
I20261117 14:49:42.264528 7447 raft_consensus.cc:2771] T 57984748adc7482a9a2d999a447a81af P ec41d6947a4a4eadadf90c3756899704 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20261117 14:49:42.354606 7449 raft_consensus.cc:2771] T 3cea00abcccd4b1284393ef8b406cab1 P ec41d6947a4a4eadadf90c3756899704 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20261117 14:49:42.547886 7449 raft_consensus.cc:499] T d1732d75bf044feb8884fc3135373072 P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7900e455dd64c68bccfc499bda413f7)
I20261117 14:49:42.551646 7449 raft_consensus.cc:521] T d1732d75bf044feb8884fc3135373072 P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:42.554133 7449 leader_election.cc:290] T d1732d75bf044feb8884fc3135373072 P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271), def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611)
I20261117 14:49:42.556849 6655 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "d1732d75bf044feb8884fc3135373072" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 2 candidate_status { last_received { term: 1 index: 1129 } } ignore_live_leader: false dest_uuid: "c7900e455dd64c68bccfc499bda413f7" is_pre_election: true
I20261117 14:49:42.558192 6787 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "d1732d75bf044feb8884fc3135373072" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 2 candidate_status { last_received { term: 1 index: 1129 } } ignore_live_leader: false dest_uuid: "def6b23bccc94a78a47118da331f2798" is_pre_election: true
I20261117 14:49:42.560861 7267 leader_election.cc:304] T d1732d75bf044feb8884fc3135373072 P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec41d6947a4a4eadadf90c3756899704; no voters: c7900e455dd64c68bccfc499bda413f7, def6b23bccc94a78a47118da331f2798
I20261117 14:49:42.561200 7449 raft_consensus.cc:2771] T d1732d75bf044feb8884fc3135373072 P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20261117 14:49:42.586524 7449 raft_consensus.cc:499] T 47d9af37b05545f0b5b0c033f4ec953f P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader def6b23bccc94a78a47118da331f2798)
I20261117 14:49:42.586738 7449 raft_consensus.cc:521] T 47d9af37b05545f0b5b0c033f4ec953f P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:42.587496 7449 leader_election.cc:290] T 47d9af37b05545f0b5b0c033f4ec953f P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271), def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611)
I20261117 14:49:42.587893 6788 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "47d9af37b05545f0b5b0c033f4ec953f" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 2 candidate_status { last_received { term: 1 index: 1021 } } ignore_live_leader: false dest_uuid: "def6b23bccc94a78a47118da331f2798" is_pre_election: true
I20261117 14:49:42.588145 6655 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "47d9af37b05545f0b5b0c033f4ec953f" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 2 candidate_status { last_received { term: 1 index: 1021 } } ignore_live_leader: false dest_uuid: "c7900e455dd64c68bccfc499bda413f7" is_pre_election: true
I20261117 14:49:42.598516 7266 leader_election.cc:304] T 47d9af37b05545f0b5b0c033f4ec953f P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec41d6947a4a4eadadf90c3756899704; no voters: c7900e455dd64c68bccfc499bda413f7, def6b23bccc94a78a47118da331f2798
I20261117 14:49:42.606366 7449 raft_consensus.cc:2771] T 47d9af37b05545f0b5b0c033f4ec953f P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20261117 14:49:42.137167 7341 rpcz_store.cc:276] 1117 14:49:39.819674 (+ 0us) service_pool.cc:167] Inserting onto call queue
1117 14:49:39.819755 (+ 81us) service_pool.cc:224] Handling call
1117 14:49:40.206495 (+386740us) raft_consensus.cc:1481] Updating replica for 237 ops
1117 14:49:40.530846 (+324351us) raft_consensus.cc:1545] Early marking committed up to index 784
1117 14:49:40.530977 (+ 131us) raft_consensus.cc:1550] Triggering prepare for 237 ops
1117 14:49:40.531086 (+ 109us) write_op.cc:270] Start()
1117 14:49:40.531124 (+ 38us) write_op.cc:276] Timestamp: P: 1794926975007227 usec, L: 0
1117 14:49:40.531345 (+ 221us) write_op.cc:270] Start()
1117 14:49:40.531374 (+ 29us) write_op.cc:276] Timestamp: P: 1794926975017170 usec, L: 0
1117 14:49:40.548796 (+ 17422us) write_op.cc:270] Start()
1117 14:49:40.548821 (+ 25us) write_op.cc:276] Timestamp: P: 1794926975019051 usec, L: 0
1117 14:49:40.549026 (+ 205us) write_op.cc:270] Start()
1117 14:49:40.549050 (+ 24us) write_op.cc:276] Timestamp: P: 1794926975099294 usec, L: 0
1117 14:49:40.549226 (+ 176us) write_op.cc:270] Start()
1117 14:49:40.549250 (+ 24us) write_op.cc:276] Timestamp: P: 1794926975100672 usec, L: 0
1117 14:49:40.549430 (+ 180us) write_op.cc:270] Start()
1117 14:49:40.549456 (+ 26us) write_op.cc:276] Timestamp: P: 1794926975123722 usec, L: 0
1117 14:49:40.549627 (+ 171us) write_op.cc:270] Start()
1117 14:49:40.549666 (+ 39us) write_op.cc:276] Timestamp: P: 1794926975124355 usec, L: 0
1117 14:49:40.549839 (+ 173us) write_op.cc:270] Start()
1117 14:49:40.549860 (+ 21us) write_op.cc:276] Timestamp: P: 1794926975142934 usec, L: 0
1117 14:49:40.550064 (+ 204us) write_op.cc:270] Start()
1117 14:49:40.550095 (+ 31us) write_op.cc:276] Timestamp: P: 1794926975169059 usec, L: 0
1117 14:49:40.550245 (+ 150us) write_op.cc:270] Start()
1117 14:49:40.550266 (+ 21us) write_op.cc:276] Timestamp: P: 1794926975171283 usec, L: 0
1117 14:49:40.550445 (+ 179us) write_op.cc:270] Start()
1117 14:49:40.550468 (+ 23us) write_op.cc:276] Timestamp: P: 1794926975172873 usec, L: 0
1117 14:49:40.550661 (+ 193us) write_op.cc:270] Start()
1117 14:49:40.550686 (+ 25us) write_op.cc:276] Timestamp: P: 1794926975200074 usec, L: 0
1117 14:49:40.550853 (+ 167us) write_op.cc:270] Start()
1117 14:49:40.550880 (+ 27us) write_op.cc:276] Timestamp: P: 1794926975258860 usec, L: 0
1117 14:49:40.551058 (+ 178us) write_op.cc:270] Start()
1117 14:49:40.551082 (+ 24us) write_op.cc:276] Timestamp: P: 1794926975263185 usec, L: 0
1117 14:49:40.551256 (+ 174us) write_op.cc:270] Start()
1117 14:49:40.551279 (+ 23us) write_op.cc:276] Timestamp: P: 1794926975293527 usec, L: 0
1117 14:49:40.551414 (+ 135us) write_op.cc:270] Start()
1117 14:49:40.551431 (+ 17us) write_op.cc:276] Timestamp: P: 1794926975333005 usec, L: 0
1117 14:49:40.551599 (+ 168us) write_op.cc:270] Start()
1117 14:49:40.551620 (+ 21us) write_op.cc:276] Timestamp: P: 1794926975350625 usec, L: 0
1117 14:49:40.551786 (+ 166us) write_op.cc:270] Start()
1117 14:49:40.551806 (+ 20us) write_op.cc:276] Timestamp: P: 1794926975362653 usec, L: 0
1117 14:49:40.551996 (+ 190us) write_op.cc:270] Start()
1117 14:49:40.552022 (+ 26us) write_op.cc:276] Timestamp: P: 1794926975363446 usec, L: 0
1117 14:49:40.552188 (+ 166us) write_op.cc:270] Start()
1117 14:49:40.552211 (+ 23us) write_op.cc:276] Timestamp: P: 1794926975391954 usec, L: 0
1117 14:49:40.552370 (+ 159us) write_op.cc:270] Start()
1117 14:49:40.552391 (+ 21us) write_op.cc:276] Timestamp: P: 1794926975426884 usec, L: 0
1117 14:49:40.579650 (+ 27259us) write_op.cc:270] Start()
1117 14:49:40.579677 (+ 27us) write_op.cc:276] Timestamp: P: 1794926975427615 usec, L: 0
1117 14:49:40.643519 (+ 63842us) spinlock_profiling.cc:245] Waited 7.07 ms on lock 0x60f00001a288. stack: 00007f9a08fa33a6 00007f9a08fa3160 00007f9a07f9434d 00007f9a1f567704 00007f9a1f5676cd 00007f9a1f56709a 00007f9a121160b8 00007f9a1505c919 00007f9a15003c49 00007f9a15001417 00007f9a18ed38cd 00007f9a1303bae6 00007f9a1303b815 00007f9a100eb8de 00007f9a100ea7be 00007f9a100f09f8
1117 14:49:40.650883 (+ 7364us) write_op.cc:270] Start()
1117 14:49:40.650900 (+ 17us) write_op.cc:276] Timestamp: P: 1794926975433332 usec, L: 0
1117 14:49:40.651033 (+ 133us) write_op.cc:270] Start()
1117 14:49:40.651050 (+ 17us) write_op.cc:276] Timestamp: P: 1794926975460135 usec, L: 0
1117 14:49:40.683537 (+ 32487us) write_op.cc:270] Start()
1117 14:49:40.683569 (+ 32us) write_op.cc:276] Timestamp: P: 1794926975471803 usec, L: 0
1117 14:49:40.683748 (+ 179us) write_op.cc:270] Start()
1117 14:49:40.683771 (+ 23us) write_op.cc:276] Timestamp: P: 1794926975472474 usec, L: 0
1117 14:49:40.690923 (+ 7152us) write_op.cc:270] Start()
1117 14:49:40.690962 (+ 39us) write_op.cc:276] Timestamp: P: 1794926975512806 usec, L: 0
1117 14:49:40.698769 (+ 7807us) write_op.cc:270] Start()
1117 14:49:40.698804 (+ 35us) write_op.cc:276] Timestamp: P: 1794926975528937 usec, L: 0
1117 14:49:40.707094 (+ 8290us) write_op.cc:270] Start()
1117 14:49:40.707120 (+ 26us) write_op.cc:276] Timestamp: P: 1794926975572424 usec, L: 0
1117 14:49:40.710182 (+ 3062us) write_op.cc:270] Start()
1117 14:49:40.710202 (+ 20us) write_op.cc:276] Timestamp: P: 1794926975585711 usec, L: 0
1117 14:49:40.710329 (+ 127us) write_op.cc:270] Start()
1117 14:49:40.710347 (+ 18us) write_op.cc:276] Timestamp: P: 1794926975604870 usec, L: 0
1117 14:49:40.710466 (+ 119us) write_op.cc:270] Start()
1117 14:49:40.710484 (+ 18us) write_op.cc:276] Timestamp: P: 1794926975624160 usec, L: 0
1117 14:49:40.717280 (+ 6796us) write_op.cc:270] Start()
1117 14:49:40.717303 (+ 23us) write_op.cc:276] Timestamp: P: 1794926975639231 usec, L: 0
1117 14:49:40.725936 (+ 8633us) write_op.cc:270] Start()
1117 14:49:40.725960 (+ 24us) write_op.cc:276] Timestamp: P: 1794926975665269 usec, L: 0
1117 14:49:40.765029 (+ 39069us) write_op.cc:270] Start()
1117 14:49:40.765056 (+ 27us) write_op.cc:276] Timestamp: P: 1794926975667738 usec, L: 0
1117 14:49:40.769336 (+ 4280us) write_op.cc:270] Start()
1117 14:49:40.769366 (+ 30us) write_op.cc:276] Timestamp: P: 1794926975678783 usec, L: 0
1117 14:49:40.781064 (+ 11698us) write_op.cc:270] Start()
1117 14:49:40.781086 (+ 22us) write_op.cc:276] Timestamp: P: 1794926975682297 usec, L: 0
1117 14:49:40.781249 (+ 163us) write_op.cc:270] Start()
1117 14:49:40.781269 (+ 20us) write_op.cc:276] Timestamp: P: 1794926975711868 usec, L: 0
1117 14:49:40.781429 (+ 160us) write_op.cc:270] Start()
1117 14:49:40.781448 (+ 19us) write_op.cc:276] Timestamp: P: 1794926975750890 usec, L: 0
1117 14:49:40.782638 (+ 1190us) write_op.cc:270] Start()
1117 14:49:40.782658 (+ 20us) write_op.cc:276] Timestamp: P: 1794926975759983 usec, L: 0
1117 14:49:40.867628 (+ 84970us) write_op.cc:270] Start()
1117 14:49:40.867655 (+ 27us) write_op.cc:276] Timestamp: P: 1794926975781106 usec, L: 0
1117 14:49:40.867809 (+ 154us) write_op.cc:270] Start()
1117 14:49:40.867828 (+ 19us) write_op.cc:276] Timestamp: P: 1794926975801993 usec, L: 0
1117 14:49:40.875172 (+ 7344us) write_op.cc:270] Start()
1117 14:49:40.875198 (+ 26us) write_op.cc:276] Timestamp: P: 1794926975827074 usec, L: 0
1117 14:49:40.878082 (+ 2884us) write_op.cc:270] Start()
1117 14:49:40.878105 (+ 23us) write_op.cc:276] Timestamp: P: 1794926975847905 usec, L: 0
1117 14:49:40.878266 (+ 161us) write_op.cc:270] Start()
1117 14:49:40.878290 (+ 24us) write_op.cc:276] Timestamp: P: 1794926975850554 usec, L: 0
1117 14:49:40.888946 (+ 10656us) write_op.cc:270] Start()
1117 14:49:40.888977 (+ 31us) write_op.cc:276] Timestamp: P: 1794926975851217 usec, L: 0
1117 14:49:40.889152 (+ 175us) write_op.cc:270] Start()
1117 14:49:40.889175 (+ 23us) write_op.cc:276] Timestamp: P: 1794926975892841 usec, L: 0
1117 14:49:40.890729 (+ 1554us) write_op.cc:270] Start()
1117 14:49:40.890755 (+ 26us) write_op.cc:276] Timestamp: P: 1794926975901444 usec, L: 0
1117 14:49:40.890940 (+ 185us) write_op.cc:270] Start()
1117 14:49:40.890963 (+ 23us) write_op.cc:276] Timestamp: P: 1794926975933593 usec, L: 0
1117 14:49:40.893729 (+ 2766us) write_op.cc:270] Start()
1117 14:49:40.893760 (+ 31us) write_op.cc:276] Timestamp: P: 1794926975961875 usec, L: 0
1117 14:49:40.928603 (+ 34843us) write_op.cc:270] Start()
1117 14:49:40.928636 (+ 33us) write_op.cc:276] Timestamp: P: 1794926975975803 usec, L: 0
1117 14:49:40.942739 (+ 14103us) write_op.cc:270] Start()
1117 14:49:40.942770 (+ 31us) write_op.cc:276] Timestamp: P: 1794926976011339 usec, L: 0
1117 14:49:40.976533 (+ 33763us) write_op.cc:270] Start()
1117 14:49:40.976567 (+ 34us) write_op.cc:276] Timestamp: P: 1794926976014665 usec, L: 0
1117 14:49:40.979180 (+ 2613us) write_op.cc:270] Start()
1117 14:49:40.979209 (+ 29us) write_op.cc:276] Timestamp: P: 1794926976015639 usec, L: 0
1117 14:49:41.031020 (+ 51811us) write_op.cc:270] Start()
1117 14:49:41.031073 (+ 53us) write_op.cc:276] Timestamp: P: 1794926976043405 usec, L: 0
1117 14:49:41.042707 (+ 11634us) write_op.cc:270] Start()
1117 14:49:41.042732 (+ 25us) write_op.cc:276] Timestamp: P: 1794926976081608 usec, L: 0
1117 14:49:41.061950 (+ 19218us) write_op.cc:270] Start()
1117 14:49:41.061978 (+ 28us) write_op.cc:276] Timestamp: P: 1794926976082528 usec, L: 0
1117 14:49:41.064994 (+ 3016us) write_op.cc:270] Start()
1117 14:49:41.065021 (+ 27us) write_op.cc:276] Timestamp: P: 1794926976115901 usec, L: 0
1117 14:49:41.067297 (+ 2276us) write_op.cc:270] Start()
1117 14:49:41.067324 (+ 27us) write_op.cc:276] Timestamp: P: 1794926976154617 usec, L: 0
1117 14:49:41.073194 (+ 5870us) write_op.cc:270] Start()
1117 14:49:41.073219 (+ 25us) write_op.cc:276] Timestamp: P: 1794926976182390 usec, L: 0
1117 14:49:41.087785 (+ 14566us) write_op.cc:270] Start()
1117 14:49:41.087809 (+ 24us) write_op.cc:276] Timestamp: P: 1794926976216739 usec, L: 0
1117 14:49:41.099911 (+ 12102us) write_op.cc:270] Start()
1117 14:49:41.099938 (+ 27us) write_op.cc:276] Timestamp: P: 1794926976227461 usec, L: 0
1117 14:49:41.110606 (+ 10668us) write_op.cc:270] Start()
1117 14:49:41.110635 (+ 29us) write_op.cc:276] Timestamp: P: 1794926976241638 usec, L: 0
1117 14:49:41.112014 (+ 1379us) write_op.cc:270] Start()
1117 14:49:41.112041 (+ 27us) write_op.cc:276] Timestamp: P: 1794926976264390 usec, L: 0
1117 14:49:41.123640 (+ 11599us) write_op.cc:270] Start()
1117 14:49:41.123667 (+ 27us) write_op.cc:276] Timestamp: P: 1794926976265465 usec, L: 0
1117 14:49:41.126128 (+ 2461us) write_op.cc:270] Start()
1117 14:49:41.126150 (+ 22us) write_op.cc:276] Timestamp: P: 1794926976296712 usec, L: 0
1117 14:49:41.127080 (+ 930us) write_op.cc:270] Start()
1117 14:49:41.127111 (+ 31us) write_op.cc:276] Timestamp: P: 1794926976312847 usec, L: 0
1117 14:49:41.139258 (+ 12147us) write_op.cc:270] Start()
1117 14:49:41.139286 (+ 28us) write_op.cc:276] Timestamp: P: 1794926976313396 usec, L: 0
1117 14:49:41.139479 (+ 193us) write_op.cc:270] Start()
1117 14:49:41.139501 (+ 22us) write_op.cc:276] Timestamp: P: 1794926976343745 usec, L: 0
1117 14:49:41.157811 (+ 18310us) write_op.cc:270] Start()
1117 14:49:41.157845 (+ 34us) write_op.cc:276] Timestamp: P: 1794926976347349 usec, L: 0
1117 14:49:41.158031 (+ 186us) write_op.cc:270] Start()
1117 14:49:41.158054 (+ 23us) write_op.cc:276] Timestamp: P: 1794926976364486 usec, L: 0
1117 14:49:41.158193 (+ 139us) write_op.cc:270] Start()
1117 14:49:41.158211 (+ 18us) write_op.cc:276] Timestamp: P: 1794926976399710 usec, L: 0
1117 14:49:41.170767 (+ 12556us) write_op.cc:270] Start()
1117 14:49:41.170796 (+ 29us) write_op.cc:276] Timestamp: P: 1794926976407307 usec, L: 0
1117 14:49:41.170985 (+ 189us) write_op.cc:270] Start()
1117 14:49:41.171008 (+ 23us) write_op.cc:276] Timestamp: P: 1794926976415472 usec, L: 0
1117 14:49:41.188533 (+ 17525us) write_op.cc:270] Start()
1117 14:49:41.188565 (+ 32us) write_op.cc:276] Timestamp: P: 1794926976466230 usec, L: 0
1117 14:49:41.202027 (+ 13462us) write_op.cc:270] Start()
1117 14:49:41.202054 (+ 27us) write_op.cc:276] Timestamp: P: 1794926976486877 usec, L: 0
1117 14:49:41.202222 (+ 168us) write_op.cc:270] Start()
1117 14:49:41.202241 (+ 19us) write_op.cc:276] Timestamp: P: 1794926976509296 usec, L: 0
1117 14:49:41.202387 (+ 146us) write_op.cc:270] Start()
1117 14:49:41.202411 (+ 24us) write_op.cc:276] Timestamp: P: 1794926976513915 usec, L: 0
1117 14:49:41.204126 (+ 1715us) write_op.cc:270] Start()
1117 14:49:41.204148 (+ 22us) write_op.cc:276] Timestamp: P: 1794926976531610 usec, L: 0
1117 14:49:41.237490 (+ 33342us) write_op.cc:270] Start()
1117 14:49:41.237512 (+ 22us) write_op.cc:276] Timestamp: P: 1794926976551056 usec, L: 0
1117 14:49:41.257617 (+ 20105us) write_op.cc:270] Start()
1117 14:49:41.257646 (+ 29us) write_op.cc:276] Timestamp: P: 1794926976575499 usec, L: 0
1117 14:49:41.275295 (+ 17649us) write_op.cc:270] Start()
1117 14:49:41.275324 (+ 29us) write_op.cc:276] Timestamp: P: 1794926976589628 usec, L: 0
1117 14:49:41.275517 (+ 193us) write_op.cc:270] Start()
1117 14:49:41.275541 (+ 24us) write_op.cc:276] Timestamp: P: 1794926976604625 usec, L: 0
1117 14:49:41.275697 (+ 156us) write_op.cc:270] Start()
1117 14:49:41.275717 (+ 20us) write_op.cc:276] Timestamp: P: 1794926976632496 usec, L: 0
1117 14:49:41.275864 (+ 147us) write_op.cc:270] Start()
1117 14:49:41.275883 (+ 19us) write_op.cc:276] Timestamp: P: 1794926976649018 usec, L: 0
1117 14:49:41.276041 (+ 158us) write_op.cc:270] Start()
1117 14:49:41.276062 (+ 21us) write_op.cc:276] Timestamp: P: 1794926976667441 usec, L: 0
1117 14:49:41.276219 (+ 157us) write_op.cc:270] Start()
1117 14:49:41.276239 (+ 20us) write_op.cc:276] Timestamp: P: 1794926976692490 usec, L: 0
1117 14:49:41.276378 (+ 139us) write_op.cc:270] Start()
1117 14:49:41.276397 (+ 19us) write_op.cc:276] Timestamp: P: 1794926976724716 usec, L: 0
1117 14:49:41.276609 (+ 212us) write_op.cc:270] Start()
1117 14:49:41.276631 (+ 22us) write_op.cc:276] Timestamp: P: 1794926976730799 usec, L: 0
1117 14:49:41.276784 (+ 153us) write_op.cc:270] Start()
1117 14:49:41.276809 (+ 25us) write_op.cc:276] Timestamp: P: 1794926976733600 usec, L: 0
1117 14:49:41.278666 (+ 1857us) write_op.cc:270] Start()
1117 14:49:41.278719 (+ 53us) write_op.cc:276] Timestamp: P: 1794926976746878 usec, L: 0
1117 14:49:41.281945 (+ 3226us) write_op.cc:270] Start()
1117 14:49:41.281971 (+ 26us) write_op.cc:276] Timestamp: P: 1794926976784933 usec, L: 0
1117 14:49:41.283110 (+ 1139us) write_op.cc:270] Start()
1117 14:49:41.283138 (+ 28us) write_op.cc:276] Timestamp: P: 1794926976816636 usec, L: 0
1117 14:49:41.287128 (+ 3990us) write_op.cc:270] Start()
1117 14:49:41.287152 (+ 24us) write_op.cc:276] Timestamp: P: 1794926976837870 usec, L: 0
1117 14:49:41.287318 (+ 166us) write_op.cc:270] Start()
1117 14:49:41.287337 (+ 19us) write_op.cc:276] Timestamp: P: 1794926976838517 usec, L: 0
1117 14:49:41.287489 (+ 152us) write_op.cc:270] Start()
1117 14:49:41.287510 (+ 21us) write_op.cc:276] Timestamp: P: 1794926976856458 usec, L: 0
1117 14:49:41.287666 (+ 156us) write_op.cc:270] Start()
1117 14:49:41.287686 (+ 20us) write_op.cc:276] Timestamp: P: 1794926976907165 usec, L: 0
1117 14:49:41.287844 (+ 158us) write_op.cc:270] Start()
1117 14:49:41.287865 (+ 21us) write_op.cc:276] Timestamp: P: 1794926976914218 usec, L: 0
1117 14:49:41.288020 (+ 155us) write_op.cc:270] Start()
1117 14:49:41.288041 (+ 21us) write_op.cc:276] Timestamp: P: 1794926976917116 usec, L: 0
1117 14:49:41.288182 (+ 141us) write_op.cc:270] Start()
1117 14:49:41.288200 (+ 18us) write_op.cc:276] Timestamp: P: 1794926976918216 usec, L: 0
1117 14:49:41.288339 (+ 139us) write_op.cc:270] Start()
1117 14:49:41.288359 (+ 20us) write_op.cc:276] Timestamp: P: 1794926976972006 usec, L: 0
1117 14:49:41.288571 (+ 212us) write_op.cc:270] Start()
1117 14:49:41.288597 (+ 26us) write_op.cc:276] Timestamp: P: 1794926976981467 usec, L: 0
1117 14:49:41.288764 (+ 167us) write_op.cc:270] Start()
1117 14:49:41.288785 (+ 21us) write_op.cc:276] Timestamp: P: 1794926976988706 usec, L: 0
1117 14:49:41.288947 (+ 162us) write_op.cc:270] Start()
1117 14:49:41.288970 (+ 23us) write_op.cc:276] Timestamp: P: 1794926976991674 usec, L: 0
1117 14:49:41.332715 (+ 43745us) write_op.cc:270] Start()
1117 14:49:41.332741 (+ 26us) write_op.cc:276] Timestamp: P: 1794926977030227 usec, L: 0
1117 14:49:41.340007 (+ 7266us) write_op.cc:270] Start()
1117 14:49:41.340032 (+ 25us) write_op.cc:276] Timestamp: P: 1794926977042046 usec, L: 0
1117 14:49:41.342612 (+ 2580us) write_op.cc:270] Start()
1117 14:49:41.342638 (+ 26us) write_op.cc:276] Timestamp: P: 1794926977059799 usec, L: 0
1117 14:49:41.342803 (+ 165us) write_op.cc:270] Start()
1117 14:49:41.342825 (+ 22us) write_op.cc:276] Timestamp: P: 1794926977061492 usec, L: 0
1117 14:49:41.342979 (+ 154us) write_op.cc:270] Start()
1117 14:49:41.343002 (+ 23us) write_op.cc:276] Timestamp: P: 1794926977109354 usec, L: 0
1117 14:49:41.343155 (+ 153us) write_op.cc:270] Start()
1117 14:49:41.343177 (+ 22us) write_op.cc:276] Timestamp: P: 1794926977139201 usec, L: 0
1117 14:49:41.343346 (+ 169us) write_op.cc:270] Start()
1117 14:49:41.343368 (+ 22us) write_op.cc:276] Timestamp: P: 1794926977149065 usec, L: 0
1117 14:49:41.343546 (+ 178us) write_op.cc:270] Start()
1117 14:49:41.343568 (+ 22us) write_op.cc:276] Timestamp: P: 1794926977175723 usec, L: 0
1117 14:49:41.343742 (+ 174us) write_op.cc:270] Start()
1117 14:49:41.343766 (+ 24us) write_op.cc:276] Timestamp: P: 1794926977192840 usec, L: 0
1117 14:49:41.343920 (+ 154us) write_op.cc:270] Start()
1117 14:49:41.343942 (+ 22us) write_op.cc:276] Timestamp: P: 1794926977195007 usec, L: 0
1117 14:49:41.344110 (+ 168us) write_op.cc:270] Start()
1117 14:49:41.344131 (+ 21us) write_op.cc:276] Timestamp: P: 1794926977240787 usec, L: 0
1117 14:49:41.344281 (+ 150us) write_op.cc:270] Start()
1117 14:49:41.344300 (+ 19us) write_op.cc:276] Timestamp: P: 1794926977242135 usec, L: 0
1117 14:49:41.344432 (+ 132us) write_op.cc:270] Start()
1117 14:49:41.344477 (+ 45us) write_op.cc:276] Timestamp: P: 1794926977247281 usec, L: 0
1117 14:49:41.344640 (+ 163us) write_op.cc:270] Start()
1117 14:49:41.344660 (+ 20us) write_op.cc:276] Timestamp: P: 1794926977277053 usec, L: 0
1117 14:49:41.344823 (+ 163us) write_op.cc:270] Start()
1117 14:49:41.344847 (+ 24us) write_op.cc:276] Timestamp: P: 1794926977296789 usec, L: 0
1117 14:49:41.344998 (+ 151us) write_op.cc:270] Start()
1117 14:49:41.345023 (+ 25us) write_op.cc:276] Timestamp: P: 1794926977317162 usec, L: 0
1117 14:49:41.369395 (+ 24372us) write_op.cc:270] Start()
1117 14:49:41.369418 (+ 23us) write_op.cc:276] Timestamp: P: 1794926977338080 usec, L: 0
1117 14:49:41.370852 (+ 1434us) write_op.cc:270] Start()
1117 14:49:41.370873 (+ 21us) write_op.cc:276] Timestamp: P: 1794926977356467 usec, L: 0
1117 14:49:41.385965 (+ 15092us) write_op.cc:270] Start()
1117 14:49:41.385985 (+ 20us) write_op.cc:276] Timestamp: P: 1794926977391466 usec, L: 0
1117 14:49:41.386144 (+ 159us) write_op.cc:270] Start()
1117 14:49:41.386163 (+ 19us) write_op.cc:276] Timestamp: P: 1794926977436014 usec, L: 0
1117 14:49:41.386347 (+ 184us) write_op.cc:270] Start()
1117 14:49:41.386369 (+ 22us) write_op.cc:276] Timestamp: P: 1794926977436938 usec, L: 0
1117 14:49:41.386545 (+ 176us) write_op.cc:270] Start()
1117 14:49:41.386585 (+ 40us) write_op.cc:276] Timestamp: P: 1794926977438770 usec, L: 0
1117 14:49:41.386742 (+ 157us) write_op.cc:270] Start()
1117 14:49:41.386764 (+ 22us) write_op.cc:276] Timestamp: P: 1794926977474089 usec, L: 0
1117 14:49:41.386915 (+ 151us) write_op.cc:270] Start()
1117 14:49:41.386935 (+ 20us) write_op.cc:276] Timestamp: P: 1794926977488645 usec, L: 0
1117 14:49:41.387106 (+ 171us) write_op.cc:270] Start()
1117 14:49:41.387128 (+ 22us) write_op.cc:276] Timestamp: P: 1794926977516645 usec, L: 0
1117 14:49:41.395113 (+ 7985us) write_op.cc:270] Start()
1117 14:49:41.395144 (+ 31us) write_op.cc:276] Timestamp: P: 1794926977526231 usec, L: 0
1117 14:49:41.422235 (+ 27091us) write_op.cc:270] Start()
1117 14:49:41.422270 (+ 35us) write_op.cc:276] Timestamp: P: 1794926977560774 usec, L: 0
1117 14:49:41.434905 (+ 12635us) write_op.cc:270] Start()
1117 14:49:41.434925 (+ 20us) write_op.cc:276] Timestamp: P: 1794926977592796 usec, L: 0
1117 14:49:41.435094 (+ 169us) write_op.cc:270] Start()
1117 14:49:41.435114 (+ 20us) write_op.cc:276] Timestamp: P: 1794926977607241 usec, L: 0
1117 14:49:41.446647 (+ 11533us) write_op.cc:270] Start()
1117 14:49:41.446674 (+ 27us) write_op.cc:276] Timestamp: P: 1794926977632135 usec, L: 0
1117 14:49:41.450678 (+ 4004us) write_op.cc:270] Start()
1117 14:49:41.450705 (+ 27us) write_op.cc:276] Timestamp: P: 1794926977656154 usec, L: 0
1117 14:49:41.452162 (+ 1457us) write_op.cc:270] Start()
1117 14:49:41.452189 (+ 27us) write_op.cc:276] Timestamp: P: 1794926977695465 usec, L: 0
1117 14:49:41.458661 (+ 6472us) write_op.cc:270] Start()
1117 14:49:41.458681 (+ 20us) write_op.cc:276] Timestamp: P: 1794926977727157 usec, L: 0
1117 14:49:41.458849 (+ 168us) write_op.cc:270] Start()
1117 14:49:41.458866 (+ 17us) write_op.cc:276] Timestamp: P: 1794926977728722 usec, L: 0
1117 14:49:41.458982 (+ 116us) write_op.cc:270] Start()
1117 14:49:41.458998 (+ 16us) write_op.cc:276] Timestamp: P: 1794926977757524 usec, L: 0
1117 14:49:41.485921 (+ 26923us) write_op.cc:270] Start()
1117 14:49:41.486254 (+ 333us) write_op.cc:276] Timestamp: P: 1794926977779810 usec, L: 0
1117 14:49:41.486427 (+ 173us) write_op.cc:270] Start()
1117 14:49:41.486450 (+ 23us) write_op.cc:276] Timestamp: P: 1794926977800748 usec, L: 0
1117 14:49:41.486621 (+ 171us) write_op.cc:270] Start()
1117 14:49:41.486642 (+ 21us) write_op.cc:276] Timestamp: P: 1794926977826094 usec, L: 0
1117 14:49:41.486818 (+ 176us) write_op.cc:270] Start()
1117 14:49:41.486841 (+ 23us) write_op.cc:276] Timestamp: P: 1794926977831106 usec, L: 0
1117 14:49:41.487012 (+ 171us) write_op.cc:270] Start()
1117 14:49:41.487034 (+ 22us) write_op.cc:276] Timestamp: P: 1794926977861239 usec, L: 0
1117 14:49:41.487192 (+ 158us) write_op.cc:270] Start()
1117 14:49:41.487210 (+ 18us) write_op.cc:276] Timestamp: P: 1794926977885981 usec, L: 0
1117 14:49:41.487352 (+ 142us) write_op.cc:270] Start()
1117 14:49:41.487371 (+ 19us) write_op.cc:276] Timestamp: P: 1794926977911180 usec, L: 0
1117 14:49:41.487524 (+ 153us) write_op.cc:270] Start()
1117 14:49:41.487544 (+ 20us) write_op.cc:276] Timestamp: P: 1794926977930052 usec, L: 0
1117 14:49:41.487684 (+ 140us) write_op.cc:270] Start()
1117 14:49:41.487703 (+ 19us) write_op.cc:276] Timestamp: P: 1794926977941678 usec, L: 0
1117 14:49:41.487845 (+ 142us) write_op.cc:270] Start()
1117 14:49:41.487869 (+ 24us) write_op.cc:276] Timestamp: P: 1794926977988027 usec, L: 0
1117 14:49:41.488012 (+ 143us) write_op.cc:270] Start()
1117 14:49:41.488032 (+ 20us) write_op.cc:276] Timestamp: P: 1794926977992576 usec, L: 0
1117 14:49:41.488188 (+ 156us) write_op.cc:270] Start()
1117 14:49:41.488208 (+ 20us) write_op.cc:276] Timestamp: P: 1794926978016971 usec, L: 0
1117 14:49:41.488345 (+ 137us) write_op.cc:270] Start()
1117 14:49:41.488364 (+ 19us) write_op.cc:276] Timestamp: P: 1794926978028578 usec, L: 0
1117 14:49:41.488559 (+ 195us) write_op.cc:270] Start()
1117 14:49:41.488586 (+ 27us) write_op.cc:276] Timestamp: P: 1794926978038998 usec, L: 0
1117 14:49:41.488728 (+ 142us) write_op.cc:270] Start()
1117 14:49:41.488747 (+ 19us) write_op.cc:276] Timestamp: P: 1794926978044586 usec, L: 0
1117 14:49:41.508267 (+ 19520us) write_op.cc:270] Start()
1117 14:49:41.508294 (+ 27us) write_op.cc:276] Timestamp: P: 1794926978076903 usec, L: 0
1117 14:49:41.515284 (+ 6990us) write_op.cc:270] Start()
1117 14:49:41.515312 (+ 28us) write_op.cc:276] Timestamp: P: 1794926978102815 usec, L: 0
1117 14:49:41.515524 (+ 212us) write_op.cc:270] Start()
1117 14:49:41.515546 (+ 22us) write_op.cc:276] Timestamp: P: 1794926978110680 usec, L: 0
1117 14:49:41.515701 (+ 155us) write_op.cc:270] Start()
1117 14:49:41.515722 (+ 21us) write_op.cc:276] Timestamp: P: 1794926978144502 usec, L: 0
1117 14:49:41.515871 (+ 149us) write_op.cc:270] Start()
1117 14:49:41.515892 (+ 21us) write_op.cc:276] Timestamp: P: 1794926978169360 usec, L: 0
1117 14:49:41.516046 (+ 154us) write_op.cc:270] Start()
1117 14:49:41.516385 (+ 339us) write_op.cc:276] Timestamp: P: 1794926978204433 usec, L: 0
1117 14:49:41.516608 (+ 223us) write_op.cc:270] Start()
1117 14:49:41.516639 (+ 31us) write_op.cc:276] Timestamp: P: 1794926978205197 usec, L: 0
1117 14:49:41.516837 (+ 198us) write_op.cc:270] Start()
1117 14:49:41.516859 (+ 22us) write_op.cc:276] Timestamp: P: 1794926978236586 usec, L: 0
1117 14:49:41.517595 (+ 736us) write_op.cc:270] Start()
1117 14:49:41.517622 (+ 27us) write_op.cc:276] Timestamp: P: 1794926978238542 usec, L: 0
1117 14:49:41.517816 (+ 194us) write_op.cc:270] Start()
1117 14:49:41.517839 (+ 23us) write_op.cc:276] Timestamp: P: 1794926978265817 usec, L: 0
1117 14:49:41.518050 (+ 211us) write_op.cc:270] Start()
1117 14:49:41.518165 (+ 115us) write_op.cc:276] Timestamp: P: 1794926978308081 usec, L: 0
1117 14:49:41.518385 (+ 220us) write_op.cc:270] Start()
1117 14:49:41.518410 (+ 25us) write_op.cc:276] Timestamp: P: 1794926978308965 usec, L: 0
1117 14:49:41.518583 (+ 173us) write_op.cc:270] Start()
1117 14:49:41.518610 (+ 27us) write_op.cc:276] Timestamp: P: 1794926978313722 usec, L: 0
1117 14:49:41.520278 (+ 1668us) write_op.cc:270] Start()
1117 14:49:41.528765 (+ 8487us) write_op.cc:276] Timestamp: P: 1794926978363632 usec, L: 0
1117 14:49:41.559996 (+ 31231us) write_op.cc:270] Start()
1117 14:49:41.560042 (+ 46us) write_op.cc:276] Timestamp: P: 1794926978387172 usec, L: 0
1117 14:49:41.564019 (+ 3977us) write_op.cc:270] Start()
1117 14:49:41.564044 (+ 25us) write_op.cc:276] Timestamp: P: 1794926978416698 usec, L: 0
1117 14:49:41.564359 (+ 315us) write_op.cc:270] Start()
1117 14:49:41.564387 (+ 28us) write_op.cc:276] Timestamp: P: 1794926978417405 usec, L: 0
1117 14:49:41.579578 (+ 15191us) write_op.cc:270] Start()
1117 14:49:41.579609 (+ 31us) write_op.cc:276] Timestamp: P: 1794926978422239 usec, L: 0
1117 14:49:41.586988 (+ 7379us) write_op.cc:270] Start()
1117 14:49:41.587018 (+ 30us) write_op.cc:276] Timestamp: P: 1794926978446843 usec, L: 0
1117 14:49:41.596130 (+ 9112us) write_op.cc:270] Start()
1117 14:49:41.596162 (+ 32us) write_op.cc:276] Timestamp: P: 1794926978466679 usec, L: 0
1117 14:49:41.598225 (+ 2063us) write_op.cc:270] Start()
1117 14:49:41.598257 (+ 32us) write_op.cc:276] Timestamp: P: 1794926978477390 usec, L: 0
1117 14:49:41.619256 (+ 20999us) write_op.cc:270] Start()
1117 14:49:41.619292 (+ 36us) write_op.cc:276] Timestamp: P: 1794926978501160 usec, L: 0
1117 14:49:41.619535 (+ 243us) write_op.cc:270] Start()
1117 14:49:41.619558 (+ 23us) write_op.cc:276] Timestamp: P: 1794926978506304 usec, L: 0
1117 14:49:41.623510 (+ 3952us) write_op.cc:270] Start()
1117 14:49:41.623539 (+ 29us) write_op.cc:276] Timestamp: P: 1794926978532869 usec, L: 0
1117 14:49:41.644318 (+ 20779us) write_op.cc:270] Start()
1117 14:49:41.644349 (+ 31us) write_op.cc:276] Timestamp: P: 1794926978578426 usec, L: 0
1117 14:49:41.648233 (+ 3884us) write_op.cc:270] Start()
1117 14:49:41.648257 (+ 24us) write_op.cc:276] Timestamp: P: 1794926978584759 usec, L: 0
1117 14:49:41.651846 (+ 3589us) write_op.cc:270] Start()
1117 14:49:41.651877 (+ 31us) write_op.cc:276] Timestamp: P: 1794926978609827 usec, L: 0
1117 14:49:41.667413 (+ 15536us) write_op.cc:270] Start()
1117 14:49:41.667455 (+ 42us) write_op.cc:276] Timestamp: P: 1794926978639727 usec, L: 0
1117 14:49:41.667671 (+ 216us) write_op.cc:270] Start()
1117 14:49:41.667696 (+ 25us) write_op.cc:276] Timestamp: P: 1794926978654878 usec, L: 0
1117 14:49:41.667856 (+ 160us) write_op.cc:270] Start()
1117 14:49:41.667908 (+ 52us) write_op.cc:276] Timestamp: P: 1794926978659801 usec, L: 0
1117 14:49:41.668160 (+ 252us) write_op.cc:270] Start()
1117 14:49:41.668188 (+ 28us) write_op.cc:276] Timestamp: P: 1794926978696502 usec, L: 0
1117 14:49:41.668384 (+ 196us) write_op.cc:270] Start()
1117 14:49:41.668410 (+ 26us) write_op.cc:276] Timestamp: P: 1794926978729114 usec, L: 0
1117 14:49:41.668621 (+ 211us) write_op.cc:270] Start()
1117 14:49:41.668654 (+ 33us) write_op.cc:276] Timestamp: P: 1794926978738108 usec, L: 0
1117 14:49:41.668813 (+ 159us) write_op.cc:270] Start()
1117 14:49:41.668836 (+ 23us) write_op.cc:276] Timestamp: P: 1794926978769465 usec, L: 0
1117 14:49:41.669015 (+ 179us) write_op.cc:270] Start()
1117 14:49:41.669040 (+ 25us) write_op.cc:276] Timestamp: P: 1794926978777268 usec, L: 0
1117 14:49:41.669216 (+ 176us) write_op.cc:270] Start()
1117 14:49:41.669239 (+ 23us) write_op.cc:276] Timestamp: P: 1794926978815330 usec, L: 0
1117 14:49:41.669423 (+ 184us) write_op.cc:270] Start()
1117 14:49:41.669458 (+ 35us) write_op.cc:276] Timestamp: P: 1794926978849300 usec, L: 0
1117 14:49:41.669675 (+ 217us) write_op.cc:270] Start()
1117 14:49:41.669698 (+ 23us) write_op.cc:276] Timestamp: P: 1794926978869806 usec, L: 0
1117 14:49:41.669854 (+ 156us) write_op.cc:270] Start()
1117 14:49:41.669879 (+ 25us) write_op.cc:276] Timestamp: P: 1794926978874755 usec, L: 0
1117 14:49:41.670101 (+ 222us) write_op.cc:270] Start()
1117 14:49:41.670127 (+ 26us) write_op.cc:276] Timestamp: P: 1794926978909705 usec, L: 0
1117 14:49:41.670293 (+ 166us) write_op.cc:270]
I20261117 14:49:43.104280 7444 raft_consensus.cc:2771] T b74e748e97c84edeabc1c0cb41ddae99 P ec41d6947a4a4eadadf90c3756899704 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20261117 14:49:43.120465 7449 raft_consensus.cc:499] T 57984748adc7482a9a2d999a447a81af P ec41d6947a4a4eadadf90c3756899704 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader def6b23bccc94a78a47118da331f2798)
I20261117 14:49:43.120700 7449 raft_consensus.cc:521] T 57984748adc7482a9a2d999a447a81af P ec41d6947a4a4eadadf90c3756899704 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:43.121567 7449 leader_election.cc:290] T 57984748adc7482a9a2d999a447a81af P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271), def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611)
I20261117 14:49:43.122661 6654 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "57984748adc7482a9a2d999a447a81af" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 3 candidate_status { last_received { term: 2 index: 1138 } } ignore_live_leader: false dest_uuid: "c7900e455dd64c68bccfc499bda413f7" is_pre_election: true
I20261117 14:49:43.123421 6787 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "57984748adc7482a9a2d999a447a81af" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 3 candidate_status { last_received { term: 2 index: 1138 } } ignore_live_leader: false dest_uuid: "def6b23bccc94a78a47118da331f2798" is_pre_election: true
I20261117 14:49:43.129405 7267 leader_election.cc:304] T 57984748adc7482a9a2d999a447a81af P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec41d6947a4a4eadadf90c3756899704; no voters: c7900e455dd64c68bccfc499bda413f7, def6b23bccc94a78a47118da331f2798
I20261117 14:49:43.129952 7449 raft_consensus.cc:2771] T 57984748adc7482a9a2d999a447a81af P ec41d6947a4a4eadadf90c3756899704 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20261117 14:49:43.169669 7340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.6.50.131:58395 (request call id 8) took 1031 ms. Trace:
I20261117 14:49:43.187553 7447 raft_consensus.cc:499] T 5c849aa2a21a4c13b2e31d2ca3f692cc P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7900e455dd64c68bccfc499bda413f7)
I20261117 14:49:43.187778 7447 raft_consensus.cc:521] T 5c849aa2a21a4c13b2e31d2ca3f692cc P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:43.188776 7408 heartbeater.cc:500] Master 127.6.50.190:39807 was elected leader, sending a full tablet report...
I20261117 14:49:43.188941 7447 leader_election.cc:290] T 5c849aa2a21a4c13b2e31d2ca3f692cc P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271), def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611)
I20261117 14:49:43.189715 6787 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5c849aa2a21a4c13b2e31d2ca3f692cc" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 2 candidate_status { last_received { term: 1 index: 1129 } } ignore_live_leader: false dest_uuid: "def6b23bccc94a78a47118da331f2798" is_pre_election: true
I20261117 14:49:43.194800 6658 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5c849aa2a21a4c13b2e31d2ca3f692cc" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 2 candidate_status { last_received { term: 1 index: 1129 } } ignore_live_leader: false dest_uuid: "c7900e455dd64c68bccfc499bda413f7" is_pre_election: true
I20261117 14:49:43.198896 7266 leader_election.cc:304] T 5c849aa2a21a4c13b2e31d2ca3f692cc P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec41d6947a4a4eadadf90c3756899704; no voters: c7900e455dd64c68bccfc499bda413f7, def6b23bccc94a78a47118da331f2798
I20261117 14:49:43.199478 7447 raft_consensus.cc:2771] T 5c849aa2a21a4c13b2e31d2ca3f692cc P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20261117 14:49:43.209729 7343 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.6.50.130:39451 (request call id 9) took 1211 ms. Trace:
I20261117 14:49:43.169819 7340 rpcz_store.cc:276] 1117 14:49:42.138020 (+ 0us) service_pool.cc:167] Inserting onto call queue
1117 14:49:42.138871 (+ 851us) service_pool.cc:224] Handling call
1117 14:49:42.265007 (+126136us) raft_consensus.cc:1481] Updating replica for 116 ops
1117 14:49:42.357708 (+ 92701us) raft_consensus.cc:1545] Early marking committed up to index 1022
1117 14:49:42.357784 (+ 76us) raft_consensus.cc:1550] Triggering prepare for 116 ops
1117 14:49:42.363494 (+ 5710us) write_op.cc:270] Start()
1117 14:49:42.363530 (+ 36us) write_op.cc:276] Timestamp: P: 1794926979742510 usec, L: 0
1117 14:49:42.363718 (+ 188us) write_op.cc:270] Start()
1117 14:49:42.363743 (+ 25us) write_op.cc:276] Timestamp: P: 1794926979784181 usec, L: 0
1117 14:49:42.363914 (+ 171us) write_op.cc:270] Start()
1117 14:49:42.363935 (+ 21us) write_op.cc:276] Timestamp: P: 1794926979805574 usec, L: 0
1117 14:49:42.364083 (+ 148us) write_op.cc:270] Start()
1117 14:49:42.364104 (+ 21us) write_op.cc:276] Timestamp: P: 1794926979860597 usec, L: 0
1117 14:49:42.364261 (+ 157us) write_op.cc:270] Start()
1117 14:49:42.364280 (+ 19us) write_op.cc:276] Timestamp: P: 1794926979861985 usec, L: 0
1117 14:49:42.364432 (+ 152us) write_op.cc:270] Start()
1117 14:49:42.364480 (+ 48us) write_op.cc:276] Timestamp: P: 1794926979895815 usec, L: 0
1117 14:49:42.364666 (+ 186us) write_op.cc:270] Start()
1117 14:49:42.367042 (+ 2376us) write_op.cc:276] Timestamp: P: 1794926979920116 usec, L: 0
1117 14:49:42.367230 (+ 188us) write_op.cc:270] Start()
1117 14:49:42.378642 (+ 11412us) spinlock_profiling.cc:245] Waited 8.23 ms on lock 0x6190002c6c58. stack: 00007f9a08fa33a6 00007f9a08fa3160 00007f9a07f9434d 00007f9a1f567704 00007f9a1f5676cd 00007f9a1f56709a 00007f9a165560ca 00007f9a1655d1af 00007f9a162cfd7c 00007f9a1628718a 00007f9a164460ce 00007f9a16413da7 00007f9a163bfd7f 00007f9a163bee3e 00007f9a14fe4241 00007f9a15003b67
1117 14:49:42.378667 (+ 25us) write_op.cc:276] Timestamp: P: 1794926979957327 usec, L: 0
1117 14:49:42.388665 (+ 9998us) write_op.cc:270] Start()
1117 14:49:42.388701 (+ 36us) write_op.cc:276] Timestamp: P: 1794926979959332 usec, L: 0
1117 14:49:42.396925 (+ 8224us) write_op.cc:270] Start()
1117 14:49:42.396954 (+ 29us) write_op.cc:276] Timestamp: P: 1794926980014705 usec, L: 0
1117 14:49:42.397186 (+ 232us) write_op.cc:270] Start()
1117 14:49:42.397211 (+ 25us) write_op.cc:276] Timestamp: P: 1794926980022085 usec, L: 0
1117 14:49:42.397384 (+ 173us) write_op.cc:270] Start()
1117 14:49:42.397404 (+ 20us) write_op.cc:276] Timestamp: P: 1794926980025153 usec, L: 0
1117 14:49:42.397565 (+ 161us) write_op.cc:270] Start()
1117 14:49:42.397586 (+ 21us) write_op.cc:276] Timestamp: P: 1794926980069976 usec, L: 0
1117 14:49:42.397735 (+ 149us) write_op.cc:270] Start()
1117 14:49:42.397754 (+ 19us) write_op.cc:276] Timestamp: P: 1794926980071333 usec, L: 0
1117 14:49:42.397911 (+ 157us) write_op.cc:270] Start()
1117 14:49:42.397932 (+ 21us) write_op.cc:276] Timestamp: P: 1794926980107308 usec, L: 0
1117 14:49:42.398115 (+ 183us) write_op.cc:270] Start()
1117 14:49:42.398137 (+ 22us) write_op.cc:276] Timestamp: P: 1794926980160980 usec, L: 0
1117 14:49:42.398292 (+ 155us) write_op.cc:270] Start()
1117 14:49:42.398327 (+ 35us) write_op.cc:276] Timestamp: P: 1794926980162399 usec, L: 0
1117 14:49:42.398466 (+ 139us) write_op.cc:270] Start()
1117 14:49:42.398486 (+ 20us) write_op.cc:276] Timestamp: P: 1794926980170889 usec, L: 0
1117 14:49:42.398641 (+ 155us) write_op.cc:270] Start()
1117 14:49:42.398663 (+ 22us) write_op.cc:276] Timestamp: P: 1794926980178721 usec, L: 0
1117 14:49:42.398815 (+ 152us) write_op.cc:270] Start()
1117 14:49:42.398835 (+ 20us) write_op.cc:276] Timestamp: P: 1794926980230120 usec, L: 0
1117 14:49:42.398992 (+ 157us) write_op.cc:270] Start()
1117 14:49:42.399015 (+ 23us) write_op.cc:276] Timestamp: P: 1794926980251059 usec, L: 0
1117 14:49:42.399260 (+ 245us) write_op.cc:270] Start()
1117 14:49:42.399283 (+ 23us) write_op.cc:276] Timestamp: P: 1794926980287863 usec, L: 0
1117 14:49:42.399728 (+ 445us) write_op.cc:270] Start()
1117 14:49:42.399752 (+ 24us) write_op.cc:276] Timestamp: P: 1794926980297977 usec, L: 0
1117 14:49:42.399933 (+ 181us) write_op.cc:270] Start()
1117 14:49:42.399955 (+ 22us) write_op.cc:276] Timestamp: P: 1794926980302925 usec, L: 0
1117 14:49:42.400279 (+ 324us) write_op.cc:270] Start()
1117 14:49:42.400306 (+ 27us) write_op.cc:276] Timestamp: P: 1794926980303580 usec, L: 0
1117 14:49:42.407262 (+ 6956us) write_op.cc:270] Start()
1117 14:49:42.407292 (+ 30us) write_op.cc:276] Timestamp: P: 1794926980338495 usec, L: 0
1117 14:49:42.416540 (+ 9248us) write_op.cc:270] Start()
1117 14:49:42.416569 (+ 29us) write_op.cc:276] Timestamp: P: 1794926980347951 usec, L: 0
1117 14:49:42.420882 (+ 4313us) write_op.cc:270] Start()
1117 14:49:42.420909 (+ 27us) write_op.cc:276] Timestamp: P: 1794926980376801 usec, L: 0
1117 14:49:42.421102 (+ 193us) write_op.cc:270] Start()
1117 14:49:42.421124 (+ 22us) write_op.cc:276] Timestamp: P: 1794926980402002 usec, L: 0
1117 14:49:42.421300 (+ 176us) write_op.cc:270] Start()
1117 14:49:42.421323 (+ 23us) write_op.cc:276] Timestamp: P: 1794926980406242 usec, L: 0
1117 14:49:42.421485 (+ 162us) write_op.cc:270] Start()
1117 14:49:42.421506 (+ 21us) write_op.cc:276] Timestamp: P: 1794926980417102 usec, L: 0
1117 14:49:42.421672 (+ 166us) write_op.cc:270] Start()
1117 14:49:42.421694 (+ 22us) write_op.cc:276] Timestamp: P: 1794926980471144 usec, L: 0
1117 14:49:42.421933 (+ 239us) write_op.cc:270] Start()
1117 14:49:42.421955 (+ 22us) write_op.cc:276] Timestamp: P: 1794926980480817 usec, L: 0
1117 14:49:42.422137 (+ 182us) write_op.cc:270] Start()
1117 14:49:42.422160 (+ 23us) write_op.cc:276] Timestamp: P: 1794926980493261 usec, L: 0
1117 14:49:42.422329 (+ 169us) write_op.cc:270] Start()
1117 14:49:42.422352 (+ 23us) write_op.cc:276] Timestamp: P: 1794926980499053 usec, L: 0
1117 14:49:42.422495 (+ 143us) write_op.cc:270] Start()
1117 14:49:42.422515 (+ 20us) write_op.cc:276] Timestamp: P: 1794926980542227 usec, L: 0
1117 14:49:42.422678 (+ 163us) write_op.cc:270] Start()
1117 14:49:42.422698 (+ 20us) write_op.cc:276] Timestamp: P: 1794926980548057 usec, L: 0
1117 14:49:42.422835 (+ 137us) write_op.cc:270] Start()
1117 14:49:42.422865 (+ 30us) write_op.cc:276] Timestamp: P: 1794926980561872 usec, L: 0
1117 14:49:42.423010 (+ 145us) write_op.cc:270] Start()
1117 14:49:42.423030 (+ 20us) write_op.cc:276] Timestamp: P: 1794926980608620 usec, L: 0
1117 14:49:42.423207 (+ 177us) write_op.cc:270] Start()
1117 14:49:42.423233 (+ 26us) write_op.cc:276] Timestamp: P: 1794926980609199 usec, L: 0
1117 14:49:42.423837 (+ 604us) write_op.cc:270] Start()
1117 14:49:42.423861 (+ 24us) write_op.cc:276] Timestamp: P: 1794926980612235 usec, L: 0
1117 14:49:42.424029 (+ 168us) write_op.cc:270] Start()
1117 14:49:42.424063 (+ 34us) write_op.cc:276] Timestamp: P: 1794926980647533 usec, L: 0
1117 14:49:42.502822 (+ 78759us) write_op.cc:270] Start()
1117 14:49:42.502860 (+ 38us) write_op.cc:276] Timestamp: P: 1794926980669075 usec, L: 0
1117 14:49:42.503082 (+ 222us) write_op.cc:270] Start()
1117 14:49:42.503107 (+ 25us) write_op.cc:276] Timestamp: P: 1794926980675909 usec, L: 0
1117 14:49:42.537666 (+ 34559us) write_op.cc:270] Start()
1117 14:49:42.537694 (+ 28us) write_op.cc:276] Timestamp: P: 1794926980695632 usec, L: 0
1117 14:49:42.541623 (+ 3929us) write_op.cc:270] Start()
1117 14:49:42.541644 (+ 21us) write_op.cc:276] Timestamp: P: 1794926980752662 usec, L: 0
1117 14:49:42.544028 (+ 2384us) write_op.cc:270] Start()
1117 14:49:42.544055 (+ 27us) write_op.cc:276] Timestamp: P: 1794926980753726 usec, L: 0
1117 14:49:42.550168 (+ 6113us) write_op.cc:270] Start()
1117 14:49:42.550191 (+ 23us) write_op.cc:276] Timestamp: P: 1794926980754695 usec, L: 0
1117 14:49:42.553039 (+ 2848us) write_op.cc:270] Start()
1117 14:49:42.553066 (+ 27us) write_op.cc:276] Timestamp: P: 1794926980763134 usec, L: 0
1117 14:49:42.558881 (+ 5815us) write_op.cc:270] Start()
1117 14:49:42.558911 (+ 30us) write_op.cc:276] Timestamp: P: 1794926980801414 usec, L: 0
1117 14:49:42.605402 (+ 46491us) write_op.cc:270] Start()
1117 14:49:42.605436 (+ 34us) write_op.cc:276] Timestamp: P: 1794926980802067 usec, L: 0
1117 14:49:42.605646 (+ 210us) write_op.cc:270] Start()
1117 14:49:42.605668 (+ 22us) write_op.cc:276] Timestamp: P: 1794926980815117 usec, L: 0
1117 14:49:42.607142 (+ 1474us) write_op.cc:270] Start()
1117 14:49:42.607167 (+ 25us) write_op.cc:276] Timestamp: P: 1794926980818144 usec, L: 0
1117 14:49:42.615359 (+ 8192us) write_op.cc:270] Start()
1117 14:49:42.615381 (+ 22us) write_op.cc:276] Timestamp: P: 1794926980849552 usec, L: 0
1117 14:49:42.615560 (+ 179us) write_op.cc:270] Start()
1117 14:49:42.615582 (+ 22us) write_op.cc:276] Timestamp: P: 1794926980857895 usec, L: 0
1117 14:49:42.615750 (+ 168us) write_op.cc:270] Start()
1117 14:49:42.615772 (+ 22us) write_op.cc:276] Timestamp: P: 1794926980878839 usec, L: 0
1117 14:49:42.615916 (+ 144us) write_op.cc:270] Start()
1117 14:49:42.615956 (+ 40us) write_op.cc:276] Timestamp: P: 1794926980885540 usec, L: 0
1117 14:49:42.616092 (+ 136us) write_op.cc:270] Start()
1117 14:49:42.616110 (+ 18us) write_op.cc:276] Timestamp: P: 1794926980908628 usec, L: 0
1117 14:49:42.616256 (+ 146us) write_op.cc:270] Start()
1117 14:49:42.616276 (+ 20us) write_op.cc:276] Timestamp: P: 1794926980921685 usec, L: 0
1117 14:49:42.616466 (+ 190us) write_op.cc:270] Start()
1117 14:49:42.616497 (+ 31us) write_op.cc:276] Timestamp: P: 1794926980948771 usec, L: 0
1117 14:49:42.616732 (+ 235us) write_op.cc:270] Start()
1117 14:49:42.616758 (+ 26us) write_op.cc:276] Timestamp: P: 1794926980949992 usec, L: 0
1117 14:49:42.616914 (+ 156us) write_op.cc:270] Start()
1117 14:49:42.616935 (+ 21us) write_op.cc:276] Timestamp: P: 1794926981008998 usec, L: 0
1117 14:49:42.617092 (+ 157us) write_op.cc:270] Start()
1117 14:49:42.617113 (+ 21us) write_op.cc:276] Timestamp: P: 1794926981010465 usec, L: 0
1117 14:49:42.617281 (+ 168us) write_op.cc:270] Start()
1117 14:49:42.617301 (+ 20us) write_op.cc:276] Timestamp: P: 1794926981011813 usec, L: 0
1117 14:49:42.620422 (+ 3121us) write_op.cc:270] Start()
1117 14:49:42.620472 (+ 50us) write_op.cc:276] Timestamp: P: 1794926981036335 usec, L: 0
1117 14:49:42.620690 (+ 218us) write_op.cc:270] Start()
1117 14:49:42.620714 (+ 24us) write_op.cc:276] Timestamp: P: 1794926981076695 usec, L: 0
1117 14:49:42.620895 (+ 181us) write_op.cc:270] Start()
1117 14:49:42.620917 (+ 22us) write_op.cc:276] Timestamp: P: 1794926981079808 usec, L: 0
1117 14:49:42.621075 (+ 158us) write_op.cc:270] Start()
1117 14:49:42.621097 (+ 22us) write_op.cc:276] Timestamp: P: 1794926981080470 usec, L: 0
1117 14:49:42.621255 (+ 158us) write_op.cc:270] Start()
1117 14:49:42.621276 (+ 21us) write_op.cc:276] Timestamp: P: 1794926981133640 usec, L: 0
1117 14:49:42.621430 (+ 154us) write_op.cc:270] Start()
1117 14:49:42.621473 (+ 43us) write_op.cc:276] Timestamp: P: 1794926981152520 usec, L: 0
1117 14:49:42.625349 (+ 3876us) write_op.cc:270] Start()
1117 14:49:42.625559 (+ 210us) write_op.cc:276] Timestamp: P: 1794926981154237 usec, L: 0
1117 14:49:42.670775 (+ 45216us) write_op.cc:270] Start()
1117 14:49:42.670804 (+ 29us) write_op.cc:276] Timestamp: P: 1794926981160623 usec, L: 0
1117 14:49:42.732847 (+ 62043us) write_op.cc:270] Start()
1117 14:49:42.732880 (+ 33us) write_op.cc:276] Timestamp: P: 1794926981209958 usec, L: 0
1117 14:49:42.733086 (+ 206us) write_op.cc:270] Start()
1117 14:49:42.733110 (+ 24us) write_op.cc:276] Timestamp: P: 1794926981210510 usec, L: 0
1117 14:49:42.733323 (+ 213us) write_op.cc:270] Start()
1117 14:49:42.733346 (+ 23us) write_op.cc:276] Timestamp: P: 1794926981246069 usec, L: 0
1117 14:49:42.733514 (+ 168us) write_op.cc:270] Start()
1117 14:49:42.733536 (+ 22us) write_op.cc:276] Timestamp: P: 1794926981268697 usec, L: 0
1117 14:49:42.813884 (+ 80348us) write_op.cc:270] Start()
1117 14:49:42.813913 (+ 29us) write_op.cc:276] Timestamp: P: 1794926981270446 usec, L: 0
1117 14:49:42.814085 (+ 172us) write_op.cc:270] Start()
1117 14:49:42.814111 (+ 26us) write_op.cc:276] Timestamp: P: 1794926981272037 usec, L: 0
1117 14:49:42.825566 (+ 11455us) write_op.cc:270] Start()
1117 14:49:42.825596 (+ 30us) write_op.cc:276] Timestamp: P: 1794926981314425 usec, L: 0
1117 14:49:42.828422 (+ 2826us) write_op.cc:270] Start()
1117 14:49:42.828475 (+ 53us) write_op.cc:276] Timestamp: P: 1794926981342727 usec, L: 0
1117 14:49:42.833612 (+ 5137us) write_op.cc:270] Start()
1117 14:49:42.833634 (+ 22us) write_op.cc:276] Timestamp: P: 1794926981343323 usec, L: 0
1117 14:49:42.844969 (+ 11335us) write_op.cc:270] Start()
1117 14:49:42.845004 (+ 35us) write_op.cc:276] Timestamp: P: 1794926981388212 usec, L: 0
1117 14:49:42.845222 (+ 218us) write_op.cc:270] Start()
1117 14:49:42.845247 (+ 25us) write_op.cc:276] Timestamp: P: 1794926981393019 usec, L: 0
1117 14:49:42.845414 (+ 167us) write_op.cc:270] Start()
1117 14:49:42.845436 (+ 22us) write_op.cc:276] Timestamp: P: 1794926981397249 usec, L: 0
1117 14:49:42.845629 (+ 193us) write_op.cc:270] Start()
1117 14:49:42.845653 (+ 24us) write_op.cc:276] Timestamp: P: 1794926981404355 usec, L: 0
1117 14:49:42.845832 (+ 179us) write_op.cc:270] Start()
1117 14:49:42.845872 (+ 40us) write_op.cc:276] Timestamp: P: 1794926981450919 usec, L: 0
1117 14:49:42.846049 (+ 177us) write_op.cc:270] Start()
1117 14:49:42.846075 (+ 26us) write_op.cc:276] Timestamp: P: 1794926981488300 usec, L: 0
1117 14:49:42.846253 (+ 178us) write_op.cc:270] Start()
1117 14:49:42.846279 (+ 26us) write_op.cc:276] Timestamp: P: 1794926981490008 usec, L: 0
1117 14:49:42.846432 (+ 153us) write_op.cc:270] Start()
1117 14:49:42.846455 (+ 23us) write_op.cc:276] Timestamp: P: 1794926981497974 usec, L: 0
1117 14:49:42.846627 (+ 172us) write_op.cc:270] Start()
1117 14:49:42.846647 (+ 20us) write_op.cc:276] Timestamp: P: 1794926981530714 usec, L: 0
1117 14:49:42.892924 (+ 46277us) write_op.cc:270] Start()
1117 14:49:42.892949 (+ 25us) write_op.cc:276] Timestamp: P: 1794926981538766 usec, L: 0
1117 14:49:42.893121 (+ 172us) write_op.cc:270] Start()
1117 14:49:42.893141 (+ 20us) write_op.cc:276] Timestamp: P: 1794926981570600 usec, L: 0
1117 14:49:42.893323 (+ 182us) write_op.cc:270] Start()
1117 14:49:42.893343 (+ 20us) write_op.cc:276] Timestamp: P: 1794926981610994 usec, L: 0
1117 14:49:42.893491 (+ 148us) write_op.cc:270] Start()
1117 14:49:42.893512 (+ 21us) write_op.cc:276] Timestamp: P: 1794926981615870 usec, L: 0
1117 14:49:42.893680 (+ 168us) write_op.cc:270] Start()
1117 14:49:42.893700 (+ 20us) write_op.cc:276] Timestamp: P: 1794926981621033 usec, L: 0
1117 14:49:42.893877 (+ 177us) write_op.cc:270] Start()
1117 14:49:42.893898 (+ 21us) write_op.cc:276] Timestamp: P: 1794926981676790 usec, L: 0
1117 14:49:42.894038 (+ 140us) write_op.cc:270] Start()
1117 14:49:42.894058 (+ 20us) write_op.cc:276] Timestamp: P: 1794926981716608 usec, L: 0
1117 14:49:42.894206 (+ 148us) write_op.cc:270] Start()
1117 14:49:42.894228 (+ 22us) write_op.cc:276] Timestamp: P: 1794926981718168 usec, L: 0
1117 14:49:42.894395 (+ 167us) write_op.cc:270] Start()
1117 14:49:42.894415 (+ 20us) write_op.cc:276] Timestamp: P: 1794926981718919 usec, L: 0
1117 14:49:42.897936 (+ 3521us) write_op.cc:270] Start()
1117 14:49:42.897965 (+ 29us) write_op.cc:276] Timestamp: P: 1794926981743703 usec, L: 0
1117 14:49:42.903587 (+ 5622us) write_op.cc:270] Start()
1117 14:49:42.903618 (+ 31us) write_op.cc:276] Timestamp: P: 1794926981773080 usec, L: 0
1117 14:49:42.904167 (+ 549us) write_op.cc:270] Start()
1117 14:49:42.904192 (+ 25us) write_op.cc:276] Timestamp: P: 1794926981775850 usec, L: 0
1117 14:49:42.904366 (+ 174us) write_op.cc:270] Start()
1117 14:49:42.904388 (+ 22us) write_op.cc:276] Timestamp: P: 1794926981793963 usec, L: 0
1117 14:49:42.904593 (+ 205us) write_op.cc:270] Start()
1117 14:49:42.904616 (+ 23us) write_op.cc:276] Timestamp: P: 1794926981819942 usec, L: 0
1117 14:49:42.904787 (+ 171us) write_op.cc:270] Start()
1117 14:49:42.904809 (+ 22us) write_op.cc:276] Timestamp: P: 1794926981855920 usec, L: 0
1117 14:49:42.909517 (+ 4708us) write_op.cc:270] Start()
1117 14:49:42.909544 (+ 27us) write_op.cc:276] Timestamp: P: 1794926981856744 usec, L: 0
1117 14:49:42.909752 (+ 208us) write_op.cc:270] Start()
1117 14:49:42.909774 (+ 22us) write_op.cc:276] Timestamp: P: 1794926981887568 usec, L: 0
1117 14:49:42.909942 (+ 168us) write_op.cc:270] Start()
1117 14:49:42.909970 (+ 28us) write_op.cc:276] Timestamp: P: 1794926981897748 usec, L: 0
1117 14:49:42.910130 (+ 160us) write_op.cc:270] Start()
1117 14:49:42.910153 (+ 23us) write_op.cc:276] Timestamp: P: 1794926981939794 usec, L: 0
1117 14:49:42.910300 (+ 147us) write_op.cc:270] Start()
1117 14:49:42.910320 (+ 20us) write_op.cc:276] Timestamp: P: 1794926981960186 usec, L: 0
1117 14:49:42.910460 (+ 140us) write_op.cc:270] Start()
1117 14:49:42.910494 (+ 34us) write_op.cc:276] Timestamp: P: 1794926982004333 usec, L: 0
1117 14:49:42.911100 (+ 606us) write_op.cc:270] Start()
1117 14:49:42.911125 (+ 25us) write_op.cc:276] Timestamp: P: 1794926982006582 usec, L: 0
1117 14:49:42.911299 (+ 174us) write_op.cc:270] Start()
1117 14:49:42.911325 (+ 26us) write_op.cc:276] Timestamp: P: 1794926982052302 usec, L: 0
1117 14:49:42.911498 (+ 173us) write_op.cc:270] Start()
1117 14:49:42.911520 (+ 22us) write_op.cc:276] Timestamp: P: 1794926982053536 usec, L: 0
1117 14:49:42.911695 (+ 175us) write_op.cc:270] Start()
1117 14:49:42.964882 (+ 53187us) write_op.cc:276] Timestamp: P: 1794926982054089 usec, L: 0
1117 14:49:42.965110 (+ 228us) write_op.cc:270] Start()
1117 14:49:42.965139 (+ 29us) write_op.cc:276] Timestamp: P: 1794926982054965 usec, L: 0
1117 14:49:43.060060 (+ 94921us) log.cc:844] Serialized 79376 byte log entry
1117 14:49:43.116631 (+ 56571us) raft_consensus.cc:1656] Marking committed up to 1138
1117 14:49:43.120369 (+ 3738us) raft_consensus.cc:1708] Filling consensus response to leader.
1117 14:49:43.169522 (+ 49153us) raft_consensus.cc:1679] Waiting on the replicates to finish logging
1117 14:49:43.169532 (+ 10us) raft_consensus.cc:1696] finished
1117 14:49:43.169536 (+ 4us) raft_consensus.cc:1702] UpdateReplicas() finished
1117 14:49:43.169595 (+ 59us) inbound_call.cc:177] Queueing success response
Related trace 'op':
1117 14:49:43.116678 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.116703 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.116725 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.116743 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.116762 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.116779 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.116796 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.116813 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.116840 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.116863 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.116883 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.116902 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.116927 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.116948 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.116968 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.117012 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.117043 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.117064 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.117116 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.117135 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.117152 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.117170 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.117188 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.117206 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.117223 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.117243 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.117262 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.117289 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.117308 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.117327 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.117346 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.117365 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.117404 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.117423 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.117441 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.117457 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.117474 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.117491 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.117508 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.117526 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.117545 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.117563 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.117582 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.117612 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.117636 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.117656 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.117674 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.117692 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.117709 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.117727 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.117744 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.117766 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.117787 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.117812 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.117833 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.117852 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.117871 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.117893 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.117913 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.117930 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.117947 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.117964 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.117980 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.117997 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.118014 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.118031 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.118048 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.118066 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.118084 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.118104 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.118125 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.118144 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.118163 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.118183 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.118200 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.118217 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.118234 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.118250 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.118267 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.118298 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.118320 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.118532 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.118555 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.118578 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.118597 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.118630 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.118646 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.118664 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.118682 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.118699 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.118719 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.118744 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.118764 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.118782 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.118803 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.118822 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.118841 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.118859 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.118876 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.118894 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.118914 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.118936 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.118958 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.120101 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.120149 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.120168 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.120186 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.120203 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.120220 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.120238 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.120255 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.120274 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.120297 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.120314 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.120333 (+ 0us) op_driver.cc:466] REPLICATION: finished
Related trace 'op':
1117 14:49:43.120352 (+ 0us) op_driver.cc:466] REPLICATION: finished
Metrics: {"spinlock_wait_cycles":18935040,"child_traces":[["op",{"replication_time_us":753162}],["op",{"replication_time_us":752974}],["op",{"replication_time_us":752802}],["op",{"replication_time_us":752653}],["op",{"replication_time_us":752492}],["op",{"replication_time_us":752340}],["op",{"replication_time_us":752124}],["op",{"replication_time_us":749576}],["op",{"rep
I20261117 14:49:43.209968 7343 rpcz_store.cc:276] 1117 14:49:41.998501 (+ 0us) service_pool.cc:167] Inserting onto call queue
1117 14:49:41.998581 (+ 80us) service_pool.cc:224] Handling call
1117 14:49:42.200026 (+201445us) raft_consensus.cc:1481] Updating replica for 290 ops
1117 14:49:42.381775 (+181749us) raft_consensus.cc:1545] Early marking committed up to index 839
1117 14:49:42.381823 (+ 48us) raft_consensus.cc:1550] Triggering prepare for 290 ops
1117 14:49:42.381940 (+ 117us) write_op.cc:270] Start()
1117 14:49:42.381981 (+ 41us) write_op.cc:276] Timestamp: P: 1794926976098499 usec, L: 0
1117 14:49:42.382606 (+ 625us) write_op.cc:270] Start()
1117 14:49:42.382642 (+ 36us) write_op.cc:276] Timestamp: P: 1794926976102485 usec, L: 0
1117 14:49:42.382912 (+ 270us) write_op.cc:270] Start()
1117 14:49:42.382936 (+ 24us) write_op.cc:276] Timestamp: P: 1794926976106711 usec, L: 0
1117 14:49:42.383100 (+ 164us) write_op.cc:270] Start()
1117 14:49:42.383122 (+ 22us) write_op.cc:276] Timestamp: P: 1794926976149647 usec, L: 0
1117 14:49:42.383265 (+ 143us) write_op.cc:270] Start()
1117 14:49:42.383285 (+ 20us) write_op.cc:276] Timestamp: P: 1794926976178816 usec, L: 0
1117 14:49:42.383445 (+ 160us) write_op.cc:270] Start()
1117 14:49:42.383466 (+ 21us) write_op.cc:276] Timestamp: P: 1794926976211484 usec, L: 0
1117 14:49:42.383651 (+ 185us) write_op.cc:270] Start()
1117 14:49:42.383692 (+ 41us) write_op.cc:276] Timestamp: P: 1794926976231903 usec, L: 0
1117 14:49:42.383832 (+ 140us) write_op.cc:270] Start()
1117 14:49:42.383854 (+ 22us) write_op.cc:276] Timestamp: P: 1794926976234226 usec, L: 0
1117 14:49:42.383992 (+ 138us) write_op.cc:270] Start()
1117 14:49:42.384015 (+ 23us) write_op.cc:276] Timestamp: P: 1794926976254658 usec, L: 0
1117 14:49:42.384166 (+ 151us) write_op.cc:270] Start()
1117 14:49:42.384187 (+ 21us) write_op.cc:276] Timestamp: P: 1794926976268976 usec, L: 0
1117 14:49:42.384357 (+ 170us) write_op.cc:270] Start()
1117 14:49:42.384378 (+ 21us) write_op.cc:276] Timestamp: P: 1794926976296473 usec, L: 0
1117 14:49:42.384579 (+ 201us) write_op.cc:270] Start()
1117 14:49:42.391458 (+ 6879us) write_op.cc:276] Timestamp: P: 1794926976311529 usec, L: 0
1117 14:49:42.391659 (+ 201us) write_op.cc:270] Start()
1117 14:49:42.391684 (+ 25us) write_op.cc:276] Timestamp: P: 1794926976320584 usec, L: 0
1117 14:49:42.404642 (+ 12958us) write_op.cc:270] Start()
1117 14:49:42.404672 (+ 30us) write_op.cc:276] Timestamp: P: 1794926976326510 usec, L: 0
1117 14:49:42.406621 (+ 1949us) write_op.cc:270] Start()
1117 14:49:42.406650 (+ 29us) write_op.cc:276] Timestamp: P: 1794926976346793 usec, L: 0
1117 14:49:42.425246 (+ 18596us) write_op.cc:270] Start()
1117 14:49:42.425270 (+ 24us) write_op.cc:276] Timestamp: P: 1794926976369224 usec, L: 0
1117 14:49:42.425471 (+ 201us) write_op.cc:270] Start()
1117 14:49:42.425494 (+ 23us) write_op.cc:276] Timestamp: P: 1794926976396707 usec, L: 0
1117 14:49:42.425656 (+ 162us) write_op.cc:270] Start()
1117 14:49:42.425679 (+ 23us) write_op.cc:276] Timestamp: P: 1794926976420659 usec, L: 0
1117 14:49:42.425829 (+ 150us) write_op.cc:270] Start()
1117 14:49:42.425850 (+ 21us) write_op.cc:276] Timestamp: P: 1794926976421616 usec, L: 0
1117 14:49:42.426023 (+ 173us) write_op.cc:270] Start()
1117 14:49:42.426057 (+ 34us) write_op.cc:276] Timestamp: P: 1794926976462026 usec, L: 0
1117 14:49:42.426238 (+ 181us) write_op.cc:270] Start()
1117 14:49:42.426260 (+ 22us) write_op.cc:276] Timestamp: P: 1794926976486186 usec, L: 0
1117 14:49:42.496505 (+ 70245us) write_op.cc:270] Start()
1117 14:49:42.496541 (+ 36us) write_op.cc:276] Timestamp: P: 1794926976508877 usec, L: 0
1117 14:49:42.519062 (+ 22521us) write_op.cc:270] Start()
1117 14:49:42.519099 (+ 37us) write_op.cc:276] Timestamp: P: 1794926976514805 usec, L: 0
1117 14:49:42.522091 (+ 2992us) write_op.cc:270] Start()
1117 14:49:42.522121 (+ 30us) write_op.cc:276] Timestamp: P: 1794926976524268 usec, L: 0
1117 14:49:42.522370 (+ 249us) write_op.cc:270] Start()
1117 14:49:42.522396 (+ 26us) write_op.cc:276] Timestamp: P: 1794926976553596 usec, L: 0
1117 14:49:42.522589 (+ 193us) write_op.cc:270] Start()
1117 14:49:42.522612 (+ 23us) write_op.cc:276] Timestamp: P: 1794926976578454 usec, L: 0
1117 14:49:42.522786 (+ 174us) write_op.cc:270] Start()
1117 14:49:42.522806 (+ 20us) write_op.cc:276] Timestamp: P: 1794926976582728 usec, L: 0
1117 14:49:42.522961 (+ 155us) write_op.cc:270] Start()
1117 14:49:42.522983 (+ 22us) write_op.cc:276] Timestamp: P: 1794926976621006 usec, L: 0
1117 14:49:42.523131 (+ 148us) write_op.cc:270] Start()
1117 14:49:42.523154 (+ 23us) write_op.cc:276] Timestamp: P: 1794926976624650 usec, L: 0
1117 14:49:42.523314 (+ 160us) write_op.cc:270] Start()
1117 14:49:42.523336 (+ 22us) write_op.cc:276] Timestamp: P: 1794926976650150 usec, L: 0
1117 14:49:42.523491 (+ 155us) write_op.cc:270] Start()
1117 14:49:42.523512 (+ 21us) write_op.cc:276] Timestamp: P: 1794926976678532 usec, L: 0
1117 14:49:42.524138 (+ 626us) write_op.cc:270] Start()
1117 14:49:42.524156 (+ 18us) write_op.cc:276] Timestamp: P: 1794926976701777 usec, L: 0
1117 14:49:42.541393 (+ 17237us) write_op.cc:270] Start()
1117 14:49:42.541421 (+ 28us) write_op.cc:276] Timestamp: P: 1794926976732354 usec, L: 0
1117 14:49:42.549763 (+ 8342us) write_op.cc:270] Start()
1117 14:49:42.549794 (+ 31us) write_op.cc:276] Timestamp: P: 1794926976742247 usec, L: 0
1117 14:49:42.549975 (+ 181us) write_op.cc:270] Start()
1117 14:49:42.549999 (+ 24us) write_op.cc:276] Timestamp: P: 1794926976743596 usec, L: 0
1117 14:49:42.560780 (+ 10781us) write_op.cc:270] Start()
1117 14:49:42.560810 (+ 30us) write_op.cc:276] Timestamp: P: 1794926976744548 usec, L: 0
1117 14:49:42.561493 (+ 683us) write_op.cc:270] Start()
1117 14:49:42.561533 (+ 40us) write_op.cc:276] Timestamp: P: 1794926976775639 usec, L: 0
1117 14:49:42.561734 (+ 201us) write_op.cc:270] Start()
1117 14:49:42.561757 (+ 23us) write_op.cc:276] Timestamp: P: 1794926976799668 usec, L: 0
1117 14:49:42.561969 (+ 212us) write_op.cc:270] Start()
1117 14:49:42.561993 (+ 24us) write_op.cc:276] Timestamp: P: 1794926976841152 usec, L: 0
1117 14:49:42.562158 (+ 165us) write_op.cc:270] Start()
1117 14:49:42.562179 (+ 21us) write_op.cc:276] Timestamp: P: 1794926976842464 usec, L: 0
1117 14:49:42.562346 (+ 167us) write_op.cc:270] Start()
1117 14:49:42.562367 (+ 21us) write_op.cc:276] Timestamp: P: 1794926976846002 usec, L: 0
1117 14:49:42.562542 (+ 175us) write_op.cc:270] Start()
1117 14:49:42.562563 (+ 21us) write_op.cc:276] Timestamp: P: 1794926976898757 usec, L: 0
1117 14:49:42.562755 (+ 192us) write_op.cc:270] Start()
1117 14:49:42.562779 (+ 24us) write_op.cc:276] Timestamp: P: 1794926976900141 usec, L: 0
1117 14:49:42.562955 (+ 176us) write_op.cc:270] Start()
1117 14:49:42.562977 (+ 22us) write_op.cc:276] Timestamp: P: 1794926976901362 usec, L: 0
1117 14:49:42.563116 (+ 139us) write_op.cc:270] Start()
1117 14:49:42.563300 (+ 184us) write_op.cc:276] Timestamp: P: 1794926976925873 usec, L: 0
1117 14:49:42.563645 (+ 345us) write_op.cc:270] Start()
1117 14:49:42.563666 (+ 21us) write_op.cc:276] Timestamp: P: 1794926976960073 usec, L: 0
1117 14:49:42.563830 (+ 164us) write_op.cc:270] Start()
1117 14:49:42.563850 (+ 20us) write_op.cc:276] Timestamp: P: 1794926976965260 usec, L: 0
1117 14:49:42.564006 (+ 156us) write_op.cc:270] Start()
1117 14:49:42.569857 (+ 5851us) write_op.cc:276] Timestamp: P: 1794926976986028 usec, L: 0
1117 14:49:42.611995 (+ 42138us) write_op.cc:270] Start()
1117 14:49:42.612019 (+ 24us) write_op.cc:276] Timestamp: P: 1794926976995398 usec, L: 0
1117 14:49:42.612201 (+ 182us) write_op.cc:270] Start()
1117 14:49:42.612225 (+ 24us) write_op.cc:276] Timestamp: P: 1794926977042373 usec, L: 0
1117 14:49:42.612394 (+ 169us) write_op.cc:270] Start()
1117 14:49:42.612417 (+ 23us) write_op.cc:276] Timestamp: P: 1794926977050763 usec, L: 0
1117 14:49:42.612620 (+ 203us) write_op.cc:270] Start()
1117 14:49:42.612643 (+ 23us) write_op.cc:276] Timestamp: P: 1794926977057704 usec, L: 0
1117 14:49:42.612800 (+ 157us) write_op.cc:270] Start()
1117 14:49:42.612820 (+ 20us) write_op.cc:276] Timestamp: P: 1794926977061502 usec, L: 0
1117 14:49:42.612962 (+ 142us) write_op.cc:270] Start()
1117 14:49:42.612999 (+ 37us) write_op.cc:276] Timestamp: P: 1794926977107690 usec, L: 0
1117 14:49:42.613147 (+ 148us) write_op.cc:270] Start()
1117 14:49:42.613165 (+ 18us) write_op.cc:276] Timestamp: P: 1794926977135049 usec, L: 0
1117 14:49:42.613311 (+ 146us) write_op.cc:270] Start()
1117 14:49:42.613331 (+ 20us) write_op.cc:276] Timestamp: P: 1794926977136204 usec, L: 0
1117 14:49:42.613529 (+ 198us) write_op.cc:270] Start()
1117 14:49:42.613554 (+ 25us) write_op.cc:276] Timestamp: P: 1794926977147208 usec, L: 0
1117 14:49:42.613719 (+ 165us) write_op.cc:270] Start()
1117 14:49:42.613742 (+ 23us) write_op.cc:276] Timestamp: P: 1794926977204775 usec, L: 0
1117 14:49:42.672136 (+ 58394us) write_op.cc:270] Start()
1117 14:49:42.672160 (+ 24us) write_op.cc:276] Timestamp: P: 1794926977205401 usec, L: 0
1117 14:49:42.680233 (+ 8073us) write_op.cc:270] Start()
1117 14:49:42.681155 (+ 922us) write_op.cc:276] Timestamp: P: 1794926977216548 usec, L: 0
1117 14:49:42.696612 (+ 15457us) write_op.cc:270] Start()
1117 14:49:42.696646 (+ 34us) write_op.cc:276] Timestamp: P: 1794926977246099 usec, L: 0
1117 14:49:42.696857 (+ 211us) write_op.cc:270] Start()
1117 14:49:42.696880 (+ 23us) write_op.cc:276] Timestamp: P: 1794926977248694 usec, L: 0
1117 14:49:42.705501 (+ 8621us) write_op.cc:270] Start()
1117 14:49:42.705530 (+ 29us) write_op.cc:276] Timestamp: P: 1794926977280050 usec, L: 0
1117 14:49:42.706250 (+ 720us) write_op.cc:270] Start()
1117 14:49:42.706279 (+ 29us) write_op.cc:276] Timestamp: P: 1794926977322712 usec, L: 0
1117 14:49:42.761130 (+ 54851us) write_op.cc:270] Start()
1117 14:49:42.761161 (+ 31us) write_op.cc:276] Timestamp: P: 1794926977325309 usec, L: 0
1117 14:49:42.761376 (+ 215us) write_op.cc:270] Start()
1117 14:49:42.761399 (+ 23us) write_op.cc:276] Timestamp: P: 1794926977340647 usec, L: 0
1117 14:49:42.761560 (+ 161us) write_op.cc:270] Start()
1117 14:49:42.761584 (+ 24us) write_op.cc:276] Timestamp: P: 1794926977361106 usec, L: 0
1117 14:49:42.761734 (+ 150us) write_op.cc:270] Start()
1117 14:49:42.761755 (+ 21us) write_op.cc:276] Timestamp: P: 1794926977396977 usec, L: 0
1117 14:49:42.761905 (+ 150us) write_op.cc:270] Start()
1117 14:49:42.761925 (+ 20us) write_op.cc:276] Timestamp: P: 1794926977398381 usec, L: 0
1117 14:49:42.763847 (+ 1922us) write_op.cc:270] Start()
1117 14:49:42.763874 (+ 27us) write_op.cc:276] Timestamp: P: 1794926977444675 usec, L: 0
1117 14:49:42.777611 (+ 13737us) write_op.cc:270] Start()
1117 14:49:42.777648 (+ 37us) write_op.cc:276] Timestamp: P: 1794926977447453 usec, L: 0
1117 14:49:42.778223 (+ 575us) write_op.cc:270] Start()
1117 14:49:42.778250 (+ 27us) write_op.cc:276] Timestamp: P: 1794926977496770 usec, L: 0
1117 14:49:42.778752 (+ 502us) write_op.cc:270] Start()
1117 14:49:42.778779 (+ 27us) write_op.cc:276] Timestamp: P: 1794926977498094 usec, L: 0
1117 14:49:42.877565 (+ 98786us) write_op.cc:270] Start()
1117 14:49:42.877594 (+ 29us) write_op.cc:276] Timestamp: P: 1794926977520391 usec, L: 0
1117 14:49:42.888863 (+ 11269us) write_op.cc:270] Start()
1117 14:49:42.888884 (+ 21us) write_op.cc:276] Timestamp: P: 1794926977537189 usec, L: 0
1117 14:49:42.889068 (+ 184us) write_op.cc:270] Start()
1117 14:49:42.889088 (+ 20us) write_op.cc:276] Timestamp: P: 1794926977578300 usec, L: 0
1117 14:49:42.889225 (+ 137us) write_op.cc:270] Start()
1117 14:49:42.889244 (+ 19us) write_op.cc:276] Timestamp: P: 1794926977580208 usec, L: 0
1117 14:49:42.889387 (+ 143us) write_op.cc:270] Start()
1117 14:49:42.889408 (+ 21us) write_op.cc:276] Timestamp: P: 1794926977608511 usec, L: 0
1117 14:49:42.889581 (+ 173us) write_op.cc:270] Start()
1117 14:49:42.889602 (+ 21us) write_op.cc:276] Timestamp: P: 1794926977631958 usec, L: 0
1117 14:49:42.889767 (+ 165us) write_op.cc:270] Start()
1117 14:49:42.889787 (+ 20us) write_op.cc:276] Timestamp: P: 1794926977675893 usec, L: 0
1117 14:49:42.889955 (+ 168us) write_op.cc:270] Start()
1117 14:49:42.889976 (+ 21us) write_op.cc:276] Timestamp: P: 1794926977702753 usec, L: 0
1117 14:49:42.890125 (+ 149us) write_op.cc:270] Start()
1117 14:49:42.890145 (+ 20us) write_op.cc:276] Timestamp: P: 1794926977722567 usec, L: 0
1117 14:49:42.890284 (+ 139us) write_op.cc:270] Start()
1117 14:49:42.890304 (+ 20us) write_op.cc:276] Timestamp: P: 1794926977723822 usec, L: 0
1117 14:49:42.890448 (+ 144us) write_op.cc:270] Start()
1117 14:49:42.890467 (+ 19us) write_op.cc:276] Timestamp: P: 1794926977751171 usec, L: 0
1117 14:49:42.890815 (+ 348us) write_op.cc:270] Start()
1117 14:49:42.890838 (+ 23us) write_op.cc:276] Timestamp: P: 1794926977787837 usec, L: 0
1117 14:49:42.891024 (+ 186us) write_op.cc:270] Start()
1117 14:49:42.891045 (+ 21us) write_op.cc:276] Timestamp: P: 1794926977808493 usec, L: 0
1117 14:49:42.891205 (+ 160us) write_op.cc:270] Start()
1117 14:49:42.891229 (+ 24us) write_op.cc:276] Timestamp: P: 1794926977824599 usec, L: 0
1117 14:49:42.891396 (+ 167us) write_op.cc:270] Start()
1117 14:49:42.891416 (+ 20us) write_op.cc:276] Timestamp: P: 1794926977827925 usec, L: 0
1117 14:49:42.891580 (+ 164us) write_op.cc:270] Start()
1117 14:49:42.891600 (+ 20us) write_op.cc:276] Timestamp: P: 1794926977876010 usec, L: 0
1117 14:49:42.891741 (+ 141us) write_op.cc:270] Start()
1117 14:49:42.891762 (+ 21us) write_op.cc:276] Timestamp: P: 1794926977898040 usec, L: 0
1117 14:49:42.891912 (+ 150us) write_op.cc:270] Start()
1117 14:49:42.891945 (+ 33us) write_op.cc:276] Timestamp: P: 1794926977921829 usec, L: 0
1117 14:49:42.892118 (+ 173us) write_op.cc:270] Start()
1117 14:49:42.892143 (+ 25us) write_op.cc:276] Timestamp: P: 1794926977935080 usec, L: 0
1117 14:49:42.892311 (+ 168us) write_op.cc:270] Start()
1117 14:49:42.892332 (+ 21us) write_op.cc:276] Timestamp: P: 1794926977938277 usec, L: 0
1117 14:49:42.892544 (+ 212us) write_op.cc:270] Start()
1117 14:49:42.892566 (+ 22us) write_op.cc:276] Timestamp: P: 1794926977989166 usec, L: 0
1117 14:49:42.910930 (+ 18364us) write_op.cc:270] Start()
1117 14:49:42.910949 (+ 19us) write_op.cc:276] Timestamp: P: 1794926977990265 usec, L: 0
1117 14:49:42.911205 (+ 256us) write_op.cc:270] Start()
1117 14:49:42.911230 (+ 25us) write_op.cc:276] Timestamp: P: 1794926978015947 usec, L: 0
1117 14:49:42.911459 (+ 229us) write_op.cc:270] Start()
1117 14:49:42.911483 (+ 24us) write_op.cc:276] Timestamp: P: 1794926978024604 usec, L: 0
1117 14:49:42.911635 (+ 152us) write_op.cc:270] Start()
1117 14:49:42.911657 (+ 22us) write_op.cc:276] Timestamp: P: 1794926978031843 usec, L: 0
1117 14:49:42.911792 (+ 135us) write_op.cc:270] Start()
1117 14:49:42.911811 (+ 19us) write_op.cc:276] Timestamp: P: 1794926978036888 usec, L: 0
1117 14:49:42.912078 (+ 267us) write_op.cc:270] Start()
1117 14:49:42.912102 (+ 24us) write_op.cc:276] Timestamp: P: 1794926978063693 usec, L: 0
1117 14:49:42.912346 (+ 244us) write_op.cc:270] Start()
1117 14:49:42.912369 (+ 23us) write_op.cc:276] Timestamp: P: 1794926978109611 usec, L: 0
1117 14:49:42.913034 (+ 665us) write_op.cc:270] Start()
1117 14:49:42.913059 (+ 25us) write_op.cc:276] Timestamp: P: 1794926978114452 usec, L: 0
1117 14:49:42.913255 (+ 196us) write_op.cc:270] Start()
1117 14:49:42.913283 (+ 28us) write_op.cc:276] Timestamp: P: 1794926978150424 usec, L: 0
1117 14:49:42.913453 (+ 170us) write_op.cc:270] Start()
1117 14:49:42.913475 (+ 22us) write_op.cc:276] Timestamp: P: 1794926978184863 usec, L: 0
1117 14:49:42.913628 (+ 153us) write_op.cc:270] Start()
1117 14:49:42.913653 (+ 25us) write_op.cc:276] Timestamp: P: 1794926978191099 usec, L: 0
1117 14:49:42.913822 (+ 169us) write_op.cc:270] Start()
1117 14:49:42.913845 (+ 23us) write_op.cc:276] Timestamp: P: 1794926978192469 usec, L: 0
1117 14:49:42.914012 (+ 167us) write_op.cc:270] Start()
1117 14:49:42.914035 (+ 23us) write_op.cc:276] Timestamp: P: 1794926978229266 usec, L: 0
1117 14:49:42.914211 (+ 176us) write_op.cc:270] Start()
1117 14:49:42.914230 (+ 19us) write_op.cc:276] Timestamp: P: 1794926978253780 usec, L: 0
1117 14:49:42.914555 (+ 325us) write_op.cc:270] Start()
1117 14:49:42.914579 (+ 24us) write_op.cc:276] Timestamp: P: 1794926978257315 usec, L: 0
1117 14:49:42.914752 (+ 173us) write_op.cc:270] Start()
1117 14:49:42.914774 (+ 22us) write_op.cc:276] Timestamp: P: 1794926978276442 usec, L: 0
1117 14:49:42.914936 (+ 162us) write_op.cc:270] Start()
1117 14:49:42.914956 (+ 20us) write_op.cc:276] Timestamp: P: 1794926978329170 usec, L: 0
1117 14:49:42.915119 (+ 163us) write_op.cc:270] Start()
1117 14:49:42.915139 (+ 20us) write_op.cc:276] Timestamp: P: 1794926978332792 usec, L: 0
1117 14:49:42.915286 (+ 147us) write_op.cc:270] Start()
1117 14:49:42.915305 (+ 19us) write_op.cc:276] Timestamp: P: 1794926978357219 usec, L: 0
1117 14:49:42.915457 (+ 152us) write_op.cc:270] Start()
1117 14:49:42.915476 (+ 19us) write_op.cc:276] Timestamp: P: 1794926978391388 usec, L: 0
1117 14:49:42.915631 (+ 155us) write_op.cc:270] Start()
1117 14:49:42.915652 (+ 21us) write_op.cc:276] Timestamp: P: 1794926978396796 usec, L: 0
1117 14:49:42.915818 (+ 166us) write_op.cc:270] Start()
1117 14:49:42.915842 (+ 24us) write_op.cc:276] Timestamp: P: 1794926978420986 usec, L: 0
1117 14:49:42.916948 (+ 1106us) write_op.cc:270] Start()
1117 14:49:42.916973 (+ 25us) write_op.cc:276] Timestamp: P: 1794926978421990 usec, L: 0
1117 14:49:42.917158 (+ 185us) write_op.cc:270] Start()
1117 14:49:42.917181 (+ 23us) write_op.cc:276] Timestamp: P: 1794926978451753 usec, L: 0
1117 14:49:42.917333 (+ 152us) write_op.cc:270] Start()
1117 14:49:42.917355 (+ 22us) write_op.cc:276] Timestamp: P: 1794926978463187 usec, L: 0
1117 14:49:42.917516 (+ 161us) write_op.cc:270] Start()
1117 14:49:42.917536 (+ 20us) write_op.cc:276] Timestamp: P: 1794926978482293 usec, L: 0
1117 14:49:42.917687 (+ 151us) write_op.cc:270] Start()
1117 14:49:42.917707 (+ 20us) write_op.cc:276] Timestamp: P: 1794926978515710 usec, L: 0
1117 14:49:42.917867 (+ 160us) write_op.cc:270] Start()
1117 14:49:42.917888 (+ 21us) write_op.cc:276] Timestamp: P: 1794926978520853 usec, L: 0
1117 14:49:42.918051 (+ 163us) write_op.cc:270] Start()
1117 14:49:42.918072 (+ 21us) write_op.cc:276] Timestamp: P: 1794926978540697 usec, L: 0
1117 14:49:42.918253 (+ 181us) write_op.cc:270] Start()
1117 14:49:42.918275 (+ 22us) write_op.cc:276] Timestamp: P: 1794926978565528 usec, L: 0
1117 14:49:42.918455 (+ 180us) write_op.cc:270] Start()
1117 14:49:42.918476 (+ 21us) write_op.cc:276] Timestamp: P: 1794926978615915 usec, L: 0
1117 14:49:42.918621 (+ 145us) write_op.cc:270] Start()
1117 14:49:42.918643 (+ 22us) write_op.cc:276] Timestamp: P: 1794926978635819 usec, L: 0
1117 14:49:42.918845 (+ 202us) write_op.cc:270] Start()
1117 14:49:42.918867 (+ 22us) write_op.cc:276] Timestamp: P: 1794926978661579 usec, L: 0
1117 14:49:42.919006 (+ 139us) write_op.cc:270] Start()
1117 14:49:42.919025 (+ 19us) write_op.cc:276] Timestamp: P: 1794926978662228 usec, L: 0
1117 14:49:42.919223 (+ 198us) write_op.cc:270] Start()
1117 14:49:42.919243 (+ 20us) write_op.cc:276] Timestamp: P: 1794926978662783 usec, L: 0
1117 14:49:42.919405 (+ 162us) write_op.cc:270] Start()
1117 14:49:42.919426 (+ 21us) write_op.cc:276] Timestamp: P: 1794926978691423 usec, L: 0
1117 14:49:42.919627 (+ 201us) write_op.cc:270] Start()
1117 14:49:42.919689 (+ 62us) write_op.cc:276] Timestamp: P: 1794926978727777 usec, L: 0
1117 14:49:42.919871 (+ 182us) write_op.cc:270] Start()
1117 14:49:42.919893 (+ 22us) write_op.cc:276] Timestamp: P: 1794926978749472 usec, L: 0
1117 14:49:42.920072 (+ 179us) write_op.cc:270] Start()
1117 14:49:42.920092 (+ 20us) write_op.cc:276] Timestamp: P: 1794926978751063 usec, L: 0
1117 14:49:42.920253 (+ 161us) write_op.cc:270] Start()
1117 14:49:42.920275 (+ 22us) write_op.cc:276] Timestamp: P: 1794926978751638 usec, L: 0
1117 14:49:42.920462 (+ 187us) write_op.cc:270] Start()
1117 14:49:42.920486 (+ 24us) write_op.cc:276] Timestamp: P: 1794926978831876 usec, L: 0
1117 14:49:42.920930 (+ 444us) write_op.cc:270] Start()
1117 14:49:42.920958 (+ 28us) write_op.cc:276] Timestamp: P: 1794926978837528 usec, L: 0
1117 14:49:42.921098 (+ 140us) write_op.cc:270] Start()
1117 14:49:42.921115 (+ 17us) write_op.cc:276] Timestamp: P: 1794926978840243 usec, L: 0
1117 14:49:42.921329 (+ 214us) write_op.cc:270] Start()
1117 14:49:42.921353 (+ 24us) write_op.cc:276] Timestamp: P: 1794926978859600 usec, L: 0
1117 14:49:42.921521 (+ 168us) write_op.cc:270] Start()
1117 14:49:42.921541 (+ 20us) write_op.cc:276] Timestamp: P: 1794926978906772 usec, L: 0
1117 14:49:42.921733 (+ 192us) write_op.cc:270] Start()
1117 14:49:42.921757 (+ 24us) write_op.cc:276] Timestamp: P: 1794926978916761 usec, L: 0
1117 14:49:42.921912 (+ 155us) write_op.cc:270] Start()
1117 14:49:42.921932 (+ 20us) write_op.cc:276] Timestamp: P: 1794926978920930 usec, L: 0
1117 14:49:42.922075 (+ 143us) write_op.cc:270] Start()
1117 14:49:42.922094 (+ 19us) write_op.cc:276] Timestamp: P: 1794926978939667 usec, L: 0
1117 14:49:42.922316 (+ 222us) write_op.cc:270] Start()
1117 14:49:42.922338 (+ 22us) write_op.cc:276] Timestamp: P: 1794926978962062 usec, L: 0
1117 14:49:42.922509 (+ 171us) write_op.cc:270] Start()
1117 14:49:42.922530 (+ 21us) write_op.cc:276] Timestamp: P: 1794926978969497 usec, L: 0
1117 14:49:42.922735 (+ 205us) write_op.cc:270] Start()
1117 14:49:42.922756 (+ 21us) write_op.cc:276] Timestamp: P: 1794926978972190 usec, L: 0
1117 14:49:42.922908 (+ 152us) write_op.cc:270] Start()
1117 14:49:42.922932 (+ 24us) write_op.cc:276] Timestamp: P: 1794926979015495 usec, L: 0
1117 14:49:42.923113 (+ 181us) write_op.cc:270] Start()
1117 14:49:42.923138 (+ 25us) write_op.cc:276] Timestamp: P: 1794926979044104 usec, L: 0
1117 14:49:42.923309 (+ 171us) write_op.cc:270] Start()
1117 14:49:42.923326 (+ 17us) write_op.cc:276] Timestamp: P: 1794926979069964 usec, L: 0
1117 14:49:42.923498 (+ 172us) write_op.cc:270] Start()
1117 14:49:42.923518 (+ 20us) write_op.cc:276] Timestamp: P: 1794926979083386 usec, L: 0
1117 14:49:42.923668 (+ 150us) write_op.cc:270] Start()
1117 14:49:42.923689 (+ 21us) write_op.cc:276] Timestamp: P: 1794926979104107 usec, L: 0
1117 14:49:42.923880 (+ 191us) write_op.cc:270] Start()
1117 14:49:42.923903 (+ 23us) write_op.cc:276] Timestamp: P: 1794926979138842 usec, L: 0
1117 14:49:42.924060 (+ 157us) write_op.cc:270] Start()
1117 14:49:42.924079 (+ 19us) write_op.cc:276] Timestamp: P: 1794926979139461 usec, L: 0
1117 14:49:42.924239 (+ 160us) write_op.cc:270] Start()
1117 14:49:42.924259 (+ 20us) write_op.cc:276] Timestamp: P: 1794926979182630 usec, L: 0
1117 14:49:42.924749 (+ 490us) write_op.cc:270] Start()
1117 14:49:42.924771 (+ 22us) write_op.cc:276] Timestamp: P: 1794926979190950 usec, L: 0
1117 14:49:42.924973 (+ 202us) write_op.cc:270] Start()
1117 14:49:42.924995 (+ 22us) write_op.cc:276] Timestamp: P: 1794926979223970 usec, L: 0
1117 14:49:42.925340 (+ 345us) write_op.cc:270] Start()
1117 14:49:42.925363 (+ 23us) write_op.cc:276] Timestamp: P: 1794926979263482 usec, L: 0
1117 14:49:42.925529 (+ 166us) write_op.cc:270] Start()
1117 14:49:42.925553 (+ 24us) write_op.cc:276] Timestamp: P: 1794926979277646 usec, L: 0
1117 14:49:42.925716 (+ 163us) write_op.cc:270] Start()
1117 14:49:42.925736 (+ 20us) write_op.cc:276] Timestamp: P: 1794926979281864 usec, L: 0
1117 14:49:42.925886 (+ 150us) write_op.cc:270] Start()
1117 14:49:42.925905 (+ 19us) write_op.cc:276] Timestamp: P: 1794926979304080 usec, L: 0
1117 14:49:42.926057 (+ 152us) write_op.cc:270] Start()
1117 14:49:42.926091 (+ 34us) write_op.cc:276] Timestamp: P: 1794926979311396 usec, L: 0
1117 14:49:42.926269 (+ 178us) write_op.cc:270] Start()
1117 14:49:42.926292 (+ 23us) write_op.cc:276] Timestamp: P: 1794926979331403 usec, L: 0
1117 14:49:42.926432 (+ 140us) write_op.cc:270] Start()
1117 14:49:42.926447 (+ 15us) write_op.cc:276] Timestamp: P: 1794926979354753 usec, L: 0
1117 14:49:42.926606 (+ 159us) write_op.cc:270] Start()
1117 14:49:42.926626 (+ 20us) write_op.cc:276] Timestamp: P: 1794926979368274 usec, L: 0
1117 14:49:42.926802 (+ 176us) write_op.cc:270] Start()
1117 14:49:42.926822 (+ 20us) write_op.cc:276] Timestamp: P: 1794926979368916 usec, L: 0
1117 14:49:42.926991 (+ 169us) write_op.cc:270] Start()
1117 14:49:42.927013 (+ 22us) write_op.cc:276] Timestamp: P: 1794926979391812 usec, L: 0
1117 14:49:42.927211 (+ 198us) write_op.cc:270] Start()
1117 14:49:42.927234 (+ 23us) write_op.cc:276] Timestamp: P: 1794926979424016 usec, L: 0
1117 14:49:42.927488 (+ 254us) write_op.cc:270] Start()
1117 14:49:42.927511 (+ 23us) write_op.cc:276] Timestamp: P: 1794926979432236 usec, L: 0
1117 14:49:42.927680 (+ 169us) write_op.cc:270] Start()
1117 14:49:42.927702 (+ 22us) write_op.cc:276] Timestamp: P: 1794926979436540 usec, L: 0
1117 14:49:42.927854 (+ 152us) write_op.cc:270] Start()
1117 14:49:42.927874 (+ 20us) write_op.cc:276] Timestamp: P: 1794926979452330 usec, L: 0
1117 14:49:42.928021 (+ 147us) write_op.cc:270] Start()
1117 14:49:42.928036 (+ 15us) write_op.cc:276] Timestamp: P: 1794926979477197 usec, L: 0
1117 14:49:42.928128 (+ 92us) write_op.cc:270] Start()
1117 14:49:42.928140 (+ 12us) write_op.cc:276] Timestamp: P: 1794926979483498 usec, L: 0
1117 14:49:42.928249 (+ 109us) write_op.cc:270] Start()
1117 14:49:42.928262 (+ 13us) write_op.cc:276] Timestamp: P: 1794926979543661 usec, L: 0
1117 14:49:42.928354 (+ 92us) write_op.cc:270] Start()
1117 14:49:42.928365 (+ 11us) write_op.cc:276] Timestamp: P: 1794926979547545 usec, L: 0
1117 14:49:42.928514 (+ 149us) write_op.cc:270] Start()
1117 14:49:42.928543 (+ 29us) write_op.cc:276] Timestamp: P: 1794926979548159 usec, L: 0
1117 14:49:42.928843 (+ 300us) write_op.cc:270] Start()
1117 14:49:42.928865 (+ 22us) write_op.cc:276] Timestamp: P: 1794926979548758 usec, L: 0
1117 14:49:42.929076 (+ 211us) write_op.cc:270] Start()
1117 14:49:42.929125 (+ 49us) write_op.cc:276] Timestamp: P: 1794926979594837 usec, L: 0
1117 14:49:42.929310 (+ 185us) write_op.cc:270] Start()
1117 14:49:42.929332 (+ 22us) write_op.cc:276] Timestamp: P: 1794926979595381 usec, L: 0
1117 14:49:42.929507 (+ 175us) write_op.cc:270] Start()
1117 14:49:42.929528 (+ 21us) write_op.cc:276] Timestamp: P: 1794926979599685 usec, L: 0
1117 14:49:42.929703 (+ 175us) write_op.cc:270] Start()
1117 14:49:42.929727 (+ 24us) write_op.cc:276] Timestamp: P: 1794926979642386 usec, L: 0
1117 14:49:42.929909 (+ 182us) write_op.cc:270] Start()
1117 14:49:42.929929 (+ 20us) write_op.cc:276] Timestamp: P: 1794926979655128 usec, L: 0
1117 14:49:42.930077 (+ 148us) write_op.cc:270] Start()
1117 14:49:42.930095 (+ 18us) write_op.cc:276] Timestamp: P: 1794926979677535 usec, L: 0
1117 14:49:42.930259 (+ 164us) write_op.cc:270] Start()
1117 14:49:42.930283 (+ 24us) write_op.cc:276] Timestamp: P: 1794926979681070 usec, L: 0
1117 14:49:42.930436 (+ 153us) write_op.cc:270] Start()
1117 14:49:42.930458 (+ 22us) write_op.cc:276] Timestamp: P: 1794926979724183 usec, L: 0
1117 14:49:42.930628 (+ 170us) write_op.cc:270] Start()
1117 14:49:42.930649 (+ 21us) write_op.cc:276] Timestamp: P: 1794926979754380 usec, L: 0
1117 14:49:42.930806 (+ 157us) write_op.cc:270] Start()
1117 14:49:42.930827 (+ 21us) write_op.cc:276] Timestamp: P: 1794926979830588 usec, L: 0
1117 14:49:42.931380 (+ 553us) write_op.cc:270] Start()
1117 14:49:42.931404 (+ 24us) write_op.cc:276] Timestamp: P: 1794926979853472 usec, L: 0
1117 14:49:42.931648 (+ 244us) write_op.cc:270] Start()
1117 14:49:42.931673 (+ 25us) write_op.cc:276] Timestamp: P: 1794926979861913 usec, L: 0
1117 14:49:42.931936 (+ 263us) write_op.cc:270] Start()
1117 14:49:42.931963 (+ 27us) write_op.cc:276] Timestamp: P: 1794926979891121 usec, L: 0
1117 14:49:42.932121 (+ 158us) write_op.cc:270] Start()
1117 14:49:42.932142 (+ 21us) write_op.cc:276] Timestamp: P: 1794926979920082 usec, L: 0
1117 14:49:42.932303 (+ 161us) write_op.cc:270] Start()
1117 14:49:42.932325 (+ 22us) write_op.cc:276] Timestamp: P: 1794926979952150 usec, L: 0
1117 14:49:42.932498 (+ 173us) write_op.cc:270] Start()
1117 14:49:42.932519 (+ 21us) write_op.cc:276] Timestamp: P: 1794926979973788 usec, L: 0
1117 14:49:42.932680 (+ 161us) write_op.cc:270] Start()
1117 14:49:42.932720 (+ 40us) write_op.cc:276] Timestamp: P: 1794926980001810 usec, L: 0
1117 14:49:42.932904 (+ 184us) write_op.cc:270] Start()
1117 14:49:42.932926 (+ 22us) write_op.cc:276] Timestamp: P: 1794926980003077 usec, L: 0
1117 14:49:42.933099 (+ 173us) write_op.cc:270] Start()
1117 14:49:42.933119 (+ 20us) write_op.cc:276] Timestamp: P: 1794926980028072 usec, L: 0
1117 14:49:42.933289 (+ 170us) write_op.cc:270] Start()
1117 14:49:42.933310 (+ 21us) write_op.cc:276] Timestamp: P: 1794926980061125 usec, L: 0
1117 14:49:42.933486 (+ 176us) write_op.cc:270] Start()
1117 14:49:42.933508 (+ 22us) write_op.cc:276] Timestamp: P: 1794926980081011 usec, L: 0
1117 14:49:42.936016 (+ 2508us) write_op.cc:270] Start()
1117 14:49:42.936043 (+ 27us) write_op.cc:276] Timestamp: P: 179492
I20261117 14:49:43.407356 7447 raft_consensus.cc:499] T 47d9af37b05545f0b5b0c033f4ec953f P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader def6b23bccc94a78a47118da331f2798)
I20261117 14:49:43.407577 7447 raft_consensus.cc:521] T 47d9af37b05545f0b5b0c033f4ec953f P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } }
I20261117 14:49:43.408314 7447 leader_election.cc:290] T 47d9af37b05545f0b5b0c033f4ec953f P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271), def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611)
I20261117 14:49:43.412533 6655 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "47d9af37b05545f0b5b0c033f4ec953f" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 2 candidate_status { last_received { term: 1 index: 1165 } } ignore_live_leader: false dest_uuid: "c7900e455dd64c68bccfc499bda413f7" is_pre_election: true
I20261117 14:49:43.414144 6787 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "47d9af37b05545f0b5b0c033f4ec953f" candidate_uuid: "ec41d6947a4a4eadadf90c3756899704" candidate_term: 2 candidate_status { last_received { term: 1 index: 1165 } } ignore_live_leader: false dest_uuid: "def6b23bccc94a78a47118da331f2798" is_pre_election: true
I20261117 14:49:43.420863 7267 leader_election.cc:304] T 47d9af37b05545f0b5b0c033f4ec953f P ec41d6947a4a4eadadf90c3756899704 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec41d6947a4a4eadadf90c3756899704; no voters: c7900e455dd64c68bccfc499bda413f7, def6b23bccc94a78a47118da331f2798
I20261117 14:49:43.477020 7447 raft_consensus.cc:2771] T 47d9af37b05545f0b5b0c033f4ec953f P ec41d6947a4a4eadadf90c3756899704 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20261117 14:49:43.590600 7178 ts_manager.cc:300] Unset tserver state for ec41d6947a4a4eadadf90c3756899704 from MAINTENANCE_MODE
I20261117 14:49:43.761303 6833 heartbeater.cc:508] Master 127.6.50.190:39807 requested a full tablet report, sending...
I20261117 14:49:43.789518 7096 heartbeater.cc:508] Master 127.6.50.190:39807 requested a full tablet report, sending...
I20261117 14:49:43.987313 6703 heartbeater.cc:508] Master 127.6.50.190:39807 requested a full tablet report, sending...
I20261117 14:49:44.422149 7408 heartbeater.cc:508] Master 127.6.50.190:39807 requested a full tablet report, sending...
W20261117 14:49:46.456404 6594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.50.131:33611, user_credentials={real_user=slave}} blocked reactor thread for 50788.9us
W20261117 14:49:46.614934 6723 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.50.130:36271, user_credentials={real_user=slave}} blocked reactor thread for 54941.1us
I20261117 14:49:47.144609 7178 ts_manager.cc:311] Set tserver state for ec41d6947a4a4eadadf90c3756899704 to MAINTENANCE_MODE
I20261117 14:49:47.145635 6346 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskUafhB0/build/asan/bin/kudu pid 7247
I20261117 14:49:47.149309 7401 generic_service.cc:196] Checking for leaks (request via RPC)
I20261117 14:49:47.785262 6346 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskUafhB0/build/asan/bin/kudu with pid 7247
W20261117 14:49:47.869342 6724 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.6.50.129:42937 (error 108) [suppressed 57 similar messages]
W20261117 14:49:47.869589 7165 connection.cc:573] server connection from 127.6.50.129:49603 recv error: Network error: recv error from unknown peer: Connection reset by peer (error 104)
W20261117 14:49:47.875643 6594 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.6.50.129:42937 (error 108) [suppressed 47 similar messages]
W20261117 14:49:47.884405 6724 consensus_peers.cc:597] T 57984748adc7482a9a2d999a447a81af P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20261117 14:49:47.884707 6724 consensus_peers.cc:597] T 47d9af37b05545f0b5b0c033f4ec953f P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20261117 14:49:47.884806 6724 consensus_peers.cc:597] T 3cea00abcccd4b1284393ef8b406cab1 P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20261117 14:49:47.899111 6594 consensus_peers.cc:597] T 5c849aa2a21a4c13b2e31d2ca3f692cc P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20261117 14:49:47.899397 6594 consensus_peers.cc:597] T d1732d75bf044feb8884fc3135373072 P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20261117 14:49:47.899891 6594 consensus_peers.cc:597] T b74e748e97c84edeabc1c0cb41ddae99 P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20261117 14:49:48.303517 6724 consensus_peers.cc:597] T 57984748adc7482a9a2d999a447a81af P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20261117 14:49:48.326011 6594 consensus_peers.cc:597] T d1732d75bf044feb8884fc3135373072 P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20261117 14:49:48.340035 6724 consensus_peers.cc:597] T 3cea00abcccd4b1284393ef8b406cab1 P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20261117 14:49:48.372030 6724 consensus_peers.cc:597] T 47d9af37b05545f0b5b0c033f4ec953f P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20261117 14:49:48.412744 6594 consensus_peers.cc:597] T 5c849aa2a21a4c13b2e31d2ca3f692cc P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20261117 14:49:48.416062 6594 consensus_peers.cc:597] T b74e748e97c84edeabc1c0cb41ddae99 P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20261117 14:49:48.864722 6724 consensus_peers.cc:597] T 3cea00abcccd4b1284393ef8b406cab1 P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20261117 14:49:48.889027 6724 consensus_peers.cc:597] T 47d9af37b05545f0b5b0c033f4ec953f P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20261117 14:49:48.889479 6594 consensus_peers.cc:597] T d1732d75bf044feb8884fc3135373072 P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20261117 14:49:48.893965 6724 consensus_peers.cc:597] T 57984748adc7482a9a2d999a447a81af P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20261117 14:49:48.929030 6594 consensus_peers.cc:597] T 5c849aa2a21a4c13b2e31d2ca3f692cc P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20261117 14:49:48.982462 6594 consensus_peers.cc:597] T b74e748e97c84edeabc1c0cb41ddae99 P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20261117 14:49:49.134596 7466 consensus_queue.cc:580] T 5c849aa2a21a4c13b2e31d2ca3f692cc P c7900e455dd64c68bccfc499bda413f7 [LEADER]: Leader has been unable to successfully communicate with peer ec41d6947a4a4eadadf90c3756899704 for more than 2 seconds (2.006s)
I20261117 14:49:49.176075 7483 consensus_queue.cc:580] T b74e748e97c84edeabc1c0cb41ddae99 P c7900e455dd64c68bccfc499bda413f7 [LEADER]: Leader has been unable to successfully communicate with peer ec41d6947a4a4eadadf90c3756899704 for more than 2 seconds (2.047s)
I20261117 14:49:49.192160 7441 consensus_queue.cc:580] T 3cea00abcccd4b1284393ef8b406cab1 P def6b23bccc94a78a47118da331f2798 [LEADER]: Leader has been unable to successfully communicate with peer ec41d6947a4a4eadadf90c3756899704 for more than 2 seconds (2.056s)
I20261117 14:49:49.198174 7483 consensus_queue.cc:580] T d1732d75bf044feb8884fc3135373072 P c7900e455dd64c68bccfc499bda413f7 [LEADER]: Leader has been unable to successfully communicate with peer ec41d6947a4a4eadadf90c3756899704 for more than 2 seconds (2.033s)
I20261117 14:49:49.216361 7389 consensus_queue.cc:580] T 47d9af37b05545f0b5b0c033f4ec953f P def6b23bccc94a78a47118da331f2798 [LEADER]: Leader has been unable to successfully communicate with peer ec41d6947a4a4eadadf90c3756899704 for more than 2 seconds (2.066s)
I20261117 14:49:49.216756 7492 consensus_queue.cc:580] T 57984748adc7482a9a2d999a447a81af P def6b23bccc94a78a47118da331f2798 [LEADER]: Leader has been unable to successfully communicate with peer ec41d6947a4a4eadadf90c3756899704 for more than 2 seconds (2.088s)
W20261117 14:49:49.372509 6594 consensus_peers.cc:597] T d1732d75bf044feb8884fc3135373072 P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20261117 14:49:49.389928 6724 consensus_peers.cc:597] T 3cea00abcccd4b1284393ef8b406cab1 P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20261117 14:49:49.426430 6594 consensus_peers.cc:597] T 5c849aa2a21a4c13b2e31d2ca3f692cc P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20261117 14:49:49.432960 6724 consensus_peers.cc:597] T 57984748adc7482a9a2d999a447a81af P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20261117 14:49:49.459915 6724 consensus_peers.cc:597] T 47d9af37b05545f0b5b0c033f4ec953f P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20261117 14:49:49.472916 6594 consensus_peers.cc:597] T b74e748e97c84edeabc1c0cb41ddae99 P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20261117 14:49:49.859444 7177 ts_manager.cc:300] Unset tserver state for ec41d6947a4a4eadadf90c3756899704 from MAINTENANCE_MODE
I20261117 14:49:49.861649 7096 heartbeater.cc:508] Master 127.6.50.190:39807 requested a full tablet report, sending...
W20261117 14:49:49.905108 6594 consensus_peers.cc:597] T d1732d75bf044feb8884fc3135373072 P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20261117 14:49:49.912040 6724 consensus_peers.cc:597] T 3cea00abcccd4b1284393ef8b406cab1 P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20261117 14:49:49.949365 6724 consensus_peers.cc:597] T 57984748adc7482a9a2d999a447a81af P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20261117 14:49:49.951519 6594 consensus_peers.cc:597] T 5c849aa2a21a4c13b2e31d2ca3f692cc P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20261117 14:49:49.962206 6724 consensus_peers.cc:597] T 47d9af37b05545f0b5b0c033f4ec953f P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20261117 14:49:50.100711 6594 consensus_peers.cc:597] T b74e748e97c84edeabc1c0cb41ddae99 P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20261117 14:49:50.237393 6833 heartbeater.cc:508] Master 127.6.50.190:39807 requested a full tablet report, sending...
I20261117 14:49:50.242563 6703 heartbeater.cc:508] Master 127.6.50.190:39807 requested a full tablet report, sending...
I20261117 14:49:50.304822 6783 consensus_queue.cc:238] T 3cea00abcccd4b1284393ef8b406cab1 P def6b23bccc94a78a47118da331f2798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1526, Committed index: 1526, Last appended: 2.1529, Last appended by leader: 176, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 1530 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } } peers { permanent_uuid: "b1357297ed3e46b78f7b1b44c1eec2d1" member_type: NON_VOTER last_known_addr { host: "127.6.50.132" port: 45815 } attrs { promote: true } }
I20261117 14:49:50.307677 6788 consensus_queue.cc:238] T 57984748adc7482a9a2d999a447a81af P def6b23bccc94a78a47118da331f2798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1526, Committed index: 1526, Last appended: 2.1529, Last appended by leader: 176, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 1530 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } } peers { permanent_uuid: "b1357297ed3e46b78f7b1b44c1eec2d1" member_type: NON_VOTER last_known_addr { host: "127.6.50.132" port: 45815 } attrs { promote: true } }
I20261117 14:49:50.311602 6787 consensus_queue.cc:238] T 47d9af37b05545f0b5b0c033f4ec953f P def6b23bccc94a78a47118da331f2798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1524, Committed index: 1524, Last appended: 1.1528, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 1529 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } } peers { permanent_uuid: "b1357297ed3e46b78f7b1b44c1eec2d1" member_type: NON_VOTER last_known_addr { host: "127.6.50.132" port: 45815 } attrs { promote: true } }
I20261117 14:49:50.316952 6654 raft_consensus.cc:1285] T 3cea00abcccd4b1284393ef8b406cab1 P c7900e455dd64c68bccfc499bda413f7 [term 2 FOLLOWER]: Refusing update from remote peer def6b23bccc94a78a47118da331f2798: Log matching property violated. Preceding OpId in replica: term: 2 index: 1526. Preceding OpId from leader: term: 2 index: 1530. (index mismatch)
I20261117 14:49:50.317646 6654 raft_consensus.cc:1285] T 57984748adc7482a9a2d999a447a81af P c7900e455dd64c68bccfc499bda413f7 [term 2 FOLLOWER]: Refusing update from remote peer def6b23bccc94a78a47118da331f2798: Log matching property violated. Preceding OpId in replica: term: 2 index: 1526. Preceding OpId from leader: term: 2 index: 1530. (index mismatch)
I20261117 14:49:50.318288 6654 raft_consensus.cc:1285] T 47d9af37b05545f0b5b0c033f4ec953f P c7900e455dd64c68bccfc499bda413f7 [term 1 FOLLOWER]: Refusing update from remote peer def6b23bccc94a78a47118da331f2798: Log matching property violated. Preceding OpId in replica: term: 1 index: 1525. Preceding OpId from leader: term: 1 index: 1529. (index mismatch)
I20261117 14:49:50.319968 7494 consensus_queue.cc:1049] T 57984748adc7482a9a2d999a447a81af P def6b23bccc94a78a47118da331f2798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1530, Last known committed idx: 1526, Time since last communication: 0.000s
I20261117 14:49:50.320670 7441 consensus_queue.cc:1049] T 47d9af37b05545f0b5b0c033f4ec953f P def6b23bccc94a78a47118da331f2798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1529, Last known committed idx: 1524, Time since last communication: 0.000s
I20261117 14:49:50.319742 7492 consensus_queue.cc:1049] T 3cea00abcccd4b1284393ef8b406cab1 P def6b23bccc94a78a47118da331f2798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1530, Last known committed idx: 1526, Time since last communication: 0.000s
I20261117 14:49:50.329947 6658 consensus_queue.cc:238] T 5c849aa2a21a4c13b2e31d2ca3f692cc P c7900e455dd64c68bccfc499bda413f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1527, Committed index: 1527, Last appended: 1.1528, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 1529 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } } peers { permanent_uuid: "b1357297ed3e46b78f7b1b44c1eec2d1" member_type: NON_VOTER last_known_addr { host: "127.6.50.132" port: 45815 } attrs { promote: true } }
I20261117 14:49:50.329717 7492 raft_consensus.cc:2983] T 57984748adc7482a9a2d999a447a81af P def6b23bccc94a78a47118da331f2798 [term 2 LEADER]: Committing config change with OpId 2.1530: config changed from index -1 to 1530, NON_VOTER b1357297ed3e46b78f7b1b44c1eec2d1 (127.6.50.132) added. New config: { opid_index: 1530 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } } peers { permanent_uuid: "b1357297ed3e46b78f7b1b44c1eec2d1" member_type: NON_VOTER last_known_addr { host: "127.6.50.132" port: 45815 } attrs { promote: true } } }
I20261117 14:49:50.335570 6655 consensus_queue.cc:238] T b74e748e97c84edeabc1c0cb41ddae99 P c7900e455dd64c68bccfc499bda413f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1527, Committed index: 1527, Last appended: 2.1529, Last appended by leader: 176, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 1530 OBSOLETE_local: false peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } } peers { permanent_uuid: "b1357297ed3e46b78f7b1b44c1eec2d1" member_type: NON_VOTER last_known_addr { host: "127.6.50.132" port: 45815 } attrs { promote: true } }
I20261117 14:49:50.339066 6655 consensus_queue.cc:238] T d1732d75bf044feb8884fc3135373072 P c7900e455dd64c68bccfc499bda413f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1526, Committed index: 1526, Last appended: 1.1528, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 1529 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } } peers { permanent_uuid: "b1357297ed3e46b78f7b1b44c1eec2d1" member_type: NON_VOTER last_known_addr { host: "127.6.50.132" port: 45815 } attrs { promote: true } }
W20261117 14:49:50.340729 6724 consensus_peers.cc:597] T 3cea00abcccd4b1284393ef8b406cab1 P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20261117 14:49:50.342310 7491 raft_consensus.cc:2983] T 47d9af37b05545f0b5b0c033f4ec953f P def6b23bccc94a78a47118da331f2798 [term 1 LEADER]: Committing config change with OpId 1.1529: config changed from index -1 to 1529, NON_VOTER b1357297ed3e46b78f7b1b44c1eec2d1 (127.6.50.132) added. New config: { opid_index: 1529 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } } peers { permanent_uuid: "b1357297ed3e46b78f7b1b44c1eec2d1" member_type: NON_VOTER last_known_addr { host: "127.6.50.132" port: 45815 } attrs { promote: true } } }
I20261117 14:49:50.342551 7441 raft_consensus.cc:2983] T 3cea00abcccd4b1284393ef8b406cab1 P def6b23bccc94a78a47118da331f2798 [term 2 LEADER]: Committing config change with OpId 2.1530: config changed from index -1 to 1530, NON_VOTER b1357297ed3e46b78f7b1b44c1eec2d1 (127.6.50.132) added. New config: { opid_index: 1530 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } } peers { permanent_uuid: "b1357297ed3e46b78f7b1b44c1eec2d1" member_type: NON_VOTER last_known_addr { host: "127.6.50.132" port: 45815 } attrs { promote: true } } }
I20261117 14:49:50.344244 6655 raft_consensus.cc:2983] T 57984748adc7482a9a2d999a447a81af P c7900e455dd64c68bccfc499bda413f7 [term 2 FOLLOWER]: Committing config change with OpId 2.1530: config changed from index -1 to 1530, NON_VOTER b1357297ed3e46b78f7b1b44c1eec2d1 (127.6.50.132) added. New config: { opid_index: 1530 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } } peers { permanent_uuid: "b1357297ed3e46b78f7b1b44c1eec2d1" member_type: NON_VOTER last_known_addr { host: "127.6.50.132" port: 45815 } attrs { promote: true } } }
I20261117 14:49:50.349310 6658 raft_consensus.cc:2983] T 3cea00abcccd4b1284393ef8b406cab1 P c7900e455dd64c68bccfc499bda413f7 [term 2 FOLLOWER]: Committing config change with OpId 2.1530: config changed from index -1 to 1530, NON_VOTER b1357297ed3e46b78f7b1b44c1eec2d1 (127.6.50.132) added. New config: { opid_index: 1530 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } } peers { permanent_uuid: "b1357297ed3e46b78f7b1b44c1eec2d1" member_type: NON_VOTER last_known_addr { host: "127.6.50.132" port: 45815 } attrs { promote: true } } }
I20261117 14:49:50.350598 6787 raft_consensus.cc:1285] T 5c849aa2a21a4c13b2e31d2ca3f692cc P def6b23bccc94a78a47118da331f2798 [term 1 FOLLOWER]: Refusing update from remote peer c7900e455dd64c68bccfc499bda413f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1528. Preceding OpId from leader: term: 1 index: 1529. (index mismatch)
I20261117 14:49:50.351204 6787 raft_consensus.cc:1285] T b74e748e97c84edeabc1c0cb41ddae99 P def6b23bccc94a78a47118da331f2798 [term 2 FOLLOWER]: Refusing update from remote peer c7900e455dd64c68bccfc499bda413f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 1528. Preceding OpId from leader: term: 2 index: 1530. (index mismatch)
I20261117 14:49:50.351759 6787 raft_consensus.cc:1285] T d1732d75bf044feb8884fc3135373072 P def6b23bccc94a78a47118da331f2798 [term 1 FOLLOWER]: Refusing update from remote peer c7900e455dd64c68bccfc499bda413f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1527. Preceding OpId from leader: term: 1 index: 1529. (index mismatch)
I20261117 14:49:50.351853 6654 raft_consensus.cc:2983] T 47d9af37b05545f0b5b0c033f4ec953f P c7900e455dd64c68bccfc499bda413f7 [term 1 FOLLOWER]: Committing config change with OpId 1.1529: config changed from index -1 to 1529, NON_VOTER b1357297ed3e46b78f7b1b44c1eec2d1 (127.6.50.132) added. New config: { opid_index: 1529 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } } peers { permanent_uuid: "b1357297ed3e46b78f7b1b44c1eec2d1" member_type: NON_VOTER last_known_addr { host: "127.6.50.132" port: 45815 } attrs { promote: true } } }
I20261117 14:49:50.356120 7472 consensus_queue.cc:1049] T 5c849aa2a21a4c13b2e31d2ca3f692cc P c7900e455dd64c68bccfc499bda413f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1529, Last known committed idx: 1527, Time since last communication: 0.000s
I20261117 14:49:50.356359 7493 consensus_queue.cc:1049] T b74e748e97c84edeabc1c0cb41ddae99 P c7900e455dd64c68bccfc499bda413f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1530, Last known committed idx: 1527, Time since last communication: 0.000s
I20261117 14:49:50.357605 7493 consensus_queue.cc:1049] T d1732d75bf044feb8884fc3135373072 P c7900e455dd64c68bccfc499bda413f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1529, Last known committed idx: 1526, Time since last communication: 0.000s
I20261117 14:49:50.359114 7177 catalog_manager.cc:5840] T 3cea00abcccd4b1284393ef8b406cab1 P c7900e455dd64c68bccfc499bda413f7 reported cstate change: config changed from index -1 to 1530, NON_VOTER b1357297ed3e46b78f7b1b44c1eec2d1 (127.6.50.132) added. New cstate: current_term: 2 leader_uuid: "def6b23bccc94a78a47118da331f2798" committed_config { opid_index: 1530 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } } peers { permanent_uuid: "b1357297ed3e46b78f7b1b44c1eec2d1" member_type: NON_VOTER last_known_addr { host: "127.6.50.132" port: 45815 } attrs { promote: true } } }
I20261117 14:49:50.361159 7178 catalog_manager.cc:5840] T 47d9af37b05545f0b5b0c033f4ec953f P def6b23bccc94a78a47118da331f2798 reported cstate change: config changed from index -1 to 1529, NON_VOTER b1357297ed3e46b78f7b1b44c1eec2d1 (127.6.50.132) added. New cstate: current_term: 1 leader_uuid: "def6b23bccc94a78a47118da331f2798" committed_config { opid_index: 1529 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1357297ed3e46b78f7b1b44c1eec2d1" member_type: NON_VOTER last_known_addr { host: "127.6.50.132" port: 45815 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20261117 14:49:50.363691 7165 catalog_manager.cc:5247] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 47d9af37b05545f0b5b0c033f4ec953f with cas_config_opid_index -1: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20261117 14:49:50.364473 7466 raft_consensus.cc:2983] T b74e748e97c84edeabc1c0cb41ddae99 P c7900e455dd64c68bccfc499bda413f7 [term 2 LEADER]: Committing config change with OpId 2.1530: config changed from index -1 to 1530, NON_VOTER b1357297ed3e46b78f7b1b44c1eec2d1 (127.6.50.132) added. New config: { opid_index: 1530 OBSOLETE_local: false peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } } peers { permanent_uuid: "b1357297ed3e46b78f7b1b44c1eec2d1" member_type: NON_VOTER last_known_addr { host: "127.6.50.132" port: 45815 } attrs { promote: true } } }
I20261117 14:49:50.364650 7468 raft_consensus.cc:2983] T 5c849aa2a21a4c13b2e31d2ca3f692cc P c7900e455dd64c68bccfc499bda413f7 [term 1 LEADER]: Committing config change with OpId 1.1529: config changed from index -1 to 1529, NON_VOTER b1357297ed3e46b78f7b1b44c1eec2d1 (127.6.50.132) added. New config: { opid_index: 1529 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } } peers { permanent_uuid: "b1357297ed3e46b78f7b1b44c1eec2d1" member_type: NON_VOTER last_known_addr { host: "127.6.50.132" port: 45815 } attrs { promote: true } } }
I20261117 14:49:50.369653 7164 catalog_manager.cc:5247] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet b74e748e97c84edeabc1c0cb41ddae99 with cas_config_opid_index -1: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20261117 14:49:50.372206 6787 raft_consensus.cc:2983] T b74e748e97c84edeabc1c0cb41ddae99 P def6b23bccc94a78a47118da331f2798 [term 2 FOLLOWER]: Committing config change with OpId 2.1530: config changed from index -1 to 1530, NON_VOTER b1357297ed3e46b78f7b1b44c1eec2d1 (127.6.50.132) added. New config: { opid_index: 1530 OBSOLETE_local: false peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } } peers { permanent_uuid: "b1357297ed3e46b78f7b1b44c1eec2d1" member_type: NON_VOTER last_known_addr { host: "127.6.50.132" port: 45815 } attrs { promote: true } } }
I20261117 14:49:50.375231 7165 catalog_manager.cc:5247] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 3cea00abcccd4b1284393ef8b406cab1 with cas_config_opid_index -1: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20261117 14:49:50.376063 7164 catalog_manager.cc:5247] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 5c849aa2a21a4c13b2e31d2ca3f692cc with cas_config_opid_index -1: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
W20261117 14:49:50.378664 6724 consensus_peers.cc:597] T 57984748adc7482a9a2d999a447a81af P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20261117 14:49:50.379038 6724 consensus_peers.cc:597] T 47d9af37b05545f0b5b0c033f4ec953f P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20261117 14:49:50.375540 7165 catalog_manager.cc:5247] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 57984748adc7482a9a2d999a447a81af with cas_config_opid_index -1: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
W20261117 14:49:50.379974 6594 consensus_peers.cc:597] T 5c849aa2a21a4c13b2e31d2ca3f692cc P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20261117 14:49:50.380203 6594 consensus_peers.cc:597] T d1732d75bf044feb8884fc3135373072 P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20261117 14:49:50.380399 6594 consensus_peers.cc:597] T b74e748e97c84edeabc1c0cb41ddae99 P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20261117 14:49:50.384231 6787 raft_consensus.cc:2983] T 5c849aa2a21a4c13b2e31d2ca3f692cc P def6b23bccc94a78a47118da331f2798 [term 1 FOLLOWER]: Committing config change with OpId 1.1529: config changed from index -1 to 1529, NON_VOTER b1357297ed3e46b78f7b1b44c1eec2d1 (127.6.50.132) added. New config: { opid_index: 1529 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } } peers { permanent_uuid: "b1357297ed3e46b78f7b1b44c1eec2d1" member_type: NON_VOTER last_known_addr { host: "127.6.50.132" port: 45815 } attrs { promote: true } } }
I20261117 14:49:50.395592 7480 raft_consensus.cc:2983] T d1732d75bf044feb8884fc3135373072 P c7900e455dd64c68bccfc499bda413f7 [term 1 LEADER]: Committing config change with OpId 1.1529: config changed from index -1 to 1529, NON_VOTER b1357297ed3e46b78f7b1b44c1eec2d1 (127.6.50.132) added. New config: { opid_index: 1529 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } } peers { permanent_uuid: "b1357297ed3e46b78f7b1b44c1eec2d1" member_type: NON_VOTER last_known_addr { host: "127.6.50.132" port: 45815 } attrs { promote: true } } }
I20261117 14:49:50.399139 6783 raft_consensus.cc:2983] T d1732d75bf044feb8884fc3135373072 P def6b23bccc94a78a47118da331f2798 [term 1 FOLLOWER]: Committing config change with OpId 1.1529: config changed from index -1 to 1529, NON_VOTER b1357297ed3e46b78f7b1b44c1eec2d1 (127.6.50.132) added. New config: { opid_index: 1529 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } } peers { permanent_uuid: "b1357297ed3e46b78f7b1b44c1eec2d1" member_type: NON_VOTER last_known_addr { host: "127.6.50.132" port: 45815 } attrs { promote: true } } }
W20261117 14:49:50.402961 6593 consensus_peers.cc:597] T 5c849aa2a21a4c13b2e31d2ca3f692cc P c7900e455dd64c68bccfc499bda413f7 -> Peer b1357297ed3e46b78f7b1b44c1eec2d1 (127.6.50.132:45815): Couldn't send request to peer b1357297ed3e46b78f7b1b44c1eec2d1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5c849aa2a21a4c13b2e31d2ca3f692cc. This is attempt 1: this message will repeat every 5th retry.
W20261117 14:49:50.403262 6593 consensus_peers.cc:597] T b74e748e97c84edeabc1c0cb41ddae99 P c7900e455dd64c68bccfc499bda413f7 -> Peer b1357297ed3e46b78f7b1b44c1eec2d1 (127.6.50.132:45815): Couldn't send request to peer b1357297ed3e46b78f7b1b44c1eec2d1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b74e748e97c84edeabc1c0cb41ddae99. This is attempt 1: this message will repeat every 5th retry.
W20261117 14:49:50.403457 6593 consensus_peers.cc:597] T d1732d75bf044feb8884fc3135373072 P c7900e455dd64c68bccfc499bda413f7 -> Peer b1357297ed3e46b78f7b1b44c1eec2d1 (127.6.50.132:45815): Couldn't send request to peer b1357297ed3e46b78f7b1b44c1eec2d1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d1732d75bf044feb8884fc3135373072. This is attempt 1: this message will repeat every 5th retry.
I20261117 14:49:50.406338 7177 catalog_manager.cc:5840] T 5c849aa2a21a4c13b2e31d2ca3f692cc P c7900e455dd64c68bccfc499bda413f7 reported cstate change: config changed from index -1 to 1529, NON_VOTER b1357297ed3e46b78f7b1b44c1eec2d1 (127.6.50.132) added. New cstate: current_term: 1 leader_uuid: "c7900e455dd64c68bccfc499bda413f7" committed_config { opid_index: 1529 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1357297ed3e46b78f7b1b44c1eec2d1" member_type: NON_VOTER last_known_addr { host: "127.6.50.132" port: 45815 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20261117 14:49:50.406955 7177 catalog_manager.cc:5840] T 57984748adc7482a9a2d999a447a81af P c7900e455dd64c68bccfc499bda413f7 reported cstate change: config changed from index -1 to 1530, NON_VOTER b1357297ed3e46b78f7b1b44c1eec2d1 (127.6.50.132) added. New cstate: current_term: 2 leader_uuid: "def6b23bccc94a78a47118da331f2798" committed_config { opid_index: 1530 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } } peers { permanent_uuid: "b1357297ed3e46b78f7b1b44c1eec2d1" member_type: NON_VOTER last_known_addr { host: "127.6.50.132" port: 45815 } attrs { promote: true } } }
I20261117 14:49:50.407423 7177 catalog_manager.cc:5840] T b74e748e97c84edeabc1c0cb41ddae99 P c7900e455dd64c68bccfc499bda413f7 reported cstate change: config changed from index -1 to 1530, NON_VOTER b1357297ed3e46b78f7b1b44c1eec2d1 (127.6.50.132) added. New cstate: current_term: 2 leader_uuid: "c7900e455dd64c68bccfc499bda413f7" committed_config { opid_index: 1530 OBSOLETE_local: false peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1357297ed3e46b78f7b1b44c1eec2d1" member_type: NON_VOTER last_known_addr { host: "127.6.50.132" port: 45815 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20261117 14:49:50.411264 6723 consensus_peers.cc:597] T 3cea00abcccd4b1284393ef8b406cab1 P def6b23bccc94a78a47118da331f2798 -> Peer b1357297ed3e46b78f7b1b44c1eec2d1 (127.6.50.132:45815): Couldn't send request to peer b1357297ed3e46b78f7b1b44c1eec2d1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3cea00abcccd4b1284393ef8b406cab1. This is attempt 1: this message will repeat every 5th retry.
W20261117 14:49:50.411520 6723 consensus_peers.cc:597] T 57984748adc7482a9a2d999a447a81af P def6b23bccc94a78a47118da331f2798 -> Peer b1357297ed3e46b78f7b1b44c1eec2d1 (127.6.50.132:45815): Couldn't send request to peer b1357297ed3e46b78f7b1b44c1eec2d1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 57984748adc7482a9a2d999a447a81af. This is attempt 1: this message will repeat every 5th retry.
W20261117 14:49:50.413142 6723 consensus_peers.cc:597] T 47d9af37b05545f0b5b0c033f4ec953f P def6b23bccc94a78a47118da331f2798 -> Peer b1357297ed3e46b78f7b1b44c1eec2d1 (127.6.50.132:45815): Couldn't send request to peer b1357297ed3e46b78f7b1b44c1eec2d1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 47d9af37b05545f0b5b0c033f4ec953f. This is attempt 1: this message will repeat every 5th retry.
I20261117 14:49:50.440215 7518 ts_tablet_manager.cc:979] T 5c849aa2a21a4c13b2e31d2ca3f692cc P b1357297ed3e46b78f7b1b44c1eec2d1: Initiating tablet copy from peer c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271)
I20261117 14:49:50.457461 7520 ts_tablet_manager.cc:979] T 3cea00abcccd4b1284393ef8b406cab1 P b1357297ed3e46b78f7b1b44c1eec2d1: Initiating tablet copy from peer def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611)
I20261117 14:49:50.458194 7164 catalog_manager.cc:5247] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet d1732d75bf044feb8884fc3135373072 with cas_config_opid_index -1: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20261117 14:49:50.460808 7178 catalog_manager.cc:5840] T d1732d75bf044feb8884fc3135373072 P c7900e455dd64c68bccfc499bda413f7 reported cstate change: config changed from index -1 to 1529, NON_VOTER b1357297ed3e46b78f7b1b44c1eec2d1 (127.6.50.132) added. New cstate: current_term: 1 leader_uuid: "c7900e455dd64c68bccfc499bda413f7" committed_config { opid_index: 1529 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1357297ed3e46b78f7b1b44c1eec2d1" member_type: NON_VOTER last_known_addr { host: "127.6.50.132" port: 45815 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20261117 14:49:50.498871 7524 ts_tablet_manager.cc:979] T 57984748adc7482a9a2d999a447a81af P b1357297ed3e46b78f7b1b44c1eec2d1: Initiating tablet copy from peer def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611)
I20261117 14:49:50.504005 7524 tablet_copy_client.cc:323] T 57984748adc7482a9a2d999a447a81af P b1357297ed3e46b78f7b1b44c1eec2d1: tablet copy: Beginning tablet copy session from remote peer at address 127.6.50.131:33611
I20261117 14:49:50.504865 7517 ts_tablet_manager.cc:979] T b74e748e97c84edeabc1c0cb41ddae99 P b1357297ed3e46b78f7b1b44c1eec2d1: Initiating tablet copy from peer c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271)
I20261117 14:49:50.505293 7519 ts_tablet_manager.cc:979] T 47d9af37b05545f0b5b0c033f4ec953f P b1357297ed3e46b78f7b1b44c1eec2d1: Initiating tablet copy from peer def6b23bccc94a78a47118da331f2798 (127.6.50.131:33611)
I20261117 14:49:50.514479 7517 tablet_copy_client.cc:323] T b74e748e97c84edeabc1c0cb41ddae99 P b1357297ed3e46b78f7b1b44c1eec2d1: tablet copy: Beginning tablet copy session from remote peer at address 127.6.50.130:36271
I20261117 14:49:50.530779 7519 tablet_copy_client.cc:323] T 47d9af37b05545f0b5b0c033f4ec953f P b1357297ed3e46b78f7b1b44c1eec2d1: tablet copy: Beginning tablet copy session from remote peer at address 127.6.50.131:33611
I20261117 14:49:50.530743 6808 tablet_copy_service.cc:140] P def6b23bccc94a78a47118da331f2798: Received BeginTabletCopySession request for tablet 57984748adc7482a9a2d999a447a81af from peer b1357297ed3e46b78f7b1b44c1eec2d1 ({username='slave'} at 127.6.50.132:48831)
I20261117 14:49:50.530994 6808 tablet_copy_service.cc:161] P def6b23bccc94a78a47118da331f2798: Beginning new tablet copy session on tablet 57984748adc7482a9a2d999a447a81af from peer b1357297ed3e46b78f7b1b44c1eec2d1 at {username='slave'} at 127.6.50.132:48831: session id = b1357297ed3e46b78f7b1b44c1eec2d1-57984748adc7482a9a2d999a447a81af
I20261117 14:49:50.531994 6807 tablet_copy_service.cc:140] P def6b23bccc94a78a47118da331f2798: Received BeginTabletCopySession request for tablet 47d9af37b05545f0b5b0c033f4ec953f from peer b1357297ed3e46b78f7b1b44c1eec2d1 ({username='slave'} at 127.6.50.132:48831)
I20261117 14:49:50.532217 6807 tablet_copy_service.cc:161] P def6b23bccc94a78a47118da331f2798: Beginning new tablet copy session on tablet 47d9af37b05545f0b5b0c033f4ec953f from peer b1357297ed3e46b78f7b1b44c1eec2d1 at {username='slave'} at 127.6.50.132:48831: session id = b1357297ed3e46b78f7b1b44c1eec2d1-47d9af37b05545f0b5b0c033f4ec953f
I20261117 14:49:50.535382 6808 tablet_copy_source_session.cc:215] T 57984748adc7482a9a2d999a447a81af P def6b23bccc94a78a47118da331f2798: Tablet Copy: opened 0 blocks and 1 log segments
I20261117 14:49:50.535573 6807 tablet_copy_source_session.cc:215] T 47d9af37b05545f0b5b0c033f4ec953f P def6b23bccc94a78a47118da331f2798: Tablet Copy: opened 0 blocks and 1 log segments
I20261117 14:49:50.538183 7522 ts_tablet_manager.cc:979] T d1732d75bf044feb8884fc3135373072 P b1357297ed3e46b78f7b1b44c1eec2d1: Initiating tablet copy from peer c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271)
I20261117 14:49:50.539299 7522 tablet_copy_client.cc:323] T d1732d75bf044feb8884fc3135373072 P b1357297ed3e46b78f7b1b44c1eec2d1: tablet copy: Beginning tablet copy session from remote peer at address 127.6.50.130:36271
I20261117 14:49:50.539937 7518 tablet_copy_client.cc:323] T 5c849aa2a21a4c13b2e31d2ca3f692cc P b1357297ed3e46b78f7b1b44c1eec2d1: tablet copy: Beginning tablet copy session from remote peer at address 127.6.50.130:36271
I20261117 14:49:50.549595 6678 tablet_copy_service.cc:140] P c7900e455dd64c68bccfc499bda413f7: Received BeginTabletCopySession request for tablet b74e748e97c84edeabc1c0cb41ddae99 from peer b1357297ed3e46b78f7b1b44c1eec2d1 ({username='slave'} at 127.6.50.132:60699)
I20261117 14:49:50.549790 6678 tablet_copy_service.cc:161] P c7900e455dd64c68bccfc499bda413f7: Beginning new tablet copy session on tablet b74e748e97c84edeabc1c0cb41ddae99 from peer b1357297ed3e46b78f7b1b44c1eec2d1 at {username='slave'} at 127.6.50.132:60699: session id = b1357297ed3e46b78f7b1b44c1eec2d1-b74e748e97c84edeabc1c0cb41ddae99
I20261117 14:49:50.550120 6676 tablet_copy_service.cc:140] P c7900e455dd64c68bccfc499bda413f7: Received BeginTabletCopySession request for tablet 5c849aa2a21a4c13b2e31d2ca3f692cc from peer b1357297ed3e46b78f7b1b44c1eec2d1 ({username='slave'} at 127.6.50.132:60699)
I20261117 14:49:50.550266 6676 tablet_copy_service.cc:161] P c7900e455dd64c68bccfc499bda413f7: Beginning new tablet copy session on tablet 5c849aa2a21a4c13b2e31d2ca3f692cc from peer b1357297ed3e46b78f7b1b44c1eec2d1 at {username='slave'} at 127.6.50.132:60699: session id = b1357297ed3e46b78f7b1b44c1eec2d1-5c849aa2a21a4c13b2e31d2ca3f692cc
I20261117 14:49:50.549602 6677 tablet_copy_service.cc:140] P c7900e455dd64c68bccfc499bda413f7: Received BeginTabletCopySession request for tablet d1732d75bf044feb8884fc3135373072 from peer b1357297ed3e46b78f7b1b44c1eec2d1 ({username='slave'} at 127.6.50.132:60699)
I20261117 14:49:50.552701 6677 tablet_copy_service.cc:161] P c7900e455dd64c68bccfc499bda413f7: Beginning new tablet copy session on tablet d1732d75bf044feb8884fc3135373072 from peer b1357297ed3e46b78f7b1b44c1eec2d1 at {username='slave'} at 127.6.50.132:60699: session id = b1357297ed3e46b78f7b1b44c1eec2d1-d1732d75bf044feb8884fc3135373072
I20261117 14:49:50.553849 6676 tablet_copy_source_session.cc:215] T 5c849aa2a21a4c13b2e31d2ca3f692cc P c7900e455dd64c68bccfc499bda413f7: Tablet Copy: opened 0 blocks and 1 log segments
I20261117 14:49:50.546887 7524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57984748adc7482a9a2d999a447a81af. 1 dirs total, 0 dirs full, 0 dirs failed
I20261117 14:49:50.555533 7518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c849aa2a21a4c13b2e31d2ca3f692cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20261117 14:49:50.555860 6677 tablet_copy_source_session.cc:215] T d1732d75bf044feb8884fc3135373072 P c7900e455dd64c68bccfc499bda413f7: Tablet Copy: opened 0 blocks and 1 log segments
I20261117 14:49:50.556571 7519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47d9af37b05545f0b5b0c033f4ec953f. 1 dirs total, 0 dirs full, 0 dirs failed
I20261117 14:49:50.557443 6678 tablet_copy_source_session.cc:215] T b74e748e97c84edeabc1c0cb41ddae99 P c7900e455dd64c68bccfc499bda413f7: Tablet Copy: opened 0 blocks and 1 log segments
I20261117 14:49:50.572219 7524 tablet_copy_client.cc:806] T 57984748adc7482a9a2d999a447a81af P b1357297ed3e46b78f7b1b44c1eec2d1: tablet copy: Starting download of 0 data blocks...
I20261117 14:49:50.572953 7524 tablet_copy_client.cc:670] T 57984748adc7482a9a2d999a447a81af P b1357297ed3e46b78f7b1b44c1eec2d1: tablet copy: Starting download of 1 WAL segments...
I20261117 14:49:50.573638 7518 tablet_copy_client.cc:806] T 5c849aa2a21a4c13b2e31d2ca3f692cc P b1357297ed3e46b78f7b1b44c1eec2d1: tablet copy: Starting download of 0 data blocks...
I20261117 14:49:50.574034 7518 tablet_copy_client.cc:670] T 5c849aa2a21a4c13b2e31d2ca3f692cc P b1357297ed3e46b78f7b1b44c1eec2d1: tablet copy: Starting download of 1 WAL segments...
I20261117 14:49:50.576624 7519 tablet_copy_client.cc:806] T 47d9af37b05545f0b5b0c033f4ec953f P b1357297ed3e46b78f7b1b44c1eec2d1: tablet copy: Starting download of 0 data blocks...
I20261117 14:49:50.576874 7519 tablet_copy_client.cc:670] T 47d9af37b05545f0b5b0c033f4ec953f P b1357297ed3e46b78f7b1b44c1eec2d1: tablet copy: Starting download of 1 WAL segments...
I20261117 14:49:50.588758 7522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1732d75bf044feb8884fc3135373072. 1 dirs total, 0 dirs full, 0 dirs failed
I20261117 14:49:50.594156 7517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b74e748e97c84edeabc1c0cb41ddae99. 1 dirs total, 0 dirs full, 0 dirs failed
I20261117 14:49:50.599965 7522 tablet_copy_client.cc:806] T d1732d75bf044feb8884fc3135373072 P b1357297ed3e46b78f7b1b44c1eec2d1: tablet copy: Starting download of 0 data blocks...
I20261117 14:49:50.600297 7522 tablet_copy_client.cc:670] T d1732d75bf044feb8884fc3135373072 P b1357297ed3e46b78f7b1b44c1eec2d1: tablet copy: Starting download of 1 WAL segments...
I20261117 14:49:50.615491 7519 tablet_copy_client.cc:538] T 47d9af37b05545f0b5b0c033f4ec953f P b1357297ed3e46b78f7b1b44c1eec2d1: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20261117 14:49:50.616247 7517 tablet_copy_client.cc:806] T b74e748e97c84edeabc1c0cb41ddae99 P b1357297ed3e46b78f7b1b44c1eec2d1: tablet copy: Starting download of 0 data blocks...
I20261117 14:49:50.615491 7524 tablet_copy_client.cc:538] T 57984748adc7482a9a2d999a447a81af P b1357297ed3e46b78f7b1b44c1eec2d1: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20261117 14:49:50.616604 7517 tablet_copy_client.cc:670] T b74e748e97c84edeabc1c0cb41ddae99 P b1357297ed3e46b78f7b1b44c1eec2d1: tablet copy: Starting download of 1 WAL segments...
I20261117 14:49:50.620791 7519 tablet_bootstrap.cc:492] T 47d9af37b05545f0b5b0c033f4ec953f P b1357297ed3e46b78f7b1b44c1eec2d1: Bootstrap starting.
I20261117 14:49:50.620826 7524 tablet_bootstrap.cc:492] T 57984748adc7482a9a2d999a447a81af P b1357297ed3e46b78f7b1b44c1eec2d1: Bootstrap starting.
I20261117 14:49:50.626093 7518 tablet_copy_client.cc:538] T 5c849aa2a21a4c13b2e31d2ca3f692cc P b1357297ed3e46b78f7b1b44c1eec2d1: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20261117 14:49:50.630002 7518 tablet_bootstrap.cc:492] T 5c849aa2a21a4c13b2e31d2ca3f692cc P b1357297ed3e46b78f7b1b44c1eec2d1: Bootstrap starting.
I20261117 14:49:50.637245 7522 tablet_copy_client.cc:538] T d1732d75bf044feb8884fc3135373072 P b1357297ed3e46b78f7b1b44c1eec2d1: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20261117 14:49:50.641085 7522 tablet_bootstrap.cc:492] T d1732d75bf044feb8884fc3135373072 P b1357297ed3e46b78f7b1b44c1eec2d1: Bootstrap starting.
I20261117 14:49:50.648350 7520 tablet_copy_client.cc:323] T 3cea00abcccd4b1284393ef8b406cab1 P b1357297ed3e46b78f7b1b44c1eec2d1: tablet copy: Beginning tablet copy session from remote peer at address 127.6.50.131:33611
I20261117 14:49:50.649296 6807 tablet_copy_service.cc:140] P def6b23bccc94a78a47118da331f2798: Received BeginTabletCopySession request for tablet 3cea00abcccd4b1284393ef8b406cab1 from peer b1357297ed3e46b78f7b1b44c1eec2d1 ({username='slave'} at 127.6.50.132:48831)
I20261117 14:49:50.649461 6807 tablet_copy_service.cc:161] P def6b23bccc94a78a47118da331f2798: Beginning new tablet copy session on tablet 3cea00abcccd4b1284393ef8b406cab1 from peer b1357297ed3e46b78f7b1b44c1eec2d1 at {username='slave'} at 127.6.50.132:48831: session id = b1357297ed3e46b78f7b1b44c1eec2d1-3cea00abcccd4b1284393ef8b406cab1
I20261117 14:49:50.652510 6807 tablet_copy_source_session.cc:215] T 3cea00abcccd4b1284393ef8b406cab1 P def6b23bccc94a78a47118da331f2798: Tablet Copy: opened 0 blocks and 1 log segments
I20261117 14:49:50.654678 7520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cea00abcccd4b1284393ef8b406cab1. 1 dirs total, 0 dirs full, 0 dirs failed
I20261117 14:49:50.671986 7520 tablet_copy_client.cc:806] T 3cea00abcccd4b1284393ef8b406cab1 P b1357297ed3e46b78f7b1b44c1eec2d1: tablet copy: Starting download of 0 data blocks...
I20261117 14:49:50.672580 7520 tablet_copy_client.cc:670] T 3cea00abcccd4b1284393ef8b406cab1 P b1357297ed3e46b78f7b1b44c1eec2d1: tablet copy: Starting download of 1 WAL segments...
I20261117 14:49:50.699049 7520 tablet_copy_client.cc:538] T 3cea00abcccd4b1284393ef8b406cab1 P b1357297ed3e46b78f7b1b44c1eec2d1: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20261117 14:49:50.723713 7517 tablet_copy_client.cc:538] T b74e748e97c84edeabc1c0cb41ddae99 P b1357297ed3e46b78f7b1b44c1eec2d1: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20261117 14:49:50.723773 7520 tablet_bootstrap.cc:492] T 3cea00abcccd4b1284393ef8b406cab1 P b1357297ed3e46b78f7b1b44c1eec2d1: Bootstrap starting.
I20261117 14:49:50.728333 7517 tablet_bootstrap.cc:492] T b74e748e97c84edeabc1c0cb41ddae99 P b1357297ed3e46b78f7b1b44c1eec2d1: Bootstrap starting.
W20261117 14:49:50.782250 6976 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletCopyService.FetchData -> {remote=127.6.50.130:36271, user_credentials={real_user=slave}} blocked reactor thread for 60159.4us
W20261117 14:49:50.808562 6724 consensus_peers.cc:597] T 3cea00abcccd4b1284393ef8b406cab1 P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20261117 14:49:50.832897 6724 consensus_peers.cc:597] T 47d9af37b05545f0b5b0c033f4ec953f P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20261117 14:49:50.853595 6594 consensus_peers.cc:597] T 5c849aa2a21a4c13b2e31d2ca3f692cc P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20261117 14:49:50.854151 6724 consensus_peers.cc:597] T 57984748adc7482a9a2d999a447a81af P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20261117 14:49:50.882475 6594 consensus_peers.cc:597] T b74e748e97c84edeabc1c0cb41ddae99 P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20261117 14:49:50.940726 6594 consensus_peers.cc:597] T d1732d75bf044feb8884fc3135373072 P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20261117 14:49:51.038010 6593 consensus_peers.cc:597] T 5c849aa2a21a4c13b2e31d2ca3f692cc P c7900e455dd64c68bccfc499bda413f7 -> Peer b1357297ed3e46b78f7b1b44c1eec2d1 (127.6.50.132:45815): Couldn't send request to peer b1357297ed3e46b78f7b1b44c1eec2d1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
W20261117 14:49:51.070564 6593 consensus_peers.cc:597] T d1732d75bf044feb8884fc3135373072 P c7900e455dd64c68bccfc499bda413f7 -> Peer b1357297ed3e46b78f7b1b44c1eec2d1 (127.6.50.132:45815): Couldn't send request to peer b1357297ed3e46b78f7b1b44c1eec2d1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
W20261117 14:49:51.084663 6723 consensus_peers.cc:597] T 57984748adc7482a9a2d999a447a81af P def6b23bccc94a78a47118da331f2798 -> Peer b1357297ed3e46b78f7b1b44c1eec2d1 (127.6.50.132:45815): Couldn't send request to peer b1357297ed3e46b78f7b1b44c1eec2d1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
W20261117 14:49:51.088184 6723 consensus_peers.cc:597] T 47d9af37b05545f0b5b0c033f4ec953f P def6b23bccc94a78a47118da331f2798 -> Peer b1357297ed3e46b78f7b1b44c1eec2d1 (127.6.50.132:45815): Couldn't send request to peer b1357297ed3e46b78f7b1b44c1eec2d1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
W20261117 14:49:51.108960 6593 consensus_peers.cc:597] T b74e748e97c84edeabc1c0cb41ddae99 P c7900e455dd64c68bccfc499bda413f7 -> Peer b1357297ed3e46b78f7b1b44c1eec2d1 (127.6.50.132:45815): Couldn't send request to peer b1357297ed3e46b78f7b1b44c1eec2d1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
W20261117 14:49:51.137701 6723 consensus_peers.cc:597] T 3cea00abcccd4b1284393ef8b406cab1 P def6b23bccc94a78a47118da331f2798 -> Peer b1357297ed3e46b78f7b1b44c1eec2d1 (127.6.50.132:45815): Couldn't send request to peer b1357297ed3e46b78f7b1b44c1eec2d1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
W20261117 14:49:51.287824 6724 consensus_peers.cc:597] T 3cea00abcccd4b1284393ef8b406cab1 P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20261117 14:49:51.306093 6594 consensus_peers.cc:597] T b74e748e97c84edeabc1c0cb41ddae99 P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20261117 14:49:51.332733 6594 consensus_peers.cc:597] T 5c849aa2a21a4c13b2e31d2ca3f692cc P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20261117 14:49:51.355135 6724 consensus_peers.cc:597] T 47d9af37b05545f0b5b0c033f4ec953f P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20261117 14:49:51.390369 6724 consensus_peers.cc:597] T 57984748adc7482a9a2d999a447a81af P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20261117 14:49:51.422662 6594 consensus_peers.cc:597] T d1732d75bf044feb8884fc3135373072 P c7900e455dd64c68bccfc499bda413f7 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20261117 14:49:51.521384 6593 consensus_peers.cc:597] T 5c849aa2a21a4c13b2e31d2ca3f692cc P c7900e455dd64c68bccfc499bda413f7 -> Peer b1357297ed3e46b78f7b1b44c1eec2d1 (127.6.50.132:45815): Couldn't send request to peer b1357297ed3e46b78f7b1b44c1eec2d1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
W20261117 14:49:51.529982 6593 consensus_peers.cc:597] T d1732d75bf044feb8884fc3135373072 P c7900e455dd64c68bccfc499bda413f7 -> Peer b1357297ed3e46b78f7b1b44c1eec2d1 (127.6.50.132:45815): Couldn't send request to peer b1357297ed3e46b78f7b1b44c1eec2d1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
W20261117 14:49:51.558943 6723 consensus_peers.cc:597] T 57984748adc7482a9a2d999a447a81af P def6b23bccc94a78a47118da331f2798 -> Peer b1357297ed3e46b78f7b1b44c1eec2d1 (127.6.50.132:45815): Couldn't send request to peer b1357297ed3e46b78f7b1b44c1eec2d1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
W20261117 14:49:51.560813 6723 consensus_peers.cc:597] T 47d9af37b05545f0b5b0c033f4ec953f P def6b23bccc94a78a47118da331f2798 -> Peer b1357297ed3e46b78f7b1b44c1eec2d1 (127.6.50.132:45815): Couldn't send request to peer b1357297ed3e46b78f7b1b44c1eec2d1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
W20261117 14:49:51.615759 6593 consensus_peers.cc:597] T b74e748e97c84edeabc1c0cb41ddae99 P c7900e455dd64c68bccfc499bda413f7 -> Peer b1357297ed3e46b78f7b1b44c1eec2d1 (127.6.50.132:45815): Couldn't send request to peer b1357297ed3e46b78f7b1b44c1eec2d1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
I20261117 14:49:51.635532 7519 log.cc:826] T 47d9af37b05545f0b5b0c033f4ec953f P b1357297ed3e46b78f7b1b44c1eec2d1: Log is configured to *not* fsync() on all Append() calls
W20261117 14:49:51.667399 6723 consensus_peers.cc:597] T 3cea00abcccd4b1284393ef8b406cab1 P def6b23bccc94a78a47118da331f2798 -> Peer b1357297ed3e46b78f7b1b44c1eec2d1 (127.6.50.132:45815): Couldn't send request to peer b1357297ed3e46b78f7b1b44c1eec2d1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
I20261117 14:49:51.748289 6346 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskUafhB0/build/asan/bin/kudu pid 6576
I20261117 14:49:51.750293 6698 generic_service.cc:196] Checking for leaks (request via RPC)
W20261117 14:49:51.762632 6724 consensus_peers.cc:597] T 3cea00abcccd4b1284393ef8b406cab1 P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20261117 14:49:51.864099 6724 consensus_peers.cc:597] T 47d9af37b05545f0b5b0c033f4ec953f P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20261117 14:49:51.957080 6724 consensus_peers.cc:597] T 57984748adc7482a9a2d999a447a81af P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20261117 14:49:51.958755 7389 raft_consensus.cc:499] T 5c849aa2a21a4c13b2e31d2ca3f692cc P def6b23bccc94a78a47118da331f2798 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7900e455dd64c68bccfc499bda413f7)
I20261117 14:49:51.958940 7389 raft_consensus.cc:521] T 5c849aa2a21a4c13b2e31d2ca3f692cc P def6b23bccc94a78a47118da331f2798 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 1529 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } } peers { permanent_uuid: "b1357297ed3e46b78f7b1b44c1eec2d1" member_type: NON_VOTER last_known_addr { host: "127.6.50.132" port: 45815 } attrs { promote: true } }
I20261117 14:49:51.959689 7389 leader_election.cc:290] T 5c849aa2a21a4c13b2e31d2ca3f692cc P def6b23bccc94a78a47118da331f2798 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937), c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271)
W20261117 14:49:51.962450 6724 leader_election.cc:336] T 5c849aa2a21a4c13b2e31d2ca3f692cc P def6b23bccc94a78a47118da331f2798 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111)
I20261117 14:49:51.971815 7389 raft_consensus.cc:499] T d1732d75bf044feb8884fc3135373072 P def6b23bccc94a78a47118da331f2798 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7900e455dd64c68bccfc499bda413f7)
I20261117 14:49:51.972008 7389 raft_consensus.cc:521] T d1732d75bf044feb8884fc3135373072 P def6b23bccc94a78a47118da331f2798 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 1529 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } } peers { permanent_uuid: "b1357297ed3e46b78f7b1b44c1eec2d1" member_type: NON_VOTER last_known_addr { host: "127.6.50.132" port: 45815 } attrs { promote: true } }
I20261117 14:49:51.972786 7389 leader_election.cc:290] T d1732d75bf044feb8884fc3135373072 P def6b23bccc94a78a47118da331f2798 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937), c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271)
W20261117 14:49:51.973855 6724 leader_election.cc:336] T d1732d75bf044feb8884fc3135373072 P def6b23bccc94a78a47118da331f2798 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111)
W20261117 14:49:52.036432 6723 consensus_peers.cc:597] T 47d9af37b05545f0b5b0c033f4ec953f P def6b23bccc94a78a47118da331f2798 -> Peer b1357297ed3e46b78f7b1b44c1eec2d1 (127.6.50.132:45815): Couldn't send request to peer b1357297ed3e46b78f7b1b44c1eec2d1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 16: this message will repeat every 5th retry.
I20261117 14:49:52.047429 7389 raft_consensus.cc:499] T b74e748e97c84edeabc1c0cb41ddae99 P def6b23bccc94a78a47118da331f2798 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c7900e455dd64c68bccfc499bda413f7)
I20261117 14:49:52.047621 7389 raft_consensus.cc:521] T b74e748e97c84edeabc1c0cb41ddae99 P def6b23bccc94a78a47118da331f2798 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 1530 OBSOLETE_local: false peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } } peers { permanent_uuid: "b1357297ed3e46b78f7b1b44c1eec2d1" member_type: NON_VOTER last_known_addr { host: "127.6.50.132" port: 45815 } attrs { promote: true } }
I20261117 14:49:52.049064 7389 leader_election.cc:290] T b74e748e97c84edeabc1c0cb41ddae99 P def6b23bccc94a78a47118da331f2798 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271), ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937)
W20261117 14:49:52.050421 6723 consensus_peers.cc:597] T 57984748adc7482a9a2d999a447a81af P def6b23bccc94a78a47118da331f2798 -> Peer b1357297ed3e46b78f7b1b44c1eec2d1 (127.6.50.132:45815): Couldn't send request to peer b1357297ed3e46b78f7b1b44c1eec2d1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 16: this message will repeat every 5th retry.
W20261117 14:49:52.050861 6724 leader_election.cc:336] T b74e748e97c84edeabc1c0cb41ddae99 P def6b23bccc94a78a47118da331f2798 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111)
W20261117 14:49:52.151866 6723 consensus_peers.cc:597] T 3cea00abcccd4b1284393ef8b406cab1 P def6b23bccc94a78a47118da331f2798 -> Peer b1357297ed3e46b78f7b1b44c1eec2d1 (127.6.50.132:45815): Couldn't send request to peer b1357297ed3e46b78f7b1b44c1eec2d1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 16: this message will repeat every 5th retry.
W20261117 14:49:52.231693 6724 consensus_peers.cc:597] T 3cea00abcccd4b1284393ef8b406cab1 P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20261117 14:49:52.329247 7389 consensus_queue.cc:580] T 3cea00abcccd4b1284393ef8b406cab1 P def6b23bccc94a78a47118da331f2798 [LEADER]: Leader has been unable to successfully communicate with peer ec41d6947a4a4eadadf90c3756899704 for more than 2 seconds (2.024s)
I20261117 14:49:52.340091 7491 consensus_queue.cc:580] T 57984748adc7482a9a2d999a447a81af P def6b23bccc94a78a47118da331f2798 [LEADER]: Leader has been unable to successfully communicate with peer ec41d6947a4a4eadadf90c3756899704 for more than 2 seconds (2.032s)
I20261117 14:49:52.353929 7389 consensus_queue.cc:580] T 47d9af37b05545f0b5b0c033f4ec953f P def6b23bccc94a78a47118da331f2798 [LEADER]: Leader has been unable to successfully communicate with peer ec41d6947a4a4eadadf90c3756899704 for more than 2 seconds (2.042s)
W20261117 14:49:52.358451 6724 consensus_peers.cc:597] T 47d9af37b05545f0b5b0c033f4ec953f P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20261117 14:49:52.461092 6724 consensus_peers.cc:597] T 57984748adc7482a9a2d999a447a81af P def6b23bccc94a78a47118da331f2798 -> Peer ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937): Couldn't send request to peer ec41d6947a4a4eadadf90c3756899704. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:42937: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20261117 14:49:52.496217 6723 consensus_peers.cc:597] T 47d9af37b05545f0b5b0c033f4ec953f P def6b23bccc94a78a47118da331f2798 -> Peer b1357297ed3e46b78f7b1b44c1eec2d1 (127.6.50.132:45815): Couldn't send request to peer b1357297ed3e46b78f7b1b44c1eec2d1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 21: this message will repeat every 5th retry.
I20261117 14:49:52.501879 6657 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5c849aa2a21a4c13b2e31d2ca3f692cc" candidate_uuid: "def6b23bccc94a78a47118da331f2798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1546 } } ignore_live_leader: false dest_uuid: "c7900e455dd64c68bccfc499bda413f7" is_pre_election: true
I20261117 14:49:52.513099 6656 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "d1732d75bf044feb8884fc3135373072" candidate_uuid: "def6b23bccc94a78a47118da331f2798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1546 } } ignore_live_leader: false dest_uuid: "c7900e455dd64c68bccfc499bda413f7" is_pre_election: true
I20261117 14:49:52.514179 6653 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "b74e748e97c84edeabc1c0cb41ddae99" candidate_uuid: "def6b23bccc94a78a47118da331f2798" candidate_term: 3 candidate_status { last_received { term: 2 index: 1547 } } ignore_live_leader: false dest_uuid: "c7900e455dd64c68bccfc499bda413f7" is_pre_election: true
I20261117 14:49:52.515158 6653 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "d1732d75bf044feb8884fc3135373072" candidate_uuid: "def6b23bccc94a78a47118da331f2798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1546 } } ignore_live_leader: false dest_uuid: "c7900e455dd64c68bccfc499bda413f7" is_pre_election: true
I20261117 14:49:52.516775 6723 leader_election.cc:304] T d1732d75bf044feb8884fc3135373072 P def6b23bccc94a78a47118da331f2798 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: def6b23bccc94a78a47118da331f2798; no voters: c7900e455dd64c68bccfc499bda413f7, ec41d6947a4a4eadadf90c3756899704
I20261117 14:49:52.517094 7491 raft_consensus.cc:2771] T d1732d75bf044feb8884fc3135373072 P def6b23bccc94a78a47118da331f2798 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20261117 14:49:52.520741 6656 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "5c849aa2a21a4c13b2e31d2ca3f692cc" candidate_uuid: "def6b23bccc94a78a47118da331f2798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1546 } } ignore_live_leader: false dest_uuid: "c7900e455dd64c68bccfc499bda413f7" is_pre_election: true
I20261117 14:49:52.521204 6653 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "b74e748e97c84edeabc1c0cb41ddae99" candidate_uuid: "def6b23bccc94a78a47118da331f2798" candidate_term: 3 candidate_status { last_received { term: 2 index: 1547 } } ignore_live_leader: false dest_uuid: "c7900e455dd64c68bccfc499bda413f7" is_pre_election: true
I20261117 14:49:52.521926 6723 leader_election.cc:304] T 5c849aa2a21a4c13b2e31d2ca3f692cc P def6b23bccc94a78a47118da331f2798 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: def6b23bccc94a78a47118da331f2798; no voters: c7900e455dd64c68bccfc499bda413f7, ec41d6947a4a4eadadf90c3756899704
I20261117 14:49:52.522213 7491 raft_consensus.cc:2771] T 5c849aa2a21a4c13b2e31d2ca3f692cc P def6b23bccc94a78a47118da331f2798 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20261117 14:49:52.522373 6723 leader_election.cc:304] T b74e748e97c84edeabc1c0cb41ddae99 P def6b23bccc94a78a47118da331f2798 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: def6b23bccc94a78a47118da331f2798; no voters: c7900e455dd64c68bccfc499bda413f7, ec41d6947a4a4eadadf90c3756899704
I20261117 14:49:52.522682 7491 raft_consensus.cc:2771] T b74e748e97c84edeabc1c0cb41ddae99 P def6b23bccc94a78a47118da331f2798 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20261117 14:49:52.533783 7472 consensus_queue.cc:580] T d1732d75bf044feb8884fc3135373072 P c7900e455dd64c68bccfc499bda413f7 [LEADER]: Leader has been unable to successfully communicate with peer ec41d6947a4a4eadadf90c3756899704 for more than 2 seconds (2.194s)
W20261117 14:49:52.537976 6723 consensus_peers.cc:597] T 57984748adc7482a9a2d999a447a81af P def6b23bccc94a78a47118da331f2798 -> Peer b1357297ed3e46b78f7b1b44c1eec2d1 (127.6.50.132:45815): Couldn't send request to peer b1357297ed3e46b78f7b1b44c1eec2d1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 21: this message will repeat every 5th retry.
W20261117 14:49:52.541118 6698 rpcz_store.cc:267] Call kudu.server.GenericService.CheckLeaks from 127.0.0.1:57164 (request call id 105) took 791 ms (client timeout 1000 ms). Trace:
W20261117 14:49:52.544615 6698 rpcz_store.cc:269] 1117 14:49:51.749318 (+ 0us) service_pool.cc:167] Inserting onto call queue
1117 14:49:51.750094 (+ 776us) service_pool.cc:224] Handling call
1117 14:49:52.541093 (+790999us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20261117 14:49:52.547214 6346 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskUafhB0/build/asan/bin/kudu with pid 6576
W20261117 14:49:52.640897 6724 connection.cc:573] server connection from 127.6.50.130:48827 recv error: Network error: recv error from unknown peer: Connection reset by peer (error 104)
W20261117 14:49:52.640935 6723 connection.cc:573] client connection to 127.6.50.130:36271 recv error: Network error: recv error from unknown peer: Connection reset by peer (error 104)
W20261117 14:49:52.642638 7162 connection.cc:573] server connection from 127.6.50.130:37691 recv error: Network error: recv error from unknown peer: Connection reset by peer (error 104)
W20261117 14:49:52.642709 7488 negotiation.cc:336] Failed RPC negotiation. Trace:
1117 14:49:52.641560 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.6.50.130:36271 (local address 127.6.50.131:58269)
1117 14:49:52.641700 (+ 140us) negotiation.cc:107] Waiting for socket to connect
1117 14:49:52.641719 (+ 19us) client_negotiation.cc:175] Beginning negotiation
1117 14:49:52.641845 (+ 126us) client_negotiation.cc:262] Sending NEGOTIATE NegotiatePB request
1117 14:49:52.642681 (+ 836us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.50.130:36271: BlockingRecv error: recv error from unknown peer: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":35}
W20261117 14:49:52.644191 6723 consensus_peers.cc:597] T 47d9af37b05545f0b5b0c033f4ec953f P def6b23bccc94a78a47118da331f2798 -> Peer c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271): Couldn't send request to peer c7900e455dd64c68bccfc499bda413f7. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.130:36271: BlockingRecv error: recv error from unknown peer: Connection reset by peer (error 104). This is attempt 1: this message will repeat every 5th retry.
W20261117 14:49:52.644315 6723 consensus_peers.cc:597] T 57984748adc7482a9a2d999a447a81af P def6b23bccc94a78a47118da331f2798 -> Peer c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271): Couldn't send request to peer c7900e455dd64c68bccfc499bda413f7. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.130:36271: BlockingRecv error: recv error from unknown peer: Connection reset by peer (error 104). This is attempt 1: this message will repeat every 5th retry.
W20261117 14:49:52.644402 6723 consensus_peers.cc:597] T 3cea00abcccd4b1284393ef8b406cab1 P def6b23bccc94a78a47118da331f2798 -> Peer c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271): Couldn't send request to peer c7900e455dd64c68bccfc499bda413f7. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.130:36271: BlockingRecv error: recv error from unknown peer: Connection reset by peer (error 104). This is attempt 1: this message will repeat every 5th retry.
I20261117 14:49:52.645217 6346 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskUafhB0/build/asan/bin/kudu pid 6706
I20261117 14:49:52.646395 6828 generic_service.cc:196] Checking for leaks (request via RPC)
W20261117 14:49:53.493963 6828 rpcz_store.cc:267] Call kudu.server.GenericService.CheckLeaks from 127.0.0.1:57802 (request call id 105) took 847 ms (client timeout 1000 ms). Trace:
W20261117 14:49:53.494160 6828 rpcz_store.cc:269] 1117 14:49:52.646067 (+ 0us) service_pool.cc:167] Inserting onto call queue
1117 14:49:52.646137 (+ 70us) service_pool.cc:224] Handling call
1117 14:49:53.493917 (+847780us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20261117 14:49:53.509231 7389 raft_consensus.cc:499] T b74e748e97c84edeabc1c0cb41ddae99 P def6b23bccc94a78a47118da331f2798 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c7900e455dd64c68bccfc499bda413f7)
I20261117 14:49:53.509433 7389 raft_consensus.cc:521] T b74e748e97c84edeabc1c0cb41ddae99 P def6b23bccc94a78a47118da331f2798 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 1530 OBSOLETE_local: false peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } } peers { permanent_uuid: "b1357297ed3e46b78f7b1b44c1eec2d1" member_type: NON_VOTER last_known_addr { host: "127.6.50.132" port: 45815 } attrs { promote: true } }
I20261117 14:49:53.510139 7389 leader_election.cc:290] T b74e748e97c84edeabc1c0cb41ddae99 P def6b23bccc94a78a47118da331f2798 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271), ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937)
I20261117 14:49:53.510856 7389 raft_consensus.cc:499] T d1732d75bf044feb8884fc3135373072 P def6b23bccc94a78a47118da331f2798 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7900e455dd64c68bccfc499bda413f7)
I20261117 14:49:53.510994 7389 raft_consensus.cc:521] T d1732d75bf044feb8884fc3135373072 P def6b23bccc94a78a47118da331f2798 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 1529 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } } peers { permanent_uuid: "b1357297ed3e46b78f7b1b44c1eec2d1" member_type: NON_VOTER last_known_addr { host: "127.6.50.132" port: 45815 } attrs { promote: true } }
I20261117 14:49:53.511556 7389 leader_election.cc:290] T d1732d75bf044feb8884fc3135373072 P def6b23bccc94a78a47118da331f2798 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937), c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271)
I20261117 14:49:53.511924 7389 raft_consensus.cc:499] T 5c849aa2a21a4c13b2e31d2ca3f692cc P def6b23bccc94a78a47118da331f2798 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7900e455dd64c68bccfc499bda413f7)
I20261117 14:49:53.512074 7389 raft_consensus.cc:521] T 5c849aa2a21a4c13b2e31d2ca3f692cc P def6b23bccc94a78a47118da331f2798 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 1529 OBSOLETE_local: false peers { permanent_uuid: "ec41d6947a4a4eadadf90c3756899704" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 42937 } } peers { permanent_uuid: "c7900e455dd64c68bccfc499bda413f7" member_type: VOTER last_known_addr { host: "127.6.50.130" port: 36271 } } peers { permanent_uuid: "def6b23bccc94a78a47118da331f2798" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 33611 } } peers { permanent_uuid: "b1357297ed3e46b78f7b1b44c1eec2d1" member_type: NON_VOTER last_known_addr { host: "127.6.50.132" port: 45815 } attrs { promote: true } }
I20261117 14:49:53.512666 7389 leader_election.cc:290] T 5c849aa2a21a4c13b2e31d2ca3f692cc P def6b23bccc94a78a47118da331f2798 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ec41d6947a4a4eadadf90c3756899704 (127.6.50.129:42937), c7900e455dd64c68bccfc499bda413f7 (127.6.50.130:36271)
I20261117 14:49:53.525633 6346 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskUafhB0/build/asan/bin/kudu with pid 6706
W20261117 14:49:53.634660 6977 connection.cc:573] server connection from 127.6.50.131:57633 recv error: Network error: recv error from unknown peer: Connection reset by peer (error 104)
W20261117 14:49:53.635952 7165 connection.cc:573] server connection from 127.6.50.131:50031 recv error: Network error: recv error from unknown peer: Connection reset by peer (error 104)
I20261117 14:49:53.636785 6346 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskUafhB0/build/asan/bin/kudu pid 6923
I20261117 14:49:53.638188 7091 generic_service.cc:196] Checking for leaks (request via RPC)
I20261117 14:49:53.861035 6346 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskUafhB0/build/asan/bin/kudu with pid 6923
I20261117 14:49:53.893652 6346 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskUafhB0/build/asan/bin/kudu pid 7145
I20261117 14:49:53.895025 7208 generic_service.cc:196] Checking for leaks (request via RPC)
I20261117 14:49:54.007339 6346 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskUafhB0/build/asan/bin/kudu with pid 7145
2026-11-17T14:49:54Z chronyd exiting
[ OK ] MaintenanceModeRF3ITest.TestFailedTServerInMaintenanceModeDoesntRereplicate (39705 ms)
[----------] 1 test from MaintenanceModeRF3ITest (39705 ms total)
[----------] 1 test from RollingRestartArgs/RollingRestartITest
[ RUN ] RollingRestartArgs/RollingRestartITest.TestWorkloads/4
2026-11-17T14:49:54Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-11-17T14:49:54Z Disabled control of system clock
I20261117 14:49:54.103616 6346 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskUafhB0/build/asan/bin/kudu
/tmp/dist-test-taskUafhB0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.50.190:39297
--webserver_interface=127.6.50.190
--webserver_port=0
--builtin_ntp_servers=127.6.50.148:44279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.50.190:39297
--location_mapping_cmd=/tmp/dist-test-taskUafhB0/build/asan/bin/testdata/assign-location.py --state_store=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/location-assignment.state --map /L0:4
--master_client_location_assignment_enabled=false with env {}
W20261117 14:49:54.463321 7563 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261117 14:49:54.463657 7563 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261117 14:49:54.463824 7563 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261117 14:49:54.472524 7563 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20261117 14:49:54.472638 7563 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261117 14:49:54.472731 7563 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20261117 14:49:54.472811 7563 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20261117 14:49:54.483470 7563 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.50.148:44279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/master-0/wal
--location_mapping_cmd=/tmp/dist-test-taskUafhB0/build/asan/bin/testdata/assign-location.py --state_store=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/location-assignment.state --map /L0:4
--ipki_ca_key_size=768
--master_addresses=127.6.50.190:39297
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.50.190:39297
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.6.50.190
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type FASTDEBUG
built by None at 17 Nov 2026 14:43:24 UTC on bdcb31816ec0
build id 14829
ASAN enabled
I20261117 14:49:54.485292 7563 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261117 14:49:54.487270 7563 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261117 14:49:54.496280 7569 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261117 14:49:54.496266 7568 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261117 14:49:54.497087 7571 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261117 14:49:54.497522 7563 server_base.cc:1061] running on GCE node
I20261117 14:49:54.498333 7563 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261117 14:49:54.499874 7563 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261117 14:49:54.501116 7563 hybrid_clock.cc:648] HybridClock initialized: now 1794926994501062 us; error 43 us; skew 500 ppm
I20261117 14:49:54.501500 7563 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261117 14:49:54.503726 7563 webserver.cc:577] Webserver started at http://127.6.50.190:35449/ using document root <none> and password file <none>
I20261117 14:49:54.504544 7563 fs_manager.cc:362] Metadata directory not provided
I20261117 14:49:54.504655 7563 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261117 14:49:54.504993 7563 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261117 14:49:54.507472 7563 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/master-0/data/instance:
uuid: "1a699960f11a428781845045b4b03daf"
format_stamp: "Formatted at 2026-11-17 14:49:54 on dist-test-slave-jwg6"
I20261117 14:49:54.508514 7563 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/master-0/wal/instance:
uuid: "1a699960f11a428781845045b4b03daf"
format_stamp: "Formatted at 2026-11-17 14:49:54 on dist-test-slave-jwg6"
I20261117 14:49:54.514187 7563 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20261117 14:49:54.517802 7577 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20261117 14:49:54.519323 7563 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20261117 14:49:54.519510 7563 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/master-0/data,/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/master-0/wal
uuid: "1a699960f11a428781845045b4b03daf"
format_stamp: "Formatted at 2026-11-17 14:49:54 on dist-test-slave-jwg6"
I20261117 14:49:54.519810 7563 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261117 14:49:54.532382 7563 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20261117 14:49:54.533342 7563 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261117 14:49:54.533654 7563 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261117 14:49:54.554575 7563 rpc_server.cc:307] RPC server started. Bound to: 127.6.50.190:39297
I20261117 14:49:54.554587 7628 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.50.190:39297 every 8 connection(s)
I20261117 14:49:54.556218 7563 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/master-0/data/info.pb
I20261117 14:49:54.558670 6346 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskUafhB0/build/asan/bin/kudu as pid 7563
I20261117 14:49:54.558892 6346 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/master-0/wal/instance
I20261117 14:49:54.562345 7629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20261117 14:49:54.573266 7629 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1a699960f11a428781845045b4b03daf: Bootstrap starting.
I20261117 14:49:54.576874 7629 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1a699960f11a428781845045b4b03daf: Neither blocks nor log segments found. Creating new log.
I20261117 14:49:54.577975 7629 log.cc:826] T 00000000000000000000000000000000 P 1a699960f11a428781845045b4b03daf: Log is configured to *not* fsync() on all Append() calls
I20261117 14:49:54.580932 7629 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1a699960f11a428781845045b4b03daf: No bootstrap required, opened a new log
I20261117 14:49:54.586431 7629 raft_consensus.cc:360] T 00000000000000000000000000000000 P 1a699960f11a428781845045b4b03daf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a699960f11a428781845045b4b03daf" member_type: VOTER last_known_addr { host: "127.6.50.190" port: 39297 } }
I20261117 14:49:54.586798 7629 raft_consensus.cc:386] T 00000000000000000000000000000000 P 1a699960f11a428781845045b4b03daf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261117 14:49:54.586902 7629 raft_consensus.cc:748] T 00000000000000000000000000000000 P 1a699960f11a428781845045b4b03daf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a699960f11a428781845045b4b03daf, State: Initialized, Role: FOLLOWER
I20261117 14:49:54.587533 7629 consensus_queue.cc:261] T 00000000000000000000000000000000 P 1a699960f11a428781845045b4b03daf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a699960f11a428781845045b4b03daf" member_type: VOTER last_known_addr { host: "127.6.50.190" port: 39297 } }
I20261117 14:49:54.587725 7629 raft_consensus.cc:400] T 00000000000000000000000000000000 P 1a699960f11a428781845045b4b03daf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20261117 14:49:54.587879 7629 raft_consensus.cc:499] T 00000000000000000000000000000000 P 1a699960f11a428781845045b4b03daf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20261117 14:49:54.588063 7629 raft_consensus.cc:3096] T 00000000000000000000000000000000 P 1a699960f11a428781845045b4b03daf [term 0 FOLLOWER]: Advancing to term 1
I20261117 14:49:54.590301 7629 raft_consensus.cc:521] T 00000000000000000000000000000000 P 1a699960f11a428781845045b4b03daf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a699960f11a428781845045b4b03daf" member_type: VOTER last_known_addr { host: "127.6.50.190" port: 39297 } }
I20261117 14:49:54.590821 7629 leader_election.cc:304] T 00000000000000000000000000000000 P 1a699960f11a428781845045b4b03daf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1a699960f11a428781845045b4b03daf; no voters:
I20261117 14:49:54.591475 7629 leader_election.cc:290] T 00000000000000000000000000000000 P 1a699960f11a428781845045b4b03daf [CANDIDATE]: Term 1 election: Requested vote from peers
I20261117 14:49:54.591670 7634 raft_consensus.cc:2826] T 00000000000000000000000000000000 P 1a699960f11a428781845045b4b03daf [term 1 FOLLOWER]: Leader election won for term 1
I20261117 14:49:54.593053 7634 raft_consensus.cc:705] T 00000000000000000000000000000000 P 1a699960f11a428781845045b4b03daf [term 1 LEADER]: Becoming Leader. State: Replica: 1a699960f11a428781845045b4b03daf, State: Running, Role: LEADER
I20261117 14:49:54.593623 7634 consensus_queue.cc:238] T 00000000000000000000000000000000 P 1a699960f11a428781845045b4b03daf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a699960f11a428781845045b4b03daf" member_type: VOTER last_known_addr { host: "127.6.50.190" port: 39297 } }
I20261117 14:49:54.593896 7629 sys_catalog.cc:565] T 00000000000000000000000000000000 P 1a699960f11a428781845045b4b03daf [sys.catalog]: configured and running, proceeding with master startup.
I20261117 14:49:54.596710 7636 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1a699960f11a428781845045b4b03daf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1a699960f11a428781845045b4b03daf. Latest consensus state: current_term: 1 leader_uuid: "1a699960f11a428781845045b4b03daf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a699960f11a428781845045b4b03daf" member_type: VOTER last_known_addr { host: "127.6.50.190" port: 39297 } } }
I20261117 14:49:54.597097 7636 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1a699960f11a428781845045b4b03daf [sys.catalog]: This master's current role is: LEADER
I20261117 14:49:54.597455 7635 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1a699960f11a428781845045b4b03daf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1a699960f11a428781845045b4b03daf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a699960f11a428781845045b4b03daf" member_type: VOTER last_known_addr { host: "127.6.50.190" port: 39297 } } }
I20261117 14:49:54.597726 7635 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1a699960f11a428781845045b4b03daf [sys.catalog]: This master's current role is: LEADER
I20261117 14:49:54.599481 7643 catalog_manager.cc:1526] Loading table and tablet metadata into memory...
I20261117 14:49:54.605007 7643 catalog_manager.cc:1535] Initializing Kudu cluster ID...
I20261117 14:49:54.614669 7643 catalog_manager.cc:1398] Generated new cluster ID: 5cb4618f44214fd6811e7e6013760ac3
I20261117 14:49:54.614809 7643 catalog_manager.cc:1546] Initializing Kudu internal certificate authority...
I20261117 14:49:54.628772 7643 catalog_manager.cc:1421] Generated new certificate authority record
I20261117 14:49:54.630532 7643 catalog_manager.cc:1555] Loading token signing keys...
I20261117 14:49:54.646018 7643 catalog_manager.cc:6221] T 00000000000000000000000000000000 P 1a699960f11a428781845045b4b03daf: Generated new TSK 0
I20261117 14:49:54.647230 7643 catalog_manager.cc:1565] Initializing in-progress tserver states...
I20261117 14:49:54.657125 6346 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskUafhB0/build/asan/bin/kudu
/tmp/dist-test-taskUafhB0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.50.129:0
--local_ip_for_outbound_sockets=127.6.50.129
--webserver_interface=127.6.50.129
--webserver_port=0
--tserver_master_addrs=127.6.50.190:39297
--builtin_ntp_servers=127.6.50.148:44279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
W20261117 14:49:55.033185 7653 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261117 14:49:55.033488 7653 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261117 14:49:55.033674 7653 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261117 14:49:55.042582 7653 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261117 14:49:55.042860 7653 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.50.129
I20261117 14:49:55.053440 7653 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.50.148:44279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.50.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.6.50.129
--webserver_port=0
--tserver_master_addrs=127.6.50.190:39297
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.50.129
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type FASTDEBUG
built by None at 17 Nov 2026 14:43:24 UTC on bdcb31816ec0
build id 14829
ASAN enabled
I20261117 14:49:55.055321 7653 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261117 14:49:55.057201 7653 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20261117 14:49:55.061280 7653 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20261117 14:49:55.067377 7661 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261117 14:49:55.067448 7658 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261117 14:49:55.067413 7659 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261117 14:49:55.068745 7653 server_base.cc:1061] running on GCE node
I20261117 14:49:55.069347 7653 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261117 14:49:55.070333 7653 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261117 14:49:55.071570 7653 hybrid_clock.cc:648] HybridClock initialized: now 1794926995071518 us; error 37 us; skew 500 ppm
I20261117 14:49:55.071878 7653 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261117 14:49:55.074232 7653 webserver.cc:577] Webserver started at http://127.6.50.129:39191/ using document root <none> and password file <none>
I20261117 14:49:55.074978 7653 fs_manager.cc:362] Metadata directory not provided
I20261117 14:49:55.075133 7653 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261117 14:49:55.075512 7653 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261117 14:49:55.078023 7653 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-0/data/instance:
uuid: "6041859320d34e679a287826f4f54fd6"
format_stamp: "Formatted at 2026-11-17 14:49:55 on dist-test-slave-jwg6"
I20261117 14:49:55.078799 7653 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-0/wal/instance:
uuid: "6041859320d34e679a287826f4f54fd6"
format_stamp: "Formatted at 2026-11-17 14:49:55 on dist-test-slave-jwg6"
I20261117 14:49:55.084347 7653 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20261117 14:49:55.087966 7667 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20261117 14:49:55.089514 7653 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20261117 14:49:55.089696 7653 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-0/data,/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-0/wal
uuid: "6041859320d34e679a287826f4f54fd6"
format_stamp: "Formatted at 2026-11-17 14:49:55 on dist-test-slave-jwg6"
I20261117 14:49:55.089880 7653 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261117 14:49:55.108609 7653 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20261117 14:49:55.109500 7653 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261117 14:49:55.109797 7653 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261117 14:49:55.110818 7653 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261117 14:49:55.112684 7653 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261117 14:49:55.112785 7653 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20261117 14:49:55.112933 7653 ts_tablet_manager.cc:662] Registered 0 tablets
I20261117 14:49:55.113005 7653 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20261117 14:49:55.147620 7653 rpc_server.cc:307] RPC server started. Bound to: 127.6.50.129:36371
I20261117 14:49:55.147729 7779 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.50.129:36371 every 8 connection(s)
I20261117 14:49:55.149235 7653 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-0/data/info.pb
I20261117 14:49:55.156790 6346 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskUafhB0/build/asan/bin/kudu as pid 7653
I20261117 14:49:55.157049 6346 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-0/wal/instance
I20261117 14:49:55.160842 6346 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskUafhB0/build/asan/bin/kudu
/tmp/dist-test-taskUafhB0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.50.130:0
--local_ip_for_outbound_sockets=127.6.50.130
--webserver_interface=127.6.50.130
--webserver_port=0
--tserver_master_addrs=127.6.50.190:39297
--builtin_ntp_servers=127.6.50.148:44279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
I20261117 14:49:55.163880 7780 heartbeater.cc:345] Connected to a master server at 127.6.50.190:39297
I20261117 14:49:55.164299 7780 heartbeater.cc:462] Registering TS with master...
I20261117 14:49:55.165449 7780 heartbeater.cc:508] Master 127.6.50.190:39297 requested a full tablet report, sending...
I20261117 14:49:55.212320 7594 ts_manager.cc:210] Registered new tserver with Master: 6041859320d34e679a287826f4f54fd6 (127.6.50.129:36371)
I20261117 14:49:55.214313 7594 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.6.50.129:34463
W20261117 14:49:55.514957 7784 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261117 14:49:55.515265 7784 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261117 14:49:55.515425 7784 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261117 14:49:55.524016 7784 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261117 14:49:55.524276 7784 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.50.130
I20261117 14:49:55.534732 7784 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.50.148:44279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.50.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.6.50.130
--webserver_port=0
--tserver_master_addrs=127.6.50.190:39297
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.50.130
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type FASTDEBUG
built by None at 17 Nov 2026 14:43:24 UTC on bdcb31816ec0
build id 14829
ASAN enabled
I20261117 14:49:55.536528 7784 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261117 14:49:55.538537 7784 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20261117 14:49:55.542682 7784 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20261117 14:49:55.550339 7790 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261117 14:49:55.550726 7791 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261117 14:49:55.551239 7793 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261117 14:49:55.551681 7784 server_base.cc:1061] running on GCE node
I20261117 14:49:55.552280 7784 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261117 14:49:55.553349 7784 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261117 14:49:55.554621 7784 hybrid_clock.cc:648] HybridClock initialized: now 1794926995554543 us; error 49 us; skew 500 ppm
I20261117 14:49:55.554988 7784 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261117 14:49:55.557826 7784 webserver.cc:577] Webserver started at http://127.6.50.130:45239/ using document root <none> and password file <none>
I20261117 14:49:55.558707 7784 fs_manager.cc:362] Metadata directory not provided
I20261117 14:49:55.558833 7784 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261117 14:49:55.559224 7784 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261117 14:49:55.562458 7784 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-1/data/instance:
uuid: "39c0d031db104a9d83a434fb89d0a277"
format_stamp: "Formatted at 2026-11-17 14:49:55 on dist-test-slave-jwg6"
I20261117 14:49:55.563418 7784 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-1/wal/instance:
uuid: "39c0d031db104a9d83a434fb89d0a277"
format_stamp: "Formatted at 2026-11-17 14:49:55 on dist-test-slave-jwg6"
I20261117 14:49:55.570451 7784 fs_manager.cc:696] Time spent creating directory manager: real 0.007s user 0.008s sys 0.000s
I20261117 14:49:55.574740 7799 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20261117 14:49:55.576435 7784 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20261117 14:49:55.576625 7784 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-1/data,/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-1/wal
uuid: "39c0d031db104a9d83a434fb89d0a277"
format_stamp: "Formatted at 2026-11-17 14:49:55 on dist-test-slave-jwg6"
I20261117 14:49:55.576812 7784 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261117 14:49:55.604646 7784 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20261117 14:49:55.605589 7784 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261117 14:49:55.605836 7784 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261117 14:49:55.606911 7784 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261117 14:49:55.608700 7784 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261117 14:49:55.608774 7784 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20261117 14:49:55.608856 7784 ts_tablet_manager.cc:662] Registered 0 tablets
I20261117 14:49:55.608898 7784 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20261117 14:49:55.643455 7784 rpc_server.cc:307] RPC server started. Bound to: 127.6.50.130:38123
I20261117 14:49:55.643501 7911 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.50.130:38123 every 8 connection(s)
I20261117 14:49:55.644994 7784 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-1/data/info.pb
I20261117 14:49:55.648994 6346 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskUafhB0/build/asan/bin/kudu as pid 7784
I20261117 14:49:55.649219 6346 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-1/wal/instance
I20261117 14:49:55.652814 6346 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskUafhB0/build/asan/bin/kudu
/tmp/dist-test-taskUafhB0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.50.131:0
--local_ip_for_outbound_sockets=127.6.50.131
--webserver_interface=127.6.50.131
--webserver_port=0
--tserver_master_addrs=127.6.50.190:39297
--builtin_ntp_servers=127.6.50.148:44279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
I20261117 14:49:55.659871 7912 heartbeater.cc:345] Connected to a master server at 127.6.50.190:39297
I20261117 14:49:55.660259 7912 heartbeater.cc:462] Registering TS with master...
I20261117 14:49:55.661185 7912 heartbeater.cc:508] Master 127.6.50.190:39297 requested a full tablet report, sending...
I20261117 14:49:55.706135 7594 ts_manager.cc:210] Registered new tserver with Master: 39c0d031db104a9d83a434fb89d0a277 (127.6.50.130:38123)
I20261117 14:49:55.707151 7594 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.6.50.130:49099
W20261117 14:49:56.007230 7915 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261117 14:49:56.007617 7915 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261117 14:49:56.007778 7915 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261117 14:49:56.016892 7915 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261117 14:49:56.017215 7915 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.50.131
I20261117 14:49:56.029039 7915 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.50.148:44279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.50.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.6.50.131
--webserver_port=0
--tserver_master_addrs=127.6.50.190:39297
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.50.131
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type FASTDEBUG
built by None at 17 Nov 2026 14:43:24 UTC on bdcb31816ec0
build id 14829
ASAN enabled
I20261117 14:49:56.030913 7915 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261117 14:49:56.032976 7915 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20261117 14:49:56.037525 7915 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20261117 14:49:56.044282 7921 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261117 14:49:56.044273 7922 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261117 14:49:56.044981 7924 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261117 14:49:56.046222 7915 server_base.cc:1061] running on GCE node
I20261117 14:49:56.046815 7915 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261117 14:49:56.047818 7915 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261117 14:49:56.049090 7915 hybrid_clock.cc:648] HybridClock initialized: now 1794926996049024 us; error 37 us; skew 500 ppm
I20261117 14:49:56.049422 7915 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261117 14:49:56.051772 7915 webserver.cc:577] Webserver started at http://127.6.50.131:39699/ using document root <none> and password file <none>
I20261117 14:49:56.052609 7915 fs_manager.cc:362] Metadata directory not provided
I20261117 14:49:56.052776 7915 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261117 14:49:56.053176 7915 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261117 14:49:56.055675 7915 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-2/data/instance:
uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3"
format_stamp: "Formatted at 2026-11-17 14:49:56 on dist-test-slave-jwg6"
I20261117 14:49:56.056552 7915 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-2/wal/instance:
uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3"
format_stamp: "Formatted at 2026-11-17 14:49:56 on dist-test-slave-jwg6"
I20261117 14:49:56.062541 7915 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20261117 14:49:56.066213 7930 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20261117 14:49:56.068018 7915 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.000s sys 0.001s
I20261117 14:49:56.068195 7915 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-2/data,/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-2/wal
uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3"
format_stamp: "Formatted at 2026-11-17 14:49:56 on dist-test-slave-jwg6"
I20261117 14:49:56.068383 7915 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261117 14:49:56.081707 7915 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20261117 14:49:56.082546 7915 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261117 14:49:56.082830 7915 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261117 14:49:56.083820 7915 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261117 14:49:56.085592 7915 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261117 14:49:56.085700 7915 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20261117 14:49:56.085851 7915 ts_tablet_manager.cc:662] Registered 0 tablets
I20261117 14:49:56.085924 7915 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20261117 14:49:56.120409 7915 rpc_server.cc:307] RPC server started. Bound to: 127.6.50.131:34551
I20261117 14:49:56.120427 8042 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.50.131:34551 every 8 connection(s)
I20261117 14:49:56.122062 7915 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-2/data/info.pb
I20261117 14:49:56.130811 6346 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskUafhB0/build/asan/bin/kudu as pid 7915
I20261117 14:49:56.131054 6346 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-2/wal/instance
I20261117 14:49:56.134749 6346 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskUafhB0/build/asan/bin/kudu
/tmp/dist-test-taskUafhB0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.50.132:0
--local_ip_for_outbound_sockets=127.6.50.132
--webserver_interface=127.6.50.132
--webserver_port=0
--tserver_master_addrs=127.6.50.190:39297
--builtin_ntp_servers=127.6.50.148:44279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
I20261117 14:49:56.141359 8043 heartbeater.cc:345] Connected to a master server at 127.6.50.190:39297
I20261117 14:49:56.141780 8043 heartbeater.cc:462] Registering TS with master...
I20261117 14:49:56.143201 8043 heartbeater.cc:508] Master 127.6.50.190:39297 requested a full tablet report, sending...
I20261117 14:49:56.190256 7594 ts_manager.cc:210] Registered new tserver with Master: fa94e5d3d33a4f70b3e2c9c5f62cc9f3 (127.6.50.131:34551)
I20261117 14:49:56.191239 7594 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.6.50.131:43423
I20261117 14:49:56.217866 7780 heartbeater.cc:500] Master 127.6.50.190:39297 was elected leader, sending a full tablet report...
W20261117 14:49:56.486649 8046 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261117 14:49:56.486938 8046 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261117 14:49:56.487107 8046 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261117 14:49:56.495543 8046 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261117 14:49:56.495775 8046 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.50.132
I20261117 14:49:56.505980 8046 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-3/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.50.148:44279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.50.132:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-3/data/info.pb
--webserver_interface=127.6.50.132
--webserver_port=0
--tserver_master_addrs=127.6.50.190:39297
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.50.132
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type FASTDEBUG
built by None at 17 Nov 2026 14:43:24 UTC on bdcb31816ec0
build id 14829
ASAN enabled
I20261117 14:49:56.507825 8046 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261117 14:49:56.509652 8046 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20261117 14:49:56.513477 8046 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20261117 14:49:56.519258 8052 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261117 14:49:56.519225 8053 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261117 14:49:56.519964 8055 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261117 14:49:56.520275 8046 server_base.cc:1061] running on GCE node
I20261117 14:49:56.520864 8046 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261117 14:49:56.521795 8046 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261117 14:49:56.523062 8046 hybrid_clock.cc:648] HybridClock initialized: now 1794926996522951 us; error 70 us; skew 500 ppm
I20261117 14:49:56.523358 8046 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261117 14:49:56.525646 8046 webserver.cc:577] Webserver started at http://127.6.50.132:34537/ using document root <none> and password file <none>
I20261117 14:49:56.526357 8046 fs_manager.cc:362] Metadata directory not provided
I20261117 14:49:56.526500 8046 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261117 14:49:56.526851 8046 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261117 14:49:56.529299 8046 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-3/data/instance:
uuid: "624366c73dc34561925e1d1b5216cf2b"
format_stamp: "Formatted at 2026-11-17 14:49:56 on dist-test-slave-jwg6"
I20261117 14:49:56.530061 8046 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-3/wal/instance:
uuid: "624366c73dc34561925e1d1b5216cf2b"
format_stamp: "Formatted at 2026-11-17 14:49:56 on dist-test-slave-jwg6"
I20261117 14:49:56.535440 8046 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20261117 14:49:56.538982 8061 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20261117 14:49:56.540638 8046 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20261117 14:49:56.540822 8046 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-3/data,/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-3/wal
uuid: "624366c73dc34561925e1d1b5216cf2b"
format_stamp: "Formatted at 2026-11-17 14:49:56 on dist-test-slave-jwg6"
I20261117 14:49:56.540997 8046 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-3/wal
metadata directory: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-3/wal
1 data directories: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261117 14:49:56.559680 8046 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20261117 14:49:56.560695 8046 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261117 14:49:56.560981 8046 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261117 14:49:56.562091 8046 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261117 14:49:56.564147 8046 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261117 14:49:56.564235 8046 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20261117 14:49:56.564332 8046 ts_tablet_manager.cc:662] Registered 0 tablets
I20261117 14:49:56.564385 8046 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20261117 14:49:56.599152 8046 rpc_server.cc:307] RPC server started. Bound to: 127.6.50.132:33799
I20261117 14:49:56.599186 8173 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.50.132:33799 every 8 connection(s)
I20261117 14:49:56.600695 8046 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-3/data/info.pb
I20261117 14:49:56.603179 6346 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskUafhB0/build/asan/bin/kudu as pid 8046
I20261117 14:49:56.603363 6346 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-3/wal/instance
I20261117 14:49:56.617829 8174 heartbeater.cc:345] Connected to a master server at 127.6.50.190:39297
I20261117 14:49:56.618309 8174 heartbeater.cc:462] Registering TS with master...
I20261117 14:49:56.619526 8174 heartbeater.cc:508] Master 127.6.50.190:39297 requested a full tablet report, sending...
I20261117 14:49:56.670567 7594 ts_manager.cc:210] Registered new tserver with Master: 624366c73dc34561925e1d1b5216cf2b (127.6.50.132:33799)
I20261117 14:49:56.671527 7594 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.6.50.132:50015
I20261117 14:49:56.682237 6346 external_mini_cluster.cc:955] 4 TS(s) registered with all masters
I20261117 14:49:56.711030 7912 heartbeater.cc:500] Master 127.6.50.190:39297 was elected leader, sending a full tablet report...
I20261117 14:49:56.724267 7594 catalog_manager.cc:2298] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40534:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20261117 14:49:56.781450 7978 tablet_service.cc:1500] Processing CreateTablet for tablet a1fc825ee85f40d1aee4695db8235828 (DEFAULT_TABLE table=test-workload [id=639ffe0836ba40d08e353836c7465a0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20261117 14:49:56.782907 7978 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1fc825ee85f40d1aee4695db8235828. 1 dirs total, 0 dirs full, 0 dirs failed
I20261117 14:49:56.783366 7715 tablet_service.cc:1500] Processing CreateTablet for tablet a1fc825ee85f40d1aee4695db8235828 (DEFAULT_TABLE table=test-workload [id=639ffe0836ba40d08e353836c7465a0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20261117 14:49:56.782061 8109 tablet_service.cc:1500] Processing CreateTablet for tablet a1fc825ee85f40d1aee4695db8235828 (DEFAULT_TABLE table=test-workload [id=639ffe0836ba40d08e353836c7465a0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20261117 14:49:56.785040 7715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1fc825ee85f40d1aee4695db8235828. 1 dirs total, 0 dirs full, 0 dirs failed
I20261117 14:49:56.785890 8109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1fc825ee85f40d1aee4695db8235828. 1 dirs total, 0 dirs full, 0 dirs failed
I20261117 14:49:56.802636 8198 tablet_bootstrap.cc:492] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3: Bootstrap starting.
I20261117 14:49:56.810195 8198 tablet_bootstrap.cc:654] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3: Neither blocks nor log segments found. Creating new log.
I20261117 14:49:56.811256 8199 tablet_bootstrap.cc:492] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6: Bootstrap starting.
I20261117 14:49:56.813266 8200 tablet_bootstrap.cc:492] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b: Bootstrap starting.
I20261117 14:49:56.814723 8198 log.cc:826] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3: Log is configured to *not* fsync() on all Append() calls
I20261117 14:49:56.815090 8199 tablet_bootstrap.cc:654] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6: Neither blocks nor log segments found. Creating new log.
I20261117 14:49:56.816118 8199 log.cc:826] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6: Log is configured to *not* fsync() on all Append() calls
I20261117 14:49:56.819094 8200 tablet_bootstrap.cc:654] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b: Neither blocks nor log segments found. Creating new log.
I20261117 14:49:56.820755 8200 log.cc:826] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b: Log is configured to *not* fsync() on all Append() calls
I20261117 14:49:56.825753 8198 tablet_bootstrap.cc:492] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3: No bootstrap required, opened a new log
I20261117 14:49:56.826056 8198 ts_tablet_manager.cc:1449] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3: Time spent bootstrapping tablet: real 0.024s user 0.014s sys 0.000s
I20261117 14:49:56.826838 8199 tablet_bootstrap.cc:492] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6: No bootstrap required, opened a new log
I20261117 14:49:56.827162 8199 ts_tablet_manager.cc:1449] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6: Time spent bootstrapping tablet: real 0.016s user 0.008s sys 0.004s
I20261117 14:49:56.829613 8200 tablet_bootstrap.cc:492] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b: No bootstrap required, opened a new log
I20261117 14:49:56.829931 8200 ts_tablet_manager.cc:1449] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b: Time spent bootstrapping tablet: real 0.017s user 0.006s sys 0.005s
I20261117 14:49:56.832746 8198 raft_consensus.cc:360] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "624366c73dc34561925e1d1b5216cf2b" member_type: VOTER last_known_addr { host: "127.6.50.132" port: 33799 } } peers { permanent_uuid: "6041859320d34e679a287826f4f54fd6" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 36371 } } peers { permanent_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 34551 } }
I20261117 14:49:56.833246 8198 raft_consensus.cc:386] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261117 14:49:56.833386 8198 raft_consensus.cc:748] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa94e5d3d33a4f70b3e2c9c5f62cc9f3, State: Initialized, Role: FOLLOWER
I20261117 14:49:56.834262 8198 consensus_queue.cc:261] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "624366c73dc34561925e1d1b5216cf2b" member_type: VOTER last_known_addr { host: "127.6.50.132" port: 33799 } } peers { permanent_uuid: "6041859320d34e679a287826f4f54fd6" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 36371 } } peers { permanent_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 34551 } }
I20261117 14:49:56.836616 8199 raft_consensus.cc:360] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "624366c73dc34561925e1d1b5216cf2b" member_type: VOTER last_known_addr { host: "127.6.50.132" port: 33799 } } peers { permanent_uuid: "6041859320d34e679a287826f4f54fd6" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 36371 } } peers { permanent_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 34551 } }
I20261117 14:49:56.837110 8199 raft_consensus.cc:386] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261117 14:49:56.837281 8199 raft_consensus.cc:748] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6041859320d34e679a287826f4f54fd6, State: Initialized, Role: FOLLOWER
I20261117 14:49:56.837919 8200 raft_consensus.cc:360] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "624366c73dc34561925e1d1b5216cf2b" member_type: VOTER last_known_addr { host: "127.6.50.132" port: 33799 } } peers { permanent_uuid: "6041859320d34e679a287826f4f54fd6" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 36371 } } peers { permanent_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 34551 } }
I20261117 14:49:56.838421 8200 raft_consensus.cc:386] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261117 14:49:56.838575 8200 raft_consensus.cc:748] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 624366c73dc34561925e1d1b5216cf2b, State: Initialized, Role: FOLLOWER
I20261117 14:49:56.838356 8199 consensus_queue.cc:261] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "624366c73dc34561925e1d1b5216cf2b" member_type: VOTER last_known_addr { host: "127.6.50.132" port: 33799 } } peers { permanent_uuid: "6041859320d34e679a287826f4f54fd6" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 36371 } } peers { permanent_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 34551 } }
I20261117 14:49:56.839373 8200 consensus_queue.cc:261] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "624366c73dc34561925e1d1b5216cf2b" member_type: VOTER last_known_addr { host: "127.6.50.132" port: 33799 } } peers { permanent_uuid: "6041859320d34e679a287826f4f54fd6" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 36371 } } peers { permanent_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 34551 } }
I20261117 14:49:56.843143 8198 ts_tablet_manager.cc:1480] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3: Time spent starting tablet: real 0.017s user 0.009s sys 0.006s
I20261117 14:49:56.843699 8043 heartbeater.cc:500] Master 127.6.50.190:39297 was elected leader, sending a full tablet report...
I20261117 14:49:56.847268 8199 ts_tablet_manager.cc:1480] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6: Time spent starting tablet: real 0.020s user 0.019s sys 0.001s
I20261117 14:49:56.853801 8174 heartbeater.cc:500] Master 127.6.50.190:39297 was elected leader, sending a full tablet report...
I20261117 14:49:56.854461 8200 ts_tablet_manager.cc:1480] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b: Time spent starting tablet: real 0.024s user 0.014s sys 0.008s
W20261117 14:49:56.874145 8044 tablet.cc:2441] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20261117 14:49:56.880591 8204 raft_consensus.cc:499] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261117 14:49:56.880883 8204 raft_consensus.cc:521] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "624366c73dc34561925e1d1b5216cf2b" member_type: VOTER last_known_addr { host: "127.6.50.132" port: 33799 } } peers { permanent_uuid: "6041859320d34e679a287826f4f54fd6" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 36371 } } peers { permanent_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 34551 } }
I20261117 14:49:56.883033 8204 leader_election.cc:290] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 624366c73dc34561925e1d1b5216cf2b (127.6.50.132:33799), 6041859320d34e679a287826f4f54fd6 (127.6.50.129:36371)
I20261117 14:49:56.891680 8205 raft_consensus.cc:499] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261117 14:49:56.891978 8205 raft_consensus.cc:521] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "624366c73dc34561925e1d1b5216cf2b" member_type: VOTER last_known_addr { host: "127.6.50.132" port: 33799 } } peers { permanent_uuid: "6041859320d34e679a287826f4f54fd6" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 36371 } } peers { permanent_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 34551 } }
I20261117 14:49:56.893729 8129 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "a1fc825ee85f40d1aee4695db8235828" candidate_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "624366c73dc34561925e1d1b5216cf2b" is_pre_election: true
I20261117 14:49:56.894280 8129 raft_consensus.cc:2490] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa94e5d3d33a4f70b3e2c9c5f62cc9f3 in term 0.
I20261117 14:49:56.894737 8205 leader_election.cc:290] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 624366c73dc34561925e1d1b5216cf2b (127.6.50.132:33799), fa94e5d3d33a4f70b3e2c9c5f62cc9f3 (127.6.50.131:34551)
I20261117 14:49:56.896994 7735 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "a1fc825ee85f40d1aee4695db8235828" candidate_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6041859320d34e679a287826f4f54fd6" is_pre_election: true
I20261117 14:49:56.897461 7735 raft_consensus.cc:2490] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa94e5d3d33a4f70b3e2c9c5f62cc9f3 in term 0.
I20261117 14:49:56.898288 7931 leader_election.cc:304] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6041859320d34e679a287826f4f54fd6, fa94e5d3d33a4f70b3e2c9c5f62cc9f3; no voters:
I20261117 14:49:56.898782 8204 raft_consensus.cc:2826] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20261117 14:49:56.898936 8204 raft_consensus.cc:499] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20261117 14:49:56.899040 8204 raft_consensus.cc:3096] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 0 FOLLOWER]: Advancing to term 1
W20261117 14:49:56.902268 7781 tablet.cc:2441] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20261117 14:49:56.903230 8204 raft_consensus.cc:521] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "624366c73dc34561925e1d1b5216cf2b" member_type: VOTER last_known_addr { host: "127.6.50.132" port: 33799 } } peers { permanent_uuid: "6041859320d34e679a287826f4f54fd6" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 36371 } } peers { permanent_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 34551 } }
I20261117 14:49:56.904695 8129 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "a1fc825ee85f40d1aee4695db8235828" candidate_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "624366c73dc34561925e1d1b5216cf2b"
I20261117 14:49:56.904925 8129 raft_consensus.cc:3096] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b [term 0 FOLLOWER]: Advancing to term 1
I20261117 14:49:56.909446 7735 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "a1fc825ee85f40d1aee4695db8235828" candidate_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6041859320d34e679a287826f4f54fd6"
I20261117 14:49:56.909685 7735 raft_consensus.cc:3096] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [term 0 FOLLOWER]: Advancing to term 1
I20261117 14:49:56.913997 7735 raft_consensus.cc:2490] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa94e5d3d33a4f70b3e2c9c5f62cc9f3 in term 1.
I20261117 14:49:56.914214 8204 leader_election.cc:290] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [CANDIDATE]: Term 1 election: Requested vote from peers 624366c73dc34561925e1d1b5216cf2b (127.6.50.132:33799), 6041859320d34e679a287826f4f54fd6 (127.6.50.129:36371)
I20261117 14:49:56.915145 8129 raft_consensus.cc:2490] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa94e5d3d33a4f70b3e2c9c5f62cc9f3 in term 1.
I20261117 14:49:56.915779 7931 leader_election.cc:304] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6041859320d34e679a287826f4f54fd6, fa94e5d3d33a4f70b3e2c9c5f62cc9f3; no voters:
I20261117 14:49:56.916205 8204 raft_consensus.cc:2826] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 1 FOLLOWER]: Leader election won for term 1
I20261117 14:49:56.922248 8204 raft_consensus.cc:705] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 1 LEADER]: Becoming Leader. State: Replica: fa94e5d3d33a4f70b3e2c9c5f62cc9f3, State: Running, Role: LEADER
I20261117 14:49:56.922865 8204 consensus_queue.cc:238] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "624366c73dc34561925e1d1b5216cf2b" member_type: VOTER last_known_addr { host: "127.6.50.132" port: 33799 } } peers { permanent_uuid: "6041859320d34e679a287826f4f54fd6" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 36371 } } peers { permanent_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 34551 } }
I20261117 14:49:56.926854 7998 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "a1fc825ee85f40d1aee4695db8235828" candidate_uuid: "6041859320d34e679a287826f4f54fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" is_pre_election: true
I20261117 14:49:56.929807 8129 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "a1fc825ee85f40d1aee4695db8235828" candidate_uuid: "6041859320d34e679a287826f4f54fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "624366c73dc34561925e1d1b5216cf2b" is_pre_election: true
I20261117 14:49:56.930182 8129 raft_consensus.cc:2415] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6041859320d34e679a287826f4f54fd6 in current term 1: Already voted for candidate fa94e5d3d33a4f70b3e2c9c5f62cc9f3 in this term.
I20261117 14:49:56.931583 7669 leader_election.cc:304] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6041859320d34e679a287826f4f54fd6; no voters: 624366c73dc34561925e1d1b5216cf2b, fa94e5d3d33a4f70b3e2c9c5f62cc9f3
I20261117 14:49:56.932917 8205 raft_consensus.cc:2771] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20261117 14:49:56.932349 7593 catalog_manager.cc:5840] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to fa94e5d3d33a4f70b3e2c9c5f62cc9f3 (127.6.50.131). New cstate: current_term: 1 leader_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "624366c73dc34561925e1d1b5216cf2b" member_type: VOTER last_known_addr { host: "127.6.50.132" port: 33799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6041859320d34e679a287826f4f54fd6" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 36371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 34551 } health_report { overall_health: HEALTHY } } }
I20261117 14:49:56.933595 8212 consensus_queue.cc:1049] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "624366c73dc34561925e1d1b5216cf2b" member_type: VOTER last_known_addr { host: "127.6.50.132" port: 33799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261117 14:49:56.933967 8204 consensus_queue.cc:1049] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6041859320d34e679a287826f4f54fd6" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 36371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261117 14:49:56.988782 6346 maintenance_mode-itest.cc:745] Restarting batch of 4 tservers: 39c0d031db104a9d83a434fb89d0a277,fa94e5d3d33a4f70b3e2c9c5f62cc9f3,6041859320d34e679a287826f4f54fd6,624366c73dc34561925e1d1b5216cf2b
W20261117 14:49:58.348564 8221 meta_cache.cc:1261] Time spent looking up entry by key: real 0.068s user 0.004s sys 0.000s
I20261117 14:49:58.481098 7591 ts_manager.cc:311] Set tserver state for fa94e5d3d33a4f70b3e2c9c5f62cc9f3 to MAINTENANCE_MODE
I20261117 14:49:58.488289 7587 ts_manager.cc:311] Set tserver state for 6041859320d34e679a287826f4f54fd6 to MAINTENANCE_MODE
I20261117 14:49:58.490792 7589 ts_manager.cc:311] Set tserver state for 624366c73dc34561925e1d1b5216cf2b to MAINTENANCE_MODE
I20261117 14:49:58.896576 7589 ts_manager.cc:311] Set tserver state for 39c0d031db104a9d83a434fb89d0a277 to MAINTENANCE_MODE
I20261117 14:49:59.867933 7978 tablet_service.cc:1449] Tablet server fa94e5d3d33a4f70b3e2c9c5f62cc9f3 set to quiescing
I20261117 14:49:59.868196 7978 tablet_service.cc:1456] Tablet server has 1 leaders and 2 scanners
I20261117 14:49:59.871429 8301 raft_consensus.cc:1003] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3: : Instructing follower 6041859320d34e679a287826f4f54fd6 to start an election
I20261117 14:49:59.871614 8301 raft_consensus.cc:1091] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 1 LEADER]: Signalling peer 6041859320d34e679a287826f4f54fd6 to start an election
I20261117 14:49:59.873461 7735 tablet_service.cc:2033] Received Run Leader Election RPC: tablet_id: "a1fc825ee85f40d1aee4695db8235828"
dest_uuid: "6041859320d34e679a287826f4f54fd6"
from {username='slave'} at 127.6.50.131:59355
I20261117 14:49:59.873763 7735 raft_consensus.cc:499] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20261117 14:49:59.873881 7735 raft_consensus.cc:3096] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [term 1 FOLLOWER]: Advancing to term 2
I20261117 14:49:59.877446 7735 raft_consensus.cc:521] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "624366c73dc34561925e1d1b5216cf2b" member_type: VOTER last_known_addr { host: "127.6.50.132" port: 33799 } } peers { permanent_uuid: "6041859320d34e679a287826f4f54fd6" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 36371 } } peers { permanent_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 34551 } }
I20261117 14:49:59.879086 7998 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "a1fc825ee85f40d1aee4695db8235828" candidate_uuid: "6041859320d34e679a287826f4f54fd6" candidate_term: 2 candidate_status { last_received { term: 1 index: 104 } } ignore_live_leader: true dest_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3"
I20261117 14:49:59.879170 8129 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "a1fc825ee85f40d1aee4695db8235828" candidate_uuid: "6041859320d34e679a287826f4f54fd6" candidate_term: 2 candidate_status { last_received { term: 1 index: 104 } } ignore_live_leader: true dest_uuid: "624366c73dc34561925e1d1b5216cf2b"
I20261117 14:49:59.879310 7998 raft_consensus.cc:3091] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 1 LEADER]: Stepping down as leader of term 1
I20261117 14:49:59.879415 8129 raft_consensus.cc:3096] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b [term 1 FOLLOWER]: Advancing to term 2
I20261117 14:49:59.879418 7998 raft_consensus.cc:748] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fa94e5d3d33a4f70b3e2c9c5f62cc9f3, State: Running, Role: LEADER
I20261117 14:49:59.879959 7734 raft_consensus.cc:1250] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [term 2 FOLLOWER]: Rejecting Update request from peer fa94e5d3d33a4f70b3e2c9c5f62cc9f3 for earlier term 1. Current term is 2. Ops: []
I20261117 14:49:59.879943 7998 consensus_queue.cc:261] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 104, Committed index: 104, Last appended: 1.104, Last appended by leader: 104, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "624366c73dc34561925e1d1b5216cf2b" member_type: VOTER last_known_addr { host: "127.6.50.132" port: 33799 } } peers { permanent_uuid: "6041859320d34e679a287826f4f54fd6" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 36371 } } peers { permanent_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 34551 } }
I20261117 14:49:59.880257 7998 raft_consensus.cc:3096] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 1 FOLLOWER]: Advancing to term 2
I20261117 14:49:59.880640 7735 leader_election.cc:290] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [CANDIDATE]: Term 2 election: Requested vote from peers 624366c73dc34561925e1d1b5216cf2b (127.6.50.132:33799), fa94e5d3d33a4f70b3e2c9c5f62cc9f3 (127.6.50.131:34551)
I20261117 14:49:59.882717 8129 raft_consensus.cc:2490] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6041859320d34e679a287826f4f54fd6 in term 2.
I20261117 14:49:59.883306 7669 leader_election.cc:304] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6041859320d34e679a287826f4f54fd6, 624366c73dc34561925e1d1b5216cf2b; no voters:
I20261117 14:49:59.884968 7998 raft_consensus.cc:2490] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6041859320d34e679a287826f4f54fd6 in term 2.
I20261117 14:49:59.885878 8315 raft_consensus.cc:2826] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [term 2 FOLLOWER]: Leader election won for term 2
W20261117 14:49:59.888690 7955 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52012: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:49:59.889588 7958 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52012: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
I20261117 14:49:59.903254 8315 raft_consensus.cc:705] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [term 2 LEADER]: Becoming Leader. State: Replica: 6041859320d34e679a287826f4f54fd6, State: Running, Role: LEADER
I20261117 14:49:59.903875 8315 consensus_queue.cc:238] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 103, Committed index: 103, Last appended: 1.104, Last appended by leader: 104, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "624366c73dc34561925e1d1b5216cf2b" member_type: VOTER last_known_addr { host: "127.6.50.132" port: 33799 } } peers { permanent_uuid: "6041859320d34e679a287826f4f54fd6" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 36371 } } peers { permanent_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 34551 } }
I20261117 14:49:59.908097 7589 catalog_manager.cc:5840] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 reported cstate change: term changed from 1 to 2, leader changed from fa94e5d3d33a4f70b3e2c9c5f62cc9f3 (127.6.50.131) to 6041859320d34e679a287826f4f54fd6 (127.6.50.129). New cstate: current_term: 2 leader_uuid: "6041859320d34e679a287826f4f54fd6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "624366c73dc34561925e1d1b5216cf2b" member_type: VOTER last_known_addr { host: "127.6.50.132" port: 33799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6041859320d34e679a287826f4f54fd6" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 36371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 34551 } health_report { overall_health: UNKNOWN } } }
I20261117 14:49:59.911449 7998 raft_consensus.cc:1285] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 2 FOLLOWER]: Refusing update from remote peer 6041859320d34e679a287826f4f54fd6: Log matching property violated. Preceding OpId in replica: term: 1 index: 104. Preceding OpId from leader: term: 2 index: 105. (index mismatch)
I20261117 14:49:59.913168 8316 consensus_queue.cc:1049] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 34551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 105, Last known committed idx: 104, Time since last communication: 0.000s
I20261117 14:49:59.938581 8129 raft_consensus.cc:1285] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b [term 2 FOLLOWER]: Refusing update from remote peer 6041859320d34e679a287826f4f54fd6: Log matching property violated. Preceding OpId in replica: term: 1 index: 104. Preceding OpId from leader: term: 2 index: 105. (index mismatch)
I20261117 14:49:59.939407 8316 consensus_queue.cc:1049] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "624366c73dc34561925e1d1b5216cf2b" member_type: VOTER last_known_addr { host: "127.6.50.132" port: 33799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 105, Last known committed idx: 103, Time since last communication: 0.000s
W20261117 14:49:59.940712 8089 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:49:59.950826 8089 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:49:59.952947 8088 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
I20261117 14:50:00.196900 7715 tablet_service.cc:1449] Tablet server 6041859320d34e679a287826f4f54fd6 set to quiescing
I20261117 14:50:00.197160 7715 tablet_service.cc:1456] Tablet server has 1 leaders and 1 scanners
I20261117 14:50:00.224856 8316 raft_consensus.cc:1003] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6: : Instructing follower 624366c73dc34561925e1d1b5216cf2b to start an election
I20261117 14:50:00.225029 8316 raft_consensus.cc:1091] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [term 2 LEADER]: Signalling peer 624366c73dc34561925e1d1b5216cf2b to start an election
I20261117 14:50:00.232969 8129 tablet_service.cc:2033] Received Run Leader Election RPC: tablet_id: "a1fc825ee85f40d1aee4695db8235828"
dest_uuid: "624366c73dc34561925e1d1b5216cf2b"
from {username='slave'} at 127.6.50.129:54523
I20261117 14:50:00.233269 8129 raft_consensus.cc:499] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20261117 14:50:00.233408 8129 raft_consensus.cc:3096] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b [term 2 FOLLOWER]: Advancing to term 3
I20261117 14:50:00.236426 8129 raft_consensus.cc:521] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "624366c73dc34561925e1d1b5216cf2b" member_type: VOTER last_known_addr { host: "127.6.50.132" port: 33799 } } peers { permanent_uuid: "6041859320d34e679a287826f4f54fd6" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 36371 } } peers { permanent_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 34551 } }
I20261117 14:50:00.248481 8129 leader_election.cc:290] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b [CANDIDATE]: Term 3 election: Requested vote from peers 6041859320d34e679a287826f4f54fd6 (127.6.50.129:36371), fa94e5d3d33a4f70b3e2c9c5f62cc9f3 (127.6.50.131:34551)
I20261117 14:50:00.255358 8129 raft_consensus.cc:1250] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b [term 3 FOLLOWER]: Rejecting Update request from peer 6041859320d34e679a287826f4f54fd6 for earlier term 2. Current term is 3. Ops: []
I20261117 14:50:00.261282 8320 consensus_queue.cc:1060] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "624366c73dc34561925e1d1b5216cf2b" member_type: VOTER last_known_addr { host: "127.6.50.132" port: 33799 }, Status: INVALID_TERM, Last received: 2.118, Next index: 119, Last known committed idx: 117, Time since last communication: 0.000s
I20261117 14:50:00.262001 8315 raft_consensus.cc:3091] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [term 2 LEADER]: Stepping down as leader of term 2
I20261117 14:50:00.262148 8315 raft_consensus.cc:748] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6041859320d34e679a287826f4f54fd6, State: Running, Role: LEADER
I20261117 14:50:00.262442 8315 consensus_queue.cc:261] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 121, Committed index: 121, Last appended: 2.121, Last appended by leader: 121, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "624366c73dc34561925e1d1b5216cf2b" member_type: VOTER last_known_addr { host: "127.6.50.132" port: 33799 } } peers { permanent_uuid: "6041859320d34e679a287826f4f54fd6" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 36371 } } peers { permanent_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 34551 } }
I20261117 14:50:00.263432 8315 raft_consensus.cc:3096] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [term 2 FOLLOWER]: Advancing to term 3
W20261117 14:50:00.273602 7693 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:00.276604 7694 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:00.277622 7694 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
I20261117 14:50:00.283238 8109 tablet_service.cc:1449] Tablet server 624366c73dc34561925e1d1b5216cf2b set to quiescing
I20261117 14:50:00.283509 8109 tablet_service.cc:1456] Tablet server has 0 leaders and 1 scanners
W20261117 14:50:00.290607 8089 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:00.291877 8087 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:00.292979 8086 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:00.298168 7958 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52012: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:00.299978 7958 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52012: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:00.301673 7958 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52012: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
I20261117 14:50:00.314638 7735 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "a1fc825ee85f40d1aee4695db8235828" candidate_uuid: "624366c73dc34561925e1d1b5216cf2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 118 } } ignore_live_leader: true dest_uuid: "6041859320d34e679a287826f4f54fd6"
I20261117 14:50:00.315004 7735 raft_consensus.cc:2432] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 624366c73dc34561925e1d1b5216cf2b for term 3 because replica has last-logged OpId of term: 2 index: 121, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 118.
W20261117 14:50:00.315707 7694 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:00.317245 7694 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:00.318499 7694 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
I20261117 14:50:00.325443 7998 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "a1fc825ee85f40d1aee4695db8235828" candidate_uuid: "624366c73dc34561925e1d1b5216cf2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 118 } } ignore_live_leader: true dest_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3"
I20261117 14:50:00.325672 7998 raft_consensus.cc:3096] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 2 FOLLOWER]: Advancing to term 3
W20261117 14:50:00.327368 8086 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
I20261117 14:50:00.328934 7998 raft_consensus.cc:2432] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 624366c73dc34561925e1d1b5216cf2b for term 3 because replica has last-logged OpId of term: 2 index: 121, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 118.
I20261117 14:50:00.329730 8062 leader_election.cc:304] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 624366c73dc34561925e1d1b5216cf2b; no voters: 6041859320d34e679a287826f4f54fd6, fa94e5d3d33a4f70b3e2c9c5f62cc9f3
I20261117 14:50:00.330295 8327 raft_consensus.cc:2771] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20261117 14:50:00.331328 8086 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:00.333249 8086 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:00.336334 7958 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52012: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:00.339919 7958 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52012: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:00.344884 7958 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52012: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:00.352984 7694 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:00.361136 7693 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:00.362323 7693 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:00.370754 8086 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:00.372759 8086 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:00.374536 8086 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:00.382952 7958 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52012: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:00.386698 7958 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52012: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:00.395879 7958 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52012: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:00.414155 7694 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:00.414222 7695 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:00.431735 7694 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:00.434900 8086 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:00.438355 8087 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:00.450960 8086 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:00.453279 7958 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52012: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:00.459741 7958 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52012: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:00.470108 7958 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52012: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:00.472779 7695 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:00.486491 7694 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:00.495321 7695 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:00.500790 8088 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:00.507627 8085 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:00.512933 8085 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:00.518453 7958 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52012: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:00.528891 7958 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52012: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:00.534073 7958 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52012: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:00.540030 7694 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:00.551462 7694 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:00.554445 7694 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:00.556365 8315 raft_consensus.cc:678] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6: failed to trigger leader election: Illegal state: leader elections are disabled
W20261117 14:50:00.560567 8085 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:00.575205 8085 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:00.575290 8359 raft_consensus.cc:678] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3: failed to trigger leader election: Illegal state: leader elections are disabled
W20261117 14:50:00.577081 8085 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:00.583294 7958 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52012: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:00.596930 7958 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52012: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:00.605336 7958 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52012: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:00.611073 7694 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:00.622359 7694 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:00.635259 7694 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:00.637629 8085 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:00.648763 8085 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:00.659909 8085 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:00.661566 7958 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52012: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:00.675212 7958 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52012: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:00.687983 7694 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:00.689582 7958 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52012: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
I20261117 14:50:00.697363 7847 tablet_service.cc:1449] Tablet server 39c0d031db104a9d83a434fb89d0a277 set to quiescing
I20261117 14:50:00.697647 7847 tablet_service.cc:1456] Tablet server has 0 leaders and 0 scanners
W20261117 14:50:00.701925 7694 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:00.715163 7694 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:00.716771 8085 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:00.727200 8327 raft_consensus.cc:678] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b: failed to trigger leader election: Illegal state: leader elections are disabled
W20261117 14:50:00.729936 8085 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:00.741884 8085 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:00.747380 7958 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52012: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:00.759717 7958 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52012: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:00.769102 7958 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52012: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:00.779321 7694 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:00.788797 7694 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:00.801326 7694 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:00.809800 8085 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:00.820165 8085 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:00.834830 8085 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:00.842666 7958 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52012: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:00.851152 7958 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52012: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:00.866739 7958 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52012: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:00.878912 7694 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:00.889110 7694 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:00.904356 7694 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:00.914916 8085 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:00.920285 8085 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:00.938315 8085 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:00.957930 7958 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52012: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:00.965281 7958 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52012: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:00.977365 7958 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52012: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:01.012984 7694 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:01.015259 7694 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:01.021216 7694 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:01.053653 8085 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:01.056478 8085 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:01.059859 8085 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:01.092309 7958 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52012: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:01.094592 7958 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52012: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:01.098871 7958 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52012: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:01.132692 7694 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:01.136822 7694 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:01.140297 7694 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:01.172739 8085 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:01.175804 8085 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:01.177083 8085 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:01.211990 7958 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52012: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:01.214389 7958 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52012: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:01.215145 7957 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52012: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:01.256702 7694 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:01.256940 7695 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:01.257417 7693 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:01.306243 8085 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:01.306507 8088 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:01.307513 8087 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:01.349634 7957 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52012: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:01.350382 7958 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52012: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:01.352319 7958 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52012: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:01.399001 7695 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:01.399761 7694 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:01.399050 7693 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:01.450999 8087 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:01.452896 8087 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:01.454981 8087 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:01.498790 7958 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52012: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:01.500134 7957 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52012: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:01.503262 7958 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52012: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:01.553556 7693 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:01.555660 7693 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:01.573010 7693 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:01.620481 8087 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:01.621311 8088 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:01.623344 8088 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:01.671903 7958 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52012: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:01.673381 7957 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52012: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:01.676333 7957 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52012: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:01.728564 7693 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:01.734647 7693 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:01.739012 7693 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:01.785573 8088 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:01.788784 8088 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:01.791242 8088 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:01.837594 7957 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52012: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:01.845144 7958 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52012: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:01.846648 7957 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52012: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
I20261117 14:50:01.892491 7978 tablet_service.cc:1449] Tablet server fa94e5d3d33a4f70b3e2c9c5f62cc9f3 set to quiescing
I20261117 14:50:01.892766 7978 tablet_service.cc:1456] Tablet server has 0 leaders and 0 scanners
W20261117 14:50:01.895161 7693 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:01.901757 7693 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:01.903708 7693 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:01.950335 8088 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:01.954335 8088 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:01.956396 8088 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:02.006465 7958 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52012: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:02.008865 7958 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52012: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:02.010771 7958 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52012: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
I20261117 14:50:02.024462 7715 tablet_service.cc:1449] Tablet server 6041859320d34e679a287826f4f54fd6 set to quiescing
I20261117 14:50:02.024735 7715 tablet_service.cc:1456] Tablet server has 0 leaders and 0 scanners
W20261117 14:50:02.065850 7693 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:02.066334 7694 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:02.068981 7694 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:02.123921 8088 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:02.124912 8085 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:02.125700 8087 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:02.182363 7958 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52012: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:02.184226 7958 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52012: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:02.185456 7958 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52012: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
I20261117 14:50:02.236133 8109 tablet_service.cc:1449] Tablet server 624366c73dc34561925e1d1b5216cf2b set to quiescing
I20261117 14:50:02.236392 8109 tablet_service.cc:1456] Tablet server has 0 leaders and 0 scanners
W20261117 14:50:02.244409 7694 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:02.246274 7694 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:02.246842 7693 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:02.305296 8087 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:02.305454 8085 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:02.305454 8088 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:02.365161 7958 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52012: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:02.367316 7958 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52012: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:02.368932 7958 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52012: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
I20261117 14:50:02.375605 6346 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskUafhB0/build/asan/bin/kudu pid 7784
I20261117 14:50:02.383347 7907 generic_service.cc:196] Checking for leaks (request via RPC)
W20261117 14:50:02.431542 7695 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:02.431492 7694 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:02.431463 7693 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
I20261117 14:50:02.472846 6346 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskUafhB0/build/asan/bin/kudu with pid 7784
W20261117 14:50:02.492148 8085 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
I20261117 14:50:02.492600 6346 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskUafhB0/build/asan/bin/kudu
/tmp/dist-test-taskUafhB0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.50.130:38123
--local_ip_for_outbound_sockets=127.6.50.130
--tserver_master_addrs=127.6.50.190:39297
--webserver_port=45239
--webserver_interface=127.6.50.130
--builtin_ntp_servers=127.6.50.148:44279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
W20261117 14:50:02.493212 8088 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:02.503494 8088 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:02.556047 7958 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52012: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:02.565352 7958 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52012: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:02.566431 7958 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52012: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:02.623706 7694 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:02.633903 7694 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:02.634056 7693 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:02.691315 8088 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:02.700913 8088 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:02.701148 8085 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:02.760577 7958 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52012: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:02.767766 7958 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52012: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:02.769073 7958 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52012: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:02.829833 7693 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:02.834999 7693 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:02.838096 7693 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:02.867406 8408 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261117 14:50:02.867729 8408 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261117 14:50:02.867813 8408 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261117 14:50:02.876636 8408 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261117 14:50:02.876816 8408 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.50.130
I20261117 14:50:02.887060 8408 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.50.148:44279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.50.130:38123
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.6.50.130
--webserver_port=45239
--tserver_master_addrs=127.6.50.190:39297
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.50.130
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type FASTDEBUG
built by None at 17 Nov 2026 14:43:24 UTC on bdcb31816ec0
build id 14829
ASAN enabled
I20261117 14:50:02.888803 8408 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261117 14:50:02.890547 8408 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20261117 14:50:02.894486 8408 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20261117 14:50:02.898686 8085 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:02.901297 8414 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261117 14:50:02.901320 8413 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261117 14:50:02.902678 8416 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261117 14:50:02.903057 8408 server_base.cc:1061] running on GCE node
I20261117 14:50:02.903837 8408 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
W20261117 14:50:02.904865 8085 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
I20261117 14:50:02.905107 8408 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261117 14:50:02.906351 8408 hybrid_clock.cc:648] HybridClock initialized: now 1794927002906265 us; error 60 us; skew 500 ppm
I20261117 14:50:02.906672 8408 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
W20261117 14:50:02.907922 8085 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
I20261117 14:50:02.909332 8408 webserver.cc:577] Webserver started at http://127.6.50.130:45239/ using document root <none> and password file <none>
I20261117 14:50:02.910111 8408 fs_manager.cc:362] Metadata directory not provided
I20261117 14:50:02.910277 8408 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261117 14:50:02.916775 8408 fs_manager.cc:714] Time spent opening directory manager: real 0.004s user 0.007s sys 0.000s
I20261117 14:50:02.919734 8422 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20261117 14:50:02.921463 8408 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20261117 14:50:02.921646 8408 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-1/data,/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-1/wal
uuid: "39c0d031db104a9d83a434fb89d0a277"
format_stamp: "Formatted at 2026-11-17 14:49:55 on dist-test-slave-jwg6"
I20261117 14:50:02.922415 8408 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261117 14:50:02.947234 8408 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20261117 14:50:02.948518 8408 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261117 14:50:02.948833 8408 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261117 14:50:02.950316 8408 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261117 14:50:02.952699 8408 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261117 14:50:02.952814 8408 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20261117 14:50:02.952955 8408 ts_tablet_manager.cc:662] Registered 0 tablets
I20261117 14:50:02.953039 8408 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
W20261117 14:50:02.967762 7958 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52012: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:02.972848 7958 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52012: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:02.975153 7958 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52012: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
I20261117 14:50:02.990324 8408 rpc_server.cc:307] RPC server started. Bound to: 127.6.50.130:38123
I20261117 14:50:02.990413 8534 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.50.130:38123 every 8 connection(s)
I20261117 14:50:02.991997 8408 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-1/data/info.pb
I20261117 14:50:02.992739 6346 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskUafhB0/build/asan/bin/kudu as pid 8408
I20261117 14:50:02.993023 6346 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskUafhB0/build/asan/bin/kudu pid 7915
I20261117 14:50:03.001631 8038 generic_service.cc:196] Checking for leaks (request via RPC)
I20261117 14:50:03.010206 8535 heartbeater.cc:345] Connected to a master server at 127.6.50.190:39297
I20261117 14:50:03.010694 8535 heartbeater.cc:462] Registering TS with master...
I20261117 14:50:03.011858 8535 heartbeater.cc:508] Master 127.6.50.190:39297 requested a full tablet report, sending...
I20261117 14:50:03.014183 7591 ts_manager.cc:210] Re-registered known tserver with Master: 39c0d031db104a9d83a434fb89d0a277 (127.6.50.130:38123)
I20261117 14:50:03.015470 7591 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.6.50.130:43073
W20261117 14:50:03.040634 7693 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:03.043722 7693 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:03.045586 7693 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:03.110452 8085 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:03.117735 8088 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:03.117735 8085 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
I20261117 14:50:03.141605 6346 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskUafhB0/build/asan/bin/kudu with pid 7915
I20261117 14:50:03.179680 6346 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskUafhB0/build/asan/bin/kudu
/tmp/dist-test-taskUafhB0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.50.131:34551
--local_ip_for_outbound_sockets=127.6.50.131
--tserver_master_addrs=127.6.50.190:39297
--webserver_port=39699
--webserver_interface=127.6.50.131
--builtin_ntp_servers=127.6.50.148:44279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
W20261117 14:50:03.192036 8183 meta_cache.cc:302] tablet a1fc825ee85f40d1aee4695db8235828: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 (127.6.50.131:34551) has failed: Network error: Client connection negotiation failed: client connection to 127.6.50.131:34551: connect: Connection refused (error 111)
W20261117 14:50:03.265653 7694 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:03.266952 7694 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:03.339452 8088 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:03.339486 8085 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:03.342430 7694 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:03.417292 8085 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:03.419499 7694 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:03.494445 8085 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:03.497012 7694 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:03.567848 8542 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261117 14:50:03.568158 8542 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261117 14:50:03.568379 8542 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261117 14:50:03.573487 8085 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:03.575521 7694 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:03.578545 8542 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261117 14:50:03.578792 8542 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.50.131
I20261117 14:50:03.590268 8542 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.50.148:44279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.50.131:34551
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.6.50.131
--webserver_port=39699
--tserver_master_addrs=127.6.50.190:39297
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.50.131
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type FASTDEBUG
built by None at 17 Nov 2026 14:43:24 UTC on bdcb31816ec0
build id 14829
ASAN enabled
I20261117 14:50:03.592074 8542 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261117 14:50:03.594097 8542 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20261117 14:50:03.598851 8542 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20261117 14:50:03.605371 8548 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261117 14:50:03.607461 8549 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261117 14:50:03.615824 8551 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261117 14:50:03.615926 8542 server_base.cc:1061] running on GCE node
I20261117 14:50:03.616677 8542 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261117 14:50:03.617786 8542 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261117 14:50:03.619032 8542 hybrid_clock.cc:648] HybridClock initialized: now 1794927003618962 us; error 36 us; skew 500 ppm
I20261117 14:50:03.619436 8542 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261117 14:50:03.621778 8542 webserver.cc:577] Webserver started at http://127.6.50.131:39699/ using document root <none> and password file <none>
I20261117 14:50:03.622570 8542 fs_manager.cc:362] Metadata directory not provided
I20261117 14:50:03.622730 8542 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261117 14:50:03.628716 8542 fs_manager.cc:714] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20261117 14:50:03.632184 8557 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20261117 14:50:03.634251 8542 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20261117 14:50:03.634428 8542 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-2/data,/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-2/wal
uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3"
format_stamp: "Formatted at 2026-11-17 14:49:56 on dist-test-slave-jwg6"
I20261117 14:50:03.635654 8542 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20261117 14:50:03.653277 7694 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:03.653278 8085 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
I20261117 14:50:03.665373 8542 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20261117 14:50:03.666642 8542 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261117 14:50:03.666985 8542 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261117 14:50:03.668392 8542 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261117 14:50:03.671463 8564 ts_tablet_manager.cc:594] Loading tablet metadata (0/1 complete)
I20261117 14:50:03.678133 8542 ts_tablet_manager.cc:631] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20261117 14:50:03.678265 8542 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.007s user 0.001s sys 0.000s
I20261117 14:50:03.678407 8542 ts_tablet_manager.cc:646] Registering tablets (0/1 complete)
I20261117 14:50:03.683003 8542 ts_tablet_manager.cc:662] Registered 1 tablets
I20261117 14:50:03.683080 8542 ts_tablet_manager.cc:641] Time spent register tablets: real 0.005s user 0.002s sys 0.000s
I20261117 14:50:03.683558 8564 tablet_bootstrap.cc:492] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3: Bootstrap starting.
W20261117 14:50:03.734722 8085 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:03.736821 7694 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
I20261117 14:50:03.738533 8542 rpc_server.cc:307] RPC server started. Bound to: 127.6.50.131:34551
I20261117 14:50:03.738556 8670 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.50.131:34551 every 8 connection(s)
I20261117 14:50:03.740993 8542 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-2/data/info.pb
I20261117 14:50:03.741428 6346 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskUafhB0/build/asan/bin/kudu as pid 8542
I20261117 14:50:03.741640 6346 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskUafhB0/build/asan/bin/kudu pid 7653
I20261117 14:50:03.764209 7775 generic_service.cc:196] Checking for leaks (request via RPC)
I20261117 14:50:03.765492 8564 log.cc:826] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3: Log is configured to *not* fsync() on all Append() calls
I20261117 14:50:03.770285 8671 heartbeater.cc:345] Connected to a master server at 127.6.50.190:39297
I20261117 14:50:03.770695 8671 heartbeater.cc:462] Registering TS with master...
I20261117 14:50:03.771595 8671 heartbeater.cc:508] Master 127.6.50.190:39297 requested a full tablet report, sending...
I20261117 14:50:03.774240 7591 ts_manager.cc:210] Re-registered known tserver with Master: fa94e5d3d33a4f70b3e2c9c5f62cc9f3 (127.6.50.131:34551)
I20261117 14:50:03.775492 7591 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.6.50.131:53659
W20261117 14:50:03.901582 8085 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:03.933256 7693 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:03.933385 7694 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:60960: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
I20261117 14:50:03.933815 6346 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskUafhB0/build/asan/bin/kudu with pid 7653
I20261117 14:50:03.960394 6346 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskUafhB0/build/asan/bin/kudu
/tmp/dist-test-taskUafhB0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.50.129:36371
--local_ip_for_outbound_sockets=127.6.50.129
--tserver_master_addrs=127.6.50.190:39297
--webserver_port=39191
--webserver_interface=127.6.50.129
--builtin_ntp_servers=127.6.50.148:44279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
W20261117 14:50:04.018064 8085 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:04.018141 8088 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
I20261117 14:50:04.019109 8535 heartbeater.cc:500] Master 127.6.50.190:39297 was elected leader, sending a full tablet report...
W20261117 14:50:04.070813 8088 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
I20261117 14:50:04.110172 8564 tablet_bootstrap.cc:492] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3: Bootstrap replayed 1/1 log segments. Stats: ops{read=121 overwritten=0 applied=121 ignored=0} inserts{seen=5950 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20261117 14:50:04.110944 8564 tablet_bootstrap.cc:492] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3: Bootstrap complete.
I20261117 14:50:04.112221 8564 ts_tablet_manager.cc:1449] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3: Time spent bootstrapping tablet: real 0.429s user 0.375s sys 0.048s
I20261117 14:50:04.116053 8564 raft_consensus.cc:360] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "624366c73dc34561925e1d1b5216cf2b" member_type: VOTER last_known_addr { host: "127.6.50.132" port: 33799 } } peers { permanent_uuid: "6041859320d34e679a287826f4f54fd6" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 36371 } } peers { permanent_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 34551 } }
I20261117 14:50:04.116811 8564 raft_consensus.cc:748] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa94e5d3d33a4f70b3e2c9c5f62cc9f3, State: Initialized, Role: FOLLOWER
I20261117 14:50:04.117506 8564 consensus_queue.cc:261] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 121, Last appended: 2.121, Last appended by leader: 121, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "624366c73dc34561925e1d1b5216cf2b" member_type: VOTER last_known_addr { host: "127.6.50.132" port: 33799 } } peers { permanent_uuid: "6041859320d34e679a287826f4f54fd6" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 36371 } } peers { permanent_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 34551 } }
I20261117 14:50:04.118661 8671 heartbeater.cc:500] Master 127.6.50.190:39297 was elected leader, sending a full tablet report...
I20261117 14:50:04.119163 8564 ts_tablet_manager.cc:1480] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3: Time spent starting tablet: real 0.007s user 0.009s sys 0.000s
W20261117 14:50:04.157174 8586 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52112: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:04.245401 8183 meta_cache.cc:302] tablet a1fc825ee85f40d1aee4695db8235828: replica 6041859320d34e679a287826f4f54fd6 (127.6.50.129:36371) has failed: Network error: Client connection negotiation failed: client connection to 127.6.50.129:36371: connect: Connection refused (error 111)
W20261117 14:50:04.271589 8088 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:04.272522 8085 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:04.333220 8085 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:04.333863 8680 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261117 14:50:04.334187 8680 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261117 14:50:04.334339 8680 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261117 14:50:04.345587 8680 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261117 14:50:04.345885 8680 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.50.129
W20261117 14:50:04.346701 8225 scanner-internal.cc:464] Time spent opening tablet: real 4.061s user 0.006s sys 0.002s
W20261117 14:50:04.359491 8585 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52112: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:04.360792 8584 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52112: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
I20261117 14:50:04.362872 8680 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.50.148:44279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.50.129:36371
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.6.50.129
--webserver_port=39191
--tserver_master_addrs=127.6.50.190:39297
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.50.129
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type FASTDEBUG
built by None at 17 Nov 2026 14:43:24 UTC on bdcb31816ec0
build id 14829
ASAN enabled
I20261117 14:50:04.364903 8680 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261117 14:50:04.367063 8680 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20261117 14:50:04.371542 8680 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20261117 14:50:04.377688 8687 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261117 14:50:04.379484 8688 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261117 14:50:04.380949 8690 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261117 14:50:04.382108 8680 server_base.cc:1061] running on GCE node
I20261117 14:50:04.382750 8680 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261117 14:50:04.383831 8680 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261117 14:50:04.385078 8680 hybrid_clock.cc:648] HybridClock initialized: now 1794927004384942 us; error 102 us; skew 500 ppm
I20261117 14:50:04.385466 8680 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261117 14:50:04.388412 8680 webserver.cc:577] Webserver started at http://127.6.50.129:39191/ using document root <none> and password file <none>
I20261117 14:50:04.389484 8680 fs_manager.cc:362] Metadata directory not provided
I20261117 14:50:04.389660 8680 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261117 14:50:04.397753 8680 fs_manager.cc:714] Time spent opening directory manager: real 0.005s user 0.003s sys 0.000s
I20261117 14:50:04.405736 8696 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20261117 14:50:04.407900 8680 fs_manager.cc:730] Time spent opening block manager: real 0.008s user 0.006s sys 0.001s
I20261117 14:50:04.408104 8680 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-0/data,/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-0/wal
uuid: "6041859320d34e679a287826f4f54fd6"
format_stamp: "Formatted at 2026-11-17 14:49:55 on dist-test-slave-jwg6"
I20261117 14:50:04.409152 8680 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20261117 14:50:04.421896 8586 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52112: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
I20261117 14:50:04.453279 8680 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20261117 14:50:04.454478 8680 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261117 14:50:04.454795 8680 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261117 14:50:04.456004 8680 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261117 14:50:04.458953 8703 ts_tablet_manager.cc:594] Loading tablet metadata (0/1 complete)
I20261117 14:50:04.467588 8680 ts_tablet_manager.cc:631] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20261117 14:50:04.467747 8680 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.009s user 0.001s sys 0.000s
I20261117 14:50:04.467897 8680 ts_tablet_manager.cc:646] Registering tablets (0/1 complete)
I20261117 14:50:04.471222 8680 ts_tablet_manager.cc:662] Registered 1 tablets
I20261117 14:50:04.471333 8680 ts_tablet_manager.cc:641] Time spent register tablets: real 0.003s user 0.001s sys 0.000s
I20261117 14:50:04.471781 8703 tablet_bootstrap.cc:492] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6: Bootstrap starting.
I20261117 14:50:04.475526 8681 raft_consensus.cc:499] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261117 14:50:04.475878 8681 raft_consensus.cc:521] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "624366c73dc34561925e1d1b5216cf2b" member_type: VOTER last_known_addr { host: "127.6.50.132" port: 33799 } } peers { permanent_uuid: "6041859320d34e679a287826f4f54fd6" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 36371 } } peers { permanent_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 34551 } }
W20261117 14:50:04.485561 8558 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.50.129:36371: connect: Connection refused (error 111)
I20261117 14:50:04.486661 8681 leader_election.cc:290] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 624366c73dc34561925e1d1b5216cf2b (127.6.50.132:33799), 6041859320d34e679a287826f4f54fd6 (127.6.50.129:36371)
W20261117 14:50:04.490031 8558 leader_election.cc:336] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6041859320d34e679a287826f4f54fd6 (127.6.50.129:36371): Network error: Client connection negotiation failed: client connection to 127.6.50.129:36371: connect: Connection refused (error 111)
I20261117 14:50:04.495551 8129 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "a1fc825ee85f40d1aee4695db8235828" candidate_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 121 } } ignore_live_leader: false dest_uuid: "624366c73dc34561925e1d1b5216cf2b" is_pre_election: true
I20261117 14:50:04.495834 8129 raft_consensus.cc:2490] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa94e5d3d33a4f70b3e2c9c5f62cc9f3 in term 3.
I20261117 14:50:04.496585 8559 leader_election.cc:304] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 624366c73dc34561925e1d1b5216cf2b, fa94e5d3d33a4f70b3e2c9c5f62cc9f3; no voters: 6041859320d34e679a287826f4f54fd6
I20261117 14:50:04.497648 8681 raft_consensus.cc:2826] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20261117 14:50:04.497845 8681 raft_consensus.cc:499] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20261117 14:50:04.497967 8681 raft_consensus.cc:3096] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 3 FOLLOWER]: Advancing to term 4
I20261117 14:50:04.505556 8681 raft_consensus.cc:521] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "624366c73dc34561925e1d1b5216cf2b" member_type: VOTER last_known_addr { host: "127.6.50.132" port: 33799 } } peers { permanent_uuid: "6041859320d34e679a287826f4f54fd6" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 36371 } } peers { permanent_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 34551 } }
I20261117 14:50:04.507350 8129 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "a1fc825ee85f40d1aee4695db8235828" candidate_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 121 } } ignore_live_leader: false dest_uuid: "624366c73dc34561925e1d1b5216cf2b"
I20261117 14:50:04.507567 8129 raft_consensus.cc:3096] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b [term 3 FOLLOWER]: Advancing to term 4
W20261117 14:50:04.510316 8558 leader_election.cc:336] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 6041859320d34e679a287826f4f54fd6 (127.6.50.129:36371): Network error: Client connection negotiation failed: client connection to 127.6.50.129:36371: connect: Connection refused (error 111)
I20261117 14:50:04.510633 8681 leader_election.cc:290] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [CANDIDATE]: Term 4 election: Requested vote from peers 624366c73dc34561925e1d1b5216cf2b (127.6.50.132:33799), 6041859320d34e679a287826f4f54fd6 (127.6.50.129:36371)
I20261117 14:50:04.511409 8129 raft_consensus.cc:2490] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa94e5d3d33a4f70b3e2c9c5f62cc9f3 in term 4.
I20261117 14:50:04.511958 8559 leader_election.cc:304] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 624366c73dc34561925e1d1b5216cf2b, fa94e5d3d33a4f70b3e2c9c5f62cc9f3; no voters: 6041859320d34e679a287826f4f54fd6
I20261117 14:50:04.512596 8681 raft_consensus.cc:2826] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 4 FOLLOWER]: Leader election won for term 4
I20261117 14:50:04.516637 8681 raft_consensus.cc:705] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 4 LEADER]: Becoming Leader. State: Replica: fa94e5d3d33a4f70b3e2c9c5f62cc9f3, State: Running, Role: LEADER
I20261117 14:50:04.517438 8681 consensus_queue.cc:238] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 121, Committed index: 121, Last appended: 2.121, Last appended by leader: 121, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "624366c73dc34561925e1d1b5216cf2b" member_type: VOTER last_known_addr { host: "127.6.50.132" port: 33799 } } peers { permanent_uuid: "6041859320d34e679a287826f4f54fd6" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 36371 } } peers { permanent_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 34551 } }
I20261117 14:50:04.527527 7591 catalog_manager.cc:5840] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 reported cstate change: term changed from 2 to 4, leader changed from 6041859320d34e679a287826f4f54fd6 (127.6.50.129) to fa94e5d3d33a4f70b3e2c9c5f62cc9f3 (127.6.50.131). New cstate: current_term: 4 leader_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "624366c73dc34561925e1d1b5216cf2b" member_type: VOTER last_known_addr { host: "127.6.50.132" port: 33799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6041859320d34e679a287826f4f54fd6" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 36371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 34551 } health_report { overall_health: HEALTHY } } }
W20261117 14:50:04.529963 8558 consensus_peers.cc:597] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 -> Peer 6041859320d34e679a287826f4f54fd6 (127.6.50.129:36371): Couldn't send request to peer 6041859320d34e679a287826f4f54fd6. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:36371: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20261117 14:50:04.531412 8129 raft_consensus.cc:1285] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b [term 4 FOLLOWER]: Refusing update from remote peer fa94e5d3d33a4f70b3e2c9c5f62cc9f3: Log matching property violated. Preceding OpId in replica: term: 2 index: 118. Preceding OpId from leader: term: 4 index: 122. (index mismatch)
I20261117 14:50:04.532276 8681 consensus_queue.cc:1049] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "624366c73dc34561925e1d1b5216cf2b" member_type: VOTER last_known_addr { host: "127.6.50.132" port: 33799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 122, Last known committed idx: 117, Time since last communication: 0.000s
W20261117 14:50:04.540192 8085 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:04.542068 8085 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
I20261117 14:50:04.581457 8703 log.cc:826] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6: Log is configured to *not* fsync() on all Append() calls
W20261117 14:50:04.606508 8085 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40238: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:04.756553 8224 scanner-internal.cc:464] Time spent opening tablet: real 4.108s user 0.008s sys 0.000s
W20261117 14:50:04.757025 8223 scanner-internal.cc:464] Time spent opening tablet: real 4.103s user 0.005s sys 0.001s
W20261117 14:50:05.065528 8558 consensus_peers.cc:597] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 -> Peer 6041859320d34e679a287826f4f54fd6 (127.6.50.129:36371): Couldn't send request to peer 6041859320d34e679a287826f4f54fd6. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:36371: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20261117 14:50:05.418792 8703 tablet_bootstrap.cc:492] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6: Bootstrap replayed 1/1 log segments. Stats: ops{read=121 overwritten=0 applied=121 ignored=0} inserts{seen=5950 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20261117 14:50:05.419761 8703 tablet_bootstrap.cc:492] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6: Bootstrap complete.
I20261117 14:50:05.422097 8703 ts_tablet_manager.cc:1449] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6: Time spent bootstrapping tablet: real 0.951s user 0.697s sys 0.071s
I20261117 14:50:05.432761 8703 raft_consensus.cc:360] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "624366c73dc34561925e1d1b5216cf2b" member_type: VOTER last_known_addr { host: "127.6.50.132" port: 33799 } } peers { permanent_uuid: "6041859320d34e679a287826f4f54fd6" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 36371 } } peers { permanent_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 34551 } }
I20261117 14:50:05.434051 8703 raft_consensus.cc:748] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6041859320d34e679a287826f4f54fd6, State: Initialized, Role: FOLLOWER
I20261117 14:50:05.435510 8703 consensus_queue.cc:261] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 121, Last appended: 2.121, Last appended by leader: 121, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "624366c73dc34561925e1d1b5216cf2b" member_type: VOTER last_known_addr { host: "127.6.50.132" port: 33799 } } peers { permanent_uuid: "6041859320d34e679a287826f4f54fd6" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 36371 } } peers { permanent_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 34551 } }
I20261117 14:50:05.444568 8703 ts_tablet_manager.cc:1480] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6: Time spent starting tablet: real 0.022s user 0.007s sys 0.015s
I20261117 14:50:05.470013 8680 rpc_server.cc:307] RPC server started. Bound to: 127.6.50.129:36371
I20261117 14:50:05.472019 8680 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-0/data/info.pb
I20261117 14:50:05.482383 6346 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskUafhB0/build/asan/bin/kudu as pid 8680
I20261117 14:50:05.484113 6346 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskUafhB0/build/asan/bin/kudu pid 8046
I20261117 14:50:05.512045 8831 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.50.129:36371 every 8 connection(s)
I20261117 14:50:05.528364 8169 generic_service.cc:196] Checking for leaks (request via RPC)
I20261117 14:50:05.547452 8832 heartbeater.cc:345] Connected to a master server at 127.6.50.190:39297
I20261117 14:50:05.547927 8832 heartbeater.cc:462] Registering TS with master...
I20261117 14:50:05.549213 8832 heartbeater.cc:508] Master 127.6.50.190:39297 requested a full tablet report, sending...
I20261117 14:50:05.552544 7591 ts_manager.cc:210] Re-registered known tserver with Master: 6041859320d34e679a287826f4f54fd6 (127.6.50.129:36371)
I20261117 14:50:05.554014 7591 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.6.50.129:58067
I20261117 14:50:05.568053 8786 raft_consensus.cc:3096] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [term 3 FOLLOWER]: Advancing to term 4
I20261117 14:50:05.573347 8832 heartbeater.cc:500] Master 127.6.50.190:39297 was elected leader, sending a full tablet report...
I20261117 14:50:05.756248 8840 mvcc.cc:204] Tried to move back new op lower bound from 7352021014718238720 to 7352021010511269888. Current Snapshot: MvccSnapshot[applied={T|T < 7352021014527516672 or (T in {7352021014632230912})}]
I20261117 14:50:05.827697 6346 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskUafhB0/build/asan/bin/kudu with pid 8046
W20261117 14:50:05.862358 7581 connection.cc:573] server connection from 127.6.50.132:50015 recv error: Network error: recv error from unknown peer: Connection reset by peer (error 104)
I20261117 14:50:05.863790 6346 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskUafhB0/build/asan/bin/kudu
/tmp/dist-test-taskUafhB0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.50.132:33799
--local_ip_for_outbound_sockets=127.6.50.132
--tserver_master_addrs=127.6.50.190:39297
--webserver_port=34537
--webserver_interface=127.6.50.132
--builtin_ntp_servers=127.6.50.148:44279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
W20261117 14:50:05.863132 8705 negotiation.cc:336] Failed RPC negotiation. Trace:
1117 14:50:05.862586 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.6.50.132:33799 (local address 127.6.50.131:51701)
1117 14:50:05.862729 (+ 143us) negotiation.cc:107] Waiting for socket to connect
1117 14:50:05.862751 (+ 22us) client_negotiation.cc:175] Beginning negotiation
1117 14:50:05.862868 (+ 117us) client_negotiation.cc:262] Sending NEGOTIATE NegotiatePB request
1117 14:50:05.863092 (+ 224us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.50.132:33799: BlockingRecv error: recv error from unknown peer: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":37}
W20261117 14:50:05.864838 8559 consensus_peers.cc:597] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 -> Peer 624366c73dc34561925e1d1b5216cf2b (127.6.50.132:33799): Couldn't send request to peer 624366c73dc34561925e1d1b5216cf2b. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.132:33799: BlockingRecv error: recv error from unknown peer: Connection reset by peer (error 104). This is attempt 1: this message will repeat every 5th retry.
W20261117 14:50:06.280396 8559 consensus_peers.cc:597] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 -> Peer 624366c73dc34561925e1d1b5216cf2b (127.6.50.132:33799): Couldn't send request to peer 624366c73dc34561925e1d1b5216cf2b. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.132:33799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20261117 14:50:06.404726 8848 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261117 14:50:06.405270 8848 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261117 14:50:06.405514 8848 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261117 14:50:06.418588 8848 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261117 14:50:06.418947 8848 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.50.132
I20261117 14:50:06.435261 8848 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-3/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.50.148:44279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.50.132:33799
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-3/data/info.pb
--webserver_interface=127.6.50.132
--webserver_port=34537
--tserver_master_addrs=127.6.50.190:39297
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.50.132
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type FASTDEBUG
built by None at 17 Nov 2026 14:43:24 UTC on bdcb31816ec0
build id 14829
ASAN enabled
I20261117 14:50:06.437500 8848 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261117 14:50:06.439961 8848 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20261117 14:50:06.445350 8848 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20261117 14:50:06.481784 8853 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261117 14:50:06.489223 8854 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261117 14:50:06.512188 8856 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261117 14:50:06.515002 8848 server_base.cc:1061] running on GCE node
I20261117 14:50:06.516031 8848 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261117 14:50:06.527194 8848 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261117 14:50:06.530629 8848 hybrid_clock.cc:648] HybridClock initialized: now 1794927006530470 us; error 114 us; skew 500 ppm
I20261117 14:50:06.531284 8848 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261117 14:50:06.537552 8848 webserver.cc:577] Webserver started at http://127.6.50.132:34537/ using document root <none> and password file <none>
I20261117 14:50:06.538635 8848 fs_manager.cc:362] Metadata directory not provided
I20261117 14:50:06.538836 8848 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261117 14:50:06.558104 8848 fs_manager.cc:714] Time spent opening directory manager: real 0.016s user 0.006s sys 0.000s
I20261117 14:50:06.563617 8862 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20261117 14:50:06.568996 8848 fs_manager.cc:730] Time spent opening block manager: real 0.009s user 0.004s sys 0.000s
I20261117 14:50:06.569197 8848 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-3/data,/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-3/wal
uuid: "624366c73dc34561925e1d1b5216cf2b"
format_stamp: "Formatted at 2026-11-17 14:49:56 on dist-test-slave-jwg6"
I20261117 14:50:06.570195 8848 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-3/wal
metadata directory: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-3/wal
1 data directories: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261117 14:50:06.638010 8848 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20261117 14:50:06.639699 8848 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261117 14:50:06.640089 8848 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261117 14:50:06.648020 8848 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261117 14:50:06.656781 8869 ts_tablet_manager.cc:594] Loading tablet metadata (0/1 complete)
I20261117 14:50:06.666350 8848 ts_tablet_manager.cc:631] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20261117 14:50:06.666565 8848 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.011s user 0.001s sys 0.000s
I20261117 14:50:06.666756 8848 ts_tablet_manager.cc:646] Registering tablets (0/1 complete)
I20261117 14:50:06.671937 8848 ts_tablet_manager.cc:662] Registered 1 tablets
I20261117 14:50:06.673939 8869 tablet_bootstrap.cc:492] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b: Bootstrap starting.
I20261117 14:50:06.674449 8848 ts_tablet_manager.cc:641] Time spent register tablets: real 0.008s user 0.005s sys 0.000s
W20261117 14:50:06.769204 8559 consensus_peers.cc:597] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 -> Peer 624366c73dc34561925e1d1b5216cf2b (127.6.50.132:33799): Couldn't send request to peer 624366c73dc34561925e1d1b5216cf2b. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.132:33799: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20261117 14:50:06.846856 8869 log.cc:826] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b: Log is configured to *not* fsync() on all Append() calls
W20261117 14:50:07.309301 8559 consensus_peers.cc:597] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 -> Peer 624366c73dc34561925e1d1b5216cf2b (127.6.50.132:33799): Couldn't send request to peer 624366c73dc34561925e1d1b5216cf2b. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.132:33799: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20261117 14:50:07.776384 8559 consensus_peers.cc:597] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 -> Peer 624366c73dc34561925e1d1b5216cf2b (127.6.50.132:33799): Couldn't send request to peer 624366c73dc34561925e1d1b5216cf2b. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.132:33799: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20261117 14:50:07.853896 8980 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.50.132:33799 every 8 connection(s)
I20261117 14:50:07.854276 8848 rpc_server.cc:307] RPC server started. Bound to: 127.6.50.132:33799
I20261117 14:50:07.856350 8848 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-3/data/info.pb
I20261117 14:50:07.862097 6346 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskUafhB0/build/asan/bin/kudu as pid 8848
I20261117 14:50:07.945576 8981 heartbeater.cc:345] Connected to a master server at 127.6.50.190:39297
I20261117 14:50:07.946010 8981 heartbeater.cc:462] Registering TS with master...
I20261117 14:50:07.947263 8981 heartbeater.cc:508] Master 127.6.50.190:39297 requested a full tablet report, sending...
I20261117 14:50:07.959693 7591 ts_manager.cc:210] Re-registered known tserver with Master: 624366c73dc34561925e1d1b5216cf2b (127.6.50.132:33799)
I20261117 14:50:07.961241 7591 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.6.50.132:60575
I20261117 14:50:08.211833 8869 tablet_bootstrap.cc:492] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b: Bootstrap replayed 1/1 log segments. Stats: ops{read=176 overwritten=0 applied=174 ignored=0} inserts{seen=8550 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 2 replicates
I20261117 14:50:08.212774 8869 tablet_bootstrap.cc:492] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b: Bootstrap complete.
I20261117 14:50:08.214485 8869 ts_tablet_manager.cc:1449] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b: Time spent bootstrapping tablet: real 1.541s user 0.928s sys 0.084s
I20261117 14:50:08.220762 8869 raft_consensus.cc:360] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b [term 4 FOLLOWER]: Replica starting. Triggering 2 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "624366c73dc34561925e1d1b5216cf2b" member_type: VOTER last_known_addr { host: "127.6.50.132" port: 33799 } } peers { permanent_uuid: "6041859320d34e679a287826f4f54fd6" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 36371 } } peers { permanent_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 34551 } }
I20261117 14:50:08.278843 8869 raft_consensus.cc:748] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b [term 4 FOLLOWER]: Becoming Follower/Learner. State: Replica: 624366c73dc34561925e1d1b5216cf2b, State: Initialized, Role: FOLLOWER
I20261117 14:50:08.282856 8869 consensus_queue.cc:261] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 174, Last appended: 4.176, Last appended by leader: 176, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "624366c73dc34561925e1d1b5216cf2b" member_type: VOTER last_known_addr { host: "127.6.50.132" port: 33799 } } peers { permanent_uuid: "6041859320d34e679a287826f4f54fd6" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 36371 } } peers { permanent_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 34551 } }
I20261117 14:50:08.331297 8981 heartbeater.cc:500] Master 127.6.50.190:39297 was elected leader, sending a full tablet report...
I20261117 14:50:08.332744 8869 ts_tablet_manager.cc:1480] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b: Time spent starting tablet: real 0.118s user 0.017s sys 0.022s
I20261117 14:50:09.482095 8470 tablet_service.cc:1456] Tablet server has 0 leaders and 0 scanners
I20261117 14:50:09.606989 8766 tablet_service.cc:1456] Tablet server has 0 leaders and 0 scanners
I20261117 14:50:09.650089 8596 tablet_service.cc:1456] Tablet server has 1 leaders and 3 scanners
I20261117 14:50:09.689318 8914 tablet_service.cc:1456] Tablet server has 0 leaders and 0 scanners
W20261117 14:50:10.905397 8222 meta_cache.cc:1261] Time spent looking up entry by key: real 0.053s user 0.004s sys 0.000s
I20261117 14:50:11.189798 7591 ts_manager.cc:300] Unset tserver state for 39c0d031db104a9d83a434fb89d0a277 from MAINTENANCE_MODE
I20261117 14:50:11.485688 7591 ts_manager.cc:300] Unset tserver state for 6041859320d34e679a287826f4f54fd6 from MAINTENANCE_MODE
I20261117 14:50:11.618876 8981 heartbeater.cc:508] Master 127.6.50.190:39297 requested a full tablet report, sending...
I20261117 14:50:11.677487 8832 heartbeater.cc:508] Master 127.6.50.190:39297 requested a full tablet report, sending...
I20261117 14:50:11.680649 8671 heartbeater.cc:508] Master 127.6.50.190:39297 requested a full tablet report, sending...
I20261117 14:50:11.748692 7591 ts_manager.cc:300] Unset tserver state for fa94e5d3d33a4f70b3e2c9c5f62cc9f3 from MAINTENANCE_MODE
I20261117 14:50:12.042383 8535 heartbeater.cc:508] Master 127.6.50.190:39297 requested a full tablet report, sending...
I20261117 14:50:12.319371 7591 ts_manager.cc:300] Unset tserver state for 624366c73dc34561925e1d1b5216cf2b from MAINTENANCE_MODE
I20261117 14:50:12.630195 8981 heartbeater.cc:508] Master 127.6.50.190:39297 requested a full tablet report, sending...
I20261117 14:50:12.683038 8832 heartbeater.cc:508] Master 127.6.50.190:39297 requested a full tablet report, sending...
I20261117 14:50:12.685309 8671 heartbeater.cc:508] Master 127.6.50.190:39297 requested a full tablet report, sending...
I20261117 14:50:13.052395 8535 heartbeater.cc:508] Master 127.6.50.190:39297 requested a full tablet report, sending...
W20261117 14:50:13.719545 8183 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.6.50.131:34551, user_credentials={real_user=slave}} blocked reactor thread for 54248.4us
I20261117 14:50:13.930683 7591 ts_manager.cc:311] Set tserver state for 624366c73dc34561925e1d1b5216cf2b to MAINTENANCE_MODE
I20261117 14:50:14.197719 7591 ts_manager.cc:311] Set tserver state for 6041859320d34e679a287826f4f54fd6 to MAINTENANCE_MODE
I20261117 14:50:14.229980 7591 ts_manager.cc:311] Set tserver state for fa94e5d3d33a4f70b3e2c9c5f62cc9f3 to MAINTENANCE_MODE
I20261117 14:50:15.013684 7591 ts_manager.cc:311] Set tserver state for 39c0d031db104a9d83a434fb89d0a277 to MAINTENANCE_MODE
I20261117 14:50:15.249171 8914 tablet_service.cc:1449] Tablet server 624366c73dc34561925e1d1b5216cf2b set to quiescing
I20261117 14:50:15.249464 8914 tablet_service.cc:1456] Tablet server has 0 leaders and 0 scanners
I20261117 14:50:15.807237 8596 tablet_service.cc:1449] Tablet server fa94e5d3d33a4f70b3e2c9c5f62cc9f3 set to quiescing
I20261117 14:50:15.807456 8596 tablet_service.cc:1456] Tablet server has 1 leaders and 3 scanners
I20261117 14:50:15.814891 9104 raft_consensus.cc:1003] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3: : Instructing follower 6041859320d34e679a287826f4f54fd6 to start an election
I20261117 14:50:15.815054 9104 raft_consensus.cc:1091] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 4 LEADER]: Signalling peer 6041859320d34e679a287826f4f54fd6 to start an election
I20261117 14:50:15.822935 9180 raft_consensus.cc:1003] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3: : Instructing follower 6041859320d34e679a287826f4f54fd6 to start an election
I20261117 14:50:15.823091 9180 raft_consensus.cc:1091] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 4 LEADER]: Signalling peer 6041859320d34e679a287826f4f54fd6 to start an election
I20261117 14:50:15.824636 8783 tablet_service.cc:2033] Received Run Leader Election RPC: tablet_id: "a1fc825ee85f40d1aee4695db8235828"
dest_uuid: "6041859320d34e679a287826f4f54fd6"
from {username='slave'} at 127.6.50.131:44005
I20261117 14:50:15.824944 8783 raft_consensus.cc:499] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20261117 14:50:15.825196 8786 tablet_service.cc:2033] Received Run Leader Election RPC: tablet_id: "a1fc825ee85f40d1aee4695db8235828"
dest_uuid: "6041859320d34e679a287826f4f54fd6"
from {username='slave'} at 127.6.50.131:44005
I20261117 14:50:15.825214 8783 raft_consensus.cc:3096] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [term 4 FOLLOWER]: Advancing to term 5
I20261117 14:50:15.828548 8783 raft_consensus.cc:521] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "624366c73dc34561925e1d1b5216cf2b" member_type: VOTER last_known_addr { host: "127.6.50.132" port: 33799 } } peers { permanent_uuid: "6041859320d34e679a287826f4f54fd6" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 36371 } } peers { permanent_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 34551 } }
I20261117 14:50:15.831069 8786 raft_consensus.cc:499] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20261117 14:50:15.831207 8786 raft_consensus.cc:3096] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [term 5 FOLLOWER]: Advancing to term 6
I20261117 14:50:15.834157 8786 raft_consensus.cc:521] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "624366c73dc34561925e1d1b5216cf2b" member_type: VOTER last_known_addr { host: "127.6.50.132" port: 33799 } } peers { permanent_uuid: "6041859320d34e679a287826f4f54fd6" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 36371 } } peers { permanent_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 34551 } }
I20261117 14:50:15.835155 8786 leader_election.cc:290] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [CANDIDATE]: Term 6 election: Requested vote from peers 624366c73dc34561925e1d1b5216cf2b (127.6.50.132:33799), fa94e5d3d33a4f70b3e2c9c5f62cc9f3 (127.6.50.131:34551)
I20261117 14:50:15.838243 8783 leader_election.cc:290] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [CANDIDATE]: Term 5 election: Requested vote from peers 624366c73dc34561925e1d1b5216cf2b (127.6.50.132:33799), fa94e5d3d33a4f70b3e2c9c5f62cc9f3 (127.6.50.131:34551)
I20261117 14:50:15.866026 8786 raft_consensus.cc:1250] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [term 6 FOLLOWER]: Rejecting Update request from peer fa94e5d3d33a4f70b3e2c9c5f62cc9f3 for earlier term 4. Current term is 6. Ops: [4.939-4.939]
I20261117 14:50:15.867167 9104 consensus_queue.cc:1060] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6041859320d34e679a287826f4f54fd6" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 36371 }, Status: INVALID_TERM, Last received: 4.938, Next index: 939, Last known committed idx: 938, Time since last communication: 0.000s
I20261117 14:50:15.867458 9104 raft_consensus.cc:3091] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 4 LEADER]: Stepping down as leader of term 4
I20261117 14:50:15.867555 9104 raft_consensus.cc:748] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fa94e5d3d33a4f70b3e2c9c5f62cc9f3, State: Running, Role: LEADER
I20261117 14:50:15.867858 9104 consensus_queue.cc:261] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 938, Committed index: 938, Last appended: 4.939, Last appended by leader: 939, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "624366c73dc34561925e1d1b5216cf2b" member_type: VOTER last_known_addr { host: "127.6.50.132" port: 33799 } } peers { permanent_uuid: "6041859320d34e679a287826f4f54fd6" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 36371 } } peers { permanent_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 34551 } }
I20261117 14:50:15.868500 9104 raft_consensus.cc:3096] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 4 FOLLOWER]: Advancing to term 6
W20261117 14:50:15.869234 8728 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52112: Illegal state: Cannot assign timestamp to op. Tablet is not in leader mode. Last heard from a leader: 0.011s ago.
W20261117 14:50:15.870633 8728 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52112: Illegal state: Cannot assign timestamp to op. Tablet is not in leader mode. Last heard from a leader: 0.013s ago.
I20261117 14:50:15.872924 8933 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "a1fc825ee85f40d1aee4695db8235828" candidate_uuid: "6041859320d34e679a287826f4f54fd6" candidate_term: 6 candidate_status { last_received { term: 4 index: 938 } } ignore_live_leader: true dest_uuid: "624366c73dc34561925e1d1b5216cf2b"
I20261117 14:50:15.872881 8934 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "a1fc825ee85f40d1aee4695db8235828" candidate_uuid: "6041859320d34e679a287826f4f54fd6" candidate_term: 5 candidate_status { last_received { term: 4 index: 938 } } ignore_live_leader: true dest_uuid: "624366c73dc34561925e1d1b5216cf2b"
I20261117 14:50:15.873260 8933 raft_consensus.cc:3096] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b [term 4 FOLLOWER]: Advancing to term 6
I20261117 14:50:15.878611 8933 raft_consensus.cc:2432] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6041859320d34e679a287826f4f54fd6 for term 6 because replica has last-logged OpId of term: 4 index: 939, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 938.
I20261117 14:50:15.899129 8626 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "a1fc825ee85f40d1aee4695db8235828" candidate_uuid: "6041859320d34e679a287826f4f54fd6" candidate_term: 6 candidate_status { last_received { term: 4 index: 938 } } ignore_live_leader: true dest_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3"
I20261117 14:50:15.899614 8626 raft_consensus.cc:2432] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6041859320d34e679a287826f4f54fd6 for term 6 because replica has last-logged OpId of term: 4 index: 939, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 938.
I20261117 14:50:15.899133 8625 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "a1fc825ee85f40d1aee4695db8235828" candidate_uuid: "6041859320d34e679a287826f4f54fd6" candidate_term: 5 candidate_status { last_received { term: 4 index: 938 } } ignore_live_leader: true dest_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3"
I20261117 14:50:15.900343 8625 raft_consensus.cc:2390] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6041859320d34e679a287826f4f54fd6 for earlier term 5. Current term is 6.
I20261117 14:50:15.900233 8697 leader_election.cc:304] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6041859320d34e679a287826f4f54fd6; no voters: 624366c73dc34561925e1d1b5216cf2b, fa94e5d3d33a4f70b3e2c9c5f62cc9f3
W20261117 14:50:15.923424 8894 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47042: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:15.924890 8894 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47042: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
I20261117 14:50:15.927657 9198 raft_consensus.cc:2771] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20261117 14:50:15.928472 8697 leader_election.cc:400] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [CANDIDATE]: Term 5 election: Vote denied by peer fa94e5d3d33a4f70b3e2c9c5f62cc9f3 (127.6.50.131:34551) with higher term. Message: Invalid argument: T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6041859320d34e679a287826f4f54fd6 for earlier term 5. Current term is 6.
I20261117 14:50:15.930279 8697 leader_election.cc:403] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20261117 14:50:15.931912 9198 raft_consensus.cc:2771] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer fa94e5d3d33a4f70b3e2c9c5f62cc9f3 (127.6.50.131:34551) with higher term. Message: Invalid argument: T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6041859320d34e679a287826f4f54fd6 for earlier term 5. Current term is 6.
W20261117 14:50:15.933245 8583 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52112: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:15.934026 8580 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52112: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:15.940508 8894 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47042: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:15.942154 8894 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47042: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:15.970621 8746 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:39994: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:15.970745 8744 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:39994: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:15.987094 8580 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52112: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:15.988427 8580 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52112: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:16.000339 8894 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47042: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:16.001667 8894 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47042: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:16.013739 8744 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:39994: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:16.013885 8746 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:39994: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:16.027051 8580 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52112: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:16.033066 8582 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52112: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:16.042852 8894 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47042: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:16.048144 8894 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47042: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:16.056087 8746 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:39994: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:16.063760 8746 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:39994: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:16.083202 8584 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52112: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:16.088270 8583 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52112: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:16.100629 8894 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47042: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:16.105026 8894 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47042: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:16.117323 8746 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:39994: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:16.120682 8746 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:39994: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:16.141592 8582 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52112: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:16.142828 8584 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52112: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
I20261117 14:50:16.154511 8766 tablet_service.cc:1449] Tablet server 6041859320d34e679a287826f4f54fd6 set to quiescing
I20261117 14:50:16.154820 8766 tablet_service.cc:1456] Tablet server has 0 leaders and 0 scanners
W20261117 14:50:16.163501 8894 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47042: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:16.163722 8893 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47042: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:16.169023 9209 raft_consensus.cc:678] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b: failed to trigger leader election: Illegal state: leader elections are disabled
W20261117 14:50:16.182004 8746 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:39994: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:16.182866 8744 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:39994: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:16.207085 8583 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52112: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:16.207194 8580 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52112: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:16.230561 8893 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47042: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:16.232865 8893 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47042: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:16.239534 9180 raft_consensus.cc:678] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3: failed to trigger leader election: Illegal state: leader elections are disabled
W20261117 14:50:16.252112 8744 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:39994: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:16.254388 8744 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:39994: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:16.278339 8580 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52112: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:16.283281 8584 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52112: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:16.304406 8893 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47042: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:16.308223 8893 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47042: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:16.329392 8744 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:39994: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:16.332604 8744 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:39994: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:16.360859 8580 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52112: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:16.361130 8582 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52112: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
I20261117 14:50:16.385706 8470 tablet_service.cc:1449] Tablet server 39c0d031db104a9d83a434fb89d0a277 set to quiescing
I20261117 14:50:16.385912 8470 tablet_service.cc:1456] Tablet server has 0 leaders and 0 scanners
W20261117 14:50:16.390216 8893 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47042: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:16.391366 8893 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47042: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:16.419821 8746 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:39994: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:16.419852 8744 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:39994: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:16.451275 8582 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52112: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:16.451680 8580 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52112: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:16.482667 8893 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47042: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:16.484822 8893 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47042: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:16.491058 9222 raft_consensus.cc:678] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6: failed to trigger leader election: Illegal state: leader elections are disabled
W20261117 14:50:16.514978 8746 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:39994: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:16.516309 8746 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:39994: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:16.550382 8580 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52112: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:16.551378 8580 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52112: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:16.586723 8893 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47042: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:16.586730 8894 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47042: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:16.623265 8746 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:39994: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:16.624579 8746 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:39994: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:16.659839 8580 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52112: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:16.662223 8580 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52112: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:16.698526 8893 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47042: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:16.700506 8893 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47042: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:16.735987 8746 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:39994: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:16.741212 8746 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:39994: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:16.778409 8580 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52112: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:16.783285 8580 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52112: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:16.820905 8893 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47042: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:16.822703 8893 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47042: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:16.860759 8746 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:39994: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:16.863765 8746 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:39994: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:16.904644 8580 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52112: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:16.907781 8580 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52112: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:16.948539 8893 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47042: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:16.952746 8893 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47042: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:16.991012 8746 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:39994: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:16.998314 8746 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:39994: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:17.040737 8580 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52112: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:17.047152 8580 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52112: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:17.086824 8893 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47042: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:17.098332 8893 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47042: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:17.146112 8746 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:39994: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:17.148036 8746 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:39994: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:17.199319 8580 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52112: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:17.199512 8582 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52112: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:17.246977 8893 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47042: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:17.251034 8893 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47042: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:17.297408 8746 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:39994: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:17.303453 8746 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:39994: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:17.353663 8582 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52112: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:17.357815 8582 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52112: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:17.407334 8893 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47042: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:17.410418 8893 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47042: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:17.461346 8746 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:39994: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:17.465435 8746 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:39994: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
I20261117 14:50:17.492794 8596 tablet_service.cc:1449] Tablet server fa94e5d3d33a4f70b3e2c9c5f62cc9f3 set to quiescing
I20261117 14:50:17.492986 8596 tablet_service.cc:1456] Tablet server has 0 leaders and 0 scanners
W20261117 14:50:17.518589 8582 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52112: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:17.521929 8582 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52112: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:17.575273 8893 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47042: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:17.578295 8893 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47042: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
I20261117 14:50:17.581207 6346 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskUafhB0/build/asan/bin/kudu pid 8408
I20261117 14:50:17.588119 8530 generic_service.cc:196] Checking for leaks (request via RPC)
W20261117 14:50:17.632884 8746 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:39994: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:17.633775 8744 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:39994: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
I20261117 14:50:17.679847 6346 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskUafhB0/build/asan/bin/kudu with pid 8408
W20261117 14:50:17.693223 8582 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52112: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:17.693969 8580 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52112: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
I20261117 14:50:17.699765 6346 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskUafhB0/build/asan/bin/kudu
/tmp/dist-test-taskUafhB0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.50.130:38123
--local_ip_for_outbound_sockets=127.6.50.130
--tserver_master_addrs=127.6.50.190:39297
--webserver_port=45239
--webserver_interface=127.6.50.130
--builtin_ntp_servers=127.6.50.148:44279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
W20261117 14:50:17.752363 8893 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47042: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:17.753185 8894 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47042: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:17.813772 8744 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:39994: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:17.814699 8746 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:39994: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:17.879477 8580 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52112: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:17.879801 8582 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52112: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:17.939320 8894 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47042: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:17.943506 8894 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47042: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:18.002836 8746 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:39994: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:18.007153 8746 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:39994: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:18.068559 8582 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52112: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:18.072090 8582 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52112: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:18.075044 9238 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261117 14:50:18.075421 9238 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261117 14:50:18.075595 9238 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261117 14:50:18.084642 9238 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261117 14:50:18.084973 9238 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.50.130
I20261117 14:50:18.096112 9238 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.50.148:44279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.50.130:38123
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.6.50.130
--webserver_port=45239
--tserver_master_addrs=127.6.50.190:39297
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.50.130
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type FASTDEBUG
built by None at 17 Nov 2026 14:43:24 UTC on bdcb31816ec0
build id 14829
ASAN enabled
I20261117 14:50:18.097889 9238 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261117 14:50:18.099851 9238 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20261117 14:50:18.104041 9238 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20261117 14:50:18.111346 9244 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261117 14:50:18.111459 9246 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261117 14:50:18.111328 9243 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261117 14:50:18.112131 9238 server_base.cc:1061] running on GCE node
I20261117 14:50:18.112851 9238 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261117 14:50:18.114167 9238 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261117 14:50:18.115414 9238 hybrid_clock.cc:648] HybridClock initialized: now 1794927018115332 us; error 66 us; skew 500 ppm
I20261117 14:50:18.115777 9238 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261117 14:50:18.118225 9238 webserver.cc:577] Webserver started at http://127.6.50.130:45239/ using document root <none> and password file <none>
I20261117 14:50:18.118983 9238 fs_manager.cc:362] Metadata directory not provided
I20261117 14:50:18.119146 9238 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261117 14:50:18.125190 9238 fs_manager.cc:714] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20261117 14:50:18.128239 9252 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20261117 14:50:18.129900 9238 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20261117 14:50:18.130112 9238 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-1/data,/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-1/wal
uuid: "39c0d031db104a9d83a434fb89d0a277"
format_stamp: "Formatted at 2026-11-17 14:49:55 on dist-test-slave-jwg6"
I20261117 14:50:18.130873 9238 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20261117 14:50:18.132661 8894 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47042: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:18.136864 8894 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47042: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
I20261117 14:50:18.159523 9238 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20261117 14:50:18.160660 9238 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261117 14:50:18.160945 9238 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261117 14:50:18.162060 9238 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261117 14:50:18.163784 9238 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261117 14:50:18.163900 9238 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20261117 14:50:18.163988 9238 ts_tablet_manager.cc:662] Registered 0 tablets
I20261117 14:50:18.164048 9238 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20261117 14:50:18.200577 9238 rpc_server.cc:307] RPC server started. Bound to: 127.6.50.130:38123
W20261117 14:50:18.200702 8744 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:39994: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
I20261117 14:50:18.200664 9364 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.50.130:38123 every 8 connection(s)
W20261117 14:50:18.200757 8746 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:39994: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
I20261117 14:50:18.202411 9238 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-1/data/info.pb
I20261117 14:50:18.204866 6346 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskUafhB0/build/asan/bin/kudu as pid 9238
I20261117 14:50:18.205090 6346 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskUafhB0/build/asan/bin/kudu pid 8542
I20261117 14:50:18.226779 8666 generic_service.cc:196] Checking for leaks (request via RPC)
I20261117 14:50:18.231153 9365 heartbeater.cc:345] Connected to a master server at 127.6.50.190:39297
I20261117 14:50:18.231582 9365 heartbeater.cc:462] Registering TS with master...
I20261117 14:50:18.232502 9365 heartbeater.cc:508] Master 127.6.50.190:39297 requested a full tablet report, sending...
I20261117 14:50:18.234217 7591 ts_manager.cc:210] Re-registered known tserver with Master: 39c0d031db104a9d83a434fb89d0a277 (127.6.50.130:38123)
I20261117 14:50:18.235105 7591 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.6.50.130:53481
W20261117 14:50:18.403908 8582 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52112: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
I20261117 14:50:18.404345 6346 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskUafhB0/build/asan/bin/kudu with pid 8542
W20261117 14:50:18.404342 8580 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:52112: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:18.448861 8183 meta_cache.cc:302] tablet a1fc825ee85f40d1aee4695db8235828: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 (127.6.50.131:34551) has failed: Network error: recv got EOF from 127.6.50.131:34551 (error 108)
I20261117 14:50:18.449429 6346 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskUafhB0/build/asan/bin/kudu
/tmp/dist-test-taskUafhB0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.50.131:34551
--local_ip_for_outbound_sockets=127.6.50.131
--tserver_master_addrs=127.6.50.190:39297
--webserver_port=39699
--webserver_interface=127.6.50.131
--builtin_ntp_servers=127.6.50.148:44279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
W20261117 14:50:18.516287 8894 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47042: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:18.518224 8894 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47042: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:18.586743 8746 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:39994: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:18.586896 8744 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:39994: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:18.728607 8894 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47042: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:18.800626 8894 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47042: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:18.801858 8746 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:39994: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:18.823051 9372 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261117 14:50:18.823405 9372 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261117 14:50:18.823555 9372 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261117 14:50:18.832295 9372 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261117 14:50:18.832564 9372 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.50.131
I20261117 14:50:18.843268 9372 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.50.148:44279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.50.131:34551
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.6.50.131
--webserver_port=39699
--tserver_master_addrs=127.6.50.190:39297
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.50.131
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type FASTDEBUG
built by None at 17 Nov 2026 14:43:24 UTC on bdcb31816ec0
build id 14829
ASAN enabled
I20261117 14:50:18.845080 9372 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261117 14:50:18.846963 9372 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20261117 14:50:18.851066 9372 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20261117 14:50:18.857414 9378 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261117 14:50:18.858287 9379 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261117 14:50:18.859725 9381 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261117 14:50:18.860188 9372 server_base.cc:1061] running on GCE node
I20261117 14:50:18.860918 9372 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261117 14:50:18.861956 9372 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261117 14:50:18.863286 9372 hybrid_clock.cc:648] HybridClock initialized: now 1794927018863230 us; error 32 us; skew 500 ppm
I20261117 14:50:18.863690 9372 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261117 14:50:18.866119 9372 webserver.cc:577] Webserver started at http://127.6.50.131:39699/ using document root <none> and password file <none>
I20261117 14:50:18.867005 9372 fs_manager.cc:362] Metadata directory not provided
I20261117 14:50:18.867179 9372 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
W20261117 14:50:18.871829 8746 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:39994: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
I20261117 14:50:18.873826 9372 fs_manager.cc:714] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20261117 14:50:18.877236 9387 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20261117 14:50:18.878903 9372 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20261117 14:50:18.879107 9372 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-2/data,/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-2/wal
uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3"
format_stamp: "Formatted at 2026-11-17 14:49:56 on dist-test-slave-jwg6"
I20261117 14:50:18.879954 9372 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261117 14:50:18.899724 9372 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20261117 14:50:18.900743 9372 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261117 14:50:18.901031 9372 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261117 14:50:18.902108 9372 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261117 14:50:18.904326 9394 ts_tablet_manager.cc:594] Loading tablet metadata (0/1 complete)
I20261117 14:50:18.910650 9372 ts_tablet_manager.cc:631] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20261117 14:50:18.910845 9372 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.007s user 0.001s sys 0.000s
I20261117 14:50:18.910996 9372 ts_tablet_manager.cc:646] Registering tablets (0/1 complete)
I20261117 14:50:18.914258 9372 ts_tablet_manager.cc:662] Registered 1 tablets
I20261117 14:50:18.914371 9372 ts_tablet_manager.cc:641] Time spent register tablets: real 0.003s user 0.000s sys 0.002s
I20261117 14:50:18.914868 9394 tablet_bootstrap.cc:492] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3: Bootstrap starting.
I20261117 14:50:18.923285 8225 meta_cache.cc:1510] marking tablet server fa94e5d3d33a4f70b3e2c9c5f62cc9f3 (127.6.50.131:34551) as failed
I20261117 14:50:18.977634 9372 rpc_server.cc:307] RPC server started. Bound to: 127.6.50.131:34551
I20261117 14:50:18.977694 9500 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.50.131:34551 every 8 connection(s)
I20261117 14:50:18.979424 9372 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-2/data/info.pb
I20261117 14:50:18.981650 6346 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskUafhB0/build/asan/bin/kudu as pid 9372
I20261117 14:50:18.981879 6346 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskUafhB0/build/asan/bin/kudu pid 8680
I20261117 14:50:19.010890 8826 generic_service.cc:196] Checking for leaks (request via RPC)
I20261117 14:50:19.012288 9501 heartbeater.cc:345] Connected to a master server at 127.6.50.190:39297
I20261117 14:50:19.012845 9501 heartbeater.cc:462] Registering TS with master...
I20261117 14:50:19.014307 9501 heartbeater.cc:508] Master 127.6.50.190:39297 requested a full tablet report, sending...
W20261117 14:50:19.018741 8894 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47042: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
I20261117 14:50:19.019649 7587 ts_manager.cc:210] Re-registered known tserver with Master: fa94e5d3d33a4f70b3e2c9c5f62cc9f3 (127.6.50.131:34551)
I20261117 14:50:19.021785 7587 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.6.50.131:33225
W20261117 14:50:19.108167 8894 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47042: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:19.205359 8746 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:39994: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:19.205384 8744 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:39994: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
I20261117 14:50:19.206328 6346 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskUafhB0/build/asan/bin/kudu with pid 8680
I20261117 14:50:19.235652 6346 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskUafhB0/build/asan/bin/kudu
/tmp/dist-test-taskUafhB0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.50.129:36371
--local_ip_for_outbound_sockets=127.6.50.129
--tserver_master_addrs=127.6.50.190:39297
--webserver_port=39191
--webserver_interface=127.6.50.129
--builtin_ntp_servers=127.6.50.148:44279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
I20261117 14:50:19.238065 9365 heartbeater.cc:500] Master 127.6.50.190:39297 was elected leader, sending a full tablet report...
I20261117 14:50:19.265726 9394 log.cc:826] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3: Log is configured to *not* fsync() on all Append() calls
W20261117 14:50:19.361133 8894 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47042: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:19.363005 8894 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47042: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:19.518285 8183 meta_cache.cc:302] tablet a1fc825ee85f40d1aee4695db8235828: replica 6041859320d34e679a287826f4f54fd6 (127.6.50.129:36371) has failed: Network error: Client connection negotiation failed: client connection to 127.6.50.129:36371: connect: Connection refused (error 111)
W20261117 14:50:19.527216 8894 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47042: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:19.648422 9509 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261117 14:50:19.648732 9509 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261117 14:50:19.648917 9509 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261117 14:50:19.658329 9509 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261117 14:50:19.658561 9509 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.50.129
I20261117 14:50:19.669287 9509 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.50.148:44279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.50.129:36371
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.6.50.129
--webserver_port=39191
--tserver_master_addrs=127.6.50.190:39297
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.50.129
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type FASTDEBUG
built by None at 17 Nov 2026 14:43:24 UTC on bdcb31816ec0
build id 14829
ASAN enabled
I20261117 14:50:19.671023 9509 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261117 14:50:19.672930 9509 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20261117 14:50:19.676906 9509 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20261117 14:50:19.681350 8894 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47042: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:19.682538 9515 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261117 14:50:19.684242 9516 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261117 14:50:19.685427 9518 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261117 14:50:19.686231 9509 server_base.cc:1061] running on GCE node
I20261117 14:50:19.687021 9509 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261117 14:50:19.688225 9509 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261117 14:50:19.689483 9509 hybrid_clock.cc:648] HybridClock initialized: now 1794927019689405 us; error 50 us; skew 500 ppm
I20261117 14:50:19.689849 9509 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261117 14:50:19.692953 9509 webserver.cc:577] Webserver started at http://127.6.50.129:39191/ using document root <none> and password file <none>
I20261117 14:50:19.693941 9509 fs_manager.cc:362] Metadata directory not provided
I20261117 14:50:19.694135 9509 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261117 14:50:19.701687 9509 fs_manager.cc:714] Time spent opening directory manager: real 0.005s user 0.003s sys 0.001s
I20261117 14:50:19.705432 9524 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20261117 14:50:19.707271 9509 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20261117 14:50:19.707443 9509 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-0/data,/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-0/wal
uuid: "6041859320d34e679a287826f4f54fd6"
format_stamp: "Formatted at 2026-11-17 14:49:55 on dist-test-slave-jwg6"
I20261117 14:50:19.708370 9509 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261117 14:50:19.727330 9509 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20261117 14:50:19.728470 9509 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261117 14:50:19.728746 9509 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261117 14:50:19.729934 9509 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261117 14:50:19.732834 9531 ts_tablet_manager.cc:594] Loading tablet metadata (0/1 complete)
I20261117 14:50:19.739820 9509 ts_tablet_manager.cc:631] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20261117 14:50:19.739964 9509 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.008s user 0.001s sys 0.000s
I20261117 14:50:19.740082 9509 ts_tablet_manager.cc:646] Registering tablets (0/1 complete)
I20261117 14:50:19.744554 9509 ts_tablet_manager.cc:662] Registered 1 tablets
I20261117 14:50:19.744688 9509 ts_tablet_manager.cc:641] Time spent register tablets: real 0.005s user 0.005s sys 0.000s
I20261117 14:50:19.745221 9531 tablet_bootstrap.cc:492] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6: Bootstrap starting.
W20261117 14:50:19.778299 8894 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47042: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
I20261117 14:50:19.801478 9509 rpc_server.cc:307] RPC server started. Bound to: 127.6.50.129:36371
I20261117 14:50:19.801748 9637 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.50.129:36371 every 8 connection(s)
I20261117 14:50:19.803849 9509 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-0/data/info.pb
I20261117 14:50:19.805620 6346 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskUafhB0/build/asan/bin/kudu as pid 9509
I20261117 14:50:19.805850 6346 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskUafhB0/build/asan/bin/kudu pid 8848
I20261117 14:50:19.821658 8976 generic_service.cc:196] Checking for leaks (request via RPC)
I20261117 14:50:19.841778 9638 heartbeater.cc:345] Connected to a master server at 127.6.50.190:39297
I20261117 14:50:19.842156 9638 heartbeater.cc:462] Registering TS with master...
I20261117 14:50:19.843394 9638 heartbeater.cc:508] Master 127.6.50.190:39297 requested a full tablet report, sending...
I20261117 14:50:19.847039 7587 ts_manager.cc:210] Re-registered known tserver with Master: 6041859320d34e679a287826f4f54fd6 (127.6.50.129:36371)
I20261117 14:50:19.848672 7587 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.6.50.129:55713
I20261117 14:50:20.025544 9501 heartbeater.cc:500] Master 127.6.50.190:39297 was elected leader, sending a full tablet report...
W20261117 14:50:20.052702 8894 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47042: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
I20261117 14:50:20.056955 6346 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskUafhB0/build/asan/bin/kudu with pid 8848
I20261117 14:50:20.092334 9531 log.cc:826] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6: Log is configured to *not* fsync() on all Append() calls
W20261117 14:50:20.094769 8184 connection.cc:573] client connection to 127.6.50.132:33799 recv error: Network error: recv error from unknown peer: Connection reset by peer (error 104)
I20261117 14:50:20.095404 6346 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskUafhB0/build/asan/bin/kudu
/tmp/dist-test-taskUafhB0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.50.132:33799
--local_ip_for_outbound_sockets=127.6.50.132
--tserver_master_addrs=127.6.50.190:39297
--webserver_port=34537
--webserver_interface=127.6.50.132
--builtin_ntp_servers=127.6.50.148:44279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
I20261117 14:50:20.158993 8223 meta_cache.cc:1510] marking tablet server 624366c73dc34561925e1d1b5216cf2b (127.6.50.132:33799) as failed
I20261117 14:50:20.365341 8224 meta_cache.cc:1510] marking tablet server 624366c73dc34561925e1d1b5216cf2b (127.6.50.132:33799) as failed
W20261117 14:50:20.577935 8184 meta_cache.cc:302] tablet a1fc825ee85f40d1aee4695db8235828: replica 624366c73dc34561925e1d1b5216cf2b (127.6.50.132:33799) has failed: Network error: Client connection negotiation failed: client connection to 127.6.50.132:33799: connect: Connection refused (error 111)
W20261117 14:50:20.601398 9647 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261117 14:50:20.601807 9647 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261117 14:50:20.601953 9647 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261117 14:50:20.615482 9647 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261117 14:50:20.615758 9647 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.50.132
I20261117 14:50:20.631981 9647 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-3/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.50.148:44279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.50.132:33799
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-3/data/info.pb
--webserver_interface=127.6.50.132
--webserver_port=34537
--tserver_master_addrs=127.6.50.190:39297
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.50.132
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type FASTDEBUG
built by None at 17 Nov 2026 14:43:24 UTC on bdcb31816ec0
build id 14829
ASAN enabled
I20261117 14:50:20.634264 9647 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261117 14:50:20.636729 9647 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20261117 14:50:20.641902 9647 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20261117 14:50:20.648077 9652 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261117 14:50:20.648717 9653 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261117 14:50:20.656174 9655 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261117 14:50:20.656927 9647 server_base.cc:1061] running on GCE node
I20261117 14:50:20.657680 9647 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261117 14:50:20.658862 9647 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261117 14:50:20.660126 9647 hybrid_clock.cc:648] HybridClock initialized: now 1794927020660047 us; error 45 us; skew 500 ppm
I20261117 14:50:20.660542 9647 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261117 14:50:20.663341 9647 webserver.cc:577] Webserver started at http://127.6.50.132:34537/ using document root <none> and password file <none>
I20261117 14:50:20.664317 9647 fs_manager.cc:362] Metadata directory not provided
I20261117 14:50:20.664495 9647 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261117 14:50:20.671748 9647 fs_manager.cc:714] Time spent opening directory manager: real 0.005s user 0.005s sys 0.001s
I20261117 14:50:20.678997 9661 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20261117 14:50:20.680928 9647 fs_manager.cc:730] Time spent opening block manager: real 0.007s user 0.001s sys 0.006s
I20261117 14:50:20.681113 9647 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-3/data,/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-3/wal
uuid: "624366c73dc34561925e1d1b5216cf2b"
format_stamp: "Formatted at 2026-11-17 14:49:56 on dist-test-slave-jwg6"
I20261117 14:50:20.682051 9647 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-3/wal
metadata directory: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-3/wal
1 data directories: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261117 14:50:20.707661 9647 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20261117 14:50:20.708801 9647 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261117 14:50:20.709087 9647 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261117 14:50:20.710304 9647 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261117 14:50:20.714669 9668 ts_tablet_manager.cc:594] Loading tablet metadata (0/1 complete)
I20261117 14:50:20.723483 9647 ts_tablet_manager.cc:631] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20261117 14:50:20.723627 9647 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.011s user 0.000s sys 0.002s
I20261117 14:50:20.723759 9647 ts_tablet_manager.cc:646] Registering tablets (0/1 complete)
I20261117 14:50:20.728226 9647 ts_tablet_manager.cc:662] Registered 1 tablets
I20261117 14:50:20.728322 9647 ts_tablet_manager.cc:641] Time spent register tablets: real 0.005s user 0.001s sys 0.000s
I20261117 14:50:20.729002 9668 tablet_bootstrap.cc:492] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b: Bootstrap starting.
I20261117 14:50:20.853067 9638 heartbeater.cc:500] Master 127.6.50.190:39297 was elected leader, sending a full tablet report...
I20261117 14:50:21.316810 9668 log.cc:826] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b: Log is configured to *not* fsync() on all Append() calls
I20261117 14:50:21.462502 9776 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.50.132:33799 every 8 connection(s)
I20261117 14:50:21.462860 9647 rpc_server.cc:307] RPC server started. Bound to: 127.6.50.132:33799
I20261117 14:50:21.465067 9647 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-3/data/info.pb
I20261117 14:50:21.470713 6346 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskUafhB0/build/asan/bin/kudu as pid 9647
I20261117 14:50:21.548166 9777 heartbeater.cc:345] Connected to a master server at 127.6.50.190:39297
I20261117 14:50:21.548655 9777 heartbeater.cc:462] Registering TS with master...
I20261117 14:50:21.549885 9777 heartbeater.cc:508] Master 127.6.50.190:39297 requested a full tablet report, sending...
I20261117 14:50:21.553189 7587 ts_manager.cc:210] Re-registered known tserver with Master: 624366c73dc34561925e1d1b5216cf2b (127.6.50.132:33799)
I20261117 14:50:21.554737 7587 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.6.50.132:56395
I20261117 14:50:22.558518 9777 heartbeater.cc:500] Master 127.6.50.190:39297 was elected leader, sending a full tablet report...
I20261117 14:50:22.575968 9300 tablet_service.cc:1456] Tablet server has 0 leaders and 0 scanners
I20261117 14:50:22.582944 9711 tablet_service.cc:1456] Tablet server has 0 leaders and 0 scanners
I20261117 14:50:22.599401 9573 tablet_service.cc:1456] Tablet server has 0 leaders and 0 scanners
I20261117 14:50:22.624514 9436 tablet_service.cc:1456] Tablet server has 0 leaders and 0 scanners
I20261117 14:50:23.424521 9531 tablet_bootstrap.cc:492] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6: Bootstrap replayed 1/1 log segments. Stats: ops{read=938 overwritten=0 applied=938 ignored=0} inserts{seen=46750 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20261117 14:50:23.425253 9531 tablet_bootstrap.cc:492] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6: Bootstrap complete.
I20261117 14:50:23.426806 9531 ts_tablet_manager.cc:1449] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6: Time spent bootstrapping tablet: real 3.682s user 3.346s sys 0.240s
I20261117 14:50:23.430110 9394 tablet_bootstrap.cc:492] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3: Bootstrap replayed 1/1 log segments. Stats: ops{read=939 overwritten=0 applied=938 ignored=0} inserts{seen=46750 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20261117 14:50:23.430905 9394 tablet_bootstrap.cc:492] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3: Bootstrap complete.
I20261117 14:50:23.432228 9531 raft_consensus.cc:360] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [term 6 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "624366c73dc34561925e1d1b5216cf2b" member_type: VOTER last_known_addr { host: "127.6.50.132" port: 33799 } } peers { permanent_uuid: "6041859320d34e679a287826f4f54fd6" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 36371 } } peers { permanent_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 34551 } }
I20261117 14:50:23.432860 9394 ts_tablet_manager.cc:1449] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3: Time spent bootstrapping tablet: real 4.518s user 3.946s sys 0.248s
I20261117 14:50:23.432997 9531 raft_consensus.cc:748] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [term 6 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6041859320d34e679a287826f4f54fd6, State: Initialized, Role: FOLLOWER
I20261117 14:50:23.433851 9531 consensus_queue.cc:261] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 938, Last appended: 4.938, Last appended by leader: 938, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "624366c73dc34561925e1d1b5216cf2b" member_type: VOTER last_known_addr { host: "127.6.50.132" port: 33799 } } peers { permanent_uuid: "6041859320d34e679a287826f4f54fd6" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 36371 } } peers { permanent_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 34551 } }
I20261117 14:50:23.435628 9531 ts_tablet_manager.cc:1480] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6: Time spent starting tablet: real 0.009s user 0.010s sys 0.000s
I20261117 14:50:23.440229 9394 raft_consensus.cc:360] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 6 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "624366c73dc34561925e1d1b5216cf2b" member_type: VOTER last_known_addr { host: "127.6.50.132" port: 33799 } } peers { permanent_uuid: "6041859320d34e679a287826f4f54fd6" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 36371 } } peers { permanent_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 34551 } }
I20261117 14:50:23.443854 9394 raft_consensus.cc:748] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 6 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa94e5d3d33a4f70b3e2c9c5f62cc9f3, State: Initialized, Role: FOLLOWER
I20261117 14:50:23.444801 9394 consensus_queue.cc:261] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 938, Last appended: 4.939, Last appended by leader: 939, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "624366c73dc34561925e1d1b5216cf2b" member_type: VOTER last_known_addr { host: "127.6.50.132" port: 33799 } } peers { permanent_uuid: "6041859320d34e679a287826f4f54fd6" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 36371 } } peers { permanent_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 34551 } }
I20261117 14:50:23.446638 9394 ts_tablet_manager.cc:1480] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3: Time spent starting tablet: real 0.014s user 0.013s sys 0.000s
W20261117 14:50:23.496030 9416 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:46290: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:23.502429 9553 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:23.608733 9553 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:23.615840 9553 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
I20261117 14:50:23.714568 9817 raft_consensus.cc:499] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261117 14:50:23.714757 9819 raft_consensus.cc:499] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261117 14:50:23.714979 9817 raft_consensus.cc:521] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "624366c73dc34561925e1d1b5216cf2b" member_type: VOTER last_known_addr { host: "127.6.50.132" port: 33799 } } peers { permanent_uuid: "6041859320d34e679a287826f4f54fd6" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 36371 } } peers { permanent_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 34551 } }
I20261117 14:50:23.715078 9819 raft_consensus.cc:521] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "624366c73dc34561925e1d1b5216cf2b" member_type: VOTER last_known_addr { host: "127.6.50.132" port: 33799 } } peers { permanent_uuid: "6041859320d34e679a287826f4f54fd6" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 36371 } } peers { permanent_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 34551 } }
I20261117 14:50:23.717365 9817 leader_election.cc:290] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 624366c73dc34561925e1d1b5216cf2b (127.6.50.132:33799), fa94e5d3d33a4f70b3e2c9c5f62cc9f3 (127.6.50.131:34551)
W20261117 14:50:23.731400 9416 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:46290: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
I20261117 14:50:23.736099 9819 leader_election.cc:290] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 624366c73dc34561925e1d1b5216cf2b (127.6.50.132:33799), 6041859320d34e679a287826f4f54fd6 (127.6.50.129:36371)
I20261117 14:50:23.743309 9731 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "a1fc825ee85f40d1aee4695db8235828" candidate_uuid: "6041859320d34e679a287826f4f54fd6" candidate_term: 7 candidate_status { last_received { term: 4 index: 938 } } ignore_live_leader: false dest_uuid: "624366c73dc34561925e1d1b5216cf2b" is_pre_election: true
W20261117 14:50:23.747730 9526 leader_election.cc:343] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [CANDIDATE]: Term 7 pre-election: Tablet error from VoteRequest() call to peer 624366c73dc34561925e1d1b5216cf2b (127.6.50.132:33799): Illegal state: must be running to vote when last-logged opid is not known
I20261117 14:50:23.750445 9731 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "a1fc825ee85f40d1aee4695db8235828" candidate_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" candidate_term: 7 candidate_status { last_received { term: 4 index: 939 } } ignore_live_leader: false dest_uuid: "624366c73dc34561925e1d1b5216cf2b" is_pre_election: true
W20261117 14:50:23.751297 9389 leader_election.cc:343] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [CANDIDATE]: Term 7 pre-election: Tablet error from VoteRequest() call to peer 624366c73dc34561925e1d1b5216cf2b (127.6.50.132:33799): Illegal state: must be running to vote when last-logged opid is not known
I20261117 14:50:23.751354 9593 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "a1fc825ee85f40d1aee4695db8235828" candidate_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" candidate_term: 7 candidate_status { last_received { term: 4 index: 939 } } ignore_live_leader: false dest_uuid: "6041859320d34e679a287826f4f54fd6" is_pre_election: true
I20261117 14:50:23.751748 9593 raft_consensus.cc:2490] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa94e5d3d33a4f70b3e2c9c5f62cc9f3 in term 6.
I20261117 14:50:23.752290 9388 leader_election.cc:304] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6041859320d34e679a287826f4f54fd6, fa94e5d3d33a4f70b3e2c9c5f62cc9f3; no voters: 624366c73dc34561925e1d1b5216cf2b
I20261117 14:50:23.752796 9819 raft_consensus.cc:2826] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20261117 14:50:23.752995 9819 raft_consensus.cc:499] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20261117 14:50:23.753095 9819 raft_consensus.cc:3096] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 6 FOLLOWER]: Advancing to term 7
I20261117 14:50:23.756855 9456 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "a1fc825ee85f40d1aee4695db8235828" candidate_uuid: "6041859320d34e679a287826f4f54fd6" candidate_term: 7 candidate_status { last_received { term: 4 index: 938 } } ignore_live_leader: false dest_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" is_pre_election: true
I20261117 14:50:23.758049 9819 raft_consensus.cc:521] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "624366c73dc34561925e1d1b5216cf2b" member_type: VOTER last_known_addr { host: "127.6.50.132" port: 33799 } } peers { permanent_uuid: "6041859320d34e679a287826f4f54fd6" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 36371 } } peers { permanent_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 34551 } }
I20261117 14:50:23.758534 9456 raft_consensus.cc:2415] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6041859320d34e679a287826f4f54fd6 in current term 7: Already voted for candidate fa94e5d3d33a4f70b3e2c9c5f62cc9f3 in this term.
I20261117 14:50:23.758901 9819 leader_election.cc:290] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [CANDIDATE]: Term 7 election: Requested vote from peers 624366c73dc34561925e1d1b5216cf2b (127.6.50.132:33799), 6041859320d34e679a287826f4f54fd6 (127.6.50.129:36371)
I20261117 14:50:23.759362 9731 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "a1fc825ee85f40d1aee4695db8235828" candidate_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" candidate_term: 7 candidate_status { last_received { term: 4 index: 939 } } ignore_live_leader: false dest_uuid: "624366c73dc34561925e1d1b5216cf2b"
I20261117 14:50:23.759481 9593 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "a1fc825ee85f40d1aee4695db8235828" candidate_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" candidate_term: 7 candidate_status { last_received { term: 4 index: 939 } } ignore_live_leader: false dest_uuid: "6041859320d34e679a287826f4f54fd6"
I20261117 14:50:23.759680 9593 raft_consensus.cc:3096] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [term 6 FOLLOWER]: Advancing to term 7
W20261117 14:50:23.760236 9389 leader_election.cc:343] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [CANDIDATE]: Term 7 election: Tablet error from VoteRequest() call to peer 624366c73dc34561925e1d1b5216cf2b (127.6.50.132:33799): Illegal state: must be running to vote when last-logged opid is not known
I20261117 14:50:23.760425 9525 leader_election.cc:304] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6041859320d34e679a287826f4f54fd6; no voters: 624366c73dc34561925e1d1b5216cf2b, fa94e5d3d33a4f70b3e2c9c5f62cc9f3
I20261117 14:50:23.764067 9593 raft_consensus.cc:2490] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa94e5d3d33a4f70b3e2c9c5f62cc9f3 in term 7.
I20261117 14:50:23.764294 9817 raft_consensus.cc:2771] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20261117 14:50:23.764635 9388 leader_election.cc:304] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6041859320d34e679a287826f4f54fd6, fa94e5d3d33a4f70b3e2c9c5f62cc9f3; no voters: 624366c73dc34561925e1d1b5216cf2b
I20261117 14:50:23.765038 9819 raft_consensus.cc:2826] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 7 FOLLOWER]: Leader election won for term 7
I20261117 14:50:23.765550 9819 raft_consensus.cc:705] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 7 LEADER]: Becoming Leader. State: Replica: fa94e5d3d33a4f70b3e2c9c5f62cc9f3, State: Running, Role: LEADER
I20261117 14:50:23.766274 9819 consensus_queue.cc:238] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 938, Committed index: 938, Last appended: 4.939, Last appended by leader: 939, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "624366c73dc34561925e1d1b5216cf2b" member_type: VOTER last_known_addr { host: "127.6.50.132" port: 33799 } } peers { permanent_uuid: "6041859320d34e679a287826f4f54fd6" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 36371 } } peers { permanent_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 34551 } }
I20261117 14:50:23.770323 9593 raft_consensus.cc:1285] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [term 7 FOLLOWER]: Refusing update from remote peer fa94e5d3d33a4f70b3e2c9c5f62cc9f3: Log matching property violated. Preceding OpId in replica: term: 4 index: 938. Preceding OpId from leader: term: 7 index: 940. (index mismatch)
I20261117 14:50:23.770715 7587 catalog_manager.cc:5840] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "624366c73dc34561925e1d1b5216cf2b" member_type: VOTER last_known_addr { host: "127.6.50.132" port: 33799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6041859320d34e679a287826f4f54fd6" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 36371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 34551 } health_report { overall_health: HEALTHY } } }
I20261117 14:50:23.772223 9830 consensus_queue.cc:1049] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6041859320d34e679a287826f4f54fd6" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 36371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 940, Last known committed idx: 938, Time since last communication: 0.000s
W20261117 14:50:23.773430 9389 consensus_peers.cc:597] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 -> Peer 624366c73dc34561925e1d1b5216cf2b (127.6.50.132:33799): Couldn't send request to peer 624366c73dc34561925e1d1b5216cf2b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20261117 14:50:23.801234 9553 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:23.978802 9553 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:23.987771 9553 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:23.990945 9553 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:24.265740 9389 consensus_peers.cc:597] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 -> Peer 624366c73dc34561925e1d1b5216cf2b (127.6.50.132:33799): Couldn't send request to peer 624366c73dc34561925e1d1b5216cf2b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
W20261117 14:50:24.393347 8223 scanner-internal.cc:464] Time spent opening tablet: real 8.161s user 0.010s sys 0.000s
W20261117 14:50:24.580338 8224 scanner-internal.cc:464] Time spent opening tablet: real 8.139s user 0.002s sys 0.008s
W20261117 14:50:24.769037 8225 scanner-internal.cc:464] Time spent opening tablet: real 8.263s user 0.008s sys 0.002s
W20261117 14:50:24.779352 9389 consensus_peers.cc:597] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 -> Peer 624366c73dc34561925e1d1b5216cf2b (127.6.50.132:33799): Couldn't send request to peer 624366c73dc34561925e1d1b5216cf2b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
I20261117 14:50:25.297873 9668 tablet_bootstrap.cc:492] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b: Bootstrap replayed 1/1 log segments. Stats: ops{read=939 overwritten=0 applied=938 ignored=0} inserts{seen=46750 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20261117 14:50:25.298980 9668 tablet_bootstrap.cc:492] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b: Bootstrap complete.
I20261117 14:50:25.300993 9668 ts_tablet_manager.cc:1449] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b: Time spent bootstrapping tablet: real 4.572s user 4.069s sys 0.314s
I20261117 14:50:25.304783 9668 raft_consensus.cc:360] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b [term 6 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "624366c73dc34561925e1d1b5216cf2b" member_type: VOTER last_known_addr { host: "127.6.50.132" port: 33799 } } peers { permanent_uuid: "6041859320d34e679a287826f4f54fd6" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 36371 } } peers { permanent_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 34551 } }
W20261117 14:50:25.318781 9389 consensus_peers.cc:597] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 -> Peer 624366c73dc34561925e1d1b5216cf2b (127.6.50.132:33799): Couldn't send request to peer 624366c73dc34561925e1d1b5216cf2b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 16: this message will repeat every 5th retry.
I20261117 14:50:25.321759 9668 raft_consensus.cc:748] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b [term 6 FOLLOWER]: Becoming Follower/Learner. State: Replica: 624366c73dc34561925e1d1b5216cf2b, State: Initialized, Role: FOLLOWER
I20261117 14:50:25.322849 9668 consensus_queue.cc:261] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 938, Last appended: 4.939, Last appended by leader: 939, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "624366c73dc34561925e1d1b5216cf2b" member_type: VOTER last_known_addr { host: "127.6.50.132" port: 33799 } } peers { permanent_uuid: "6041859320d34e679a287826f4f54fd6" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 36371 } } peers { permanent_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 34551 } }
I20261117 14:50:25.331425 9668 ts_tablet_manager.cc:1480] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b: Time spent starting tablet: real 0.030s user 0.012s sys 0.016s
I20261117 14:50:25.452118 9731 raft_consensus.cc:3096] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b [term 6 FOLLOWER]: Advancing to term 7
I20261117 14:50:25.893738 9846 mvcc.cc:204] Tried to move back new op lower bound from 7352021096129753088 to 7352021089350828032. Current Snapshot: MvccSnapshot[applied={T|T < 7352021095163686912 or (T in {7352021095250423808,7352021095383932928,7352021095308869632,7352021095413530624,7352021095531601920,7352021095427661824,7352021095551713280,7352021095717478400})}]
I20261117 14:50:29.285440 9300 tablet_service.cc:1456] Tablet server has 0 leaders and 0 scanners
I20261117 14:50:29.307276 9711 tablet_service.cc:1456] Tablet server has 0 leaders and 0 scanners
I20261117 14:50:29.313727 9573 tablet_service.cc:1456] Tablet server has 0 leaders and 0 scanners
I20261117 14:50:29.358745 9436 tablet_service.cc:1456] Tablet server has 1 leaders and 3 scanners
I20261117 14:50:31.504791 7586 ts_manager.cc:300] Unset tserver state for fa94e5d3d33a4f70b3e2c9c5f62cc9f3 from MAINTENANCE_MODE
I20261117 14:50:31.508888 7594 ts_manager.cc:300] Unset tserver state for 624366c73dc34561925e1d1b5216cf2b from MAINTENANCE_MODE
I20261117 14:50:31.552068 7594 ts_manager.cc:300] Unset tserver state for 39c0d031db104a9d83a434fb89d0a277 from MAINTENANCE_MODE
I20261117 14:50:31.716511 9777 heartbeater.cc:508] Master 127.6.50.190:39297 requested a full tablet report, sending...
I20261117 14:50:31.726869 9501 heartbeater.cc:508] Master 127.6.50.190:39297 requested a full tablet report, sending...
I20261117 14:50:31.809360 9638 heartbeater.cc:508] Master 127.6.50.190:39297 requested a full tablet report, sending...
I20261117 14:50:32.273382 7594 ts_manager.cc:300] Unset tserver state for 6041859320d34e679a287826f4f54fd6 from MAINTENANCE_MODE
I20261117 14:50:32.274631 9365 heartbeater.cc:508] Master 127.6.50.190:39297 requested a full tablet report, sending...
I20261117 14:50:32.720993 9777 heartbeater.cc:508] Master 127.6.50.190:39297 requested a full tablet report, sending...
I20261117 14:50:32.731886 9501 heartbeater.cc:508] Master 127.6.50.190:39297 requested a full tablet report, sending...
I20261117 14:50:32.816308 9638 heartbeater.cc:508] Master 127.6.50.190:39297 requested a full tablet report, sending...
I20261117 14:50:34.673708 7586 ts_manager.cc:311] Set tserver state for 6041859320d34e679a287826f4f54fd6 to MAINTENANCE_MODE
I20261117 14:50:35.376579 7594 ts_manager.cc:311] Set tserver state for 39c0d031db104a9d83a434fb89d0a277 to MAINTENANCE_MODE
I20261117 14:50:35.394214 7586 ts_manager.cc:311] Set tserver state for 624366c73dc34561925e1d1b5216cf2b to MAINTENANCE_MODE
I20261117 14:50:36.074996 7586 ts_manager.cc:311] Set tserver state for fa94e5d3d33a4f70b3e2c9c5f62cc9f3 to MAINTENANCE_MODE
I20261117 14:50:37.026002 9300 tablet_service.cc:1449] Tablet server 39c0d031db104a9d83a434fb89d0a277 set to quiescing
I20261117 14:50:37.026297 9300 tablet_service.cc:1456] Tablet server has 0 leaders and 0 scanners
I20261117 14:50:37.100839 9573 tablet_service.cc:1449] Tablet server 6041859320d34e679a287826f4f54fd6 set to quiescing
I20261117 14:50:37.101106 9573 tablet_service.cc:1456] Tablet server has 0 leaders and 0 scanners
W20261117 14:50:37.848150 8183 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.6.50.131:34551, user_credentials={real_user=slave}} blocked reactor thread for 64691.5us
I20261117 14:50:37.892606 9436 tablet_service.cc:1449] Tablet server fa94e5d3d33a4f70b3e2c9c5f62cc9f3 set to quiescing
I20261117 14:50:37.892849 9436 tablet_service.cc:1456] Tablet server has 1 leaders and 3 scanners
I20261117 14:50:37.896916 10015 raft_consensus.cc:1003] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3: : Instructing follower 624366c73dc34561925e1d1b5216cf2b to start an election
I20261117 14:50:37.897075 10015 raft_consensus.cc:1091] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 7 LEADER]: Signalling peer 624366c73dc34561925e1d1b5216cf2b to start an election
I20261117 14:50:37.899325 9731 tablet_service.cc:2033] Received Run Leader Election RPC: tablet_id: "a1fc825ee85f40d1aee4695db8235828"
dest_uuid: "624366c73dc34561925e1d1b5216cf2b"
from {username='slave'} at 127.6.50.131:41459
I20261117 14:50:37.899613 9731 raft_consensus.cc:499] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20261117 14:50:37.899812 9731 raft_consensus.cc:3096] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b [term 7 FOLLOWER]: Advancing to term 8
I20261117 14:50:37.902931 9731 raft_consensus.cc:521] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "624366c73dc34561925e1d1b5216cf2b" member_type: VOTER last_known_addr { host: "127.6.50.132" port: 33799 } } peers { permanent_uuid: "6041859320d34e679a287826f4f54fd6" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 36371 } } peers { permanent_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 34551 } }
I20261117 14:50:37.904774 9731 leader_election.cc:290] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b [CANDIDATE]: Term 8 election: Requested vote from peers 6041859320d34e679a287826f4f54fd6 (127.6.50.129:36371), fa94e5d3d33a4f70b3e2c9c5f62cc9f3 (127.6.50.131:34551)
I20261117 14:50:37.909356 9731 raft_consensus.cc:1250] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b [term 8 FOLLOWER]: Rejecting Update request from peer fa94e5d3d33a4f70b3e2c9c5f62cc9f3 for earlier term 7. Current term is 8. Ops: [7.2032-7.2032]
I20261117 14:50:37.910246 10015 consensus_queue.cc:1060] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "624366c73dc34561925e1d1b5216cf2b" member_type: VOTER last_known_addr { host: "127.6.50.132" port: 33799 }, Status: INVALID_TERM, Last received: 7.2031, Next index: 2032, Last known committed idx: 2031, Time since last communication: 0.000s
I20261117 14:50:37.910604 10015 raft_consensus.cc:3091] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 7 LEADER]: Stepping down as leader of term 7
I20261117 14:50:37.910706 10015 raft_consensus.cc:748] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fa94e5d3d33a4f70b3e2c9c5f62cc9f3, State: Running, Role: LEADER
I20261117 14:50:37.911039 10015 consensus_queue.cc:261] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2032, Committed index: 2032, Last appended: 7.2032, Last appended by leader: 2032, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "624366c73dc34561925e1d1b5216cf2b" member_type: VOTER last_known_addr { host: "127.6.50.132" port: 33799 } } peers { permanent_uuid: "6041859320d34e679a287826f4f54fd6" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 36371 } } peers { permanent_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 34551 } }
I20261117 14:50:37.911619 10015 raft_consensus.cc:3096] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 7 FOLLOWER]: Advancing to term 8
W20261117 14:50:37.912161 9414 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:46290: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:37.913172 9412 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:46290: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:37.918571 9413 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:46290: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:37.926524 9690 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:37.926716 9691 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:37.928781 9688 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:37.934327 9553 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:37.934902 9552 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:37.937414 9552 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
I20261117 14:50:37.942215 9592 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "a1fc825ee85f40d1aee4695db8235828" candidate_uuid: "624366c73dc34561925e1d1b5216cf2b" candidate_term: 8 candidate_status { last_received { term: 7 index: 2031 } } ignore_live_leader: true dest_uuid: "6041859320d34e679a287826f4f54fd6"
I20261117 14:50:37.942203 9456 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "a1fc825ee85f40d1aee4695db8235828" candidate_uuid: "624366c73dc34561925e1d1b5216cf2b" candidate_term: 8 candidate_status { last_received { term: 7 index: 2031 } } ignore_live_leader: true dest_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3"
I20261117 14:50:37.942431 9592 raft_consensus.cc:3096] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [term 7 FOLLOWER]: Advancing to term 8
I20261117 14:50:37.942531 9456 raft_consensus.cc:2432] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 624366c73dc34561925e1d1b5216cf2b for term 8 because replica has last-logged OpId of term: 7 index: 2032, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 2031.
I20261117 14:50:37.945986 9592 raft_consensus.cc:2432] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 624366c73dc34561925e1d1b5216cf2b for term 8 because replica has last-logged OpId of term: 7 index: 2032, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 2031.
I20261117 14:50:37.947142 9662 leader_election.cc:304] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 624366c73dc34561925e1d1b5216cf2b; no voters: 6041859320d34e679a287826f4f54fd6, fa94e5d3d33a4f70b3e2c9c5f62cc9f3
W20261117 14:50:37.947342 9416 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:46290: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:37.948252 9414 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:46290: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:37.948397 9413 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:46290: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
I20261117 14:50:37.959057 10098 raft_consensus.cc:2771] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20261117 14:50:37.959079 9711 tablet_service.cc:1449] Tablet server 624366c73dc34561925e1d1b5216cf2b set to quiescing
I20261117 14:50:37.959523 9711 tablet_service.cc:1456] Tablet server has 0 leaders and 0 scanners
W20261117 14:50:37.962586 9688 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:37.965893 9690 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:37.967075 9690 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:37.974701 9552 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:37.976097 9553 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:37.977177 9553 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:37.989006 9414 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:46290: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:37.991613 9416 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:46290: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:37.997033 9414 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:46290: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:38.005224 9690 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:38.006826 9690 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:38.009003 9690 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:38.017690 9553 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:38.019977 9553 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:38.023605 9553 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:38.033759 9412 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:46290: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:38.036742 9414 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:46290: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:38.039512 9416 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:46290: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:38.048395 9690 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:38.049027 9688 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:38.052800 9688 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:38.063675 9553 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:38.066887 9553 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:38.069164 9553 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:38.086483 9413 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:46290: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:38.089720 9414 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:46290: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:38.089720 9416 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:46290: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:38.108311 9688 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:38.108840 9690 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:38.109265 9691 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:38.126413 9553 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:38.128705 9553 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:38.128705 9552 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:38.148839 9412 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:46290: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:38.149230 9415 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:46290: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:38.152287 9413 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:46290: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:38.172744 9691 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:38.174901 9691 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:38.175158 9690 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:38.194365 9553 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:38.196125 9553 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:38.197582 9553 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:38.202167 10015 raft_consensus.cc:678] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3: failed to trigger leader election: Illegal state: leader elections are disabled
W20261117 14:50:38.208473 10101 raft_consensus.cc:678] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6: failed to trigger leader election: Illegal state: leader elections are disabled
W20261117 14:50:38.218606 9414 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:46290: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:38.218608 9416 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:46290: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:38.220134 9412 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:46290: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:38.244424 9690 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:38.244488 9691 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:38.245388 9688 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:38.268384 9553 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:38.270689 9553 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:38.270917 9552 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:38.284698 10098 raft_consensus.cc:678] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b: failed to trigger leader election: Illegal state: leader elections are disabled
W20261117 14:50:38.298185 9415 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:46290: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:38.298593 9416 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:46290: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:38.300073 9412 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:46290: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:38.325359 9688 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:38.325363 9690 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:38.327790 9690 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:38.351154 9552 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:38.352952 9552 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:38.356182 9552 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:38.381194 9416 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:46290: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:38.381419 9413 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:46290: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:38.387908 9412 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:46290: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:38.410086 9690 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:38.413098 9690 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:38.417030 9690 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:38.440130 9552 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:38.445317 9552 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:38.445317 9553 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:38.473799 9413 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:46290: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:38.477144 9412 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:46290: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:38.479657 9413 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:46290: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:38.504343 9690 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:38.509356 9690 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:38.513202 9690 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:38.536180 9553 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:38.544214 9553 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:38.547577 9553 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:38.572962 9413 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:46290: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:38.582047 9412 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:46290: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:38.585254 9413 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:46290: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:38.609277 9688 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:38.618244 9688 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:38.621064 9688 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:38.646109 9553 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:38.655328 9553 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:38.656808 9553 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:38.685883 9416 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:46290: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:38.692267 9416 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:46290: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:38.696950 9416 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:46290: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:38.725176 9688 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:38.727949 9688 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:38.735296 9688 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:38.764235 9553 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:38.769253 9553 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:38.772570 9553 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:38.808879 9416 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:46290: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:38.809557 9413 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:46290: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:38.814891 9413 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:46290: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:38.850574 9688 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:38.852773 9688 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:38.854823 9688 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:38.890715 9553 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:38.893842 9553 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:38.898967 9553 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:38.937633 9413 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:46290: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:38.940543 9413 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:46290: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:38.941628 9413 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:46290: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:38.982703 9688 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:38.984752 9688 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:38.987861 9688 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:39.029017 9553 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:39.030874 9553 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:39.035151 9553 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:39.077379 9413 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:46290: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:39.077536 9416 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:46290: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:39.082371 9416 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:46290: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:39.125063 9688 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:39.126151 9690 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:39.127128 9690 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:39.173514 9553 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:39.175339 9553 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:39.176595 9553 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:39.227843 9413 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:46290: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:39.227846 9416 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:46290: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:39.228220 9412 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:46290: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:39.279107 9690 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:39.281128 9690 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:39.281186 9688 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:39.329787 9553 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:39.330901 9552 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:39.333948 9552 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:39.383220 9412 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:46290: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:39.386565 9412 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:46290: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:39.387763 9412 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:46290: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:39.438062 9688 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:39.439150 9690 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:39.441069 9690 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:39.493647 9553 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:39.493712 9552 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:39.495496 9552 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
I20261117 14:50:39.516508 9436 tablet_service.cc:1449] Tablet server fa94e5d3d33a4f70b3e2c9c5f62cc9f3 set to quiescing
I20261117 14:50:39.516759 9436 tablet_service.cc:1456] Tablet server has 0 leaders and 0 scanners
W20261117 14:50:39.554711 9416 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:46290: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:39.554764 9412 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:46290: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:39.554733 9413 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:46290: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
I20261117 14:50:39.604087 6346 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskUafhB0/build/asan/bin/kudu pid 9238
W20261117 14:50:39.610325 9690 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:39.610550 9688 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
I20261117 14:50:39.611692 9359 generic_service.cc:196] Checking for leaks (request via RPC)
W20261117 14:50:39.612154 9688 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:39.668421 9552 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:39.669430 9553 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:39.669615 9552 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
I20261117 14:50:39.704522 6346 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskUafhB0/build/asan/bin/kudu with pid 9238
I20261117 14:50:39.724866 6346 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskUafhB0/build/asan/bin/kudu
/tmp/dist-test-taskUafhB0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.50.130:38123
--local_ip_for_outbound_sockets=127.6.50.130
--tserver_master_addrs=127.6.50.190:39297
--webserver_port=45239
--webserver_interface=127.6.50.130
--builtin_ntp_servers=127.6.50.148:44279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
W20261117 14:50:39.738114 9412 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:46290: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:39.739151 9412 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:46290: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:39.739441 9416 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:46290: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:39.795948 9688 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:39.801266 9690 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:39.801266 9688 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:39.856065 9552 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:39.860033 9552 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:39.863420 9552 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:39.919325 9416 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:46290: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:39.924099 9416 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:46290: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:39.924487 9412 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:46290: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:39.982617 9690 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:39.984750 9690 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:39.985865 9690 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:40.046444 9552 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:40.047725 9552 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:40.048848 9552 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:40.103809 10117 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261117 14:50:40.104118 10117 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261117 14:50:40.104295 10117 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261117 14:50:40.111495 9412 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:46290: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:40.113142 9412 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:46290: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:40.114334 10117 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261117 14:50:40.114611 10117 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.50.130
W20261117 14:50:40.114984 9412 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:46290: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
I20261117 14:50:40.125545 10117 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.50.148:44279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.50.130:38123
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.6.50.130
--webserver_port=45239
--tserver_master_addrs=127.6.50.190:39297
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.50.130
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type FASTDEBUG
built by None at 17 Nov 2026 14:43:24 UTC on bdcb31816ec0
build id 14829
ASAN enabled
I20261117 14:50:40.127226 10117 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261117 14:50:40.129213 10117 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20261117 14:50:40.133098 10117 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20261117 14:50:40.139483 10123 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261117 14:50:40.139513 10122 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261117 14:50:40.140069 10125 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261117 14:50:40.140419 10117 server_base.cc:1061] running on GCE node
I20261117 14:50:40.141026 10117 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261117 14:50:40.141995 10117 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261117 14:50:40.143231 10117 hybrid_clock.cc:648] HybridClock initialized: now 1794927040143173 us; error 39 us; skew 500 ppm
I20261117 14:50:40.143545 10117 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261117 14:50:40.145833 10117 webserver.cc:577] Webserver started at http://127.6.50.130:45239/ using document root <none> and password file <none>
I20261117 14:50:40.146589 10117 fs_manager.cc:362] Metadata directory not provided
I20261117 14:50:40.146749 10117 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261117 14:50:40.152215 10117 fs_manager.cc:714] Time spent opening directory manager: real 0.003s user 0.002s sys 0.001s
I20261117 14:50:40.155033 10131 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20261117 14:50:40.156541 10117 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20261117 14:50:40.156729 10117 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-1/data,/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-1/wal
uuid: "39c0d031db104a9d83a434fb89d0a277"
format_stamp: "Formatted at 2026-11-17 14:49:55 on dist-test-slave-jwg6"
I20261117 14:50:40.157459 10117 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20261117 14:50:40.181036 9690 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:40.181752 9691 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:40.182698 9688 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
I20261117 14:50:40.185593 10117 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20261117 14:50:40.186493 10117 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261117 14:50:40.186757 10117 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261117 14:50:40.187932 10117 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261117 14:50:40.189764 10117 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261117 14:50:40.189875 10117 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20261117 14:50:40.190006 10117 ts_tablet_manager.cc:662] Registered 0 tablets
I20261117 14:50:40.190109 10117 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20261117 14:50:40.225926 10117 rpc_server.cc:307] RPC server started. Bound to: 127.6.50.130:38123
I20261117 14:50:40.226032 10243 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.50.130:38123 every 8 connection(s)
I20261117 14:50:40.227557 10117 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-1/data/info.pb
I20261117 14:50:40.231393 6346 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskUafhB0/build/asan/bin/kudu as pid 10117
I20261117 14:50:40.231652 6346 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskUafhB0/build/asan/bin/kudu pid 9372
I20261117 14:50:40.239109 9496 generic_service.cc:196] Checking for leaks (request via RPC)
I20261117 14:50:40.243541 10244 heartbeater.cc:345] Connected to a master server at 127.6.50.190:39297
I20261117 14:50:40.243892 10244 heartbeater.cc:462] Registering TS with master...
I20261117 14:50:40.244831 10244 heartbeater.cc:508] Master 127.6.50.190:39297 requested a full tablet report, sending...
I20261117 14:50:40.246770 7586 ts_manager.cc:210] Re-registered known tserver with Master: 39c0d031db104a9d83a434fb89d0a277 (127.6.50.130:38123)
W20261117 14:50:40.247049 9552 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
I20261117 14:50:40.247759 7586 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.6.50.130:58173
W20261117 14:50:40.248906 9552 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:40.251828 9552 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:40.478206 9412 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:46290: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:40.478601 9413 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:46290: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
I20261117 14:50:40.478909 6346 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskUafhB0/build/asan/bin/kudu with pid 9372
W20261117 14:50:40.478607 9416 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:46290: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:40.524797 8183 meta_cache.cc:302] tablet a1fc825ee85f40d1aee4695db8235828: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 (127.6.50.131:34551) has failed: Network error: recv got EOF from 127.6.50.131:34551 (error 108)
I20261117 14:50:40.525420 6346 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskUafhB0/build/asan/bin/kudu
/tmp/dist-test-taskUafhB0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.50.131:34551
--local_ip_for_outbound_sockets=127.6.50.131
--tserver_master_addrs=127.6.50.190:39297
--webserver_port=39699
--webserver_interface=127.6.50.131
--builtin_ntp_servers=127.6.50.148:44279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
W20261117 14:50:40.546325 9688 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:40.547360 9688 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:40.594056 9688 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:40.617672 9553 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:40.617690 9552 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:40.666244 9552 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:40.757861 9688 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:40.764138 9688 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:40.812891 9688 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:40.828792 9552 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:40.837962 9552 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:40.887880 9552 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:40.895924 10251 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261117 14:50:40.896234 10251 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261117 14:50:40.896327 10251 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261117 14:50:40.905213 10251 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261117 14:50:40.905400 10251 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.50.131
I20261117 14:50:40.916199 10251 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.50.148:44279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.50.131:34551
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.6.50.131
--webserver_port=39699
--tserver_master_addrs=127.6.50.190:39297
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.50.131
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type FASTDEBUG
built by None at 17 Nov 2026 14:43:24 UTC on bdcb31816ec0
build id 14829
ASAN enabled
I20261117 14:50:40.918107 10251 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261117 14:50:40.919955 10251 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20261117 14:50:40.924115 10251 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20261117 14:50:40.930823 10258 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261117 14:50:40.930763 10257 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261117 14:50:40.930873 10260 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261117 14:50:40.931221 10251 server_base.cc:1061] running on GCE node
I20261117 14:50:40.932175 10251 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261117 14:50:40.933244 10251 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261117 14:50:40.934507 10251 hybrid_clock.cc:648] HybridClock initialized: now 1794927040934435 us; error 47 us; skew 500 ppm
I20261117 14:50:40.934841 10251 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261117 14:50:40.937253 10251 webserver.cc:577] Webserver started at http://127.6.50.131:39699/ using document root <none> and password file <none>
I20261117 14:50:40.938021 10251 fs_manager.cc:362] Metadata directory not provided
I20261117 14:50:40.938179 10251 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261117 14:50:40.943987 10251 fs_manager.cc:714] Time spent opening directory manager: real 0.004s user 0.006s sys 0.000s
I20261117 14:50:40.947156 10266 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20261117 14:50:40.948879 10251 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20261117 14:50:40.949066 10251 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-2/data,/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-2/wal
uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3"
format_stamp: "Formatted at 2026-11-17 14:49:56 on dist-test-slave-jwg6"
I20261117 14:50:40.950271 10251 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261117 14:50:40.968914 10251 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20261117 14:50:40.969779 10251 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261117 14:50:40.970060 10251 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261117 14:50:40.971014 10251 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261117 14:50:40.973214 10273 ts_tablet_manager.cc:594] Loading tablet metadata (0/1 complete)
W20261117 14:50:40.974474 9688 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
I20261117 14:50:40.979789 10251 ts_tablet_manager.cc:631] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20261117 14:50:40.979914 10251 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.007s user 0.001s sys 0.000s
I20261117 14:50:40.980064 10251 ts_tablet_manager.cc:646] Registering tablets (0/1 complete)
W20261117 14:50:40.982517 9688 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
I20261117 14:50:40.983727 10251 ts_tablet_manager.cc:662] Registered 1 tablets
I20261117 14:50:40.983830 10251 ts_tablet_manager.cc:641] Time spent register tablets: real 0.004s user 0.001s sys 0.000s
I20261117 14:50:40.984376 10273 tablet_bootstrap.cc:492] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3: Bootstrap starting.
I20261117 14:50:41.032366 10251 rpc_server.cc:307] RPC server started. Bound to: 127.6.50.131:34551
I20261117 14:50:41.032407 10379 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.50.131:34551 every 8 connection(s)
I20261117 14:50:41.034138 10251 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-2/data/info.pb
W20261117 14:50:41.037343 9688 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
I20261117 14:50:41.039903 6346 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskUafhB0/build/asan/bin/kudu as pid 10251
I20261117 14:50:41.040118 6346 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskUafhB0/build/asan/bin/kudu pid 9509
W20261117 14:50:41.047796 9552 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
I20261117 14:50:41.052060 9633 generic_service.cc:196] Checking for leaks (request via RPC)
I20261117 14:50:41.053146 10380 heartbeater.cc:345] Connected to a master server at 127.6.50.190:39297
I20261117 14:50:41.053692 10380 heartbeater.cc:462] Registering TS with master...
I20261117 14:50:41.055691 10380 heartbeater.cc:508] Master 127.6.50.190:39297 requested a full tablet report, sending...
I20261117 14:50:41.059108 7586 ts_manager.cc:210] Re-registered known tserver with Master: fa94e5d3d33a4f70b3e2c9c5f62cc9f3 (127.6.50.131:34551)
I20261117 14:50:41.060767 7586 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.6.50.131:43179
W20261117 14:50:41.218092 9688 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
I20261117 14:50:41.251273 10244 heartbeater.cc:500] Master 127.6.50.190:39297 was elected leader, sending a full tablet report...
W20261117 14:50:41.288102 9552 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:41.288794 9553 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:40070: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
I20261117 14:50:41.289706 6346 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskUafhB0/build/asan/bin/kudu with pid 9509
W20261117 14:50:41.347055 8183 connection.cc:573] client connection to 127.6.50.129:36371 recv error: Network error: recv error from unknown peer: Connection reset by peer (error 104)
I20261117 14:50:41.347682 6346 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskUafhB0/build/asan/bin/kudu
/tmp/dist-test-taskUafhB0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.50.129:36371
--local_ip_for_outbound_sockets=127.6.50.129
--tserver_master_addrs=127.6.50.190:39297
--webserver_port=39191
--webserver_interface=127.6.50.129
--builtin_ntp_servers=127.6.50.148:44279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
W20261117 14:50:41.510136 9691 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:41.522624 9691 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:41.522876 9688 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:41.590207 8183 meta_cache.cc:302] tablet a1fc825ee85f40d1aee4695db8235828: replica 6041859320d34e679a287826f4f54fd6 (127.6.50.129:36371) has failed: Network error: Client connection negotiation failed: client connection to 127.6.50.129:36371: connect: Connection refused (error 111)
I20261117 14:50:41.611004 10273 log.cc:826] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3: Log is configured to *not* fsync() on all Append() calls
W20261117 14:50:41.684365 9691 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:41.684396 9688 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:41.746142 10388 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261117 14:50:41.746534 10388 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261117 14:50:41.746703 10388 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261117 14:50:41.756343 10388 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261117 14:50:41.756630 10388 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.50.129
I20261117 14:50:41.768594 10388 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.50.148:44279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.50.129:36371
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.6.50.129
--webserver_port=39191
--tserver_master_addrs=127.6.50.190:39297
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.50.129
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type FASTDEBUG
built by None at 17 Nov 2026 14:43:24 UTC on bdcb31816ec0
build id 14829
ASAN enabled
I20261117 14:50:41.770809 10388 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261117 14:50:41.772903 10388 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20261117 14:50:41.777257 10388 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20261117 14:50:41.783808 10395 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261117 14:50:41.783879 10394 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261117 14:50:41.785039 10397 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261117 14:50:41.786468 10388 server_base.cc:1061] running on GCE node
I20261117 14:50:41.787253 10388 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261117 14:50:41.788527 10388 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261117 14:50:41.789808 10388 hybrid_clock.cc:648] HybridClock initialized: now 1794927041789725 us; error 59 us; skew 500 ppm
I20261117 14:50:41.790182 10388 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261117 14:50:41.792724 10388 webserver.cc:577] Webserver started at http://127.6.50.129:39191/ using document root <none> and password file <none>
I20261117 14:50:41.793524 10388 fs_manager.cc:362] Metadata directory not provided
I20261117 14:50:41.793677 10388 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261117 14:50:41.799998 10388 fs_manager.cc:714] Time spent opening directory manager: real 0.004s user 0.005s sys 0.001s
I20261117 14:50:41.803378 10403 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20261117 14:50:41.805074 10388 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20261117 14:50:41.805269 10388 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-0/data,/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-0/wal
uuid: "6041859320d34e679a287826f4f54fd6"
format_stamp: "Formatted at 2026-11-17 14:49:55 on dist-test-slave-jwg6"
I20261117 14:50:41.806013 10388 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261117 14:50:41.821950 10388 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20261117 14:50:41.822907 10388 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261117 14:50:41.823277 10388 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261117 14:50:41.824390 10388 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261117 14:50:41.826974 10410 ts_tablet_manager.cc:594] Loading tablet metadata (0/1 complete)
I20261117 14:50:41.835649 10388 ts_tablet_manager.cc:631] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20261117 14:50:41.835834 10388 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.009s user 0.000s sys 0.001s
I20261117 14:50:41.835996 10388 ts_tablet_manager.cc:646] Registering tablets (0/1 complete)
W20261117 14:50:41.839226 9688 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
I20261117 14:50:41.839906 10388 ts_tablet_manager.cc:662] Registered 1 tablets
I20261117 14:50:41.840013 10388 ts_tablet_manager.cc:641] Time spent register tablets: real 0.004s user 0.000s sys 0.001s
I20261117 14:50:41.840540 10410 tablet_bootstrap.cc:492] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6: Bootstrap starting.
W20261117 14:50:41.854419 9688 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
I20261117 14:50:41.906963 10388 rpc_server.cc:307] RPC server started. Bound to: 127.6.50.129:36371
I20261117 14:50:41.907016 10516 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.50.129:36371 every 8 connection(s)
I20261117 14:50:41.909175 10388 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-0/data/info.pb
I20261117 14:50:41.911084 6346 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskUafhB0/build/asan/bin/kudu as pid 10388
I20261117 14:50:41.911300 6346 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskUafhB0/build/asan/bin/kudu pid 9647
I20261117 14:50:41.955106 9771 generic_service.cc:196] Checking for leaks (request via RPC)
I20261117 14:50:41.961364 10517 heartbeater.cc:345] Connected to a master server at 127.6.50.190:39297
I20261117 14:50:41.961743 10517 heartbeater.cc:462] Registering TS with master...
I20261117 14:50:41.962909 10517 heartbeater.cc:508] Master 127.6.50.190:39297 requested a full tablet report, sending...
I20261117 14:50:41.971889 7588 ts_manager.cc:210] Re-registered known tserver with Master: 6041859320d34e679a287826f4f54fd6 (127.6.50.129:36371)
I20261117 14:50:41.974175 7588 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.6.50.129:55285
I20261117 14:50:42.064237 10380 heartbeater.cc:500] Master 127.6.50.190:39297 was elected leader, sending a full tablet report...
W20261117 14:50:42.213979 9688 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
W20261117 14:50:42.214188 9691 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:47308: Illegal state: replica 624366c73dc34561925e1d1b5216cf2b is not leader of this config: current role FOLLOWER
I20261117 14:50:42.214795 6346 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskUafhB0/build/asan/bin/kudu with pid 9647
I20261117 14:50:42.258788 6346 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskUafhB0/build/asan/bin/kudu
/tmp/dist-test-taskUafhB0/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.50.132:33799
--local_ip_for_outbound_sockets=127.6.50.132
--tserver_master_addrs=127.6.50.190:39297
--webserver_port=34537
--webserver_interface=127.6.50.132
--builtin_ntp_servers=127.6.50.148:44279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--scanner_default_batch_size_bytes=100 with env {}
I20261117 14:50:42.528561 8223 meta_cache.cc:1510] marking tablet server 624366c73dc34561925e1d1b5216cf2b (127.6.50.132:33799) as failed
W20261117 14:50:42.655826 10525 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261117 14:50:42.656180 10525 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261117 14:50:42.656349 10525 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261117 14:50:42.666744 10525 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261117 14:50:42.667011 10525 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.50.132
I20261117 14:50:42.679005 10525 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-3/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.50.148:44279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.50.132:33799
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-3/data/info.pb
--webserver_interface=127.6.50.132
--webserver_port=34537
--tserver_master_addrs=127.6.50.190:39297
--scanner_default_batch_size_bytes=100
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.50.132
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type FASTDEBUG
built by None at 17 Nov 2026 14:43:24 UTC on bdcb31816ec0
build id 14829
ASAN enabled
I20261117 14:50:42.680938 10525 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261117 14:50:42.683032 10525 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20261117 14:50:42.687702 10525 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20261117 14:50:42.693851 10530 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261117 14:50:42.695331 10531 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261117 14:50:42.705919 10533 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261117 14:50:42.706559 10525 server_base.cc:1061] running on GCE node
I20261117 14:50:42.707382 10525 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261117 14:50:42.708710 10525 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261117 14:50:42.709985 10525 hybrid_clock.cc:648] HybridClock initialized: now 1794927042709909 us; error 45 us; skew 500 ppm
I20261117 14:50:42.710367 10525 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
W20261117 14:50:42.714202 8184 meta_cache.cc:302] tablet a1fc825ee85f40d1aee4695db8235828: replica 624366c73dc34561925e1d1b5216cf2b (127.6.50.132:33799) has failed: Network error: Client connection negotiation failed: client connection to 127.6.50.132:33799: connect: Connection refused (error 111)
I20261117 14:50:42.716800 10525 webserver.cc:577] Webserver started at http://127.6.50.132:34537/ using document root <none> and password file <none>
I20261117 14:50:42.717890 10525 fs_manager.cc:362] Metadata directory not provided
I20261117 14:50:42.718051 10525 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261117 14:50:42.726058 10525 fs_manager.cc:714] Time spent opening directory manager: real 0.005s user 0.003s sys 0.001s
I20261117 14:50:42.730084 10539 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20261117 14:50:42.732035 10525 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20261117 14:50:42.732225 10525 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-3/data,/tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-3/wal
uuid: "624366c73dc34561925e1d1b5216cf2b"
format_stamp: "Formatted at 2026-11-17 14:49:56 on dist-test-slave-jwg6"
I20261117 14:50:42.733345 10525 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-3/wal
metadata directory: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-3/wal
1 data directories: /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261117 14:50:42.783893 10525 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20261117 14:50:42.785099 10525 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261117 14:50:42.785392 10525 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261117 14:50:42.786857 10525 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261117 14:50:42.790021 10546 ts_tablet_manager.cc:594] Loading tablet metadata (0/1 complete)
I20261117 14:50:42.793953 10410 log.cc:826] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6: Log is configured to *not* fsync() on all Append() calls
I20261117 14:50:42.798455 10525 ts_tablet_manager.cc:631] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20261117 14:50:42.798594 10525 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.009s user 0.000s sys 0.001s
I20261117 14:50:42.798740 10525 ts_tablet_manager.cc:646] Registering tablets (0/1 complete)
I20261117 14:50:42.803215 10525 ts_tablet_manager.cc:662] Registered 1 tablets
I20261117 14:50:42.803313 10525 ts_tablet_manager.cc:641] Time spent register tablets: real 0.005s user 0.002s sys 0.000s
I20261117 14:50:42.803903 10546 tablet_bootstrap.cc:492] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b: Bootstrap starting.
I20261117 14:50:42.977826 10517 heartbeater.cc:500] Master 127.6.50.190:39297 was elected leader, sending a full tablet report...
I20261117 14:50:43.543550 10653 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.50.132:33799 every 8 connection(s)
I20261117 14:50:43.543968 10525 rpc_server.cc:307] RPC server started. Bound to: 127.6.50.132:33799
I20261117 14:50:43.546191 10525 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0/minicluster-data/ts-3/data/info.pb
I20261117 14:50:43.548867 6346 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskUafhB0/build/asan/bin/kudu as pid 10525
I20261117 14:50:43.609635 10654 heartbeater.cc:345] Connected to a master server at 127.6.50.190:39297
I20261117 14:50:43.610095 10654 heartbeater.cc:462] Registering TS with master...
I20261117 14:50:43.611251 10654 heartbeater.cc:508] Master 127.6.50.190:39297 requested a full tablet report, sending...
I20261117 14:50:43.614842 7586 ts_manager.cc:210] Re-registered known tserver with Master: 624366c73dc34561925e1d1b5216cf2b (127.6.50.132:33799)
I20261117 14:50:43.616484 7586 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.6.50.132:56905
I20261117 14:50:43.923627 10546 log.cc:826] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b: Log is configured to *not* fsync() on all Append() calls
I20261117 14:50:44.620035 10654 heartbeater.cc:500] Master 127.6.50.190:39297 was elected leader, sending a full tablet report...
I20261117 14:50:44.662081 10589 tablet_service.cc:1456] Tablet server has 0 leaders and 0 scanners
I20261117 14:50:44.663790 10452 tablet_service.cc:1456] Tablet server has 0 leaders and 0 scanners
I20261117 14:50:44.665623 10179 tablet_service.cc:1456] Tablet server has 0 leaders and 0 scanners
I20261117 14:50:44.699224 10315 tablet_service.cc:1456] Tablet server has 0 leaders and 0 scanners
I20261117 14:50:46.620366 10273 tablet_bootstrap.cc:492] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3: Bootstrap replaying log segment 1/1 (2.42M/3.51M this segment, stats: ops{read=1400 overwritten=0 applied=1400 ignored=0} inserts{seen=69800 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0)
I20261117 14:50:47.796357 10410 tablet_bootstrap.cc:492] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6: Bootstrap replaying log segment 1/1 (1.95M/3.48M this segment, stats: ops{read=1135 overwritten=0 applied=1134 ignored=0} inserts{seen=56500 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0)
I20261117 14:50:48.329399 10273 tablet_bootstrap.cc:492] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3: Bootstrap replayed 1/1 log segments. Stats: ops{read=2032 overwritten=0 applied=2032 ignored=0} inserts{seen=101400 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20261117 14:50:48.330054 10273 tablet_bootstrap.cc:492] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3: Bootstrap complete.
I20261117 14:50:48.331821 10273 ts_tablet_manager.cc:1449] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3: Time spent bootstrapping tablet: real 7.348s user 6.706s sys 0.498s
I20261117 14:50:48.337113 10273 raft_consensus.cc:360] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 8 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "624366c73dc34561925e1d1b5216cf2b" member_type: VOTER last_known_addr { host: "127.6.50.132" port: 33799 } } peers { permanent_uuid: "6041859320d34e679a287826f4f54fd6" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 36371 } } peers { permanent_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 34551 } }
I20261117 14:50:48.337798 10273 raft_consensus.cc:748] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 8 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa94e5d3d33a4f70b3e2c9c5f62cc9f3, State: Initialized, Role: FOLLOWER
I20261117 14:50:48.338550 10273 consensus_queue.cc:261] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2032, Last appended: 7.2032, Last appended by leader: 2032, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "624366c73dc34561925e1d1b5216cf2b" member_type: VOTER last_known_addr { host: "127.6.50.132" port: 33799 } } peers { permanent_uuid: "6041859320d34e679a287826f4f54fd6" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 36371 } } peers { permanent_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 34551 } }
I20261117 14:50:48.340353 10273 ts_tablet_manager.cc:1480] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3: Time spent starting tablet: real 0.008s user 0.010s sys 0.000s
W20261117 14:50:48.356544 10295 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:54304: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:48.565486 10295 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:54304: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
I20261117 14:50:48.570075 10695 raft_consensus.cc:499] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261117 14:50:48.570406 10695 raft_consensus.cc:521] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "624366c73dc34561925e1d1b5216cf2b" member_type: VOTER last_known_addr { host: "127.6.50.132" port: 33799 } } peers { permanent_uuid: "6041859320d34e679a287826f4f54fd6" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 36371 } } peers { permanent_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 34551 } }
I20261117 14:50:48.572723 10695 leader_election.cc:290] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 624366c73dc34561925e1d1b5216cf2b (127.6.50.132:33799), 6041859320d34e679a287826f4f54fd6 (127.6.50.129:36371)
I20261117 14:50:48.608536 10472 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "a1fc825ee85f40d1aee4695db8235828" candidate_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" candidate_term: 9 candidate_status { last_received { term: 7 index: 2032 } } ignore_live_leader: false dest_uuid: "6041859320d34e679a287826f4f54fd6" is_pre_election: true
I20261117 14:50:48.608798 10609 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "a1fc825ee85f40d1aee4695db8235828" candidate_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" candidate_term: 9 candidate_status { last_received { term: 7 index: 2032 } } ignore_live_leader: false dest_uuid: "624366c73dc34561925e1d1b5216cf2b" is_pre_election: true
W20261117 14:50:48.612586 10267 leader_election.cc:343] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [CANDIDATE]: Term 9 pre-election: Tablet error from VoteRequest() call to peer 6041859320d34e679a287826f4f54fd6 (127.6.50.129:36371): Illegal state: must be running to vote when last-logged opid is not known
W20261117 14:50:48.614053 10268 leader_election.cc:343] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [CANDIDATE]: Term 9 pre-election: Tablet error from VoteRequest() call to peer 624366c73dc34561925e1d1b5216cf2b (127.6.50.132:33799): Illegal state: must be running to vote when last-logged opid is not known
I20261117 14:50:48.614311 10268 leader_election.cc:304] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa94e5d3d33a4f70b3e2c9c5f62cc9f3; no voters: 6041859320d34e679a287826f4f54fd6, 624366c73dc34561925e1d1b5216cf2b
I20261117 14:50:48.614777 10695 raft_consensus.cc:2771] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20261117 14:50:48.705883 10295 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:54304: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:48.786746 10295 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:54304: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
I20261117 14:50:48.932855 10546 tablet_bootstrap.cc:492] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b: Bootstrap replaying log segment 1/1 (2.12M/3.43M this segment, stats: ops{read=1257 overwritten=0 applied=1255 ignored=0} inserts{seen=62550 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0)
W20261117 14:50:48.995959 10295 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:54304: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
I20261117 14:50:49.030861 10695 raft_consensus.cc:499] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261117 14:50:49.031072 10695 raft_consensus.cc:521] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "624366c73dc34561925e1d1b5216cf2b" member_type: VOTER last_known_addr { host: "127.6.50.132" port: 33799 } } peers { permanent_uuid: "6041859320d34e679a287826f4f54fd6" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 36371 } } peers { permanent_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 34551 } }
I20261117 14:50:49.031898 10695 leader_election.cc:290] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 624366c73dc34561925e1d1b5216cf2b (127.6.50.132:33799), 6041859320d34e679a287826f4f54fd6 (127.6.50.129:36371)
I20261117 14:50:49.033241 10472 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "a1fc825ee85f40d1aee4695db8235828" candidate_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" candidate_term: 9 candidate_status { last_received { term: 7 index: 2032 } } ignore_live_leader: false dest_uuid: "6041859320d34e679a287826f4f54fd6" is_pre_election: true
W20261117 14:50:49.034296 10267 leader_election.cc:343] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [CANDIDATE]: Term 9 pre-election: Tablet error from VoteRequest() call to peer 6041859320d34e679a287826f4f54fd6 (127.6.50.129:36371): Illegal state: must be running to vote when last-logged opid is not known
I20261117 14:50:49.034924 10609 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "a1fc825ee85f40d1aee4695db8235828" candidate_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" candidate_term: 9 candidate_status { last_received { term: 7 index: 2032 } } ignore_live_leader: false dest_uuid: "624366c73dc34561925e1d1b5216cf2b" is_pre_election: true
W20261117 14:50:49.035619 10268 leader_election.cc:343] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [CANDIDATE]: Term 9 pre-election: Tablet error from VoteRequest() call to peer 624366c73dc34561925e1d1b5216cf2b (127.6.50.132:33799): Illegal state: must be running to vote when last-logged opid is not known
I20261117 14:50:49.035815 10268 leader_election.cc:304] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa94e5d3d33a4f70b3e2c9c5f62cc9f3; no voters: 6041859320d34e679a287826f4f54fd6, 624366c73dc34561925e1d1b5216cf2b
I20261117 14:50:49.036131 10695 raft_consensus.cc:2771] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20261117 14:50:49.141549 10295 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:54304: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:49.225508 10295 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:54304: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
I20261117 14:50:49.394855 10695 raft_consensus.cc:499] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261117 14:50:49.395071 10695 raft_consensus.cc:521] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "624366c73dc34561925e1d1b5216cf2b" member_type: VOTER last_known_addr { host: "127.6.50.132" port: 33799 } } peers { permanent_uuid: "6041859320d34e679a287826f4f54fd6" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 36371 } } peers { permanent_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 34551 } }
I20261117 14:50:49.395910 10695 leader_election.cc:290] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 624366c73dc34561925e1d1b5216cf2b (127.6.50.132:33799), 6041859320d34e679a287826f4f54fd6 (127.6.50.129:36371)
I20261117 14:50:49.396481 10609 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "a1fc825ee85f40d1aee4695db8235828" candidate_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" candidate_term: 9 candidate_status { last_received { term: 7 index: 2032 } } ignore_live_leader: false dest_uuid: "624366c73dc34561925e1d1b5216cf2b" is_pre_election: true
I20261117 14:50:49.396727 10472 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "a1fc825ee85f40d1aee4695db8235828" candidate_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" candidate_term: 9 candidate_status { last_received { term: 7 index: 2032 } } ignore_live_leader: false dest_uuid: "6041859320d34e679a287826f4f54fd6" is_pre_election: true
W20261117 14:50:49.397289 10268 leader_election.cc:343] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [CANDIDATE]: Term 9 pre-election: Tablet error from VoteRequest() call to peer 624366c73dc34561925e1d1b5216cf2b (127.6.50.132:33799): Illegal state: must be running to vote when last-logged opid is not known
W20261117 14:50:49.397521 10267 leader_election.cc:343] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [CANDIDATE]: Term 9 pre-election: Tablet error from VoteRequest() call to peer 6041859320d34e679a287826f4f54fd6 (127.6.50.129:36371): Illegal state: must be running to vote when last-logged opid is not known
I20261117 14:50:49.397653 10267 leader_election.cc:304] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa94e5d3d33a4f70b3e2c9c5f62cc9f3; no voters: 6041859320d34e679a287826f4f54fd6, 624366c73dc34561925e1d1b5216cf2b
I20261117 14:50:49.398002 10695 raft_consensus.cc:2771] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20261117 14:50:49.433347 10295 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:54304: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
I20261117 14:50:49.441883 8223 scanner-internal.cc:172] Scan of tablet a1fc825ee85f40d1aee4695db8235828 at fa94e5d3d33a4f70b3e2c9c5f62cc9f3 (127.6.50.131:34551) deadline exceeded after 10.000s
W20261117 14:50:49.442242 8223 scanner-internal.cc:464] Time spent opening tablet: real 10.837s user 0.010s sys 0.001s
W20261117 14:50:49.580916 10295 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:54304: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:49.674216 10295 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:54304: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
I20261117 14:50:49.809614 8225 scanner-internal.cc:172] Scan of tablet a1fc825ee85f40d1aee4695db8235828 at fa94e5d3d33a4f70b3e2c9c5f62cc9f3 (127.6.50.131:34551) deadline exceeded after 10.000s
W20261117 14:50:49.809842 8225 scanner-internal.cc:464] Time spent opening tablet: real 10.968s user 0.008s sys 0.002s
I20261117 14:50:49.815114 8224 scanner-internal.cc:172] Scan of tablet a1fc825ee85f40d1aee4695db8235828 at fa94e5d3d33a4f70b3e2c9c5f62cc9f3 (127.6.50.131:34551) deadline exceeded after 10.000s
W20261117 14:50:49.815330 8224 scanner-internal.cc:464] Time spent opening tablet: real 10.987s user 0.011s sys 0.000s
W20261117 14:50:49.879025 10295 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:54304: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
I20261117 14:50:49.886636 10695 raft_consensus.cc:499] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261117 14:50:49.886857 10695 raft_consensus.cc:521] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "624366c73dc34561925e1d1b5216cf2b" member_type: VOTER last_known_addr { host: "127.6.50.132" port: 33799 } } peers { permanent_uuid: "6041859320d34e679a287826f4f54fd6" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 36371 } } peers { permanent_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 34551 } }
I20261117 14:50:49.887668 10695 leader_election.cc:290] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 624366c73dc34561925e1d1b5216cf2b (127.6.50.132:33799), 6041859320d34e679a287826f4f54fd6 (127.6.50.129:36371)
I20261117 14:50:49.888464 10472 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "a1fc825ee85f40d1aee4695db8235828" candidate_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" candidate_term: 9 candidate_status { last_received { term: 7 index: 2032 } } ignore_live_leader: false dest_uuid: "6041859320d34e679a287826f4f54fd6" is_pre_election: true
W20261117 14:50:49.889242 10267 leader_election.cc:343] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [CANDIDATE]: Term 9 pre-election: Tablet error from VoteRequest() call to peer 6041859320d34e679a287826f4f54fd6 (127.6.50.129:36371): Illegal state: must be running to vote when last-logged opid is not known
I20261117 14:50:49.889968 10609 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "a1fc825ee85f40d1aee4695db8235828" candidate_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" candidate_term: 9 candidate_status { last_received { term: 7 index: 2032 } } ignore_live_leader: false dest_uuid: "624366c73dc34561925e1d1b5216cf2b" is_pre_election: true
W20261117 14:50:49.890625 10268 leader_election.cc:343] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [CANDIDATE]: Term 9 pre-election: Tablet error from VoteRequest() call to peer 624366c73dc34561925e1d1b5216cf2b (127.6.50.132:33799): Illegal state: must be running to vote when last-logged opid is not known
I20261117 14:50:49.890774 10268 leader_election.cc:304] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa94e5d3d33a4f70b3e2c9c5f62cc9f3; no voters: 6041859320d34e679a287826f4f54fd6, 624366c73dc34561925e1d1b5216cf2b
I20261117 14:50:49.891266 10695 raft_consensus.cc:2771] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20261117 14:50:50.036798 10295 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:54304: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:50.131160 10295 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:54304: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:50.343546 10295 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:54304: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
I20261117 14:50:50.370965 10695 raft_consensus.cc:499] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261117 14:50:50.371163 10695 raft_consensus.cc:521] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "624366c73dc34561925e1d1b5216cf2b" member_type: VOTER last_known_addr { host: "127.6.50.132" port: 33799 } } peers { permanent_uuid: "6041859320d34e679a287826f4f54fd6" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 36371 } } peers { permanent_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 34551 } }
I20261117 14:50:50.371937 10695 leader_election.cc:290] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 624366c73dc34561925e1d1b5216cf2b (127.6.50.132:33799), 6041859320d34e679a287826f4f54fd6 (127.6.50.129:36371)
I20261117 14:50:50.372860 10472 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "a1fc825ee85f40d1aee4695db8235828" candidate_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" candidate_term: 9 candidate_status { last_received { term: 7 index: 2032 } } ignore_live_leader: false dest_uuid: "6041859320d34e679a287826f4f54fd6" is_pre_election: true
W20261117 14:50:50.373562 10267 leader_election.cc:343] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [CANDIDATE]: Term 9 pre-election: Tablet error from VoteRequest() call to peer 6041859320d34e679a287826f4f54fd6 (127.6.50.129:36371): Illegal state: must be running to vote when last-logged opid is not known
I20261117 14:50:50.374368 10609 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "a1fc825ee85f40d1aee4695db8235828" candidate_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" candidate_term: 9 candidate_status { last_received { term: 7 index: 2032 } } ignore_live_leader: false dest_uuid: "624366c73dc34561925e1d1b5216cf2b" is_pre_election: true
W20261117 14:50:50.375012 10268 leader_election.cc:343] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [CANDIDATE]: Term 9 pre-election: Tablet error from VoteRequest() call to peer 624366c73dc34561925e1d1b5216cf2b (127.6.50.132:33799): Illegal state: must be running to vote when last-logged opid is not known
I20261117 14:50:50.375150 10268 leader_election.cc:304] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa94e5d3d33a4f70b3e2c9c5f62cc9f3; no voters: 6041859320d34e679a287826f4f54fd6, 624366c73dc34561925e1d1b5216cf2b
I20261117 14:50:50.375628 10695 raft_consensus.cc:2771] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20261117 14:50:50.500492 10295 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:54304: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
I20261117 14:50:50.538228 10410 tablet_bootstrap.cc:492] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2032 overwritten=0 applied=2032 ignored=0} inserts{seen=101400 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20261117 14:50:50.538858 10410 tablet_bootstrap.cc:492] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6: Bootstrap complete.
I20261117 14:50:50.540659 10410 ts_tablet_manager.cc:1449] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6: Time spent bootstrapping tablet: real 8.701s user 8.083s sys 0.430s
I20261117 14:50:50.544564 10410 raft_consensus.cc:360] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [term 8 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "624366c73dc34561925e1d1b5216cf2b" member_type: VOTER last_known_addr { host: "127.6.50.132" port: 33799 } } peers { permanent_uuid: "6041859320d34e679a287826f4f54fd6" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 36371 } } peers { permanent_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 34551 } }
I20261117 14:50:50.545245 10410 raft_consensus.cc:748] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [term 8 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6041859320d34e679a287826f4f54fd6, State: Initialized, Role: FOLLOWER
I20261117 14:50:50.546092 10410 consensus_queue.cc:261] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2032, Last appended: 7.2032, Last appended by leader: 2032, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "624366c73dc34561925e1d1b5216cf2b" member_type: VOTER last_known_addr { host: "127.6.50.132" port: 33799 } } peers { permanent_uuid: "6041859320d34e679a287826f4f54fd6" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 36371 } } peers { permanent_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 34551 } }
I20261117 14:50:50.547892 10410 ts_tablet_manager.cc:1480] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
W20261117 14:50:50.593848 10295 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:54304: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
W20261117 14:50:50.656745 10431 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:51460: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:50.657675 10432 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:51460: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
W20261117 14:50:50.755897 10432 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:51460: Illegal state: replica 6041859320d34e679a287826f4f54fd6 is not leader of this config: current role FOLLOWER
I20261117 14:50:50.776634 10589 tablet_service.cc:1456] Tablet server has 0 leaders and 0 scanners
I20261117 14:50:50.780997 10702 raft_consensus.cc:499] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261117 14:50:50.781303 10702 raft_consensus.cc:521] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "624366c73dc34561925e1d1b5216cf2b" member_type: VOTER last_known_addr { host: "127.6.50.132" port: 33799 } } peers { permanent_uuid: "6041859320d34e679a287826f4f54fd6" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 36371 } } peers { permanent_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 34551 } }
I20261117 14:50:50.783404 10702 leader_election.cc:290] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 624366c73dc34561925e1d1b5216cf2b (127.6.50.132:33799), fa94e5d3d33a4f70b3e2c9c5f62cc9f3 (127.6.50.131:34551)
I20261117 14:50:50.784145 10452 tablet_service.cc:1456] Tablet server has 0 leaders and 0 scanners
I20261117 14:50:50.802220 10315 tablet_service.cc:1456] Tablet server has 0 leaders and 3 scanners
W20261117 14:50:50.813704 10295 tablet_service.cc:720] failed op from {username='slave'} at 127.0.0.1:54304: Illegal state: replica fa94e5d3d33a4f70b3e2c9c5f62cc9f3 is not leader of this config: current role FOLLOWER
I20261117 14:50:50.814826 10609 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "a1fc825ee85f40d1aee4695db8235828" candidate_uuid: "6041859320d34e679a287826f4f54fd6" candidate_term: 9 candidate_status { last_received { term: 7 index: 2032 } } ignore_live_leader: false dest_uuid: "624366c73dc34561925e1d1b5216cf2b" is_pre_election: true
I20261117 14:50:50.817687 10179 tablet_service.cc:1456] Tablet server has 0 leaders and 0 scanners
W20261117 14:50:50.818387 10405 leader_election.cc:343] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [CANDIDATE]: Term 9 pre-election: Tablet error from VoteRequest() call to peer 624366c73dc34561925e1d1b5216cf2b (127.6.50.132:33799): Illegal state: must be running to vote when last-logged opid is not known
I20261117 14:50:50.837414 10335 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "a1fc825ee85f40d1aee4695db8235828" candidate_uuid: "6041859320d34e679a287826f4f54fd6" candidate_term: 9 candidate_status { last_received { term: 7 index: 2032 } } ignore_live_leader: false dest_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" is_pre_election: true
I20261117 14:50:50.837890 10335 raft_consensus.cc:2490] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6041859320d34e679a287826f4f54fd6 in term 8.
I20261117 14:50:50.838610 10404 leader_election.cc:304] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6041859320d34e679a287826f4f54fd6, fa94e5d3d33a4f70b3e2c9c5f62cc9f3; no voters: 624366c73dc34561925e1d1b5216cf2b
I20261117 14:50:50.839090 10702 raft_consensus.cc:2826] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20261117 14:50:50.839260 10702 raft_consensus.cc:499] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20261117 14:50:50.839373 10702 raft_consensus.cc:3096] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [term 8 FOLLOWER]: Advancing to term 9
I20261117 14:50:50.845188 10702 raft_consensus.cc:521] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "624366c73dc34561925e1d1b5216cf2b" member_type: VOTER last_known_addr { host: "127.6.50.132" port: 33799 } } peers { permanent_uuid: "6041859320d34e679a287826f4f54fd6" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 36371 } } peers { permanent_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 34551 } }
I20261117 14:50:50.846088 10702 leader_election.cc:290] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [CANDIDATE]: Term 9 election: Requested vote from peers 624366c73dc34561925e1d1b5216cf2b (127.6.50.132:33799), fa94e5d3d33a4f70b3e2c9c5f62cc9f3 (127.6.50.131:34551)
I20261117 14:50:50.846555 10609 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "a1fc825ee85f40d1aee4695db8235828" candidate_uuid: "6041859320d34e679a287826f4f54fd6" candidate_term: 9 candidate_status { last_received { term: 7 index: 2032 } } ignore_live_leader: false dest_uuid: "624366c73dc34561925e1d1b5216cf2b"
W20261117 14:50:50.847096 10405 leader_election.cc:343] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [CANDIDATE]: Term 9 election: Tablet error from VoteRequest() call to peer 624366c73dc34561925e1d1b5216cf2b (127.6.50.132:33799): Illegal state: must be running to vote when last-logged opid is not known
I20261117 14:50:50.847193 10335 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "a1fc825ee85f40d1aee4695db8235828" candidate_uuid: "6041859320d34e679a287826f4f54fd6" candidate_term: 9 candidate_status { last_received { term: 7 index: 2032 } } ignore_live_leader: false dest_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3"
I20261117 14:50:50.847422 10335 raft_consensus.cc:3096] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 8 FOLLOWER]: Advancing to term 9
I20261117 14:50:50.852504 10335 raft_consensus.cc:2490] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6041859320d34e679a287826f4f54fd6 in term 9.
I20261117 14:50:50.853121 10404 leader_election.cc:304] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6041859320d34e679a287826f4f54fd6, fa94e5d3d33a4f70b3e2c9c5f62cc9f3; no voters: 624366c73dc34561925e1d1b5216cf2b
I20261117 14:50:50.853664 10702 raft_consensus.cc:2826] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [term 9 FOLLOWER]: Leader election won for term 9
I20261117 14:50:50.863970 10702 raft_consensus.cc:705] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [term 9 LEADER]: Becoming Leader. State: Replica: 6041859320d34e679a287826f4f54fd6, State: Running, Role: LEADER
I20261117 14:50:50.864658 10702 consensus_queue.cc:238] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2032, Committed index: 2032, Last appended: 7.2032, Last appended by leader: 2032, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "624366c73dc34561925e1d1b5216cf2b" member_type: VOTER last_known_addr { host: "127.6.50.132" port: 33799 } } peers { permanent_uuid: "6041859320d34e679a287826f4f54fd6" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 36371 } } peers { permanent_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 34551 } }
I20261117 14:50:50.885732 10335 raft_consensus.cc:1285] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 9 FOLLOWER]: Refusing update from remote peer 6041859320d34e679a287826f4f54fd6: Log matching property violated. Preceding OpId in replica: term: 7 index: 2032. Preceding OpId from leader: term: 9 index: 2033. (index mismatch)
W20261117 14:50:50.886932 10405 consensus_peers.cc:597] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 -> Peer 624366c73dc34561925e1d1b5216cf2b (127.6.50.132:33799): Couldn't send request to peer 624366c73dc34561925e1d1b5216cf2b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20261117 14:50:50.887493 7586 catalog_manager.cc:5840] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 reported cstate change: term changed from 7 to 9, leader changed from fa94e5d3d33a4f70b3e2c9c5f62cc9f3 (127.6.50.131) to 6041859320d34e679a287826f4f54fd6 (127.6.50.129). New cstate: current_term: 9 leader_uuid: "6041859320d34e679a287826f4f54fd6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "624366c73dc34561925e1d1b5216cf2b" member_type: VOTER last_known_addr { host: "127.6.50.132" port: 33799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6041859320d34e679a287826f4f54fd6" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 36371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 34551 } health_report { overall_health: UNKNOWN } } }
I20261117 14:50:50.889364 10739 consensus_queue.cc:1049] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 34551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2033, Last known committed idx: 2032, Time since last communication: 0.000s
W20261117 14:50:51.427101 10405 consensus_peers.cc:597] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 -> Peer 624366c73dc34561925e1d1b5216cf2b (127.6.50.132:33799): Couldn't send request to peer 624366c73dc34561925e1d1b5216cf2b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
I20261117 14:50:51.881795 10546 tablet_bootstrap.cc:492] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2031 overwritten=0 applied=2031 ignored=0} inserts{seen=101350 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20261117 14:50:51.882598 10546 tablet_bootstrap.cc:492] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b: Bootstrap complete.
I20261117 14:50:51.884809 10546 ts_tablet_manager.cc:1449] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b: Time spent bootstrapping tablet: real 9.081s user 8.235s sys 0.550s
I20261117 14:50:51.890240 10546 raft_consensus.cc:360] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b [term 8 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "624366c73dc34561925e1d1b5216cf2b" member_type: VOTER last_known_addr { host: "127.6.50.132" port: 33799 } } peers { permanent_uuid: "6041859320d34e679a287826f4f54fd6" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 36371 } } peers { permanent_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 34551 } }
I20261117 14:50:51.891224 10546 raft_consensus.cc:748] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b [term 8 FOLLOWER]: Becoming Follower/Learner. State: Replica: 624366c73dc34561925e1d1b5216cf2b, State: Initialized, Role: FOLLOWER
I20261117 14:50:51.892088 10546 consensus_queue.cc:261] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2031, Last appended: 7.2031, Last appended by leader: 2031, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "624366c73dc34561925e1d1b5216cf2b" member_type: VOTER last_known_addr { host: "127.6.50.132" port: 33799 } } peers { permanent_uuid: "6041859320d34e679a287826f4f54fd6" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 36371 } } peers { permanent_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 34551 } }
I20261117 14:50:51.902154 10546 ts_tablet_manager.cc:1480] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b: Time spent starting tablet: real 0.017s user 0.008s sys 0.008s
I20261117 14:50:51.927990 10609 raft_consensus.cc:3096] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b [term 8 FOLLOWER]: Advancing to term 9
I20261117 14:50:51.936008 10609 raft_consensus.cc:1285] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b [term 9 FOLLOWER]: Refusing update from remote peer 6041859320d34e679a287826f4f54fd6: Log matching property violated. Preceding OpId in replica: term: 7 index: 2031. Preceding OpId from leader: term: 7 index: 2032. (index mismatch)
I20261117 14:50:51.941478 10702 consensus_queue.cc:1051] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [LEADER]: Got LMP mismatch error from peer: Peer: permanent_uuid: "624366c73dc34561925e1d1b5216cf2b" member_type: VOTER last_known_addr { host: "127.6.50.132" port: 33799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2033, Last known committed idx: 2031, Time since last communication: 0.000s
I20261117 14:50:52.182462 10759 mvcc.cc:204] Tried to move back new op lower bound from 7352021204722819072 to 7352021200392216576. Current Snapshot: MvccSnapshot[applied={T|T < 7352021203133698048}]
W20261117 14:50:56.204603 8183 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.6.50.129:36371, user_credentials={real_user=slave}} blocked reactor thread for 47574.9us
I20261117 14:50:57.047039 10452 tablet_service.cc:1456] Tablet server has 1 leaders and 0 scanners
I20261117 14:50:57.058437 10179 tablet_service.cc:1456] Tablet server has 0 leaders and 0 scanners
I20261117 14:50:57.083376 10589 tablet_service.cc:1456] Tablet server has 0 leaders and 0 scanners
I20261117 14:50:57.110127 10315 tablet_service.cc:1456] Tablet server has 0 leaders and 3 scanners
W20261117 14:50:57.433077 8222 meta_cache.cc:1261] Time spent looking up entry by key: real 0.055s user 0.001s sys 0.000s
I20261117 14:50:58.358680 7594 ts_manager.cc:300] Unset tserver state for 39c0d031db104a9d83a434fb89d0a277 from MAINTENANCE_MODE
I20261117 14:50:58.360117 10244 heartbeater.cc:508] Master 127.6.50.190:39297 requested a full tablet report, sending...
I20261117 14:50:58.361361 7585 ts_manager.cc:300] Unset tserver state for fa94e5d3d33a4f70b3e2c9c5f62cc9f3 from MAINTENANCE_MODE
I20261117 14:50:58.911226 7593 ts_manager.cc:300] Unset tserver state for 624366c73dc34561925e1d1b5216cf2b from MAINTENANCE_MODE
I20261117 14:50:58.972554 7593 ts_manager.cc:300] Unset tserver state for 6041859320d34e679a287826f4f54fd6 from MAINTENANCE_MODE
I20261117 14:50:58.975771 10380 heartbeater.cc:508] Master 127.6.50.190:39297 requested a full tablet report, sending...
I20261117 14:50:59.121515 10654 heartbeater.cc:508] Master 127.6.50.190:39297 requested a full tablet report, sending...
I20261117 14:50:59.136911 10517 heartbeater.cc:508] Master 127.6.50.190:39297 requested a full tablet report, sending...
/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/integration-tests/maintenance_mode-itest.cc:750: Failure
Value of: s.ok()
Actual: true
Expected: false
/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/test_util.cc:402: Failure
Failed
Timed out waiting for assertion to pass.
I20261117 14:50:59.215329 6346 external_mini_cluster-itest-base.cc:80] Found fatal failure
I20261117 14:50:59.215572 6346 external_mini_cluster-itest-base.cc:86] Attempting to dump stacks of TS 0 with UUID 6041859320d34e679a287826f4f54fd6 and pid 10388
I20261117 14:50:59.364797 10244 heartbeater.cc:508] Master 127.6.50.190:39297 requested a full tablet report, sending...
************************ BEGIN STACKS **************************
[New LWP 10390]
[New LWP 10391]
[New LWP 10392]
[New LWP 10393]
[New LWP 10399]
[New LWP 10400]
[New LWP 10401]
[New LWP 10404]
[New LWP 10405]
[New LWP 10406]
[New LWP 10407]
[New LWP 10408]
[New LWP 10409]
[New LWP 10411]
[New LWP 10412]
[New LWP 10413]
[New LWP 10414]
[New LWP 10415]
[New LWP 10416]
[New LWP 10417]
[New LWP 10418]
[New LWP 10419]
[New LWP 10420]
[New LWP 10421]
[New LWP 10422]
[New LWP 10423]
[New LWP 10424]
[New LWP 10425]
[New LWP 10426]
[New LWP 10427]
[New LWP 10428]
[New LWP 10429]
[New LWP 10430]
[New LWP 10431]
[New LWP 10432]
[New LWP 10433]
[New LWP 10434]
[New LWP 10435]
[New LWP 10436]
[New LWP 10437]
[New LWP 10438]
[New LWP 10439]
[New LWP 10440]
[New LWP 10441]
[New LWP 10442]
[New LWP 10443]
[New LWP 10444]
[New LWP 10445]
[New LWP 10446]
[New LWP 10447]
[New LWP 10448]
[New LWP 10449]
[New LWP 10450]
[New LWP 10451]
[New LWP 10452]
[New LWP 10453]
[New LWP 10454]
[New LWP 10455]
[New LWP 10456]
[New LWP 10457]
[New LWP 10458]
[New LWP 10459]
[New LWP 10460]
[New LWP 10461]
[New LWP 10462]
[New LWP 10463]
[New LWP 10464]
[New LWP 10465]
[New LWP 10466]
[New LWP 10467]
[New LWP 10468]
[New LWP 10469]
[New LWP 10470]
[New LWP 10471]
[New LWP 10472]
[New LWP 10473]
[New LWP 10474]
[New LWP 10475]
[New LWP 10476]
[New LWP 10477]
[New LWP 10478]
[New LWP 10479]
[New LWP 10480]
[New LWP 10481]
[New LWP 10482]
[New LWP 10483]
[New LWP 10484]
[New LWP 10485]
[New LWP 10486]
[New LWP 10487]
[New LWP 10488]
[New LWP 10489]
[New LWP 10490]
[New LWP 10491]
[New LWP 10492]
[New LWP 10493]
[New LWP 10494]
[New LWP 10495]
[New LWP 10496]
[New LWP 10497]
[New LWP 10498]
[New LWP 10499]
[New LWP 10500]
[New LWP 10501]
[New LWP 10502]
[New LWP 10503]
[New LWP 10504]
[New LWP 10505]
[New LWP 10506]
[New LWP 10507]
[New LWP 10508]
[New LWP 10509]
[New LWP 10510]
[New LWP 10511]
[New LWP 10512]
[New LWP 10513]
[New LWP 10514]
[New LWP 10515]
[New LWP 10516]
[New LWP 10517]
[New LWP 10518]
[New LWP 10740]
[New LWP 10820]
0x00007fd6433e9d50 in ?? ()
Id Target Id Frame
* 1 LWP 10388 "kudu" 0x00007fd6433e9d50 in ?? ()
2 LWP 10390 "kudu" 0x00007fd6433e5fb9 in ?? ()
3 LWP 10391 "kudu" 0x00007fd6433e5fb9 in ?? ()
4 LWP 10392 "kudu" 0x00007fd6433e5fb9 in ?? ()
5 LWP 10393 "kernel-watcher-" 0x00007fd6433e5fb9 in ?? ()
6 LWP 10399 "ntp client-1039" 0x00007fd6433e99e2 in ?? ()
7 LWP 10400 "file cache-evic" 0x00007fd6433e5fb9 in ?? ()
8 LWP 10401 "sq_acceptor" 0x00007fd63be42bb9 in ?? ()
9 LWP 10404 "rpc reactor-104" 0x00007fd63be4f947 in ?? ()
10 LWP 10405 "rpc reactor-104" 0x00007fd63be4f947 in ?? ()
11 LWP 10406 "rpc reactor-104" 0x00007fd63be4f947 in ?? ()
12 LWP 10407 "rpc reactor-104" 0x00007fd63be4f947 in ?? ()
13 LWP 10408 "MaintenanceMgr " 0x00007fd6433e5ad3 in ?? ()
14 LWP 10409 "txn-status-mana" 0x00007fd6433e5fb9 in ?? ()
15 LWP 10411 "collect_and_rem" 0x00007fd6433e5fb9 in ?? ()
16 LWP 10412 "tc-session-exp-" 0x00007fd6433e5fb9 in ?? ()
17 LWP 10413 "rpc worker-1041" 0x00007fd6433e5ad3 in ?? ()
18 LWP 10414 "rpc worker-1041" 0x00007fd6433e5ad3 in ?? ()
19 LWP 10415 "rpc worker-1041" 0x00007fd6433e5ad3 in ?? ()
20 LWP 10416 "rpc worker-1041" 0x00007fd6433e5ad3 in ?? ()
21 LWP 10417 "rpc worker-1041" 0x00007fd6433e5ad3 in ?? ()
22 LWP 10418 "rpc worker-1041" 0x00007fd6433e5ad3 in ?? ()
23 LWP 10419 "rpc worker-1041" 0x00007fd6433e5ad3 in ?? ()
24 LWP 10420 "rpc worker-1042" 0x00007fd6433e5ad3 in ?? ()
25 LWP 10421 "rpc worker-1042" 0x00007fd6433e5ad3 in ?? ()
26 LWP 10422 "rpc worker-1042" 0x00007fd6433e5ad3 in ?? ()
27 LWP 10423 "rpc worker-1042" 0x00007fd6433e5ad3 in ?? ()
28 LWP 10424 "rpc worker-1042" 0x00007fd6433e5ad3 in ?? ()
29 LWP 10425 "rpc worker-1042" 0x00007fd6433e5ad3 in ?? ()
30 LWP 10426 "rpc worker-1042" 0x00007fd6433e5ad3 in ?? ()
31 LWP 10427 "rpc worker-1042" 0x00007fd6433e5ad3 in ?? ()
32 LWP 10428 "rpc worker-1042" 0x00007fd6433e5ad3 in ?? ()
33 LWP 10429 "rpc worker-1042" 0x00007fd6433e5ad3 in ?? ()
34 LWP 10430 "rpc worker-1043" 0x00007fd6433e5ad3 in ?? ()
35 LWP 10431 "rpc worker-1043" 0x00007fd6433e5ad3 in ?? ()
36 LWP 10432 "rpc worker-1043" 0x00007fd6433e5ad3 in ?? ()
37 LWP 10433 "rpc worker-1043" 0x00007fd6433e5ad3 in ?? ()
38 LWP 10434 "rpc worker-1043" 0x00007fd6433e5ad3 in ?? ()
39 LWP 10435 "rpc worker-1043" 0x00007fd6433e5ad3 in ?? ()
40 LWP 10436 "rpc worker-1043" 0x00007fd6433e5ad3 in ?? ()
41 LWP 10437 "rpc worker-1043" 0x00007fd6433e5ad3 in ?? ()
42 LWP 10438 "rpc worker-1043" 0x00007fd6433e5ad3 in ?? ()
43 LWP 10439 "rpc worker-1043" 0x00007fd6433e5ad3 in ?? ()
44 LWP 10440 "rpc worker-1044" 0x00007fd6433e5ad3 in ?? ()
45 LWP 10441 "rpc worker-1044" 0x00007fd6433e5ad3 in ?? ()
46 LWP 10442 "rpc worker-1044" 0x00007fd6433e5ad3 in ?? ()
47 LWP 10443 "rpc worker-1044" 0x00007fd6433e5ad3 in ?? ()
48 LWP 10444 "rpc worker-1044" 0x00007fd6433e5ad3 in ?? ()
49 LWP 10445 "rpc worker-1044" 0x00007fd6433e5ad3 in ?? ()
50 LWP 10446 "rpc worker-1044" 0x00007fd6433e5ad3 in ?? ()
51 LWP 10447 "rpc worker-1044" 0x00007fd6433e5ad3 in ?? ()
52 LWP 10448 "rpc worker-1044" 0x00007fd6433e5ad3 in ?? ()
53 LWP 10449 "rpc worker-1044" 0x00007fd6433e5ad3 in ?? ()
54 LWP 10450 "rpc worker-1045" 0x00007fd6433e5ad3 in ?? ()
55 LWP 10451 "rpc worker-1045" 0x00007fd6433e5ad3 in ?? ()
56 LWP 10452 "rpc worker-1045" 0x00007fd6433e5ad3 in ?? ()
57 LWP 10453 "rpc worker-1045" 0x00007fd6433e5ad3 in ?? ()
58 LWP 10454 "rpc worker-1045" 0x00007fd6433e5ad3 in ?? ()
59 LWP 10455 "rpc worker-1045" 0x00007fd6433e5ad3 in ?? ()
60 LWP 10456 "rpc worker-1045" 0x00007fd6433e5ad3 in ?? ()
61 LWP 10457 "rpc worker-1045" 0x00007fd6433e5ad3 in ?? ()
62 LWP 10458 "rpc worker-1045" 0x00007fd6433e5ad3 in ?? ()
63 LWP 10459 "rpc worker-1045" 0x00007fd6433e5ad3 in ?? ()
64 LWP 10460 "rpc worker-1046" 0x00007fd6433e5ad3 in ?? ()
65 LWP 10461 "rpc worker-1046" 0x00007fd6433e5ad3 in ?? ()
66 LWP 10462 "rpc worker-1046" 0x00007fd6433e5ad3 in ?? ()
67 LWP 10463 "rpc worker-1046" 0x00007fd6433e5ad3 in ?? ()
68 LWP 10464 "rpc worker-1046" 0x00007fd6433e5ad3 in ?? ()
69 LWP 10465 "rpc worker-1046" 0x00007fd6433e5ad3 in ?? ()
70 LWP 10466 "rpc worker-1046" 0x00007fd6433e5ad3 in ?? ()
71 LWP 10467 "rpc worker-1046" 0x00007fd6433e5ad3 in ?? ()
72 LWP 10468 "rpc worker-1046" 0x00007fd6433e5ad3 in ?? ()
73 LWP 10469 "rpc worker-1046" 0x00007fd6433e5ad3 in ?? ()
74 LWP 10470 "rpc worker-1047" 0x00007fd6433e5ad3 in ?? ()
75 LWP 10471 "rpc worker-1047" 0x00007fd6433e5ad3 in ?? ()
76 LWP 10472 "rpc worker-1047" 0x00007fd6433e5ad3 in ?? ()
77 LWP 10473 "rpc worker-1047" 0x00007fd6433e5ad3 in ?? ()
78 LWP 10474 "rpc worker-1047" 0x00007fd6433e5ad3 in ?? ()
79 LWP 10475 "rpc worker-1047" 0x00007fd6433e5ad3 in ?? ()
80 LWP 10476 "rpc worker-1047" 0x00007fd6433e5ad3 in ?? ()
81 LWP 10477 "rpc worker-1047" 0x00007fd6433e5ad3 in ?? ()
82 LWP 10478 "rpc worker-1047" 0x00007fd6433e5ad3 in ?? ()
83 LWP 10479 "rpc worker-1047" 0x00007fd6433e5ad3 in ?? ()
84 LWP 10480 "rpc worker-1048" 0x00007fd6433e5ad3 in ?? ()
85 LWP 10481 "rpc worker-1048" 0x00007fd6433e5ad3 in ?? ()
86 LWP 10482 "rpc worker-1048" 0x00007fd6433e5ad3 in ?? ()
87 LWP 10483 "rpc worker-1048" 0x00007fd6433e5ad3 in ?? ()
88 LWP 10484 "rpc worker-1048" 0x00007fd6433e5ad3 in ?? ()
89 LWP 10485 "rpc worker-1048" 0x00007fd6433e5ad3 in ?? ()
90 LWP 10486 "rpc worker-1048" 0x00007fd6433e5ad3 in ?? ()
91 LWP 10487 "rpc worker-1048" 0x00007fd6433e5ad3 in ?? ()
92 LWP 10488 "rpc worker-1048" 0x00007fd6433e5ad3 in ?? ()
93 LWP 10489 "rpc worker-1048" 0x00007fd6433e5ad3 in ?? ()
94 LWP 10490 "rpc worker-1049" 0x00007fd6433e5ad3 in ?? ()
95 LWP 10491 "rpc worker-1049" 0x00007fd6433e5ad3 in ?? ()
96 LWP 10492 "rpc worker-1049" 0x00007fd6433e5ad3 in ?? ()
97 LWP 10493 "rpc worker-1049" 0x00007fd6433e5ad3 in ?? ()
98 LWP 10494 "rpc worker-1049" 0x00007fd6433e5ad3 in ?? ()
99 LWP 10495 "rpc worker-1049" 0x00007fd6433e5ad3 in ?? ()
100 LWP 10496 "rpc worker-1049" 0x00007fd6433e5ad3 in ?? ()
101 LWP 10497 "rpc worker-1049" 0x00007fd6433e5ad3 in ?? ()
102 LWP 10498 "rpc worker-1049" 0x00007fd6433e5ad3 in ?? ()
103 LWP 10499 "rpc worker-1049" 0x00007fd6433e5ad3 in ?? ()
104 LWP 10500 "rpc worker-1050" 0x00007fd6433e5ad3 in ?? ()
105 LWP 10501 "rpc worker-1050" 0x00007fd6433e5ad3 in ?? ()
106 LWP 10502 "rpc worker-1050" 0x00007fd6433e5ad3 in ?? ()
107 LWP 10503 "rpc worker-1050" 0x00007fd6433e5ad3 in ?? ()
108 LWP 10504 "rpc worker-1050" 0x00007fd6433e5ad3 in ?? ()
109 LWP 10505 "rpc worker-1050" 0x00007fd6433e5ad3 in ?? ()
110 LWP 10506 "rpc worker-1050" 0x00007fd6433e5ad3 in ?? ()
111 LWP 10507 "rpc worker-1050" 0x00007fd6433e5ad3 in ?? ()
112 LWP 10508 "rpc worker-1050" 0x00007fd6433e5ad3 in ?? ()
113 LWP 10509 "rpc worker-1050" 0x00007fd6433e5ad3 in ?? ()
114 LWP 10510 "rpc worker-1051" 0x00007fd6433e5ad3 in ?? ()
115 LWP 10511 "rpc worker-1051" 0x00007fd6433e5ad3 in ?? ()
116 LWP 10512 "rpc worker-1051" 0x00007fd6433e5ad3 in ?? ()
117 LWP 10513 "diag-logger-105" 0x00007fd6433e5fb9 in ?? ()
118 LWP 10514 "result-tracker-" 0x00007fd6433e5fb9 in ?? ()
119 LWP 10515 "excess-log-dele" 0x00007fd6433e5fb9 in ?? ()
120 LWP 10516 "acceptor-10516" 0x00007fd63be50fc7 in ?? ()
121 LWP 10517 "heartbeat-10517" 0x00007fd6433e5fb9 in ?? ()
122 LWP 10518 "maintenance_sch" 0x00007fd6433e5fb9 in ?? ()
123 LWP 10740 "wal-append [wor" 0x00007fd6433e5fb9 in ?? ()
124 LWP 10820 "raft [worker]-1" 0x00007fd6433e5fb9 in ?? ()
Thread 124 (LWP 10820):
#0 0x00007fd6433e5fb9 in ?? ()
#1 0x0000000045e0360e in ?? ()
#2 0x000000000000009b in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x00007fd5f2946bc0 in ?? ()
#5 0x00007fd5f2946850 in ?? ()
#6 0x0000000000000136 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 123 (LWP 10740):
#0 0x00007fd6433e5fb9 in ?? ()
#1 0x00006020002dd8d8 in ?? ()
#2 0x0000000000000732 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061a000334fb0 in ?? ()
#5 0x00007fd5f41cf130 in ?? ()
#6 0x0000000000000e64 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 122 (LWP 10518):
#0 0x00007fd6433e5fb9 in ?? ()
#1 0x00007fd5f78cc700 in ?? ()
#2 0x0000000000000047 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061600001a2a0 in ?? ()
#5 0x00007fd5f78cc750 in ?? ()
#6 0x000000000000008e in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 121 (LWP 10517):
#0 0x00007fd6433e5fb9 in ?? ()
#1 0xb8b5f76eeb459325 in ?? ()
#2 0x0000000000000013 in ?? ()
#3 0x0000000100000081 in ?? ()
#4 0x0000613000021044 in ?? ()
#5 0x00007fd5f80e4610 in ?? ()
#6 0x0000000000000027 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x00007fd5f80e4630 in ?? ()
#9 0x0000000200000000 in ?? ()
#10 0x0000008000000189 in ?? ()
#11 0x00007fd5f80e46b0 in ?? ()
#12 0x00000ffabf01c8d8 in ?? ()
#13 0x0000000000000000 in ?? ()
Thread 120 (LWP 10516):
#0 0x00007fd63be50fc7 in ?? ()
#1 0x00006080002ec090 in ?? ()
#2 0x0000000000322c2c in ?? ()
#3 0x000000000000005c in ?? ()
#4 0x00007fd5f890bea0 in ?? ()
#5 0x00007fd5f890bd90 in ?? ()
#6 0x00007fd5f890be00 in ?? ()
#7 0x0000000000000080 in ?? ()
#8 0x00000000002cf00b in ?? ()
#9 0x00007fd5f80ecdd0 in ?? ()
#10 0x0000000000354e67 in __FRAME_END__ ()
#11 0x000000000039fc60 in ?? ()
#12 0x0000000000046ca2 in ?? ()
#13 0x0000000000000000 in ?? ()
Thread 119 (LWP 10515):
#0 0x00007fd6433e5fb9 in ?? ()
#1 0x00007fd5f9124f60 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 118 (LWP 10514):
#0 0x00007fd6433e5fb9 in ?? ()
#1 0x00007fd5f993e120 in ?? ()
#2 0x0000000000000011 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061100008edf0 in ?? ()
#5 0x00007fd5f993e110 in ?? ()
#6 0x0000000000000022 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 117 (LWP 10513):
#0 0x00007fd6433e5fb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 116 (LWP 10512):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000003 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d0002b004c in ?? ()
#4 0x00007fd5fa96def0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fd5fa96df10 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0002b0000 in ?? ()
#9 0x00007fd6433e5770 in ?? ()
#10 0x00007fd5fa96df10 in ?? ()
#11 0x00007fd5fa96ded0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 115 (LWP 10511):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000009 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d0002a685c in ?? ()
#4 0x00007fd5fb185ef0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fd5fb185f10 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0002a6810 in ?? ()
#9 0x00007fd6433e5770 in ?? ()
#10 0x00007fd5fb185f10 in ?? ()
#11 0x00007fd5fb185ed0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 114 (LWP 10510):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 113 (LWP 10509):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 112 (LWP 10508):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 111 (LWP 10507):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 110 (LWP 10506):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 109 (LWP 10505):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 108 (LWP 10504):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 107 (LWP 10503):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 106 (LWP 10502):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 105 (LWP 10501):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 104 (LWP 10500):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 103 (LWP 10499):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 102 (LWP 10498):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 101 (LWP 10497):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 100 (LWP 10496):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 99 (LWP 10495):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 98 (LWP 10494):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 97 (LWP 10493):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 96 (LWP 10492):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 95 (LWP 10491):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 94 (LWP 10490):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 93 (LWP 10489):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 92 (LWP 10488):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 91 (LWP 10487):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 90 (LWP 10486):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 89 (LWP 10485):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 88 (LWP 10484):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 87 (LWP 10483):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 86 (LWP 10482):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 85 (LWP 10481):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 84 (LWP 10480):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 83 (LWP 10479):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 82 (LWP 10478):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 81 (LWP 10477):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 80 (LWP 10476):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 79 (LWP 10475):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 78 (LWP 10474):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 77 (LWP 10473):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 76 (LWP 10472):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000008 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d0001ad088 in ?? ()
#4 0x00007fd60ed3eef0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fd60ed3ef10 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 75 (LWP 10471):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 74 (LWP 10470):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 73 (LWP 10469):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 72 (LWP 10468):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 71 (LWP 10467):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 70 (LWP 10466):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 69 (LWP 10465):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 68 (LWP 10464):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 67 (LWP 10463):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 66 (LWP 10462):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 65 (LWP 10461):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 64 (LWP 10460):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 63 (LWP 10459):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 62 (LWP 10458):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 61 (LWP 10457):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 60 (LWP 10456):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 59 (LWP 10455):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 58 (LWP 10454):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 57 (LWP 10453):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 56 (LWP 10452):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000003 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00012683c in ?? ()
#4 0x00007fd618f1fef0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fd618f1ff10 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0001267f0 in ?? ()
#9 0x00007fd6433e5770 in ?? ()
#10 0x00007fd618f1ff10 in ?? ()
#11 0x00007fd618f1fed0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 55 (LWP 10451):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 54 (LWP 10450):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 53 (LWP 10449):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 52 (LWP 10448):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 51 (LWP 10447):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 50 (LWP 10446):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 49 (LWP 10445):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 48 (LWP 10444):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 47 (LWP 10443):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 46 (LWP 10442):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 45 (LWP 10441):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 44 (LWP 10440):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 43 (LWP 10439):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 42 (LWP 10438):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 41 (LWP 10437):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 40 (LWP 10436):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 39 (LWP 10435):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 38 (LWP 10434):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 37 (LWP 10433):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 36 (LWP 10432):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x00000000000001cf in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d0000a67ec in ?? ()
#4 0x00007fd623100ef0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fd623100f10 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0000a67a0 in ?? ()
#9 0x00007fd6433e5770 in ?? ()
#10 0x00007fd623100f10 in ?? ()
#11 0x00007fd623100ed0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 35 (LWP 10431):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x000000000000022d in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00009ffec in ?? ()
#4 0x00007fd623918ef0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fd623918f10 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d00009ffa0 in ?? ()
#9 0x00007fd6433e5770 in ?? ()
#10 0x00007fd623918f10 in ?? ()
#11 0x00007fd623918ed0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 34 (LWP 10430):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x000000000000002f in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d0000967fc in ?? ()
#4 0x00007fd624130ef0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fd624130f10 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0000967b0 in ?? ()
#9 0x00007fd6433e5770 in ?? ()
#10 0x00007fd624130f10 in ?? ()
#11 0x00007fd624130ed0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 33 (LWP 10429):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 32 (LWP 10428):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 31 (LWP 10427):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 30 (LWP 10426):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 29 (LWP 10425):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 28 (LWP 10424):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 27 (LWP 10423):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 26 (LWP 10422):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 25 (LWP 10421):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 24 (LWP 10420):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 23 (LWP 10419):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 22 (LWP 10418):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 21 (LWP 10417):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 20 (LWP 10416):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 19 (LWP 10415):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 18 (LWP 10414):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 17 (LWP 10413):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 16 (LWP 10412):
#0 0x00007fd6433e5fb9 in ?? ()
#1 0x00007fd62d2a1ce0 in ?? ()
#2 0x0000000000000001 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x0000613000021fe0 in ?? ()
#5 0x00007fd62d2a1cd0 in ?? ()
#6 0x0000000000000002 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 15 (LWP 10411):
#0 0x00007fd6433e5fb9 in ?? ()
#1 0x4008000000000000 in ?? ()
#2 0x0000000000000003 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x0000614000021e98 in ?? ()
#5 0x00007fd62daa3270 in ?? ()
#6 0x0000000000000006 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 14 (LWP 10409):
#0 0x00007fd6433e5fb9 in ?? ()
#1 0x00007fd62eaa4260 in ?? ()
#2 0x0000000000000001 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061800000d5a8 in ?? ()
#5 0x00007fd62eaa4250 in ?? ()
#6 0x0000000000000002 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 13 (LWP 10408):
#0 0x00007fd6433e5ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 12 (LWP 10407):
#0 0x00007fd63be4f947 in ?? ()
#1 0x00007fd62faa7340 in ?? ()
#2 0x000061a00000c680 in ?? ()
#3 0x00007fd62faa7330 in ?? ()
#4 0x00007fd62faa7540 in ?? ()
#5 0x00007fd62faa7380 in ?? ()
#6 0x0000615000012d10 in ?? ()
#7 0x00007fd62faa7400 in ?? ()
#8 0x00007fd63e06c25d in ?? ()
#9 0x3fb98549a7120000 in ?? ()
#10 0x000061a00000c680 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000c680 in ?? ()
#13 0x0000000046d8fa90 in ?? ()
#14 0x00007fd600000000 in ?? ()
#15 0x41dabf190e1752ed in ?? ()
#16 0x00000ffb45f4ce80 in ?? ()
#17 0x00007fd62faa73e0 in ?? ()
#18 0x00007fd63e070ba3 in ?? ()
#19 0x00007fd62faa73b0 in ?? ()
#20 0x3fb98549a7120000 in ?? ()
#21 0x000000002faa7400 in ?? ()
#22 0x000061a00000c680 in ?? ()
#23 0x0000615000012d10 in ?? ()
#24 0x3fb98549a7120000 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 11 (LWP 10406):
#0 0x00007fd63be4f947 in ?? ()
#1 0x00007fd6302a8340 in ?? ()
#2 0x000061a00000c080 in ?? ()
#3 0x00007fd6302a8330 in ?? ()
#4 0x00007fd6302a8540 in ?? ()
#5 0x00007fd6302a8380 in ?? ()
#6 0x0000615000012810 in ?? ()
#7 0x00007fd6302a8400 in ?? ()
#8 0x00007fd63e06c25d in ?? ()
#9 0x3f94fa197aa20000 in ?? ()
#10 0x000061a00000c080 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000c080 in ?? ()
#13 0x0000000046d8fa90 in ?? ()
#14 0x00007fd600000000 in ?? ()
#15 0x41dabf190e1752ee in ?? ()
#16 0x00000ffb4604d080 in ?? ()
#17 0x00007fd6302a83e0 in ?? ()
#18 0x00007fd63e070ba3 in ?? ()
#19 0x00007fd6302a83b0 in ?? ()
#20 0x3f94fa197aa20000 in ?? ()
#21 0x00000000302a8400 in ?? ()
#22 0x000061a00000c080 in ?? ()
#23 0x0000615000012810 in ?? ()
#24 0x3f94fa197aa20000 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 10 (LWP 10405):
#0 0x00007fd63be4f947 in ?? ()
#1 0x00007fd630aa9340 in ?? ()
#2 0x000061a00000ba80 in ?? ()
#3 0x00007fd630aa9330 in ?? ()
#4 0x00007fd630aa9540 in ?? ()
#5 0x00007fd630aa9380 in ?? ()
#6 0x0000615000012310 in ?? ()
#7 0x00007fd630aa9400 in ?? ()
#8 0x00007fd63e06c25d in ?? ()
#9 0x3f9306f886360000 in ?? ()
#10 0x000061a00000ba80 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000ba80 in ?? ()
#13 0x0000000046d8fa90 in ?? ()
#14 0x00007fd600000000 in ?? ()
#15 0x41dabf190e1752ed in ?? ()
#16 0x00000ffb4614d280 in ?? ()
#17 0x00007fd630aa93e0 in ?? ()
#18 0x00007fd63e070ba3 in ?? ()
#19 0x00007fd630aa93b0 in ?? ()
#20 0x3f9306f886360000 in ?? ()
#21 0x0000000030aa9400 in ?? ()
#22 0x000061a00000ba80 in ?? ()
#23 0x0000615000012310 in ?? ()
#24 0x3f9306f886360000 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 9 (LWP 10404):
#0 0x00007fd63be4f947 in ?? ()
#1 0x00007fd63268d340 in ?? ()
#2 0x000061a00000b480 in ?? ()
#3 0x00007fd63268d330 in ?? ()
#4 0x00007fd63268d540 in ?? ()
#5 0x00007fd63268d380 in ?? ()
#6 0x0000615000011e10 in ?? ()
#7 0x00007fd63268d400 in ?? ()
#8 0x00007fd63e06c25d in ?? ()
#9 0x3faaee53fd560000 in ?? ()
#10 0x000061a00000b480 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000b480 in ?? ()
#13 0x0000000046d8fa90 in ?? ()
#14 0x00007fd600000000 in ?? ()
#15 0x41dabf190e1752ed in ?? ()
#16 0x00000ffb464c9a80 in ?? ()
#17 0x00007fd63268d3e0 in ?? ()
#18 0x00007fd63e070ba3 in ?? ()
#19 0x0000000000000000 in ?? ()
Thread 8 (LWP 10401):
#0 0x00007fd63be42bb9 in ?? ()
#1 0x00000000000000c8 in ?? ()
#2 0x00007fd6346b77b8 in ?? ()
#3 0x0000602000020510 in ?? ()
#4 0x0000000000000002 in ?? ()
#5 0x00000000000000c8 in ?? ()
#6 0x00000000002c6c51 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 7 (LWP 10400):
#0 0x00007fd6433e5fb9 in ?? ()
#1 0x00007fd633eb60e0 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 6 (LWP 10399):
#0 0x00007fd6433e99e2 in ?? ()
#1 0x00007fd6336b3bc0 in ?? ()
#2 0x00007fd6336b3c60 in ?? ()
#3 0x000000000000001e in ?? ()
#4 0x0000000000000030 in ?? ()
#5 0x00007fd6336b3c10 in ?? ()
#6 0x0000000000c45b60 in __sanitizer::theDepot ()
#7 0x00007fd6336b3c70 in ?? ()
#8 0x000061100008f750 in ?? ()
#9 0x00007fd6336b3c60 in ?? ()
#10 0x00000000002c1147 in ?? ()
#11 0x00007fd648e2538c in ?? ()
#12 0x00007fd648e14999 in ?? ()
#13 0x00007fd648e18f86 in ?? ()
#14 0x00007fd648e1d9c0 in ?? ()
#15 0x00007fd648e1d7e9 in ?? ()
#16 0x0000000000372c7d in __sanitizer::RoundUpTo (boundary=18446744073709551612, size=4096) at /home/jenkins-slave/workspace/build_and_test/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/asan/../sanitizer_common/sanitizer_common.h:402
#17 __sanitizer::InternalMmapVectorNoCtor<char>::Realloc (new_capacity=4096, this=0x7fd6336b33e0) at /home/jenkins-slave/workspace/build_and_test/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/asan/../sanitizer_common/sanitizer_common.h:526
#18 __sanitizer::InternalMmapVectorNoCtor<char>::reserve (new_size=4096, this=0x7fd6336b33e0) at /home/jenkins-slave/workspace/build_and_test/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/asan/../sanitizer_common/sanitizer_common.h:490
#19 __sanitizer::InternalMmapVectorNoCtor<char>::Initialize (initial_capacity=4096, this=0x7fd6336b33e0) at /home/jenkins-slave/workspace/build_and_test/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/asan/../sanitizer_common/sanitizer_common.h:450
#20 __sanitizer::InternalMmapVector<char>::InternalMmapVector (cnt=4096, this=0x7fd6336b33e0) at /home/jenkins-slave/workspace/build_and_test/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/asan/../sanitizer_common/sanitizer_common.h:558
#21 __sanitizer::InternalScopedString::InternalScopedString (max_length=4096, this=0x7fd6336b33e0) at /home/jenkins-slave/workspace/build_and_test/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/asan/../sanitizer_common/sanitizer_common.h:572
#22 __asan::DescribeAddressRelativeToGlobal (g=..., access_size=<optimized out>, addr=48) at /home/jenkins-slave/workspace/build_and_test/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/asan/asan_descriptions.cpp:279
#23 __asan::GlobalAddressDescription::Print (this=0x0, bug_type=0x7fd6433df6db "dH\211\004%0\006") at /home/jenkins-slave/workspace/build_and_test/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/asan/asan_descriptions.cpp:327
#24 0x00007fd6556f678b in ?? ()
#25 0x0000000045e0360e in ?? ()
#26 0x00007fd65560e9a9 in ?? ()
#27 0x00007fd6556f6600 in ?? ()
I20261117 14:51:00.159091 10884 raft_consensus.cc:499] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6041859320d34e679a287826f4f54fd6)
#28 0x00007fd6336b32c0 in ?? ()
#29 0x00007fd680000000 in ?? ()
#30 0x00007fd648e2c706 in ?? ()
#31 0x00007fd680000000 in ?? ()
#32 0x00007fd648e2c22e in ?? ()
I20261117 14:51:00.159332 10884 raft_consensus.cc:521] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "624366c73dc34561925e1d1b5216cf2b" member_type: VOTER last_known_addr { host: "127.6.50.132" port: 33799 } } peers { permanent_uuid: "6041859320d34e679a287826f4f54fd6" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 36371 } } peers { permanent_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 34551 } }
#33 0x00007fd6336b34e0 in ?? ()
#34 0x00000ffac66d669c in ?? ()
#35 0x00007fd6336b34b0 in ?? ()
#36 0x00007fd648e2f045 in ?? ()
#37 0x00007fd6336b3520 in ?? ()
#38 0x00007fd6336b34c0 in ?? ()
#39 0x00007fd6336b35a0 in ?? ()
#40 0x00007fd648e2e389 in ?? ()
#41 0x0000000045e0360e in ?? ()
#42 0x00007fd648db1244 in ?? ()
#43 0x00007fd648e2e2c0 in ?? ()
#44 0x00007fd6336b50c0 in ?? ()
#45 0x00006150001f19d0 in ?? ()
I20261117 14:51:00.160199 10884 leader_election.cc:290] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 624366c73dc34561925e1d1b5216cf2b (127.6.50.132:33799), 6041859320d34e679a287826f4f54fd6 (127.6.50.129:36371)
#46 0x00006150001f1880 in ?? ()
#47 0x00006150001f1a78 in ?? ()
#48 0x000060d0011d6800 in ?? ()
#49 0x00006150001f19d0 in ?? ()
#50 0x00006150001f19d0 in ?? ()
#51 0x00007fd6336b3530 in ?? ()
#52 0x00007fd648e2e426 in ?? ()
#53 0x00007fd6336b3530 in ?? ()
#54 0x000061100008f880 in ?? ()
#55 0x0000000000000000 in ?? ()
I20261117 14:51:00.160851 10608 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "a1fc825ee85f40d1aee4695db8235828" candidate_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" candidate_term: 10 candidate_status { last_received { term: 9 index: 3014 } } ignore_live_leader: false dest_uuid: "624366c73dc34561925e1d1b5216cf2b" is_pre_election: true
Thread 5 (LWP 10393):
#0 0x00007fd6433e5fb9 in ?? ()
#1 0x00007fd6356b8ca0 in ?? ()
#2 0x000000000000005a in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061200000eb28 in ?? ()
#5 0x00007fd6356b8c90 in ?? ()
#6 0x00000000000000b4 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 4 (LWP 10392):
#0 0x00007fd6433e5fb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 3 (LWP 10391):
#0 0x00007fd6433e5fb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 2 (LWP 10390):
#0 0x00007fd6433e5fb9 in ?? ()
#1 0x5f5347414c46000a in ?? ()
#2 0x0000000000000002 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x0000612000013438 in ?? ()
#5 0x00007fd636ebc450 in ?? ()
#6 0x0000000000000004 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 1 (LWP 10388):
#0 0x00007fd6433e9d50 in ?? ()
#1 0x0000000000000000 in ?? ()
I20261117 14:51:00.164945 10472 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "a1fc825ee85f40d1aee4695db8235828" candidate_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" candidate_term: 10 candidate_status { last_received { term: 9 index: 3014 } } ignore_live_leader: false dest_uuid: "6041859320d34e679a287826f4f54fd6" is_pre_election: true
I20261117 14:51:00.165921 10267 leader_election.cc:304] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa94e5d3d33a4f70b3e2c9c5f62cc9f3; no voters: 6041859320d34e679a287826f4f54fd6, 624366c73dc34561925e1d1b5216cf2b
I20261117 14:51:00.166467 10884 raft_consensus.cc:2771] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
************************* END STACKS ***************************
I20261117 14:51:00.177969 6346 external_mini_cluster-itest-base.cc:86] Attempting to dump stacks of TS 1 with UUID 39c0d031db104a9d83a434fb89d0a277 and pid 10117
************************ BEGIN STACKS **************************
[New LWP 10118]
[New LWP 10119]
[New LWP 10120]
[New LWP 10121]
[New LWP 10127]
[New LWP 10128]
[New LWP 10129]
[New LWP 10132]
[New LWP 10133]
[New LWP 10134]
[New LWP 10135]
[New LWP 10136]
[New LWP 10137]
[New LWP 10138]
[New LWP 10139]
[New LWP 10140]
[New LWP 10141]
[New LWP 10142]
[New LWP 10143]
[New LWP 10144]
[New LWP 10145]
[New LWP 10146]
[New LWP 10147]
[New LWP 10148]
[New LWP 10149]
[New LWP 10150]
[New LWP 10151]
[New LWP 10152]
[New LWP 10153]
[New LWP 10154]
[New LWP 10155]
[New LWP 10156]
[New LWP 10157]
[New LWP 10158]
[New LWP 10159]
[New LWP 10160]
[New LWP 10161]
[New LWP 10162]
[New LWP 10163]
[New LWP 10164]
[New LWP 10165]
[New LWP 10166]
[New LWP 10167]
[New LWP 10168]
[New LWP 10169]
[New LWP 10170]
[New LWP 10171]
[New LWP 10172]
[New LWP 10173]
[New LWP 10174]
[New LWP 10175]
[New LWP 10176]
[New LWP 10177]
[New LWP 10178]
[New LWP 10179]
[New LWP 10180]
[New LWP 10181]
[New LWP 10182]
[New LWP 10183]
[New LWP 10184]
[New LWP 10185]
[New LWP 10186]
[New LWP 10187]
[New LWP 10188]
[New LWP 10189]
[New LWP 10190]
[New LWP 10191]
[New LWP 10192]
[New LWP 10193]
[New LWP 10194]
[New LWP 10195]
[New LWP 10196]
[New LWP 10197]
[New LWP 10198]
[New LWP 10199]
[New LWP 10200]
[New LWP 10201]
[New LWP 10202]
[New LWP 10203]
[New LWP 10204]
[New LWP 10205]
[New LWP 10206]
[New LWP 10207]
[New LWP 10208]
[New LWP 10209]
[New LWP 10210]
[New LWP 10211]
[New LWP 10212]
[New LWP 10213]
[New LWP 10214]
[New LWP 10215]
[New LWP 10216]
[New LWP 10217]
[New LWP 10218]
[New LWP 10219]
[New LWP 10220]
[New LWP 10221]
[New LWP 10222]
[New LWP 10223]
[New LWP 10224]
[New LWP 10225]
[New LWP 10226]
[New LWP 10227]
[New LWP 10228]
[New LWP 10229]
[New LWP 10230]
[New LWP 10231]
[New LWP 10232]
[New LWP 10233]
[New LWP 10234]
[New LWP 10235]
[New LWP 10236]
[New LWP 10237]
[New LWP 10238]
[New LWP 10239]
[New LWP 10240]
[New LWP 10241]
[New LWP 10242]
[New LWP 10243]
[New LWP 10244]
[New LWP 10245]
0x00007f4696c7bd50 in ?? ()
Id Target Id Frame
* 1 LWP 10117 "kudu" 0x00007f4696c7bd50 in ?? ()
2 LWP 10118 "kudu" 0x00007f4696c77fb9 in ?? ()
3 LWP 10119 "kudu" 0x00007f4696c77fb9 in ?? ()
4 LWP 10120 "kudu" 0x00007f4696c77fb9 in ?? ()
5 LWP 10121 "kernel-watcher-" 0x00007f4696c77fb9 in ?? ()
6 LWP 10127 "ntp client-1012" 0x00007f4696c7b9e2 in ?? ()
7 LWP 10128 "file cache-evic" 0x00007f4696c77fb9 in ?? ()
8 LWP 10129 "sq_acceptor" 0x00007f468f6d4bb9 in ?? ()
9 LWP 10132 "rpc reactor-101" 0x00007f468f6e1947 in ?? ()
10 LWP 10133 "rpc reactor-101" 0x00007f468f6e1947 in ?? ()
11 LWP 10134 "rpc reactor-101" 0x00007f468f6e1947 in ?? ()
12 LWP 10135 "rpc reactor-101" 0x00007f468f6e1947 in ?? ()
13 LWP 10136 "MaintenanceMgr " 0x00007f4696c77ad3 in ?? ()
14 LWP 10137 "txn-status-mana" 0x00007f4696c77fb9 in ?? ()
15 LWP 10138 "collect_and_rem" 0x00007f4696c77fb9 in ?? ()
16 LWP 10139 "tc-session-exp-" 0x00007f4696c77fb9 in ?? ()
17 LWP 10140 "rpc worker-1014" 0x00007f4696c77ad3 in ?? ()
18 LWP 10141 "rpc worker-1014" 0x00007f4696c77ad3 in ?? ()
19 LWP 10142 "rpc worker-1014" 0x00007f4696c77ad3 in ?? ()
20 LWP 10143 "rpc worker-1014" 0x00007f4696c77ad3 in ?? ()
21 LWP 10144 "rpc worker-1014" 0x00007f4696c77ad3 in ?? ()
22 LWP 10145 "rpc worker-1014" 0x00007f4696c77ad3 in ?? ()
23 LWP 10146 "rpc worker-1014" 0x00007f4696c77ad3 in ?? ()
24 LWP 10147 "rpc worker-1014" 0x00007f4696c77ad3 in ?? ()
25 LWP 10148 "rpc worker-1014" 0x00007f4696c77ad3 in ?? ()
26 LWP 10149 "rpc worker-1014" 0x00007f4696c77ad3 in ?? ()
27 LWP 10150 "rpc worker-1015" 0x00007f4696c77ad3 in ?? ()
28 LWP 10151 "rpc worker-1015" 0x00007f4696c77ad3 in ?? ()
29 LWP 10152 "rpc worker-1015" 0x00007f4696c77ad3 in ?? ()
30 LWP 10153 "rpc worker-1015" 0x00007f4696c77ad3 in ?? ()
31 LWP 10154 "rpc worker-1015" 0x00007f4696c77ad3 in ?? ()
32 LWP 10155 "rpc worker-1015" 0x00007f4696c77ad3 in ?? ()
33 LWP 10156 "rpc worker-1015" 0x00007f4696c77ad3 in ?? ()
34 LWP 10157 "rpc worker-1015" 0x00007f4696c77ad3 in ?? ()
35 LWP 10158 "rpc worker-1015" 0x00007f4696c77ad3 in ?? ()
36 LWP 10159 "rpc worker-1015" 0x00007f4696c77ad3 in ?? ()
37 LWP 10160 "rpc worker-1016" 0x00007f4696c77ad3 in ?? ()
38 LWP 10161 "rpc worker-1016" 0x00007f4696c77ad3 in ?? ()
39 LWP 10162 "rpc worker-1016" 0x00007f4696c77ad3 in ?? ()
40 LWP 10163 "rpc worker-1016" 0x00007f4696c77ad3 in ?? ()
41 LWP 10164 "rpc worker-1016" 0x00007f4696c77ad3 in ?? ()
42 LWP 10165 "rpc worker-1016" 0x00007f4696c77ad3 in ?? ()
43 LWP 10166 "rpc worker-1016" 0x00007f4696c77ad3 in ?? ()
44 LWP 10167 "rpc worker-1016" 0x00007f4696c77ad3 in ?? ()
45 LWP 10168 "rpc worker-1016" 0x00007f4696c77ad3 in ?? ()
46 LWP 10169 "rpc worker-1016" 0x00007f4696c77ad3 in ?? ()
47 LWP 10170 "rpc worker-1017" 0x00007f4696c77ad3 in ?? ()
48 LWP 10171 "rpc worker-1017" 0x00007f4696c77ad3 in ?? ()
49 LWP 10172 "rpc worker-1017" 0x00007f4696c77ad3 in ?? ()
50 LWP 10173 "rpc worker-1017" 0x00007f4696c77ad3 in ?? ()
51 LWP 10174 "rpc worker-1017" 0x00007f4696c77ad3 in ?? ()
52 LWP 10175 "rpc worker-1017" 0x00007f4696c77ad3 in ?? ()
53 LWP 10176 "rpc worker-1017" 0x00007f4696c77ad3 in ?? ()
54 LWP 10177 "rpc worker-1017" 0x00007f4696c77ad3 in ?? ()
55 LWP 10178 "rpc worker-1017" 0x00007f4696c77ad3 in ?? ()
56 LWP 10179 "rpc worker-1017" 0x00007f4696c77ad3 in ?? ()
57 LWP 10180 "rpc worker-1018" 0x00007f4696c77ad3 in ?? ()
58 LWP 10181 "rpc worker-1018" 0x00007f4696c77ad3 in ?? ()
59 LWP 10182 "rpc worker-1018" 0x00007f4696c77ad3 in ?? ()
60 LWP 10183 "rpc worker-1018" 0x00007f4696c77ad3 in ?? ()
61 LWP 10184 "rpc worker-1018" 0x00007f4696c77ad3 in ?? ()
62 LWP 10185 "rpc worker-1018" 0x00007f4696c77ad3 in ?? ()
63 LWP 10186 "rpc worker-1018" 0x00007f4696c77ad3 in ?? ()
64 LWP 10187 "rpc worker-1018" 0x00007f4696c77ad3 in ?? ()
65 LWP 10188 "rpc worker-1018" 0x00007f4696c77ad3 in ?? ()
66 LWP 10189 "rpc worker-1018" 0x00007f4696c77ad3 in ?? ()
67 LWP 10190 "rpc worker-1019" 0x00007f4696c77ad3 in ?? ()
68 LWP 10191 "rpc worker-1019" 0x00007f4696c77ad3 in ?? ()
69 LWP 10192 "rpc worker-1019" 0x00007f4696c77ad3 in ?? ()
70 LWP 10193 "rpc worker-1019" 0x00007f4696c77ad3 in ?? ()
71 LWP 10194 "rpc worker-1019" 0x00007f4696c77ad3 in ?? ()
72 LWP 10195 "rpc worker-1019" 0x00007f4696c77ad3 in ?? ()
73 LWP 10196 "rpc worker-1019" 0x00007f4696c77ad3 in ?? ()
74 LWP 10197 "rpc worker-1019" 0x00007f4696c77ad3 in ?? ()
75 LWP 10198 "rpc worker-1019" 0x00007f4696c77ad3 in ?? ()
76 LWP 10199 "rpc worker-1019" 0x00007f4696c77ad3 in ?? ()
77 LWP 10200 "rpc worker-1020" 0x00007f4696c77ad3 in ?? ()
78 LWP 10201 "rpc worker-1020" 0x00007f4696c77ad3 in ?? ()
79 LWP 10202 "rpc worker-1020" 0x00007f4696c77ad3 in ?? ()
80 LWP 10203 "rpc worker-1020" 0x00007f4696c77ad3 in ?? ()
81 LWP 10204 "rpc worker-1020" 0x00007f4696c77ad3 in ?? ()
82 LWP 10205 "rpc worker-1020" 0x00007f4696c77ad3 in ?? ()
83 LWP 10206 "rpc worker-1020" 0x00007f4696c77ad3 in ?? ()
84 LWP 10207 "rpc worker-1020" 0x00007f4696c77ad3 in ?? ()
85 LWP 10208 "rpc worker-1020" 0x00007f4696c77ad3 in ?? ()
86 LWP 10209 "rpc worker-1020" 0x00007f4696c77ad3 in ?? ()
87 LWP 10210 "rpc worker-1021" 0x00007f4696c77ad3 in ?? ()
88 LWP 10211 "rpc worker-1021" 0x00007f4696c77ad3 in ?? ()
89 LWP 10212 "rpc worker-1021" 0x00007f4696c77ad3 in ?? ()
90 LWP 10213 "rpc worker-1021" 0x00007f4696c77ad3 in ?? ()
91 LWP 10214 "rpc worker-1021" 0x00007f4696c77ad3 in ?? ()
92 LWP 10215 "rpc worker-1021" 0x00007f4696c77ad3 in ?? ()
93 LWP 10216 "rpc worker-1021" 0x00007f4696c77ad3 in ?? ()
94 LWP 10217 "rpc worker-1021" 0x00007f4696c77ad3 in ?? ()
95 LWP 10218 "rpc worker-1021" 0x00007f4696c77ad3 in ?? ()
96 LWP 10219 "rpc worker-1021" 0x00007f4696c77ad3 in ?? ()
97 LWP 10220 "rpc worker-1022" 0x00007f4696c77ad3 in ?? ()
98 LWP 10221 "rpc worker-1022" 0x00007f4696c77ad3 in ?? ()
99 LWP 10222 "rpc worker-1022" 0x00007f4696c77ad3 in ?? ()
100 LWP 10223 "rpc worker-1022" 0x00007f4696c77ad3 in ?? ()
101 LWP 10224 "rpc worker-1022" 0x00007f4696c77ad3 in ?? ()
102 LWP 10225 "rpc worker-1022" 0x00007f4696c77ad3 in ?? ()
103 LWP 10226 "rpc worker-1022" 0x00007f4696c77ad3 in ?? ()
104 LWP 10227 "rpc worker-1022" 0x00007f4696c77ad3 in ?? ()
105 LWP 10228 "rpc worker-1022" 0x00007f4696c77ad3 in ?? ()
106 LWP 10229 "rpc worker-1022" 0x00007f4696c77ad3 in ?? ()
107 LWP 10230 "rpc worker-1023" 0x00007f4696c77ad3 in ?? ()
108 LWP 10231 "rpc worker-1023" 0x00007f4696c77ad3 in ?? ()
109 LWP 10232 "rpc worker-1023" 0x00007f4696c77ad3 in ?? ()
110 LWP 10233 "rpc worker-1023" 0x00007f4696c77ad3 in ?? ()
111 LWP 10234 "rpc worker-1023" 0x00007f4696c77ad3 in ?? ()
112 LWP 10235 "rpc worker-1023" 0x00007f4696c77ad3 in ?? ()
113 LWP 10236 "rpc worker-1023" 0x00007f4696c77ad3 in ?? ()
114 LWP 10237 "rpc worker-1023" 0x00007f4696c77ad3 in ?? ()
115 LWP 10238 "rpc worker-1023" 0x00007f4696c77ad3 in ?? ()
116 LWP 10239 "rpc worker-1023" 0x00007f4696c77ad3 in ?? ()
117 LWP 10240 "diag-logger-102" 0x00007f4696c77fb9 in ?? ()
118 LWP 10241 "result-tracker-" 0x00007f4696c77fb9 in ?? ()
119 LWP 10242 "excess-log-dele" 0x00007f4696c77fb9 in ?? ()
120 LWP 10243 "acceptor-10243" 0x00007f468f6e2fc7 in ?? ()
121 LWP 10244 "heartbeat-10244" 0x00007f4696c77fb9 in ?? ()
122 LWP 10245 "maintenance_sch" 0x00007f4696c77fb9 in ?? ()
Thread 122 (LWP 10245):
#0 0x00007f4696c77fb9 in ?? ()
#1 0x00007f464b9b6700 in ?? ()
#2 0x0000000000000052 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061600001a2a0 in ?? ()
#5 0x00007f464b9b6750 in ?? ()
#6 0x00000000000000a4 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 121 (LWP 10244):
#0 0x00007f4696c77fb9 in ?? ()
#1 0xb8b5f76eeb459325 in ?? ()
#2 0x0000000000000014 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x0000613000021040 in ?? ()
#5 0x00007f464c1ce610 in ?? ()
#6 0x0000000000000028 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 120 (LWP 10243):
#0 0x00007f468f6e2fc7 in ?? ()
#1 0x00006080002cc090 in ?? ()
#2 0x0000000000322c2c in ?? ()
#3 0x000000000000005c in ?? ()
#4 0x00007f464c9f5ea0 in ?? ()
#5 0x00007f464c9f5d90 in ?? ()
#6 0x00007f464c9f5e00 in ?? ()
#7 0x0000000000000080 in ?? ()
#8 0x00000000002cf00b in ?? ()
#9 0x00007f464a985298 in ?? ()
#10 0x0000000000354e67 in __FRAME_END__ ()
#11 0x000000000039fc60 in ?? ()
#12 0x0000000000078fda in ?? ()
#13 0x0000000000000000 in ?? ()
Thread 119 (LWP 10242):
#0 0x00007f4696c77fb9 in ?? ()
#1 0x00007f464d20ff60 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 118 (LWP 10241):
#0 0x00007f4696c77fb9 in ?? ()
#1 0x00007f464da28120 in ?? ()
#2 0x0000000000000014 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061100008edf0 in ?? ()
#5 0x00007f464da28110 in ?? ()
#6 0x0000000000000028 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 117 (LWP 10240):
#0 0x00007f4696c77fb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 116 (LWP 10239):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000007 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d0002a685c in ?? ()
#4 0x00007f464ea67ef0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f464ea67f10 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0002a6810 in ?? ()
#9 0x00007f4696c77770 in ?? ()
#10 0x00007f464ea67f10 in ?? ()
#11 0x00007f464ea67ed0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 115 (LWP 10238):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000005 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d0002a005c in ?? ()
#4 0x00007f464f27fef0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f464f27ff10 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0002a0010 in ?? ()
#9 0x00007f4696c77770 in ?? ()
#10 0x00007f464f27ff10 in ?? ()
#11 0x00007f464f27fed0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 114 (LWP 10237):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 113 (LWP 10236):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 112 (LWP 10235):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 111 (LWP 10234):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 110 (LWP 10233):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 109 (LWP 10232):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 108 (LWP 10231):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 107 (LWP 10230):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 106 (LWP 10229):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 105 (LWP 10228):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 104 (LWP 10227):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 103 (LWP 10226):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 102 (LWP 10225):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 101 (LWP 10224):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 100 (LWP 10223):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 99 (LWP 10222):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 98 (LWP 10221):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 97 (LWP 10220):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 96 (LWP 10219):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 95 (LWP 10218):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 94 (LWP 10217):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 93 (LWP 10216):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 92 (LWP 10215):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 91 (LWP 10214):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 90 (LWP 10213):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 89 (LWP 10212):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 88 (LWP 10211):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 87 (LWP 10210):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 86 (LWP 10209):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 85 (LWP 10208):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 84 (LWP 10207):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 83 (LWP 10206):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 82 (LWP 10205):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 81 (LWP 10204):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 80 (LWP 10203):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 79 (LWP 10202):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 78 (LWP 10201):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 77 (LWP 10200):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 76 (LWP 10199):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000003 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d0001a688c in ?? ()
#4 0x00007f4662e28ef0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f4662e28f10 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0001a6840 in ?? ()
#9 0x00007f4696c77770 in ?? ()
#10 0x00007f4662e28f10 in ?? ()
#11 0x00007f4662e28ed0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 75 (LWP 10198):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 74 (LWP 10197):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 73 (LWP 10196):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 72 (LWP 10195):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 71 (LWP 10194):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 70 (LWP 10193):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 69 (LWP 10192):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 68 (LWP 10191):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 67 (LWP 10190):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 66 (LWP 10189):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 65 (LWP 10188):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 64 (LWP 10187):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 63 (LWP 10186):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 62 (LWP 10185):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 61 (LWP 10184):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 60 (LWP 10183):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 59 (LWP 10182):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 58 (LWP 10181):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 57 (LWP 10180):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 56 (LWP 10179):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000003 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00012003c in ?? ()
#4 0x00007f466d009ef0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f466d009f10 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d00011fff0 in ?? ()
#9 0x00007f4696c77770 in ?? ()
#10 0x00007f466d009f10 in ?? ()
#11 0x00007f466d009ed0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 55 (LWP 10178):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 54 (LWP 10177):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 53 (LWP 10176):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 52 (LWP 10175):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 51 (LWP 10174):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 50 (LWP 10173):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 49 (LWP 10172):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 48 (LWP 10171):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 47 (LWP 10170):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 46 (LWP 10169):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 45 (LWP 10168):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 44 (LWP 10167):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 43 (LWP 10166):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 42 (LWP 10165):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 41 (LWP 10164):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 40 (LWP 10163):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 39 (LWP 10162):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 38 (LWP 10161):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 37 (LWP 10160):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 36 (LWP 10159):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000003 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00009ffec in ?? ()
#4 0x00007f46771eaef0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f46771eaf10 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d00009ffa0 in ?? ()
#9 0x00007f4696c77770 in ?? ()
#10 0x00007f46771eaf10 in ?? ()
#11 0x00007f46771eaed0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 35 (LWP 10158):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 34 (LWP 10157):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 33 (LWP 10156):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 32 (LWP 10155):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 31 (LWP 10154):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 30 (LWP 10153):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 29 (LWP 10152):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 28 (LWP 10151):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 27 (LWP 10150):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 26 (LWP 10149):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 25 (LWP 10148):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 24 (LWP 10147):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 23 (LWP 10146):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 22 (LWP 10145):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 21 (LWP 10144):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 20 (LWP 10143):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 19 (LWP 10142):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 18 (LWP 10141):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 17 (LWP 10140):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 16 (LWP 10139):
#0 0x00007f4696c77fb9 in ?? ()
#1 0x00007f46813e3ce0 in ?? ()
#2 0x0000000000000002 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x00006130000218e0 in ?? ()
#5 0x00007f46813e3cd0 in ?? ()
#6 0x0000000000000004 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 15 (LWP 10138):
#0 0x00007f4696c77fb9 in ?? ()
#1 0x4008000000000000 in ?? ()
#2 0x0000000000000004 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x0000614000021e98 in ?? ()
#5 0x00007f4681c0b270 in ?? ()
#6 0x0000000000000008 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 14 (LWP 10137):
#0 0x00007f4696c77fb9 in ?? ()
#1 0x00007f4682421260 in ?? ()
#2 0x0000000000000002 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061800000d5a8 in ?? ()
#5 0x00007f4682421250 in ?? ()
#6 0x0000000000000004 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 13 (LWP 10136):
#0 0x00007f4696c77ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 12 (LWP 10135):
#0 0x00007f468f6e1947 in ?? ()
#1 0x00007f4683470340 in ?? ()
#2 0x000061a00000c680 in ?? ()
#3 0x00007f4683470330 in ?? ()
#4 0x00007f4683470540 in ?? ()
#5 0x00007f4683470380 in ?? ()
#6 0x0000615000012d10 in ?? ()
#7 0x00007f4683470400 in ?? ()
#8 0x00007f46918fe25d in ?? ()
#9 0x3fb953bf11304000 in ?? ()
#10 0x000061a00000c680 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000c680 in ?? ()
#13 0x000000009a621a90 in ?? ()
#14 0x00007f4600000000 in ?? ()
#15 0x41dabf190e1752f0 in ?? ()
#16 0x00000fe950686080 in ?? ()
#17 0x00007f46834703e0 in ?? ()
#18 0x00007f4691902ba3 in ?? ()
#19 0x00007f46834703b0 in ?? ()
#20 0x3fb953bf11304000 in ?? ()
#21 0x0000000083470400 in ?? ()
#22 0x000061a00000c680 in ?? ()
#23 0x0000615000012d10 in ?? ()
#24 0x3fb953bf11304000 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 11 (LWP 10134):
#0 0x00007f468f6e1947 in ?? ()
#1 0x00007f4683c87340 in ?? ()
#2 0x000061a00000c080 in ?? ()
#3 0x00007f4683c87330 in ?? ()
#4 0x00007f4683c87540 in ?? ()
#5 0x00007f4683c87380 in ?? ()
#6 0x0000615000012810 in ?? ()
#7 0x00007f4683c87400 in ?? ()
#8 0x00007f46918fe25d in ?? ()
#9 0x3fb95227323d0000 in ?? ()
#10 0x000061a00000c080 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000c080 in ?? ()
#13 0x000000009a621a90 in ?? ()
#14 0x00007f4600000000 in ?? ()
#15 0x41dabf190e1752ed in ?? ()
#16 0x00000fe950788e80 in ?? ()
#17 0x00007f4683c873e0 in ?? ()
#18 0x00007f4691902ba3 in ?? ()
#19 0x00007f4683c873b0 in ?? ()
#20 0x3fb95227323d0000 in ?? ()
#21 0x0000000083c87400 in ?? ()
#22 0x000061a00000c080 in ?? ()
#23 0x0000615000012810 in ?? ()
#24 0x3fb95227323d0000 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 10 (LWP 10133):
#0 0x00007f468f6e1947 in ?? ()
#1 0x00007f468449e340 in ?? ()
#2 0x000061a00000ba80 in ?? ()
#3 0x00007f468449e330 in ?? ()
#4 0x00007f468449e540 in ?? ()
#5 0x00007f468449e380 in ?? ()
#6 0x0000615000012310 in ?? ()
#7 0x00007f468449e400 in ?? ()
#8 0x00007f46918fe25d in ?? ()
#9 0x3fb98e006b178000 in ?? ()
#10 0x000061a00000ba80 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000ba80 in ?? ()
#13 0x000000009a621a90 in ?? ()
#14 0x00007f4600000000 in ?? ()
#15 0x41dabf190e1752ee in ?? ()
#16 0x00000fe95088bc80 in ?? ()
#17 0x00007f468449e3e0 in ?? ()
#18 0x00007f4691902ba3 in ?? ()
#19 0x00007f468449e3b0 in ?? ()
#20 0x3fb98e006b178000 in ?? ()
#21 0x000000008449e400 in ?? ()
#22 0x000061a00000ba80 in ?? ()
#23 0x0000615000012310 in ?? ()
#24 0x3fb98e006b178000 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 9 (LWP 10132):
#0 0x00007f468f6e1947 in ?? ()
#1 0x00007f46864ad340 in ?? ()
#2 0x000061a00000b480 in ?? ()
#3 0x00007f46864ad330 in ?? ()
#4 0x00007f46864ad540 in ?? ()
#5 0x00007f46864ad380 in ?? ()
#6 0x0000615000011e10 in ?? ()
#7 0x00007f46864ad400 in ?? ()
#8 0x00007f46918fe25d in ?? ()
#9 0x3fb957ec61394000 in ?? ()
#10 0x000061a00000b480 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000b480 in ?? ()
#13 0x000000009a621a90 in ?? ()
#14 0x00007f4600000000 in ?? ()
#15 0x41dabf190e1752ef in ?? ()
#16 0x00000fe950c8da80 in ?? ()
#17 0x00007f46864ad3e0 in ?? ()
#18 0x00007f4691902ba3 in ?? ()
#19 0x0000000000000000 in ?? ()
Thread 8 (LWP 10129):
#0 0x00007f468f6d4bb9 in ?? ()
#1 0x00000000000000c8 in ?? ()
#2 0x00007f4687eb77b8 in ?? ()
#3 0x000060200001d750 in ?? ()
#4 0x0000000000000002 in ?? ()
#5 0x00000000000000c8 in ?? ()
#6 0x00000000002c6c51 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 7 (LWP 10128):
#0 0x00007f4696c77fb9 in ?? ()
#1 0x00007f46876b60e0 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 6 (LWP 10127):
#0 0x00007f4696c7b9e2 in ?? ()
#1 0x00007f4686eb3bc0 in ?? ()
#2 0x00007f4686eb3c60 in ?? ()
#3 0x000000000000001e in ?? ()
#4 0x0000000000000030 in ?? ()
#5 0x00007f4686eb3c10 in ?? ()
#6 0x0000000000c45b60 in __sanitizer::theDepot ()
#7 0x00007f4686eb3c70 in ?? ()
#8 0x000061100008f750 in ?? ()
#9 0x00007f4686eb3c60 in ?? ()
#10 0x00000000002c1147 in ?? ()
#11 0x00007f469c6b738c in ?? ()
#12 0x00007f469c6a6999 in ?? ()
#13 0x00007f469c6aaf86 in ?? ()
#14 0x00007f469c6af9c0 in ?? ()
#15 0x00007f469c6af7e9 in ?? ()
#16 0x0000000000372c7d in __sanitizer::RoundUpTo (boundary=18446744073709551612, size=4096) at /home/jenkins-slave/workspace/build_and_test/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/asan/../sanitizer_common/sanitizer_common.h:402
#17 __sanitizer::InternalMmapVectorNoCtor<char>::Realloc (new_capacity=4096, this=0x7f4686eb33e0) at /home/jenkins-slave/workspace/build_and_test/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/asan/../sanitizer_common/sanitizer_common.h:526
#18 __sanitizer::InternalMmapVectorNoCtor<char>::reserve (new_size=4096, this=0x7f4686eb33e0) at /home/jenkins-slave/workspace/build_and_test/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/asan/../sanitizer_common/sanitizer_common.h:490
#19 __sanitizer::InternalMmapVectorNoCtor<char>::Initialize (initial_capacity=4096, this=0x7f4686eb33e0) at /home/jenkins-slave/workspace/build_and_test/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/asan/../sanitizer_common/sanitizer_common.h:450
#20 __sanitizer::InternalMmapVector<char>::InternalMmapVector (cnt=4096, this=0x7f4686eb33e0) at /home/jenkins-slave/workspace/build_and_test/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/asan/../sanitizer_common/sanitizer_common.h:558
#21 __sanitizer::InternalScopedString::InternalScopedString (max_length=4096, this=0x7f4686eb33e0) at /home/jenkins-slave/workspace/build_and_test/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/asan/../sanitizer_common/sanitizer_common.h:572
#22 __asan::DescribeAddressRelativeToGlobal (g=..., access_size=<optimized out>, addr=48) at /home/jenkins-slave/workspace/build_and_test/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/asan/asan_descriptions.cpp:279
#23 __asan::GlobalAddressDescription::Print (this=0x0, bug_type=0x7f4696c716db "dH\211\004%0\006") at /home/jenkins-slave/workspace/build_and_test/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/asan/asan_descriptions.cpp:327
#24 0x00007f46a8f8878b in ?? ()
#25 0x0000000045e0360e in ?? ()
#26 0x00007f46a8ea09a9 in ?? ()
#27 0x00007f46a8f88600 in ?? ()
#28 0x00007f4686eb32c0 in ?? ()
#29 0x00007f4680000000 in ?? ()
#30 0x00007f469c6be706 in ?? ()
#31 0x00007f4680000000 in ?? ()
#32 0x00007f469c6be22e in ?? ()
#33 0x00007f4686eb34e0 in ?? ()
#34 0x00000fe8d0dd669c in ?? ()
#35 0x00007f4686eb34b0 in ?? ()
#36 0x00007f469c6be91f in ?? ()
#37 0x00007f4686eb3520 in ?? ()
#38 0x00007f4686eb34c0 in ?? ()
#39 0x00007f4686eb35a0 in ?? ()
#40 0x00007f469c6c0389 in ?? ()
#41 0x0000000045e0360e in ?? ()
#42 0x00007f469c643244 in ?? ()
#43 0x00007f469c6c02c0 in ?? ()
#44 0x00007f4686eb33c0 in ?? ()
#45 0x0000615000042528 in ?? ()
#46 0x0000615000042480 in ?? ()
#47 0x0000615000042678 in ?? ()
#48 0x0000000000326983 in GCC_except_table1291 ()
#49 0x00007f4686eb3530 in ?? ()
#50 0x000061100008f8d8 in ?? ()
#51 0x000061100008f8d8 in ?? ()
#52 0x00000c2200011f1d in ?? ()
#53 0x00000c2200011f1e in ?? ()
#54 0x000061100008f880 in ?? ()
#55 0x0000000000000000 in ?? ()
Thread 5 (LWP 10121):
#0 0x00007f4696c77fb9 in ?? ()
#1 0x00007f4688eb8ca0 in ?? ()
#2 0x0000000000000067 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061200000eb28 in ?? ()
#5 0x00007f4688eb8c90 in ?? ()
#6 0x00000000000000ce in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 4 (LWP 10120):
#0 0x00007f4696c77fb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 3 (LWP 10119):
#0 0x00007f4696c77fb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 2 (LWP 10118):
#0 0x00007f4696c77fb9 in ?? ()
#1 0x5f5347414c46000a in ?? ()
#2 0x0000000000000002 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x0000612000013438 in ?? ()
#5 0x00007f468a6bc450 in ?? ()
#6 0x0000000000000004 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 1 (LWP 10117):
#0 0x00007f4696c7bd50 in ?? ()
#1 0x0000000000000000 in ?? ()
************************* END STACKS ***************************
I20261117 14:51:01.131567 6346 external_mini_cluster-itest-base.cc:86] Attempting to dump stacks of TS 2 with UUID fa94e5d3d33a4f70b3e2c9c5f62cc9f3 and pid 10251
************************ BEGIN STACKS **************************
[New LWP 10253]
[New LWP 10254]
[New LWP 10255]
[New LWP 10256]
[New LWP 10262]
[New LWP 10263]
[New LWP 10264]
[New LWP 10267]
[New LWP 10268]
[New LWP 10269]
[New LWP 10270]
[New LWP 10271]
[New LWP 10272]
[New LWP 10274]
[New LWP 10275]
[New LWP 10276]
[New LWP 10277]
[New LWP 10278]
[New LWP 10279]
[New LWP 10280]
[New LWP 10281]
[New LWP 10282]
[New LWP 10283]
[New LWP 10284]
[New LWP 10285]
[New LWP 10286]
[New LWP 10287]
[New LWP 10288]
[New LWP 10289]
[New LWP 10290]
[New LWP 10291]
[New LWP 10292]
[New LWP 10293]
[New LWP 10294]
[New LWP 10295]
[New LWP 10296]
[New LWP 10297]
[New LWP 10298]
[New LWP 10299]
[New LWP 10300]
[New LWP 10301]
[New LWP 10302]
[New LWP 10303]
[New LWP 10304]
[New LWP 10305]
[New LWP 10306]
[New LWP 10307]
[New LWP 10308]
[New LWP 10309]
[New LWP 10310]
[New LWP 10311]
[New LWP 10312]
[New LWP 10313]
[New LWP 10314]
[New LWP 10315]
[New LWP 10316]
[New LWP 10317]
[New LWP 10318]
[New LWP 10319]
[New LWP 10320]
[New LWP 10321]
[New LWP 10322]
[New LWP 10323]
[New LWP 10324]
[New LWP 10325]
[New LWP 10326]
[New LWP 10327]
[New LWP 10328]
[New LWP 10329]
[New LWP 10330]
[New LWP 10331]
[New LWP 10332]
[New LWP 10333]
[New LWP 10334]
[New LWP 10335]
[New LWP 10336]
[New LWP 10337]
[New LWP 10338]
[New LWP 10339]
[New LWP 10340]
[New LWP 10341]
[New LWP 10342]
[New LWP 10343]
[New LWP 10344]
[New LWP 10345]
[New LWP 10346]
[New LWP 10347]
[New LWP 10348]
[New LWP 10349]
[New LWP 10350]
[New LWP 10351]
[New LWP 10352]
[New LWP 10353]
[New LWP 10354]
[New LWP 10355]
[New LWP 10356]
[New LWP 10357]
[New LWP 10358]
[New LWP 10359]
[New LWP 10360]
[New LWP 10361]
[New LWP 10362]
[New LWP 10363]
[New LWP 10364]
[New LWP 10365]
[New LWP 10366]
[New LWP 10367]
[New LWP 10368]
[New LWP 10369]
[New LWP 10370]
[New LWP 10371]
[New LWP 10372]
[New LWP 10373]
[New LWP 10374]
[New LWP 10375]
[New LWP 10376]
[New LWP 10377]
[New LWP 10378]
[New LWP 10379]
[New LWP 10380]
[New LWP 10381]
0x00007ff2894a5d50 in ?? ()
Id Target Id Frame
* 1 LWP 10251 "kudu" 0x00007ff2894a5d50 in ?? ()
2 LWP 10253 "kudu" 0x00007ff2894a1fb9 in ?? ()
3 LWP 10254 "kudu" 0x00007ff2894a1fb9 in ?? ()
4 LWP 10255 "kudu" 0x00007ff2894a1fb9 in ?? ()
5 LWP 10256 "kernel-watcher-" 0x00007ff2894a1fb9 in ?? ()
6 LWP 10262 "ntp client-1026" 0x00007ff2894a59e2 in ?? ()
7 LWP 10263 "file cache-evic" 0x00007ff2894a1fb9 in ?? ()
8 LWP 10264 "sq_acceptor" 0x00007ff281efebb9 in ?? ()
9 LWP 10267 "rpc reactor-102" 0x00007ff281f0b947 in ?? ()
10 LWP 10268 "rpc reactor-102" 0x00007ff281f0b947 in ?? ()
11 LWP 10269 "rpc reactor-102" 0x00007ff281f0b947 in ?? ()
12 LWP 10270 "rpc reactor-102" 0x00007ff281f0b947 in ?? ()
13 LWP 10271 "MaintenanceMgr " 0x00007ff2894a1ad3 in ?? ()
14 LWP 10272 "txn-status-mana" 0x00007ff2894a1fb9 in ?? ()
15 LWP 10274 "collect_and_rem" 0x00007ff2894a1fb9 in ?? ()
16 LWP 10275 "tc-session-exp-" 0x00007ff2894a1fb9 in ?? ()
17 LWP 10276 "rpc worker-1027" 0x00007ff2894a1ad3 in ?? ()
18 LWP 10277 "rpc worker-1027" 0x00007ff2894a1ad3 in ?? ()
19 LWP 10278 "rpc worker-1027" 0x00007ff2894a1ad3 in ?? ()
20 LWP 10279 "rpc worker-1027" 0x00007ff2894a1ad3 in ?? ()
21 LWP 10280 "rpc worker-1028" 0x00007ff2894a1ad3 in ?? ()
22 LWP 10281 "rpc worker-1028" 0x00007ff2894a1ad3 in ?? ()
23 LWP 10282 "rpc worker-1028" 0x00007ff2894a1ad3 in ?? ()
24 LWP 10283 "rpc worker-1028" 0x00007ff2894a1ad3 in ?? ()
25 LWP 10284 "rpc worker-1028" 0x00007ff2894a1ad3 in ?? ()
26 LWP 10285 "rpc worker-1028" 0x00007ff2894a1ad3 in ?? ()
27 LWP 10286 "rpc worker-1028" 0x00007ff2894a1ad3 in ?? ()
28 LWP 10287 "rpc worker-1028" 0x00007ff2894a1ad3 in ?? ()
29 LWP 10288 "rpc worker-1028" 0x00007ff2894a1ad3 in ?? ()
30 LWP 10289 "rpc worker-1028" 0x00007ff2894a1ad3 in ?? ()
31 LWP 10290 "rpc worker-1029" 0x00007ff2894a1ad3 in ?? ()
32 LWP 10291 "rpc worker-1029" 0x00007ff2894a1ad3 in ?? ()
33 LWP 10292 "rpc worker-1029" 0x00007ff2894a1ad3 in ?? ()
34 LWP 10293 "rpc worker-1029" 0x00007ff2894a1ad3 in ?? ()
35 LWP 10294 "rpc worker-1029" 0x00007ff2894a1ad3 in ?? ()
36 LWP 10295 "rpc worker-1029" 0x00007ff2894a1ad3 in ?? ()
37 LWP 10296 "rpc worker-1029" 0x00007ff2894a1ad3 in ?? ()
38 LWP 10297 "rpc worker-1029" 0x00007ff2894a1ad3 in ?? ()
39 LWP 10298 "rpc worker-1029" 0x00007ff2894a1ad3 in ?? ()
40 LWP 10299 "rpc worker-1029" 0x00007ff2894a1ad3 in ?? ()
41 LWP 10300 "rpc worker-1030" 0x00007ff2894a1ad3 in ?? ()
42 LWP 10301 "rpc worker-1030" 0x00007ff2894a1ad3 in ?? ()
43 LWP 10302 "rpc worker-1030" 0x00007ff2894a1ad3 in ?? ()
44 LWP 10303 "rpc worker-1030" 0x00007ff2894a1ad3 in ?? ()
45 LWP 10304 "rpc worker-1030" 0x00007ff2894a1ad3 in ?? ()
46 LWP 10305 "rpc worker-1030" 0x00007ff2894a1ad3 in ?? ()
47 LWP 10306 "rpc worker-1030" 0x00007ff2894a1ad3 in ?? ()
48 LWP 10307 "rpc worker-1030" 0x00007ff2894a1ad3 in ?? ()
49 LWP 10308 "rpc worker-1030" 0x00007ff2894a1ad3 in ?? ()
50 LWP 10309 "rpc worker-1030" 0x00007ff2894a1ad3 in ?? ()
51 LWP 10310 "rpc worker-1031" 0x00007ff2894a1ad3 in ?? ()
52 LWP 10311 "rpc worker-1031" 0x00007ff2894a1ad3 in ?? ()
53 LWP 10312 "rpc worker-1031" 0x00007ff2894a1ad3 in ?? ()
54 LWP 10313 "rpc worker-1031" 0x00007ff2894a1ad3 in ?? ()
55 LWP 10314 "rpc worker-1031" 0x00007ff2894a1ad3 in ?? ()
56 LWP 10315 "rpc worker-1031" 0x00007ff2894a1ad3 in ?? ()
57 LWP 10316 "rpc worker-1031" 0x00007ff2894a1ad3 in ?? ()
58 LWP 10317 "rpc worker-1031" 0x00007ff2894a1ad3 in ?? ()
59 LWP 10318 "rpc worker-1031" 0x00007ff2894a1ad3 in ?? ()
60 LWP 10319 "rpc worker-1031" 0x00007ff2894a1ad3 in ?? ()
61 LWP 10320 "rpc worker-1032" 0x00007ff2894a1ad3 in ?? ()
62 LWP 10321 "rpc worker-1032" 0x00007ff2894a1ad3 in ?? ()
63 LWP 10322 "rpc worker-1032" 0x00007ff2894a1ad3 in ?? ()
64 LWP 10323 "rpc worker-1032" 0x00007ff2894a1ad3 in ?? ()
65 LWP 10324 "rpc worker-1032" 0x00007ff2894a1ad3 in ?? ()
66 LWP 10325 "rpc worker-1032" 0x00007ff2894a1ad3 in ?? ()
67 LWP 10326 "rpc worker-1032" 0x00007ff2894a1ad3 in ?? ()
68 LWP 10327 "rpc worker-1032" 0x00007ff2894a1ad3 in ?? ()
69 LWP 10328 "rpc worker-1032" 0x00007ff2894a1ad3 in ?? ()
70 LWP 10329 "rpc worker-1032" 0x00007ff2894a1ad3 in ?? ()
71 LWP 10330 "rpc worker-1033" 0x00007ff2894a1ad3 in ?? ()
72 LWP 10331 "rpc worker-1033" 0x00007ff2894a1ad3 in ?? ()
73 LWP 10332 "rpc worker-1033" 0x00007ff2894a1ad3 in ?? ()
74 LWP 10333 "rpc worker-1033" 0x00007ff2894a1ad3 in ?? ()
75 LWP 10334 "rpc worker-1033" 0x00007ff2894a1ad3 in ?? ()
76 LWP 10335 "rpc worker-1033" 0x00007ff2894a1ad3 in ?? ()
77 LWP 10336 "rpc worker-1033" 0x00007ff2894a1ad3 in ?? ()
78 LWP 10337 "rpc worker-1033" 0x00007ff2894a1ad3 in ?? ()
79 LWP 10338 "rpc worker-1033" 0x00007ff2894a1ad3 in ?? ()
80 LWP 10339 "rpc worker-1033" 0x00007ff2894a1ad3 in ?? ()
81 LWP 10340 "rpc worker-1034" 0x00007ff2894a1ad3 in ?? ()
82 LWP 10341 "rpc worker-1034" 0x00007ff2894a1ad3 in ?? ()
83 LWP 10342 "rpc worker-1034" 0x00007ff2894a1ad3 in ?? ()
84 LWP 10343 "rpc worker-1034" 0x00007ff2894a1ad3 in ?? ()
85 LWP 10344 "rpc worker-1034" 0x00007ff2894a1ad3 in ?? ()
86 LWP 10345 "rpc worker-1034" 0x00007ff2894a1ad3 in ?? ()
87 LWP 10346 "rpc worker-1034" 0x00007ff2894a1ad3 in ?? ()
88 LWP 10347 "rpc worker-1034" 0x00007ff2894a1ad3 in ?? ()
89 LWP 10348 "rpc worker-1034" 0x00007ff2894a1ad3 in ?? ()
90 LWP 10349 "rpc worker-1034" 0x00007ff2894a1ad3 in ?? ()
91 LWP 10350 "rpc worker-1035" 0x00007ff2894a1ad3 in ?? ()
92 LWP 10351 "rpc worker-1035" 0x00007ff2894a1ad3 in ?? ()
93 LWP 10352 "rpc worker-1035" 0x00007ff2894a1ad3 in ?? ()
94 LWP 10353 "rpc worker-1035" 0x00007ff2894a1ad3 in ?? ()
95 LWP 10354 "rpc worker-1035" 0x00007ff2894a1ad3 in ?? ()
96 LWP 10355 "rpc worker-1035" 0x00007ff2894a1ad3 in ?? ()
97 LWP 10356 "rpc worker-1035" 0x00007ff2894a1ad3 in ?? ()
98 LWP 10357 "rpc worker-1035" 0x00007ff2894a1ad3 in ?? ()
99 LWP 10358 "rpc worker-1035" 0x00007ff2894a1ad3 in ?? ()
100 LWP 10359 "rpc worker-1035" 0x00007ff2894a1ad3 in ?? ()
101 LWP 10360 "rpc worker-1036" 0x00007ff2894a1ad3 in ?? ()
102 LWP 10361 "rpc worker-1036" 0x00007ff2894a1ad3 in ?? ()
103 LWP 10362 "rpc worker-1036" 0x00007ff2894a1ad3 in ?? ()
104 LWP 10363 "rpc worker-1036" 0x00007ff2894a1ad3 in ?? ()
105 LWP 10364 "rpc worker-1036" 0x00007ff2894a1ad3 in ?? ()
106 LWP 10365 "rpc worker-1036" 0x00007ff2894a1ad3 in ?? ()
107 LWP 10366 "rpc worker-1036" 0x00007ff2894a1ad3 in ?? ()
108 LWP 10367 "rpc worker-1036" 0x00007ff2894a1ad3 in ?? ()
109 LWP 10368 "rpc worker-1036" 0x00007ff2894a1ad3 in ?? ()
110 LWP 10369 "rpc worker-1036" 0x00007ff2894a1ad3 in ?? ()
111 LWP 10370 "rpc worker-1037" 0x00007ff2894a1ad3 in ?? ()
112 LWP 10371 "rpc worker-1037" 0x00007ff2894a1ad3 in ?? ()
113 LWP 10372 "rpc worker-1037" 0x00007ff2894a1ad3 in ?? ()
114 LWP 10373 "rpc worker-1037" 0x00007ff2894a1ad3 in ?? ()
115 LWP 10374 "rpc worker-1037" 0x00007ff2894a1ad3 in ?? ()
116 LWP 10375 "rpc worker-1037" 0x00007ff2894a1ad3 in ?? ()
117 LWP 10376 "diag-logger-103" 0x00007ff2894a1fb9 in ?? ()
118 LWP 10377 "result-tracker-" 0x00007ff2894a1fb9 in ?? ()
119 LWP 10378 "excess-log-dele" 0x00007ff2894a1fb9 in ?? ()
120 LWP 10379 "acceptor-10379" 0x00007ff281f0cfc7 in ?? ()
121 LWP 10380 "heartbeat-10380" 0x00007ff2894a1fb9 in ?? ()
122 LWP 10381 "maintenance_sch" 0x00007ff2894a1fb9 in ?? ()
Thread 122 (LWP 10381):
#0 0x00007ff2894a1fb9 in ?? ()
#1 0x00007ff23d988700 in ?? ()
#2 0x0000000000000052 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061600001a2a0 in ?? ()
#5 0x00007ff23d988750 in ?? ()
#6 0x00000000000000a4 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 121 (LWP 10380):
#0 0x00007ff2894a1fb9 in ?? ()
#1 0xb8b5f76eeb459325 in ?? ()
#2 0x0000000000000015 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x0000613000021040 in ?? ()
#5 0x00007ff23e1a0610 in ?? ()
#6 0x000000000000002a in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 120 (LWP 10379):
#0 0x00007ff281f0cfc7 in ?? ()
#1 0x00006080002f0090 in ?? ()
#2 0x0000000000322c2c in ?? ()
#3 0x000000000000005c in ?? ()
#4 0x00007ff23e9c7ea0 in ?? ()
#5 0x00007ff23e9c7d90 in ?? ()
#6 0x00007ff23e9c7e00 in ?? ()
#7 0x0000000000000080 in ?? ()
#8 0x00000000002cf00b in ?? ()
#9 0x00007ff23c955b98 in ?? ()
#10 0x0000000000354e67 in __FRAME_END__ ()
#11 0x000000000039fc60 in ?? ()
#12 0x00000000000c4c2a in ?? ()
#13 0x0000000000000000 in ?? ()
Thread 119 (LWP 10378):
#0 0x00007ff2894a1fb9 in ?? ()
#1 0x00007ff23f1e0f60 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 118 (LWP 10377):
#0 0x00007ff2894a1fb9 in ?? ()
#1 0x00007ff23f9fa120 in ?? ()
#2 0x0000000000000014 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061100008edf0 in ?? ()
#5 0x00007ff23f9fa110 in ?? ()
#6 0x0000000000000028 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 117 (LWP 10376):
#0 0x00007ff2894a1fb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 116 (LWP 10375):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000008 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d0002b0048 in ?? ()
#4 0x00007ff240a29ef0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007ff240a29f10 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 115 (LWP 10374):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000004 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d0002a6858 in ?? ()
#4 0x00007ff241241ef0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007ff241241f10 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 114 (LWP 10373):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 113 (LWP 10372):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 112 (LWP 10371):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 111 (LWP 10370):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 110 (LWP 10369):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 109 (LWP 10368):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 108 (LWP 10367):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 107 (LWP 10366):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 106 (LWP 10365):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 105 (LWP 10364):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 104 (LWP 10363):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 103 (LWP 10362):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 102 (LWP 10361):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 101 (LWP 10360):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 100 (LWP 10359):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 99 (LWP 10358):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 98 (LWP 10357):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 97 (LWP 10356):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 96 (LWP 10355):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 95 (LWP 10354):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 94 (LWP 10353):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 93 (LWP 10352):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 92 (LWP 10351):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 91 (LWP 10350):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 90 (LWP 10349):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 89 (LWP 10348):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 88 (LWP 10347):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 87 (LWP 10346):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 86 (LWP 10345):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 85 (LWP 10344):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 84 (LWP 10343):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 83 (LWP 10342):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 82 (LWP 10341):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 81 (LWP 10340):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 80 (LWP 10339):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 79 (LWP 10338):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 78 (LWP 10337):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 77 (LWP 10336):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 76 (LWP 10335):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000271 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d0001ad08c in ?? ()
#4 0x00007ff254dfaef0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007ff254dfaf10 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0001ad040 in ?? ()
#9 0x00007ff2894a1770 in ?? ()
#10 0x00007ff254dfaf10 in ?? ()
#11 0x00007ff254dfaed0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 75 (LWP 10334):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x000000000000028c in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d0001a6888 in ?? ()
#4 0x00007ff255612ef0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007ff255612f10 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 74 (LWP 10333):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x000000000000003a in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d0001a0088 in ?? ()
#4 0x00007ff255e2aef0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007ff255e2af10 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 73 (LWP 10332):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 72 (LWP 10331):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 71 (LWP 10330):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 70 (LWP 10329):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 69 (LWP 10328):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 68 (LWP 10327):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 67 (LWP 10326):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 66 (LWP 10325):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 65 (LWP 10324):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 64 (LWP 10323):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 63 (LWP 10322):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 62 (LWP 10321):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 61 (LWP 10320):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 60 (LWP 10319):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 59 (LWP 10318):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 58 (LWP 10317):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 57 (LWP 10316):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 56 (LWP 10315):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000003 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00012683c in ?? ()
#4 0x00007ff25efdbef0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007ff25efdbf10 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0001267f0 in ?? ()
#9 0x00007ff2894a1770 in ?? ()
#10 0x00007ff25efdbf10 in ?? ()
#11 0x00007ff25efdbed0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 55 (LWP 10314):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 54 (LWP 10313):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 53 (LWP 10312):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 52 (LWP 10311):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 51 (LWP 10310):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 50 (LWP 10309):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 49 (LWP 10308):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 48 (LWP 10307):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 47 (LWP 10306):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 46 (LWP 10305):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 45 (LWP 10304):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 44 (LWP 10303):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 43 (LWP 10302):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 42 (LWP 10301):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 41 (LWP 10300):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 40 (LWP 10299):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 39 (LWP 10298):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 38 (LWP 10297):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 37 (LWP 10296):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 36 (LWP 10295):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x000000000000005e in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d0000a67e8 in ?? ()
#4 0x00007ff2691bcef0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007ff2691bcf10 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 35 (LWP 10294):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000006 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d00009ffe8 in ?? ()
#4 0x00007ff2699d4ef0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007ff2699d4f10 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 34 (LWP 10293):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 33 (LWP 10292):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 32 (LWP 10291):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 31 (LWP 10290):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 30 (LWP 10289):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 29 (LWP 10288):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 28 (LWP 10287):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 27 (LWP 10286):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 26 (LWP 10285):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 25 (LWP 10284):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 24 (LWP 10283):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 23 (LWP 10282):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 22 (LWP 10281):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 21 (LWP 10280):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 20 (LWP 10279):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 19 (LWP 10278):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 18 (LWP 10277):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 17 (LWP 10276):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 16 (LWP 10275):
#0 0x00007ff2894a1fb9 in ?? ()
#1 0x00007ff2733c8ce0 in ?? ()
#2 0x0000000000000002 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x0000613000021fe0 in ?? ()
#5 0x00007ff2733c8cd0 in ?? ()
#6 0x0000000000000004 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 15 (LWP 10274):
#0 0x00007ff2894a1fb9 in ?? ()
#1 0x4008000000000000 in ?? ()
#2 0x0000000000000004 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x0000614000021e98 in ?? ()
#5 0x00007ff273c00270 in ?? ()
#6 0x0000000000000008 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 14 (LWP 10272):
#0 0x00007ff2894a1fb9 in ?? ()
#1 0x00007ff274c4d260 in ?? ()
#2 0x0000000000000002 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061800000d5a8 in ?? ()
#5 0x00007ff274c4d250 in ?? ()
#6 0x0000000000000004 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 13 (LWP 10271):
#0 0x00007ff2894a1ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 12 (LWP 10270):
#0 0x00007ff281f0b947 in ?? ()
#1 0x00007ff275c9c340 in ?? ()
#2 0x000061a00000c680 in ?? ()
#3 0x00007ff275c9c330 in ?? ()
#4 0x00007ff275c9c540 in ?? ()
#5 0x00007ff275c9c380 in ?? ()
#6 0x0000615000012d10 in ?? ()
#7 0x00007ff275c9c400 in ?? ()
#8 0x00007ff28412825d in ?? ()
#9 0x3fb95427ecbb8000 in ?? ()
#10 0x000061a00000c680 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000c680 in ?? ()
#13 0x000000008ce4ba90 in ?? ()
#14 0x00007ff200000000 in ?? ()
#15 0x41dabf190e1752ee in ?? ()
#16 0x00000ffeceb8b880 in ?? ()
#17 0x00007ff275c9c3e0 in ?? ()
#18 0x00007ff28412cba3 in ?? ()
#19 0x00007ff275c9c3b0 in ?? ()
#20 0x3fb95427ecbb8000 in ?? ()
#21 0x0000000075c9c400 in ?? ()
#22 0x000061a00000c680 in ?? ()
#23 0x0000615000012d10 in ?? ()
#24 0x3fb95427ecbb8000 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 11 (LWP 10269):
#0 0x00007ff281f0b947 in ?? ()
#1 0x00007ff2764b3340 in ?? ()
#2 0x000061a00000c080 in ?? ()
#3 0x00007ff2764b3330 in ?? ()
#4 0x00007ff2764b3540 in ?? ()
#5 0x00007ff2764b3380 in ?? ()
#6 0x0000615000012810 in ?? ()
#7 0x00007ff2764b3400 in ?? ()
#8 0x00007ff28412825d in ?? ()
#9 0x3fb992a4cc828000 in ?? ()
#10 0x000061a00000c080 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000c080 in ?? ()
#13 0x000000008ce4ba90 in ?? ()
#14 0x00007ff200000000 in ?? ()
#15 0x41dabf190e1752ec in ?? ()
#16 0x00000ffecec8e680 in ?? ()
#17 0x00007ff2764b33e0 in ?? ()
#18 0x00007ff28412cba3 in ?? ()
#19 0x00007ff2764b33b0 in ?? ()
#20 0x3fb992a4cc828000 in ?? ()
#21 0x00000000764b3400 in ?? ()
#22 0x000061a00000c080 in ?? ()
#23 0x0000615000012810 in ?? ()
#24 0x3fb992a4cc828000 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 10 (LWP 10268):
#0 0x00007ff281f0b947 in ?? ()
#1 0x00007ff276cb4340 in ?? ()
#2 0x000061a00000ba80 in ?? ()
#3 0x00007ff276cb4330 in ?? ()
#4 0x00007ff276cb4540 in ?? ()
#5 0x00007ff276cb4380 in ?? ()
#6 0x0000615000012310 in ?? ()
#7 0x00007ff276cb4400 in ?? ()
#8 0x00007ff28412825d in ?? ()
#9 0x3fb95e58d0bc8000 in ?? ()
#10 0x000061a00000ba80 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000ba80 in ?? ()
#13 0x000000008ce4ba90 in ?? ()
#14 0x00007ff200000000 in ?? ()
#15 0x41dabf190e1752ed in ?? ()
#16 0x00000ffeced8e880 in ?? ()
#17 0x00007ff276cb43e0 in ?? ()
#18 0x00007ff28412cba3 in ?? ()
#19 0x00007ff276cb43b0 in ?? ()
#20 0x3fb95e58d0bc8000 in ?? ()
#21 0x0000000076cb4400 in ?? ()
#22 0x000061a00000ba80 in ?? ()
#23 0x0000615000012310 in ?? ()
#24 0x3fb95e58d0bc8000 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 9 (LWP 10267):
#0 0x00007ff281f0b947 in ?? ()
#1 0x00007ff278cad340 in ?? ()
#2 0x000061a00000b480 in ?? ()
#3 0x00007ff278cad330 in ?? ()
#4 0x00007ff278cad540 in ?? ()
#5 0x00007ff278cad380 in ?? ()
#6 0x0000615000011e10 in ?? ()
#7 0x00007ff278cad400 in ?? ()
#8 0x00007ff28412825d in ?? ()
#9 0x3fb98cabe86f8000 in ?? ()
#10 0x000061a00000b480 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000b480 in ?? ()
#13 0x000000008ce4ba90 in ?? ()
#14 0x00007ff200000000 in ?? ()
#15 0x41dabf190e1752ee in ?? ()
#16 0x00000ffecf18da80 in ?? ()
#17 0x00007ff278cad3e0 in ?? ()
#18 0x00007ff28412cba3 in ?? ()
#19 0x0000000000000000 in ?? ()
Thread 8 (LWP 10264):
#0 0x00007ff281efebb9 in ?? ()
#1 0x00000000000000c8 in ?? ()
#2 0x00007ff27a6b77b8 in ?? ()
#3 0x0000602000020750 in ?? ()
#4 0x0000000000000002 in ?? ()
#5 0x00000000000000c8 in ?? ()
#6 0x00000000002c6c51 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 7 (LWP 10263):
#0 0x00007ff2894a1fb9 in ?? ()
#1 0x00007ff279eb60e0 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 6 (LWP 10262):
#0 0x00007ff2894a59e2 in ?? ()
#1 0x00007ff2796b3bc0 in ?? ()
#2 0x00007ff2796b3c60 in ?? ()
#3 0x000000000000001e in ?? ()
#4 0x0000000000000030 in ?? ()
#5 0x00007ff2796b3c10 in ?? ()
#6 0x0000000000c45b60 in __sanitizer::theDepot ()
#7 0x00007ff2796b3c70 in ?? ()
#8 0x000061100008f750 in ?? ()
#9 0x00007ff2796b3c60 in ?? ()
#10 0x00000000002c1147 in ?? ()
#11 0x00007ff28eee138c in ?? ()
#12 0x00007ff28eed0999 in ?? ()
#13 0x00007ff28eed4f86 in ?? ()
#14 0x00007ff28eed99c0 in ?? ()
#15 0x00007ff28eed97e9 in ?? ()
#16 0x0000000000372c7d in __sanitizer::RoundUpTo (boundary=18446744073709551612, size=4096) at /home/jenkins-slave/workspace/build_and_test/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/asan/../sanitizer_common/sanitizer_common.h:402
#17 __sanitizer::InternalMmapVectorNoCtor<char>::Realloc (new_capacity=4096, this=0x7ff2796b33e0) at /home/jenkins-slave/workspace/build_and_test/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/asan/../sanitizer_common/sanitizer_common.h:526
#18 __sanitizer::InternalMmapVectorNoCtor<char>::reserve (new_size=4096, this=0x7ff2796b33e0) at /home/jenkins-slave/workspace/build_and_test/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/asan/../sanitizer_common/sanitizer_common.h:490
#19 __sanitizer::InternalMmapVectorNoCtor<char>::Initialize (initial_capacity=4096, this=0x7ff2796b33e0) at /home/jenkins-slave/workspace/build_and_test/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/asan/../sanitizer_common/sanitizer_common.h:450
#20 __sanitizer::InternalMmapVector<char>::InternalMmapVector (cnt=4096, this=0x7ff2796b33e0) at /home/jenkins-slave/workspace/build_and_test/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/asan/../sanitizer_common/sanitizer_common.h:558
#21 __sanitizer::InternalScopedString::InternalScopedString (max_length=4096, this=0x7ff2796b33e0) at /home/jenkins-slave/workspace/build_and_test/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/asan/../sanitizer_common/sanitizer_common.h:572
#22 __asan::DescribeAddressRelativeToGlobal (g=..., access_size=<optimized out>, addr=48) at /home/jenkins-slave/workspace/build_and_test/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/asan/asan_descriptions.cpp:279
#23 __asan::GlobalAddressDescription::Print (this=0x0, bug_type=0x7ff28949b6db "dH\211\004%0\006") at /home/jenkins-slave/workspace/build_and_test/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/asan/asan_descriptions.cpp:327
#24 0x00007ff29b7b278b in ?? ()
#25 0x0000000045e0360e in ?? ()
#26 0x00007ff29b6ca9a9 in ?? ()
#27 0x00007ff29b7b2600 in ?? ()
#28 0x00007ff2796b32c0 in ?? ()
#29 0x00007ff280000000 in ?? ()
#30 0x00007ff28eee8706 in ?? ()
#31 0x00007ff280000000 in ?? ()
#32 0x00007ff28eee822e in ?? ()
#33 0x00007ff2796b34e0 in ?? ()
#34 0x00000ffe4f2d669c in ?? ()
#35 0x00007ff2796b34b0 in ?? ()
#36 0x00007ff28eee891f in ?? ()
#37 0x00007ff2796b3520 in ?? ()
#38 0x00007ff2796b34c0 in ?? ()
#39 0x00007ff2796b35a0 in ?? ()
#40 0x00007ff28eeea389 in ?? ()
#41 0x0000000045e0360e in ?? ()
#42 0x00007ff28ee6d244 in ?? ()
#43 0x00007ff28eeea2c0 in ?? ()
#44 0x00007ff2796b33c0 in ?? ()
#45 0x0000615000241e28 in ?? ()
#46 0x0000615000241d80 in ?? ()
#47 0x0000615000241f78 in ?? ()
#48 0x0000000000326983 in GCC_except_table1291 ()
#49 0x00007ff2796b3530 in ?? ()
#50 0x000061100008f8d8 in ?? ()
#51 0x000061100008f8d8 in ?? ()
#52 0x00000c2200011f1d in ?? ()
#53 0x00000c2200011f1e in ?? ()
#54 0x000061100008f880 in ?? ()
#55 0x0000000000000000 in ?? ()
Thread 5 (LWP 10256):
#0 0x00007ff2894a1fb9 in ?? ()
#1 0x00007ff27b6b8ca0 in ?? ()
#2 0x0000000000000067 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061200000eb28 in ?? ()
#5 0x00007ff27b6b8c90 in ?? ()
#6 0x00000000000000ce in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 4 (LWP 10255):
#0 0x00007ff2894a1fb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 3 (LWP 10254):
#0 0x00007ff2894a1fb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 2 (LWP 10253):
#0 0x00007ff2894a1fb9 in ?? ()
#1 0x5f5347414c46000a in ?? ()
#2 0x0000000000000002 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x0000612000013438 in ?? ()
#5 0x00007ff27cebc450 in ?? ()
#6 0x0000000000000004 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 1 (LWP 10251):
#0 0x00007ff2894a5d50 in ?? ()
#1 0x0000000000000000 in ?? ()
I20261117 14:51:02.080838 10903 raft_consensus.cc:499] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6041859320d34e679a287826f4f54fd6)
I20261117 14:51:02.081053 10903 raft_consensus.cc:521] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "624366c73dc34561925e1d1b5216cf2b" member_type: VOTER last_known_addr { host: "127.6.50.132" port: 33799 } } peers { permanent_uuid: "6041859320d34e679a287826f4f54fd6" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 36371 } } peers { permanent_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 34551 } }
I20261117 14:51:02.082279 10903 leader_election.cc:290] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 624366c73dc34561925e1d1b5216cf2b (127.6.50.132:33799), 6041859320d34e679a287826f4f54fd6 (127.6.50.129:36371)
I20261117 14:51:02.082324 10608 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "a1fc825ee85f40d1aee4695db8235828" candidate_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" candidate_term: 10 candidate_status { last_received { term: 9 index: 3014 } } ignore_live_leader: false dest_uuid: "624366c73dc34561925e1d1b5216cf2b" is_pre_election: true
I20261117 14:51:02.082588 10472 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "a1fc825ee85f40d1aee4695db8235828" candidate_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" candidate_term: 10 candidate_status { last_received { term: 9 index: 3014 } } ignore_live_leader: false dest_uuid: "6041859320d34e679a287826f4f54fd6" is_pre_election: true
I20261117 14:51:02.083230 10267 leader_election.cc:304] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa94e5d3d33a4f70b3e2c9c5f62cc9f3; no voters: 6041859320d34e679a287826f4f54fd6, 624366c73dc34561925e1d1b5216cf2b
I20261117 14:51:02.083516 10903 raft_consensus.cc:2771] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
************************* END STACKS ***************************
I20261117 14:51:02.086942 6346 external_mini_cluster-itest-base.cc:86] Attempting to dump stacks of TS 3 with UUID 624366c73dc34561925e1d1b5216cf2b and pid 10525
************************ BEGIN STACKS **************************
[New LWP 10526]
[New LWP 10527]
[New LWP 10528]
[New LWP 10529]
[New LWP 10535]
[New LWP 10536]
[New LWP 10537]
[New LWP 10540]
[New LWP 10541]
[New LWP 10542]
[New LWP 10543]
[New LWP 10544]
[New LWP 10545]
[New LWP 10548]
[New LWP 10549]
[New LWP 10550]
[New LWP 10551]
[New LWP 10552]
[New LWP 10553]
[New LWP 10554]
[New LWP 10555]
[New LWP 10556]
[New LWP 10557]
[New LWP 10558]
[New LWP 10559]
[New LWP 10560]
[New LWP 10561]
[New LWP 10562]
[New LWP 10563]
[New LWP 10564]
[New LWP 10565]
[New LWP 10566]
[New LWP 10567]
[New LWP 10568]
[New LWP 10569]
[New LWP 10570]
[New LWP 10571]
[New LWP 10572]
[New LWP 10573]
[New LWP 10574]
[New LWP 10575]
[New LWP 10576]
[New LWP 10577]
[New LWP 10578]
[New LWP 10579]
[New LWP 10580]
[New LWP 10581]
[New LWP 10582]
[New LWP 10583]
[New LWP 10584]
[New LWP 10585]
[New LWP 10586]
[New LWP 10587]
[New LWP 10588]
[New LWP 10589]
[New LWP 10590]
[New LWP 10591]
[New LWP 10592]
[New LWP 10593]
[New LWP 10594]
[New LWP 10595]
[New LWP 10596]
[New LWP 10597]
[New LWP 10598]
[New LWP 10599]
[New LWP 10600]
[New LWP 10601]
[New LWP 10602]
[New LWP 10603]
[New LWP 10604]
[New LWP 10605]
[New LWP 10606]
[New LWP 10607]
[New LWP 10608]
[New LWP 10609]
[New LWP 10610]
[New LWP 10611]
[New LWP 10612]
[New LWP 10613]
[New LWP 10614]
[New LWP 10615]
[New LWP 10616]
[New LWP 10617]
[New LWP 10618]
[New LWP 10619]
[New LWP 10620]
[New LWP 10621]
[New LWP 10622]
[New LWP 10623]
[New LWP 10624]
[New LWP 10625]
[New LWP 10626]
[New LWP 10627]
[New LWP 10628]
[New LWP 10629]
[New LWP 10630]
[New LWP 10631]
[New LWP 10632]
[New LWP 10633]
[New LWP 10634]
[New LWP 10635]
[New LWP 10636]
[New LWP 10637]
[New LWP 10638]
[New LWP 10639]
[New LWP 10640]
[New LWP 10641]
[New LWP 10642]
[New LWP 10643]
[New LWP 10644]
[New LWP 10645]
[New LWP 10646]
[New LWP 10647]
[New LWP 10648]
[New LWP 10649]
[New LWP 10650]
[New LWP 10651]
[New LWP 10652]
[New LWP 10653]
[New LWP 10654]
[New LWP 10657]
0x00007efffd0e7d50 in ?? ()
Id Target Id Frame
* 1 LWP 10525 "kudu" 0x00007efffd0e7d50 in ?? ()
2 LWP 10526 "kudu" 0x00007efffd0e3fb9 in ?? ()
3 LWP 10527 "kudu" 0x00007efffd0e3fb9 in ?? ()
4 LWP 10528 "kudu" 0x00007efffd0e3fb9 in ?? ()
5 LWP 10529 "kernel-watcher-" 0x00007efffd0e3fb9 in ?? ()
6 LWP 10535 "ntp client-1053" 0x00007efffd0e79e2 in ?? ()
7 LWP 10536 "file cache-evic" 0x00007efffd0e3fb9 in ?? ()
8 LWP 10537 "sq_acceptor" 0x00007efff5b40bb9 in ?? ()
9 LWP 10540 "rpc reactor-105" 0x00007efff5b4d947 in ?? ()
10 LWP 10541 "rpc reactor-105" 0x00007efff5b4d947 in ?? ()
11 LWP 10542 "rpc reactor-105" 0x00007efff5b4d947 in ?? ()
12 LWP 10543 "rpc reactor-105" 0x00007efff5b4d947 in ?? ()
13 LWP 10544 "MaintenanceMgr " 0x00007efffd0e3ad3 in ?? ()
14 LWP 10545 "txn-status-mana" 0x00007efffd0e3fb9 in ?? ()
15 LWP 10548 "collect_and_rem" 0x00007efffd0e3fb9 in ?? ()
16 LWP 10549 "tc-session-exp-" 0x00007efffd0e3fb9 in ?? ()
17 LWP 10550 "rpc worker-1055" 0x00007efffd0e3ad3 in ?? ()
18 LWP 10551 "rpc worker-1055" 0x00007efffd0e3ad3 in ?? ()
19 LWP 10552 "rpc worker-1055" 0x00007efffd0e3ad3 in ?? ()
20 LWP 10553 "rpc worker-1055" 0x00007efffd0e3ad3 in ?? ()
21 LWP 10554 "rpc worker-1055" 0x00007efffd0e3ad3 in ?? ()
22 LWP 10555 "rpc worker-1055" 0x00007efffd0e3ad3 in ?? ()
23 LWP 10556 "rpc worker-1055" 0x00007efffd0e3ad3 in ?? ()
24 LWP 10557 "rpc worker-1055" 0x00007efffd0e3ad3 in ?? ()
25 LWP 10558 "rpc worker-1055" 0x00007efffd0e3ad3 in ?? ()
26 LWP 10559 "rpc worker-1055" 0x00007efffd0e3ad3 in ?? ()
27 LWP 10560 "rpc worker-1056" 0x00007efffd0e3ad3 in ?? ()
28 LWP 10561 "rpc worker-1056" 0x00007efffd0e3ad3 in ?? ()
29 LWP 10562 "rpc worker-1056" 0x00007efffd0e3ad3 in ?? ()
30 LWP 10563 "rpc worker-1056" 0x00007efffd0e3ad3 in ?? ()
31 LWP 10564 "rpc worker-1056" 0x00007efffd0e3ad3 in ?? ()
32 LWP 10565 "rpc worker-1056" 0x00007efffd0e3ad3 in ?? ()
33 LWP 10566 "rpc worker-1056" 0x00007efffd0e3ad3 in ?? ()
34 LWP 10567 "rpc worker-1056" 0x00007efffd0e3ad3 in ?? ()
35 LWP 10568 "rpc worker-1056" 0x00007efffd0e3ad3 in ?? ()
36 LWP 10569 "rpc worker-1056" 0x00007efffd0e3ad3 in ?? ()
37 LWP 10570 "rpc worker-1057" 0x00007efffd0e3ad3 in ?? ()
38 LWP 10571 "rpc worker-1057" 0x00007efffd0e3ad3 in ?? ()
39 LWP 10572 "rpc worker-1057" 0x00007efffd0e3ad3 in ?? ()
40 LWP 10573 "rpc worker-1057" 0x00007efffd0e3ad3 in ?? ()
41 LWP 10574 "rpc worker-1057" 0x00007efffd0e3ad3 in ?? ()
42 LWP 10575 "rpc worker-1057" 0x00007efffd0e3ad3 in ?? ()
43 LWP 10576 "rpc worker-1057" 0x00007efffd0e3ad3 in ?? ()
44 LWP 10577 "rpc worker-1057" 0x00007efffd0e3ad3 in ?? ()
45 LWP 10578 "rpc worker-1057" 0x00007efffd0e3ad3 in ?? ()
46 LWP 10579 "rpc worker-1057" 0x00007efffd0e3ad3 in ?? ()
47 LWP 10580 "rpc worker-1058" 0x00007efffd0e3ad3 in ?? ()
48 LWP 10581 "rpc worker-1058" 0x00007efffd0e3ad3 in ?? ()
49 LWP 10582 "rpc worker-1058" 0x00007efffd0e3ad3 in ?? ()
50 LWP 10583 "rpc worker-1058" 0x00007efffd0e3ad3 in ?? ()
51 LWP 10584 "rpc worker-1058" 0x00007efffd0e3ad3 in ?? ()
52 LWP 10585 "rpc worker-1058" 0x00007efffd0e3ad3 in ?? ()
53 LWP 10586 "rpc worker-1058" 0x00007efffd0e3ad3 in ?? ()
54 LWP 10587 "rpc worker-1058" 0x00007efffd0e3ad3 in ?? ()
55 LWP 10588 "rpc worker-1058" 0x00007efffd0e3ad3 in ?? ()
56 LWP 10589 "rpc worker-1058" 0x00007efffd0e3ad3 in ?? ()
57 LWP 10590 "rpc worker-1059" 0x00007efffd0e3ad3 in ?? ()
58 LWP 10591 "rpc worker-1059" 0x00007efffd0e3ad3 in ?? ()
59 LWP 10592 "rpc worker-1059" 0x00007efffd0e3ad3 in ?? ()
60 LWP 10593 "rpc worker-1059" 0x00007efffd0e3ad3 in ?? ()
61 LWP 10594 "rpc worker-1059" 0x00007efffd0e3ad3 in ?? ()
62 LWP 10595 "rpc worker-1059" 0x00007efffd0e3ad3 in ?? ()
63 LWP 10596 "rpc worker-1059" 0x00007efffd0e3ad3 in ?? ()
64 LWP 10597 "rpc worker-1059" 0x00007efffd0e3ad3 in ?? ()
65 LWP 10598 "rpc worker-1059" 0x00007efffd0e3ad3 in ?? ()
66 LWP 10599 "rpc worker-1059" 0x00007efffd0e3ad3 in ?? ()
67 LWP 10600 "rpc worker-1060" 0x00007efffd0e3ad3 in ?? ()
68 LWP 10601 "rpc worker-1060" 0x00007efffd0e3ad3 in ?? ()
69 LWP 10602 "rpc worker-1060" 0x00007efffd0e3ad3 in ?? ()
70 LWP 10603 "rpc worker-1060" 0x00007efffd0e3ad3 in ?? ()
71 LWP 10604 "rpc worker-1060" 0x00007efffd0e3ad3 in ?? ()
72 LWP 10605 "rpc worker-1060" 0x00007efffd0e3ad3 in ?? ()
73 LWP 10606 "rpc worker-1060" 0x00007efffd0e3ad3 in ?? ()
74 LWP 10607 "rpc worker-1060" 0x00007efffd0e3ad3 in ?? ()
75 LWP 10608 "rpc worker-1060" 0x00007efffd0e3ad3 in ?? ()
76 LWP 10609 "rpc worker-1060" 0x00007efffd0e3ad3 in ?? ()
77 LWP 10610 "rpc worker-1061" 0x00007efffd0e3ad3 in ?? ()
78 LWP 10611 "rpc worker-1061" 0x00007efffd0e3ad3 in ?? ()
79 LWP 10612 "rpc worker-1061" 0x00007efffd0e3ad3 in ?? ()
80 LWP 10613 "rpc worker-1061" 0x00007efffd0e3ad3 in ?? ()
81 LWP 10614 "rpc worker-1061" 0x00007efffd0e3ad3 in ?? ()
82 LWP 10615 "rpc worker-1061" 0x00007efffd0e3ad3 in ?? ()
83 LWP 10616 "rpc worker-1061" 0x00007efffd0e3ad3 in ?? ()
84 LWP 10617 "rpc worker-1061" 0x00007efffd0e3ad3 in ?? ()
85 LWP 10618 "rpc worker-1061" 0x00007efffd0e3ad3 in ?? ()
86 LWP 10619 "rpc worker-1061" 0x00007efffd0e3ad3 in ?? ()
87 LWP 10620 "rpc worker-1062" 0x00007efffd0e3ad3 in ?? ()
88 LWP 10621 "rpc worker-1062" 0x00007efffd0e3ad3 in ?? ()
89 LWP 10622 "rpc worker-1062" 0x00007efffd0e3ad3 in ?? ()
90 LWP 10623 "rpc worker-1062" 0x00007efffd0e3ad3 in ?? ()
91 LWP 10624 "rpc worker-1062" 0x00007efffd0e3ad3 in ?? ()
92 LWP 10625 "rpc worker-1062" 0x00007efffd0e3ad3 in ?? ()
93 LWP 10626 "rpc worker-1062" 0x00007efffd0e3ad3 in ?? ()
94 LWP 10627 "rpc worker-1062" 0x00007efffd0e3ad3 in ?? ()
95 LWP 10628 "rpc worker-1062" 0x00007efffd0e3ad3 in ?? ()
96 LWP 10629 "rpc worker-1062" 0x00007efffd0e3ad3 in ?? ()
97 LWP 10630 "rpc worker-1063" 0x00007efffd0e3ad3 in ?? ()
98 LWP 10631 "rpc worker-1063" 0x00007efffd0e3ad3 in ?? ()
99 LWP 10632 "rpc worker-1063" 0x00007efffd0e3ad3 in ?? ()
100 LWP 10633 "rpc worker-1063" 0x00007efffd0e3ad3 in ?? ()
101 LWP 10634 "rpc worker-1063" 0x00007efffd0e3ad3 in ?? ()
102 LWP 10635 "rpc worker-1063" 0x00007efffd0e3ad3 in ?? ()
103 LWP 10636 "rpc worker-1063" 0x00007efffd0e3ad3 in ?? ()
104 LWP 10637 "rpc worker-1063" 0x00007efffd0e3ad3 in ?? ()
105 LWP 10638 "rpc worker-1063" 0x00007efffd0e3ad3 in ?? ()
106 LWP 10639 "rpc worker-1063" 0x00007efffd0e3ad3 in ?? ()
107 LWP 10640 "rpc worker-1064" 0x00007efffd0e3ad3 in ?? ()
108 LWP 10641 "rpc worker-1064" 0x00007efffd0e3ad3 in ?? ()
109 LWP 10642 "rpc worker-1064" 0x00007efffd0e3ad3 in ?? ()
110 LWP 10643 "rpc worker-1064" 0x00007efffd0e3ad3 in ?? ()
111 LWP 10644 "rpc worker-1064" 0x00007efffd0e3ad3 in ?? ()
112 LWP 10645 "rpc worker-1064" 0x00007efffd0e3ad3 in ?? ()
113 LWP 10646 "rpc worker-1064" 0x00007efffd0e3ad3 in ?? ()
114 LWP 10647 "rpc worker-1064" 0x00007efffd0e3ad3 in ?? ()
115 LWP 10648 "rpc worker-1064" 0x00007efffd0e3ad3 in ?? ()
116 LWP 10649 "rpc worker-1064" 0x00007efffd0e3ad3 in ?? ()
117 LWP 10650 "diag-logger-106" 0x00007efffd0e3fb9 in ?? ()
118 LWP 10651 "result-tracker-" 0x00007efffd0e3fb9 in ?? ()
119 LWP 10652 "excess-log-dele" 0x00007efffd0e3fb9 in ?? ()
120 LWP 10653 "acceptor-10653" 0x00007efff5b4efc7 in ?? ()
121 LWP 10654 "heartbeat-10654" 0x00007efffd0e3fb9 in ?? ()
122 LWP 10657 "maintenance_sch" 0x00007efffd0e3fb9 in ?? ()
Thread 122 (LWP 10657):
#0 0x00007efffd0e3fb9 in ?? ()
#1 0x00007effb153b700 in ?? ()
#2 0x000000000000004c in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061600001a2a0 in ?? ()
#5 0x00007effb153b750 in ?? ()
#6 0x0000000000000098 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 121 (LWP 10654):
#0 0x00007efffd0e3fb9 in ?? ()
#1 0xb8b5f76eeb459325 in ?? ()
#2 0x0000000000000014 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x0000613000021040 in ?? ()
#5 0x00007effb2562610 in ?? ()
#6 0x0000000000000028 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 120 (LWP 10653):
#0 0x00007efff5b4efc7 in ?? ()
#1 0x00006080003ac090 in ?? ()
#2 0x0000000000322c2c in ?? ()
#3 0x000000000000005c in ?? ()
#4 0x00007effb2d89ea0 in ?? ()
#5 0x00007effb2d89d90 in ?? ()
#6 0x00007effb2d89e00 in ?? ()
#7 0x0000000000000080 in ?? ()
#8 0x00000000002cf00b in ?? ()
#9 0x00007effb0d18ad0 in ?? ()
#10 0x0000000000354e67 in __FRAME_END__ ()
#11 0x000000000039fc60 in ?? ()
#12 0x000000000000a4e4 in ?? ()
#13 0x0000000000000000 in ?? ()
Thread 119 (LWP 10652):
#0 0x00007efffd0e3fb9 in ?? ()
#1 0x00007effb35a2f60 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 118 (LWP 10651):
#0 0x00007efffd0e3fb9 in ?? ()
#1 0x00007effb3dbc120 in ?? ()
#2 0x0000000000000013 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061100008edf0 in ?? ()
#5 0x00007effb3dbc110 in ?? ()
#6 0x0000000000000026 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 117 (LWP 10650):
#0 0x00007efffd0e3fb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 116 (LWP 10649):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000008 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d0002b0048 in ?? ()
#4 0x00007effb4debef0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007effb4debf10 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 115 (LWP 10648):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000004 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d0002a6858 in ?? ()
#4 0x00007effb5603ef0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007effb5603f10 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 114 (LWP 10647):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 113 (LWP 10646):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 112 (LWP 10645):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 111 (LWP 10644):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 110 (LWP 10643):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 109 (LWP 10642):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 108 (LWP 10641):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 107 (LWP 10640):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 106 (LWP 10639):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 105 (LWP 10638):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 104 (LWP 10637):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 103 (LWP 10636):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 102 (LWP 10635):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 101 (LWP 10634):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 100 (LWP 10633):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 99 (LWP 10632):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 98 (LWP 10631):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 97 (LWP 10630):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 96 (LWP 10629):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 95 (LWP 10628):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 94 (LWP 10627):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 93 (LWP 10626):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 92 (LWP 10625):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 91 (LWP 10624):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 90 (LWP 10623):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 89 (LWP 10622):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 88 (LWP 10621):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 87 (LWP 10620):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 86 (LWP 10619):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 85 (LWP 10618):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 84 (LWP 10617):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 83 (LWP 10616):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 82 (LWP 10615):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 81 (LWP 10614):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 80 (LWP 10613):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 79 (LWP 10612):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 78 (LWP 10611):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 77 (LWP 10610):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 76 (LWP 10609):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x000000000000028c in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d0001ad088 in ?? ()
#4 0x00007effc9254ef0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007effc9254f10 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 75 (LWP 10608):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000251 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d0001a688c in ?? ()
#4 0x00007effc9a6cef0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007effc9a6cf10 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0001a6840 in ?? ()
#9 0x00007efffd0e3770 in ?? ()
#10 0x00007effc9a6cf10 in ?? ()
#11 0x00007effc9a6ced0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 74 (LWP 10607):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000003 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d0001a008c in ?? ()
#4 0x00007effca284ef0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007effca284f10 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0001a0040 in ?? ()
#9 0x00007efffd0e3770 in ?? ()
#10 0x00007effca284f10 in ?? ()
#11 0x00007effca284ed0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 73 (LWP 10606):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 72 (LWP 10605):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 71 (LWP 10604):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 70 (LWP 10603):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 69 (LWP 10602):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 68 (LWP 10601):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 67 (LWP 10600):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 66 (LWP 10599):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 65 (LWP 10598):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 64 (LWP 10597):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 63 (LWP 10596):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 62 (LWP 10595):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 61 (LWP 10594):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 60 (LWP 10593):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 59 (LWP 10592):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 58 (LWP 10591):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 57 (LWP 10590):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 56 (LWP 10589):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000003 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00012683c in ?? ()
#4 0x00007effd2c1def0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007effd2c1df10 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0001267f0 in ?? ()
#9 0x00007efffd0e3770 in ?? ()
#10 0x00007effd2c1df10 in ?? ()
#11 0x00007effd2c1ded0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 55 (LWP 10588):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 54 (LWP 10587):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 53 (LWP 10586):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 52 (LWP 10585):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 51 (LWP 10584):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 50 (LWP 10583):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 49 (LWP 10582):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 48 (LWP 10581):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 47 (LWP 10580):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 46 (LWP 10579):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 45 (LWP 10578):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 44 (LWP 10577):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 43 (LWP 10576):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 42 (LWP 10575):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 41 (LWP 10574):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 40 (LWP 10573):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 39 (LWP 10572):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 38 (LWP 10571):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 37 (LWP 10570):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 36 (LWP 10569):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000036 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d0000a67e8 in ?? ()
#4 0x00007effdcdfeef0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007effdcdfef10 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 35 (LWP 10568):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x000000000000000d in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00009ffec in ?? ()
#4 0x00007effdd616ef0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007effdd616f10 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d00009ffa0 in ?? ()
#9 0x00007efffd0e3770 in ?? ()
#10 0x00007effdd616f10 in ?? ()
#11 0x00007effdd616ed0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 34 (LWP 10567):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 33 (LWP 10566):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 32 (LWP 10565):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 31 (LWP 10564):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 30 (LWP 10563):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 29 (LWP 10562):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 28 (LWP 10561):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 27 (LWP 10560):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 26 (LWP 10559):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 25 (LWP 10558):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 24 (LWP 10557):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 23 (LWP 10556):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 22 (LWP 10555):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 21 (LWP 10554):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 20 (LWP 10553):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 19 (LWP 10552):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 18 (LWP 10551):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 17 (LWP 10550):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 16 (LWP 10549):
#0 0x00007efffd0e3fb9 in ?? ()
#1 0x00007effe6fface0 in ?? ()
#2 0x0000000000000001 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x0000613000021fe0 in ?? ()
#5 0x00007effe6ffacd0 in ?? ()
#6 0x0000000000000002 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 15 (LWP 10548):
#0 0x00007efffd0e3fb9 in ?? ()
#1 0x4008000000000000 in ?? ()
#2 0x0000000000000003 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x0000614000021e98 in ?? ()
#5 0x00007effe7842270 in ?? ()
#6 0x0000000000000006 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 14 (LWP 10545):
#0 0x00007efffd0e3fb9 in ?? ()
#1 0x00007effe888f260 in ?? ()
#2 0x0000000000000001 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061800000d5a8 in ?? ()
#5 0x00007effe888f250 in ?? ()
#6 0x0000000000000002 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 13 (LWP 10544):
#0 0x00007efffd0e3ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 12 (LWP 10543):
#0 0x00007efff5b4d947 in ?? ()
#1 0x00007effe98de340 in ?? ()
#2 0x000061a00000c680 in ?? ()
#3 0x00007effe98de330 in ?? ()
#4 0x00007effe98de540 in ?? ()
#5 0x00007effe98de380 in ?? ()
#6 0x0000615000012d10 in ?? ()
#7 0x00007effe98de400 in ?? ()
#8 0x00007efff7d6a25d in ?? ()
#9 0x3fb97e88a052c000 in ?? ()
#10 0x000061a00000c680 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000c680 in ?? ()
#13 0x0000000000a8da90 in __sanitizer::theDepot ()
#14 0x00007eff00000000 in ?? ()
#15 0x41dabf190e1752ed in ?? ()
#16 0x00000fe07d313c80 in ?? ()
#17 0x00007effe98de3e0 in ?? ()
#18 0x00007efff7d6eba3 in ?? ()
#19 0x00007effe98de3b0 in ?? ()
#20 0x3fb97e88a052c000 in ?? ()
#21 0x00000000e98de400 in ?? ()
#22 0x000061a00000c680 in ?? ()
#23 0x0000615000012d10 in ?? ()
#24 0x3fb97e88a052c000 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 11 (LWP 10542):
#0 0x00007efff5b4d947 in ?? ()
#1 0x00007effea0f5340 in ?? ()
#2 0x000061a00000c080 in ?? ()
#3 0x00007effea0f5330 in ?? ()
#4 0x00007effea0f5540 in ?? ()
#5 0x00007effea0f5380 in ?? ()
#6 0x0000615000012810 in ?? ()
#7 0x00007effea0f5400 in ?? ()
#8 0x00007efff7d6a25d in ?? ()
#9 0x3fb97b3a803cc000 in ?? ()
#10 0x000061a00000c080 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000c080 in ?? ()
#13 0x0000000000a8da90 in __sanitizer::theDepot ()
#14 0x00007eff00000000 in ?? ()
#15 0x41dabf190e1752ee in ?? ()
#16 0x00000fe07d416a80 in ?? ()
#17 0x00007effea0f53e0 in ?? ()
#18 0x00007efff7d6eba3 in ?? ()
#19 0x00007effea0f53b0 in ?? ()
#20 0x3fb97b3a803cc000 in ?? ()
#21 0x00000000ea0f5400 in ?? ()
#22 0x000061a00000c080 in ?? ()
#23 0x0000615000012810 in ?? ()
#24 0x3fb97b3a803cc000 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 10 (LWP 10541):
#0 0x00007efff5b4d947 in ?? ()
#1 0x00007effea90c340 in ?? ()
#2 0x000061a00000ba80 in ?? ()
#3 0x00007effea90c330 in ?? ()
#4 0x00007effea90c540 in ?? ()
#5 0x00007effea90c380 in ?? ()
#6 0x0000615000012310 in ?? ()
#7 0x00007effea90c400 in ?? ()
#8 0x00007efff7d6a25d in ?? ()
#9 0x3fb97df92177c000 in ?? ()
#10 0x000061a00000ba80 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000ba80 in ?? ()
#13 0x0000000000a8da90 in __sanitizer::theDepot ()
#14 0x00007eff00000000 in ?? ()
#15 0x41dabf190e1752f0 in ?? ()
#16 0x00000fe07d519880 in ?? ()
#17 0x00007effea90c3e0 in ?? ()
#18 0x00007efff7d6eba3 in ?? ()
#19 0x00007effea90c3b0 in ?? ()
#20 0x3fb97df92177c000 in ?? ()
#21 0x00000000ea90c400 in ?? ()
#22 0x000061a00000ba80 in ?? ()
#23 0x0000615000012310 in ?? ()
#24 0x3fb97df92177c000 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 9 (LWP 10540):
#0 0x00007efff5b4d947 in ?? ()
#1 0x00007effec932340 in ?? ()
#2 0x000061a00000b480 in ?? ()
#3 0x00007effec932330 in ?? ()
#4 0x00007effec932540 in ?? ()
#5 0x00007effec932380 in ?? ()
#6 0x0000615000011e10 in ?? ()
#7 0x00007effec932400 in ?? ()
#8 0x00007efff7d6a25d in ?? ()
#9 0x3fb972cfd62d8000 in ?? ()
#10 0x000061a00000b480 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000b480 in ?? ()
#13 0x0000000000a8da90 in __sanitizer::theDepot ()
#14 0x00007eff00000000 in ?? ()
#15 0x41dabf190e1752ed in ?? ()
#16 0x00000fe07d91e480 in ?? ()
#17 0x00007effec9323e0 in ?? ()
#18 0x00007efff7d6eba3 in ?? ()
#19 0x0000000000000000 in ?? ()
Thread 8 (LWP 10537):
#0 0x00007efff5b40bb9 in ?? ()
#1 0x00000000000000c8 in ?? ()
#2 0x00007effee3b77b8 in ?? ()
#3 0x0000602000020510 in ?? ()
#4 0x0000000000000002 in ?? ()
#5 0x00000000000000c8 in ?? ()
#6 0x00000000002c6c51 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 7 (LWP 10536):
#0 0x00007efffd0e3fb9 in ?? ()
#1 0x00007effedbb60e0 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 6 (LWP 10535):
#0 0x00007efffd0e79e2 in ?? ()
#1 0x00007effed3b3bc0 in ?? ()
#2 0x00007effed3b3c60 in ?? ()
#3 0x000000000000001e in ?? ()
#4 0x0000000000000030 in ?? ()
#5 0x00007effed3b3c10 in ?? ()
#6 0x0000000000c45b60 in __sanitizer::theDepot ()
#7 0x00007effed3b3c70 in ?? ()
#8 0x000061100008f750 in ?? ()
#9 0x00007effed3b3c60 in ?? ()
#10 0x00000000002c1147 in ?? ()
#11 0x00007f0002b2338c in ?? ()
#12 0x00007f0002b12999 in ?? ()
#13 0x00007f0002b16f86 in ?? ()
#14 0x00007f0002b1b9c0 in ?? ()
#15 0x00007f0002b1b7e9 in ?? ()
#16 0x0000000000372c7d in __sanitizer::RoundUpTo (boundary=18446744073709551612, size=4096) at /home/jenkins-slave/workspace/build_and_test/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/asan/../sanitizer_common/sanitizer_common.h:402
#17 __sanitizer::InternalMmapVectorNoCtor<char>::Realloc (new_capacity=4096, this=0x7effed3b33e0) at /home/jenkins-slave/workspace/build_and_test/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/asan/../sanitizer_common/sanitizer_common.h:526
#18 __sanitizer::InternalMmapVectorNoCtor<char>::reserve (new_size=4096, this=0x7effed3b33e0) at /home/jenkins-slave/workspace/build_and_test/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/asan/../sanitizer_common/sanitizer_common.h:490
#19 __sanitizer::InternalMmapVectorNoCtor<char>::Initialize (initial_capacity=4096, this=0x7effed3b33e0) at /home/jenkins-slave/workspace/build_and_test/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/asan/../sanitizer_common/sanitizer_common.h:450
#20 __sanitizer::InternalMmapVector<char>::InternalMmapVector (cnt=4096, this=0x7effed3b33e0) at /home/jenkins-slave/workspace/build_and_test/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/asan/../sanitizer_common/sanitizer_common.h:558
#21 __sanitizer::InternalScopedString::InternalScopedString (max_length=4096, this=0x7effed3b33e0) at /home/jenkins-slave/workspace/build_and_test/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/asan/../sanitizer_common/sanitizer_common.h:572
#22 __asan::DescribeAddressRelativeToGlobal (g=..., access_size=<optimized out>, addr=48) at /home/jenkins-slave/workspace/build_and_test/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/asan/asan_descriptions.cpp:279
#23 __asan::GlobalAddressDescription::Print (this=0x0, bug_type=0x7efffd0dd6db "dH\211\004%0\006") at /home/jenkins-slave/workspace/build_and_test/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/asan/asan_descriptions.cpp:327
#24 0x00007f000f3f478b in ?? ()
#25 0x0000000045e0360e in ?? ()
#26 0x00007f000f30c9a9 in ?? ()
#27 0x00007f000f3f4600 in ?? ()
#28 0x00007effed3b32c0 in ?? ()
#29 0x00007eff80000000 in ?? ()
#30 0x00007f0002b2a706 in ?? ()
#31 0x00007eff80000000 in ?? ()
#32 0x00007f0002b2a22e in ?? ()
#33 0x00007effed3b34e0 in ?? ()
#34 0x00000fdffda7669c in ?? ()
#35 0x00007effed3b34b0 in ?? ()
#36 0x00007f0002b2a91f in ?? ()
#37 0x00007effed3b3520 in ?? ()
#38 0x00007effed3b34c0 in ?? ()
#39 0x00007effed3b35a0 in ?? ()
#40 0x00007f0002b2c389 in ?? ()
#41 0x0000000045e0360e in ?? ()
#42 0x00007f0002aaf244 in ?? ()
#43 0x00007f0002b2c2c0 in ?? ()
#44 0x00007effed3b33c0 in ?? ()
#45 0x00006150001d1d00 in ?? ()
#46 0x00006150001d1d00 in ?? ()
#47 0x00006150001d1ef8 in ?? ()
#48 0x000060d001256820 in ?? ()
#49 0x00007effed3b50e0 in ?? ()
#50 0x000061100008f8d8 in ?? ()
#51 0x00007effed3b3530 in ?? ()
#52 0x00007efff996dbb6 in ?? ()
#53 0x00006150001d1d00 in ?? ()
#54 0x000061100008f880 in ?? ()
#55 0x0000000000000000 in ?? ()
Thread 5 (LWP 10529):
#0 0x00007efffd0e3fb9 in ?? ()
#1 0x00007effef3b8ca0 in ?? ()
#2 0x0000000000000064 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061200000eb28 in ?? ()
#5 0x00007effef3b8c90 in ?? ()
#6 0x00000000000000c8 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 4 (LWP 10528):
#0 0x00007efffd0e3fb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 3 (LWP 10527):
#0 0x00007efffd0e3fb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 2 (LWP 10526):
#0 0x00007efffd0e3fb9 in ?? ()
#1 0x5f5347414c46000a in ?? ()
#2 0x0000000000000002 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x0000612000013438 in ?? ()
#5 0x00007efff0bbc450 in ?? ()
#6 0x0000000000000004 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 1 (LWP 10525):
#0 0x00007efffd0e7d50 in ?? ()
#1 0x0000000000000000 in ?? ()
I20261117 14:51:03.031872 10912 raft_consensus.cc:499] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6041859320d34e679a287826f4f54fd6)
I20261117 14:51:03.032191 10912 raft_consensus.cc:521] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "624366c73dc34561925e1d1b5216cf2b" member_type: VOTER last_known_addr { host: "127.6.50.132" port: 33799 } } peers { permanent_uuid: "6041859320d34e679a287826f4f54fd6" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 36371 } } peers { permanent_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 34551 } }
I20261117 14:51:03.034247 10912 leader_election.cc:290] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6041859320d34e679a287826f4f54fd6 (127.6.50.129:36371), fa94e5d3d33a4f70b3e2c9c5f62cc9f3 (127.6.50.131:34551)
************************* END STACKS ***************************
I20261117 14:51:03.041239 6346 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskUafhB0/build/asan/bin/kudu pid 10388
I20261117 14:51:03.049337 10472 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "a1fc825ee85f40d1aee4695db8235828" candidate_uuid: "624366c73dc34561925e1d1b5216cf2b" candidate_term: 10 candidate_status { last_received { term: 9 index: 3014 } } ignore_live_leader: false dest_uuid: "6041859320d34e679a287826f4f54fd6" is_pre_election: true
I20261117 14:51:03.049566 10333 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "a1fc825ee85f40d1aee4695db8235828" candidate_uuid: "624366c73dc34561925e1d1b5216cf2b" candidate_term: 10 candidate_status { last_received { term: 9 index: 3014 } } ignore_live_leader: false dest_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" is_pre_election: true
I20261117 14:51:03.050706 10540 leader_election.cc:304] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 624366c73dc34561925e1d1b5216cf2b; no voters: 6041859320d34e679a287826f4f54fd6, fa94e5d3d33a4f70b3e2c9c5f62cc9f3
I20261117 14:51:03.051198 10912 raft_consensus.cc:2771] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20261117 14:51:03.060739 10511 generic_service.cc:196] Checking for leaks (request via RPC)
I20261117 14:51:03.351109 10920 raft_consensus.cc:499] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6041859320d34e679a287826f4f54fd6)
I20261117 14:51:03.351354 10920 raft_consensus.cc:521] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "624366c73dc34561925e1d1b5216cf2b" member_type: VOTER last_known_addr { host: "127.6.50.132" port: 33799 } } peers { permanent_uuid: "6041859320d34e679a287826f4f54fd6" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 36371 } } peers { permanent_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 34551 } }
I20261117 14:51:03.352254 10920 leader_election.cc:290] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 624366c73dc34561925e1d1b5216cf2b (127.6.50.132:33799), 6041859320d34e679a287826f4f54fd6 (127.6.50.129:36371)
I20261117 14:51:03.352830 10608 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "a1fc825ee85f40d1aee4695db8235828" candidate_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" candidate_term: 10 candidate_status { last_received { term: 9 index: 3014 } } ignore_live_leader: false dest_uuid: "624366c73dc34561925e1d1b5216cf2b" is_pre_election: true
I20261117 14:51:03.353267 10608 raft_consensus.cc:2490] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa94e5d3d33a4f70b3e2c9c5f62cc9f3 in term 9.
I20261117 14:51:03.353894 10268 leader_election.cc:304] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 624366c73dc34561925e1d1b5216cf2b, fa94e5d3d33a4f70b3e2c9c5f62cc9f3; no voters:
I20261117 14:51:03.354211 10920 raft_consensus.cc:2826] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20261117 14:51:03.354373 10920 raft_consensus.cc:499] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6041859320d34e679a287826f4f54fd6)
I20261117 14:51:03.354506 10920 raft_consensus.cc:3096] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 9 FOLLOWER]: Advancing to term 10
I20261117 14:51:03.357430 10920 raft_consensus.cc:521] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "624366c73dc34561925e1d1b5216cf2b" member_type: VOTER last_known_addr { host: "127.6.50.132" port: 33799 } } peers { permanent_uuid: "6041859320d34e679a287826f4f54fd6" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 36371 } } peers { permanent_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 34551 } }
I20261117 14:51:03.359978 10920 leader_election.cc:290] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [CANDIDATE]: Term 10 election: Requested vote from peers 624366c73dc34561925e1d1b5216cf2b (127.6.50.132:33799), 6041859320d34e679a287826f4f54fd6 (127.6.50.129:36371)
I20261117 14:51:03.360766 10608 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "a1fc825ee85f40d1aee4695db8235828" candidate_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" candidate_term: 10 candidate_status { last_received { term: 9 index: 3014 } } ignore_live_leader: false dest_uuid: "624366c73dc34561925e1d1b5216cf2b"
I20261117 14:51:03.360976 10608 raft_consensus.cc:3096] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b [term 9 FOLLOWER]: Advancing to term 10
I20261117 14:51:03.363214 10608 raft_consensus.cc:2490] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa94e5d3d33a4f70b3e2c9c5f62cc9f3 in term 10.
I20261117 14:51:03.363847 10609 raft_consensus.cc:1250] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b [term 10 FOLLOWER]: Rejecting Update request from peer 6041859320d34e679a287826f4f54fd6 for earlier term 9. Current term is 10. Ops: []
I20261117 14:51:03.363821 10268 leader_election.cc:304] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 624366c73dc34561925e1d1b5216cf2b, fa94e5d3d33a4f70b3e2c9c5f62cc9f3; no voters:
I20261117 14:51:03.364238 10920 raft_consensus.cc:2826] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 10 FOLLOWER]: Leader election won for term 10
I20261117 14:51:03.364853 10894 consensus_queue.cc:1060] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "624366c73dc34561925e1d1b5216cf2b" member_type: VOTER last_known_addr { host: "127.6.50.132" port: 33799 }, Status: INVALID_TERM, Last received: 9.3014, Next index: 3015, Last known committed idx: 3014, Time since last communication: 0.000s
I20261117 14:51:03.365427 10894 raft_consensus.cc:3091] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [term 9 LEADER]: Stepping down as leader of term 9
I20261117 14:51:03.365542 10894 raft_consensus.cc:748] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6041859320d34e679a287826f4f54fd6, State: Running, Role: LEADER
I20261117 14:51:03.365986 10894 consensus_queue.cc:261] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3014, Committed index: 3014, Last appended: 9.3014, Last appended by leader: 3014, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "624366c73dc34561925e1d1b5216cf2b" member_type: VOTER last_known_addr { host: "127.6.50.132" port: 33799 } } peers { permanent_uuid: "6041859320d34e679a287826f4f54fd6" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 36371 } } peers { permanent_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 34551 } }
I20261117 14:51:03.366583 10471 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "a1fc825ee85f40d1aee4695db8235828" candidate_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" candidate_term: 10 candidate_status { last_received { term: 9 index: 3014 } } ignore_live_leader: false dest_uuid: "6041859320d34e679a287826f4f54fd6"
I20261117 14:51:03.366731 10894 raft_consensus.cc:3096] T a1fc825ee85f40d1aee4695db8235828 P 6041859320d34e679a287826f4f54fd6 [term 9 FOLLOWER]: Advancing to term 10
I20261117 14:51:03.368741 6346 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskUafhB0/build/asan/bin/kudu with pid 10388
I20261117 14:51:03.369699 10920 raft_consensus.cc:705] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 10 LEADER]: Becoming Leader. State: Replica: fa94e5d3d33a4f70b3e2c9c5f62cc9f3, State: Running, Role: LEADER
I20261117 14:51:03.370307 10920 consensus_queue.cc:238] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3014, Committed index: 3014, Last appended: 9.3014, Last appended by leader: 3014, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "624366c73dc34561925e1d1b5216cf2b" member_type: VOTER last_known_addr { host: "127.6.50.132" port: 33799 } } peers { permanent_uuid: "6041859320d34e679a287826f4f54fd6" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 36371 } } peers { permanent_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 34551 } }
I20261117 14:51:03.372215 10333 raft_consensus.cc:1250] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [term 10 LEADER]: Rejecting Update request from peer 6041859320d34e679a287826f4f54fd6 for earlier term 9. Current term is 10. Ops: []
I20261117 14:51:03.374684 10609 raft_consensus.cc:1285] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b [term 10 FOLLOWER]: Refusing update from remote peer fa94e5d3d33a4f70b3e2c9c5f62cc9f3: Log matching property violated. Preceding OpId in replica: term: 9 index: 3014. Preceding OpId from leader: term: 10 index: 3015. (index mismatch)
I20261117 14:51:03.375320 7593 catalog_manager.cc:5840] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 reported cstate change: term changed from 9 to 10, leader changed from 6041859320d34e679a287826f4f54fd6 (127.6.50.129) to fa94e5d3d33a4f70b3e2c9c5f62cc9f3 (127.6.50.131). New cstate: current_term: 10 leader_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "624366c73dc34561925e1d1b5216cf2b" member_type: VOTER last_known_addr { host: "127.6.50.132" port: 33799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6041859320d34e679a287826f4f54fd6" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 36371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 34551 } health_report { overall_health: HEALTHY } } }
I20261117 14:51:03.376662 10922 consensus_queue.cc:1049] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "624366c73dc34561925e1d1b5216cf2b" member_type: VOTER last_known_addr { host: "127.6.50.132" port: 33799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3015, Last known committed idx: 3014, Time since last communication: 0.000s
I20261117 14:51:03.433480 6346 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskUafhB0/build/asan/bin/kudu pid 10117
W20261117 14:51:03.433693 10267 connection.cc:573] server connection from 127.6.50.129:37063 recv error: Network error: recv error from unknown peer: Connection reset by peer (error 104)
W20261117 14:51:03.433995 10267 connection.cc:573] client connection to 127.6.50.129:36371 recv error: Network error: recv error from unknown peer: Connection reset by peer (error 104)
W20261117 14:51:03.434226 10267 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Connection reset by peer (error 104)
W20261117 14:51:03.436754 10267 leader_election.cc:336] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 6041859320d34e679a287826f4f54fd6 (127.6.50.129:36371): Network error: Client connection negotiation failed: client connection to 127.6.50.129:36371: connect: Connection refused (error 111)
W20261117 14:51:03.437099 10267 consensus_peers.cc:597] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 -> Peer 6041859320d34e679a287826f4f54fd6 (127.6.50.129:36371): Couldn't send request to peer 6041859320d34e679a287826f4f54fd6. Status: Network error: Client connection negotiation failed: client connection to 127.6.50.129:36371: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20261117 14:51:03.437188 10267 leader_election.cc:336] T a1fc825ee85f40d1aee4695db8235828 P fa94e5d3d33a4f70b3e2c9c5f62cc9f3 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 6041859320d34e679a287826f4f54fd6 (127.6.50.129:36371): Network error: Client connection negotiation failed: client connection to 127.6.50.129:36371: connect: Connection refused (error 111)
I20261117 14:51:03.440629 10238 generic_service.cc:196] Checking for leaks (request via RPC)
I20261117 14:51:03.537199 6346 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskUafhB0/build/asan/bin/kudu with pid 10117
I20261117 14:51:03.557789 6346 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskUafhB0/build/asan/bin/kudu pid 10251
I20261117 14:51:03.564930 10375 generic_service.cc:196] Checking for leaks (request via RPC)
I20261117 14:51:03.773433 10912 raft_consensus.cc:499] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa94e5d3d33a4f70b3e2c9c5f62cc9f3)
I20261117 14:51:03.773653 10912 raft_consensus.cc:521] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "624366c73dc34561925e1d1b5216cf2b" member_type: VOTER last_known_addr { host: "127.6.50.132" port: 33799 } } peers { permanent_uuid: "6041859320d34e679a287826f4f54fd6" member_type: VOTER last_known_addr { host: "127.6.50.129" port: 36371 } } peers { permanent_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" member_type: VOTER last_known_addr { host: "127.6.50.131" port: 34551 } }
I20261117 14:51:03.774415 10912 leader_election.cc:290] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6041859320d34e679a287826f4f54fd6 (127.6.50.129:36371), fa94e5d3d33a4f70b3e2c9c5f62cc9f3 (127.6.50.131:34551)
W20261117 14:51:03.775441 10540 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.50.129:36371: connect: Connection refused (error 111)
W20261117 14:51:03.777807 10540 leader_election.cc:336] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 6041859320d34e679a287826f4f54fd6 (127.6.50.129:36371): Network error: Client connection negotiation failed: client connection to 127.6.50.129:36371: connect: Connection refused (error 111)
I20261117 14:51:03.865197 10333 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "a1fc825ee85f40d1aee4695db8235828" candidate_uuid: "624366c73dc34561925e1d1b5216cf2b" candidate_term: 11 candidate_status { last_received { term: 10 index: 3015 } } ignore_live_leader: false dest_uuid: "fa94e5d3d33a4f70b3e2c9c5f62cc9f3" is_pre_election: true
I20261117 14:51:03.865396 6346 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskUafhB0/build/asan/bin/kudu with pid 10251
W20261117 14:51:03.915921 10540 connection.cc:573] server connection from 127.6.50.131:38245 recv error: Network error: recv error from unknown peer: Connection reset by peer (error 104)
I20261117 14:51:03.916273 6346 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskUafhB0/build/asan/bin/kudu pid 10525
W20261117 14:51:03.917524 10540 leader_election.cc:336] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer fa94e5d3d33a4f70b3e2c9c5f62cc9f3 (127.6.50.131:34551): Network error: Client connection negotiation failed: client connection to 127.6.50.131:34551: connect: Connection refused (error 111)
I20261117 14:51:03.917642 10540 leader_election.cc:304] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 624366c73dc34561925e1d1b5216cf2b; no voters: 6041859320d34e679a287826f4f54fd6, fa94e5d3d33a4f70b3e2c9c5f62cc9f3
I20261117 14:51:03.918054 10912 raft_consensus.cc:2771] T a1fc825ee85f40d1aee4695db8235828 P 624366c73dc34561925e1d1b5216cf2b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20261117 14:51:03.923049 10649 generic_service.cc:196] Checking for leaks (request via RPC)
I20261117 14:51:04.209980 6346 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskUafhB0/build/asan/bin/kudu with pid 10525
I20261117 14:51:04.258625 6346 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskUafhB0/build/asan/bin/kudu pid 7563
I20261117 14:51:04.266079 7624 generic_service.cc:196] Checking for leaks (request via RPC)
I20261117 14:51:04.432313 6346 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskUafhB0/build/asan/bin/kudu with pid 7563
2026-11-17T14:51:04Z chronyd exiting
I20261117 14:51:04.484681 6346 test_util.cc:182] -----------------------------------------------
I20261117 14:51:04.484804 6346 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-taskUafhB0/test-tmp/maintenance_mode-itest.0.RollingRestartArgs_RollingRestartITest.TestWorkloads_4.1794926954293095-6346-0
[ FAILED ] RollingRestartArgs/RollingRestartITest.TestWorkloads/4, where GetParam() = 800-byte object <01-00 00-00 01-61 73-61 04-00 00-00 BE-BE BE-BE A0-24 00-00 80-61 00-00 00-00 00-00 00-00 00-00 00-BE BE-BE BE-BE BE-BE BE-BE BE-BE BE-BE BE-BE C0-24 00-00 80-61 00-00 00-00 00-00 00-00 00-00 ... BE-BE BE-BE BE-BE BE-BE 78-27 00-00 80-61 00-00 00-00 00-00 00-00 00-00 00-BE BE-BE BE-BE BE-BE BE-BE BE-BE BE-BE BE-BE 00-01 00-BE BE-BE BE-BE 04-00 00-00 03-00 00-00 01-BE BE-BE BE-BE BE-BE> (70421 ms)
[----------] 1 test from RollingRestartArgs/RollingRestartITest (70421 ms total)
[----------] Global test environment tear-down
[==========] 2 tests from 2 test suites ran. (110126 ms total)
[ PASSED ] 1 test.
[ FAILED ] 1 test, listed below:
[ FAILED ] RollingRestartArgs/RollingRestartITest.TestWorkloads/4, where GetParam() = 800-byte object <01-00 00-00 01-61 73-61 04-00 00-00 BE-BE BE-BE A0-24 00-00 80-61 00-00 00-00 00-00 00-00 00-00 00-BE BE-BE BE-BE BE-BE BE-BE BE-BE BE-BE BE-BE C0-24 00-00 80-61 00-00 00-00 00-00 00-00 00-00 ... BE-BE BE-BE BE-BE BE-BE 78-27 00-00 80-61 00-00 00-00 00-00 00-00 00-00 00-BE BE-BE BE-BE BE-BE BE-BE BE-BE BE-BE BE-BE 00-01 00-BE BE-BE BE-BE 04-00 00-00 03-00 00-00 01-BE BE-BE BE-BE BE-BE>
1 FAILED TEST
I20261117 14:51:04.486238 6346 logging.cc:436] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/client/meta_cache.cc:302: suppressed but not reported on 8 messages since previous log ~21 seconds ago